Brief Bio

I am a researcher at Microsoft AI Perception & Mixed-Reality.

I received my Ph.D. degree from the Department of Computer Science, University of Rochester. My advisor is Prof. Jiebo Luo.

View Quanzeng You's profile on LinkedIn

Research Interests

  • Computer Vision
  • Social Multimedia: Understanding of UGC
  • Media Understanding: High-level visual content understanding
  • Data Mining: Data mining on social networks
  • Publications

    View My Google Scholar


  • Quanzeng You, Hao Jiang. Action4D: Online Action Recognition in the Crowd and Clutter. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, June 2019. [News on 4D Tracking Patent>] [News on 4D tracking system]
  • Hao Jiang, Quanzeng You. Real-time Multiple People Hand Localization in 4D Point Clouds. arXiv:1903.01695.
  • 2018

  • Fenglong Ma, Quanzeng You, Houping Xiao, Radha Chitta, Jing Zhou and Jing Gao. KAME: Knowledge-based Attention Model for Diagnosis Prediction in Healthcare. Proceedings of the 27th ACM International Conference on Information and Knowledge Management (CIKM 2018)
  • Tianlang Chen, Zhongping Zhang, Quanzeng You, Chen Fang, Zhaowen Wang, Hailin Jin, Jiebo Luo, “Factual or Emotional: Stylized Image Captioning with Adaptive Learning and Attention,” ECCV, Munich, Germany, September 2018.
  • Yuxiao Chen*, Jianbo Yuan*, Quanzeng You, Jiebo Luo, "Twitter Sentiment Analysis via Bi-sense Emoji Embedding and Attention-based LSTM," ACM MM, Seoul, Korea, 2018.
  • Fenglong Ma, Jing Gao, Qiuling Suo, Quanzeng You, Jing Zhou and Aidong Zhang. "Risk Prediction on Electronic Health Records with Prior Medical Knowledge", 24th ACM SIGKDD, London, UK, August 2018.
  • Quanzeng You, Hao Jiang. Action4D: Real-time Action Recognition in the Crowd and Clutter. 2018.
  • Quanzeng You, Hailin Jin, Jiebo Luo. Image Captioning at Will: A Versatile Scheme for Effectively Injecting Sentiments into Image Descriptions, arXiv preprint arXiv:1801.10121, 2018.
  • Quanzeng You, Zhengyou Zhang, Jiebo Luo. "End-to-end Convolutional Semantic Embeddings", CVPR, Salt Lake City, UT, June 2018.
  • Tianran Hu, Anbang Xu, Zhe Liu, Quanzeng You, Yufan Guo, Vibha Sinha, Jiebo Luo, Rama Akkiraju. "Touch Your Heart: A Tone-aware Chatbot for Customer Care on Social Media", SIGCHI, Montreal, Canada, April 2018.

  • 2017

  • Honglin Zheng, Tianlang Chen, Quanzeng You, Jiebo Luo, “When Saliency Meets Sentiment: Understanding How Image Content Invokes Emotion and Sentiment,” International Conference on Image Processing (ICIP), Beijing, China, September 2017
  • Quanzeng You, Hailin Jin and Jiebo Luo. "Visual Sentiment Analysis by Attending on Local Image Regions", AAAI, San Francisco, CA. 2017.
  • Fenglong Ma, Radha Chitta, Jing Zhou, Quanzeng You, Tong Sun, Jing Gao. Dipole: Diagnosis Prediction in Healthcare via Attention-based Bidirectional Recurrent Neural Networks. ACM SIGKDD, Halifax, Nova Scotia - Canada, August 2017.
  • Quanzeng You, Liangliang Cao, Jiebo Luo, “Image Based Appraisal of Real Estate Properties,” IEEE Transactions on. Multimedia (TMM), in press. 2017.
  • Quanzeng You, Dario Garcia Garcia, Manohar Paluri, Jiebo Luo, Jungseock Joo. Cultural Dynamics and Trends in Facebook Photographs, International Conference on Web and Social Media (ICWSM), 2017.

  • 2016

  • Yang Cong, Ji Liu, Gan Sun, Quanzeng You, Yuncheng Li, and Jiebo Luo, "Adaptive Greedy Dictionary Selection for Web Media Summarization," in IEEE Transactions on Image Processing, vol.PP, no.99, pp.1-1. doi: 10.1109/TIP.2016.2619260
  • Quanzeng You. "Sentiment and Emotion Analysis for Social Multimedia: Methodologies and Applications", ACM MM, Doctoral Symposium, 2016.
  • Quanzeng You, Liangliang Cao, Hailin Jin, Jiebo Luo, "Robust Visual-Textual Sentiment Analysis: When Attention meets Tree-structured Recursive Neural Networks", ACM MM, Amsterdam, The Netherlands, October 2016.
  • Quanzeng You, Hailin Jin, Zhaowen Wang, Chen Fang, Jiebo Luo, "Image Captioning with Semantic Attention", CVPR, Las Vegas, NV, June 2016. (Spotlight)
  • Quanzeng You, Hailin Jin, Jianchao Yang, Jiebo Luo, "Building a Large Scale Dataset for Image Emotion Recognition: The Fine Print and The Benchmark," AAAI, 2016. [Project Page]
  • Quanzeng You, Hailin Jin, Jianchao Yang, Jiebo Luo, "Cross-modality Consistent Regression for Joint Visual-Textual Sentiment Analysis,". WSDM, February 2016.
  • Xianchao Zhang, Linlin Zong, Quanzeng You, Xing Yong. Sampling for Nyström Extension based Spectral Clustering: Incremental Perspective and Novel Analysis. IEEE Transactions on Knowledge DIscovery from Data (TKDD), 2016.

  • 2015

  • Quanzeng You, Liangliang Cao, Yang Cong, Xianchao Zhang and Jiebo Luo. A Multifaceted Approach to Social Multimedia-based Prediction of Elections. IEEE Transactions on Multimedia (TMM), 2015.
  • Quanzeng You, Jiebo Luo, Hailin Jin and Jianchao Yang. Joint Visual-Textual Sentiment Analysis with Deep Neural Networks, ACM Multimedia (short), 2015. [PDF]
  • Quanzeng You, Jiebo Luo, Hailin Jin and Jianchao Yang. Robust Image Sentiment Analysis Using Progressively Trained and Domain Transferred Deep Networks, AAAI, 2015.[PDF] [Project Page]
  • Quanzeng You, Jianbo Yuan, Jiaqi Wang, Philip Guo, Jiebo Luo. Snap n' Shop: Visual Search-Based Mobile Shopping Made a Breeze by Machine and Crowd Intelligence, IEEE International Conference on Semantic Computing, 2015.[PDF]
  • Quanzeng You, Sumit Bhatia, Jiebo Luo. A Picture Tells a Thousand Words--About You! User Interest Profiling from User Generated Visual Content, Signal Processing, 2015.
  • Danning Zheng, Tianran Hu, Quanzeng You, and Jiebo Luo, Towards Lifestyle Understanding: Predicting Home and Vacation Locations from User's Online Photo Collections, AAAI International Conference on Weblogs and Social Media (ICWSM), May 2015. [PDF]

  • 2014

  • Danning Zheng, Tianran Hu, Quanzeng You, Henry Kautz, and Jiebo Luo. Inferring Home Location from User's Photo Collections based on Visual Content and Mobility Patterns,ACM Multimedia Conference, Workshop on Geotagging in Multimedia (GeoMM), November 2014.
  • Quanzeng You, Sumit Bhatia, Tong Sun, Jiebo Luo. The eyes of the beholder: Gender prediction using images posted in online social networks, IEEE International Conference on Data Mining, Workshop on Social Multimedia Data Mining, 2014.[PDF]
  • Quanzeng You, John Krumm. Transit tomography using probabilistic time geography: planning routes without a road map, Journal of Location Based Services, 3(97):1-18, 2014. [PDF][PDF Proof Version]

  • 2013

  • Junhuan Zhu, QuanzengYou, Jiebo Luo and John R. Smith. Towards Understanding the Effectiveness of Election Related Images in Social Media, IEEE International Conference on Data Mining (ICDM), Workshop on Domain-driven Data Mining, December 2013. [PDF]
  • Jianbo Yuan, Quanzeng You, and Jiebo Luo, Are There Cultural Differences in Event Driven Information Propagation Over Social Media? ACM Multimedia Conference, International Workshop on Socially-Aware Multimedia (IWSAM), October 2013. [PDF]
  • Quanzeng You and Jiebo Luo, Towards Social Imagematics: Sentiment Analysis in Social Multimedia, ACM SIGKDD, Workshop on Multimedia Data Mining, August 2013. [PDF]
  • Jianbo Yuan, Quanzeng You, Sean McDonough, and Jiebo Luo, Sentribute: Image Sentiment Analysis from a Mid-level Perspetive, ACM SIGKDD, Workshop on Issues of Sentiment Discovery and Opinion Mining (WISDOM), August 2013. [PDF]
  • Xianchao Zhang, Quanzeng You. Clusterability Analysis and Incremental Sampling for Nystrom Extension Based Spectral Clustering. ICDM, 942–951, 2011. [PDF]
  • Xianchao Zhang,Quanzeng You. An Improved Spectral Clustering Based on Random Walk. Friontiers of Computer Science in China, vol. 5, no. 3, pp. 268-278, 2011. [PDF]
  • Pixels and Patches

    From Prof. Jiebo Luo

    1. TED: Body Language Shapes Who You Are