Brief Bio

I am a 5th year Ph.D. candidate at Department of Computer Science, University of Rochester. My advisor is Prof. Jiebo Luo.

View Quanzeng You's profile on LinkedIn

Research Interests

  • Social Multimedia: Understanding of UGC
  • Media Understanding: High-level visual content understanding
  • Data Mining: Data mining on social networks
  • Experience

    1. Research Intern (2016.6-2016.8), Facebook, Menlo Park, CA.
      Project: Understanding cultural dynamics in Facebook photos. Mentor: Jungseock Joo
    2. Deep Learning Research Intern (2015.6-2015.9), Adobe Research, San Jose, CA.
      Project: Image Captioning. Mentor: Hailin Jin, Zhaowen Wang and Chen Fang.
    3. Research Intern (2014.5-2014.8), PARC East, Rochester, NY.
      Project: User Profiling. Mentor: Sumit Bhatia and Tong Sun.
    4. Research Intern (2013.6-2014.8), Microsoft Research, Redmond, WA.
      Project: Using Geo-tagged Tweets for Navigation. Mentor: John Krumm.
    5. Software Engineering Intern (2012.3-2012.7), Baidu, Beijing.
      Project: Personalized Ad. Mentor: Yueting Li.

    Publications

    View My Google Scholar


    Computer Vision and Media Understanding

    1. Quanzeng You, Hailin Jin and Jiebo Luo. "Visual Sentiment Analysis by Attending on Local Image Regions", Thirty-First AAAI Conference on Artificial Intelligence (AAAI-17), San Francisco, CA. 2017.
    2. Yang Cong, Ji Liu, Gan Sun, Quanzeng You, Yuncheng Li, and Jiebo Luo, "Adaptive Greedy Dictionary Selection for Web Media Summarization," in IEEE Transactions on Image Processing, vol.PP, no.99, pp.1-1. doi: 10.1109/TIP.2016.2619260
    3. Quanzeng You. "Sentiment and Emotion Analysis for Social Multimedia: Methodologies and Applications", ACM Multimedia Conference (ACM MM), Doctoral Symposium, Amsterdam, The Netherlands, October 2016.
    4. Quanzeng You, Liangliang Cao, Hailin Jin, Jiebo Luo, "Robust Visual-Textual Sentiment Analysis: When Attention meets Tree-structured Recursive Neural Networks", ACM Multimedia Conference (ACM MM), Amsterdam, The Netherlands, October 2016.
    5. Quanzeng You, Hailin Jin, Zhaowen Wang, Chen Fang, Jiebo Luo, "Image Captioning with Semantic Attention", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, June 2016. (Spotlight)
    6. Quanzeng You, Hailin Jin, Jianchao Yang, Jiebo Luo, "Building a Large Scale Dataset for Image Emotion Recognition: The Fine Print and The Benchmark," AAAI, 2016. [Project Page]
    7. Quanzeng You, Hailin Jin, Jianchao Yang, Jiebo Luo, "Cross-modality Consistent Regression for Joint Visual-Textual Sentiment Analysis," ACM International Conference on Web Search and Data Ming (WSDM), February 2016.
    8. Quanzeng You, Liangliang Cao, Yang Cong, Xianchao Zhang and Jiebo Luo. A Multifaceted Approach to Social Multimedia-based Prediction of Elections. IEEE Transactions on Multimedia (TMM), 2015.
    9. Quanzeng You, Jiebo Luo, Hailin Jin and Jianchao Yang. Joint Visual-Textual Sentiment Analysis with Deep Neural Networks, ACM Multimedia (short), 2015. [PDF]
    10. Quanzeng You, Jiebo Luo, Hailin Jin and Jianchao Yang. Robust Image Sentiment Analysis Using Progressively Trained and Domain Transferred Deep Networks, AAAI, 2015.[PDF] [Project Page]

    Human Computer Interaction

    1. Quanzeng You, Jianbo Yuan, Jiaqi Wang, Philip Guo, Jiebo Luo. Snap n' Shop: Visual Search-Based Mobile Shopping Made a Breeze by Machine and Crowd Intelligence, IEEE International Conference on Semantic Computing, 2015.[PDF]

    Social Media Data Mining

    1. Fenglong Ma, Radha Chitta, Jing Zhou, Quanzeng You, Tong Sun, Jing Gao. Dipole: Diagnosis Prediction in Healthcare via Attention-based Bidirectional Recurrent Neural Networks. Proceedings of the 23th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2017), Halifax, Nova Scotia - Canada, August 2017.
    2. Quanzeng You, Liangliang Cao, Jiebo Luo, “Image Based Appraisal of Real Estate Properties,” IEEE Transactions on. Multimedia (TMM), in press. 2017.
    3. Quanzeng You, Dario Garcia Garcia, Manohar Paluri, Jiebo Luo, Jungseock Joo. Cultural Dynamics and Trends in Facebook Photographs, AAAI International Conference on Web and Social Media (ICWSM), 2017.
    4. Xianchao Zhang, Linlin Zong, Quanzeng You, Xing Yong. Sampling for Nyström Extension based Spectral Clustering: Incremental Perspective and Novel Analysis. IEEE Transactions on Knowledge DIscovery from Data (TKDD), 2016.
    5. Quanzeng You, Sumit Bhatia, Jiebo Luo. A Picture Tells a Thousand Words--About You! User Interest Profiling from User Generated Visual Content, Signal Processing, 2015.
    6. Danning Zheng, Tianran Hu, Quanzeng You, and Jiebo Luo, Towards Lifestyle Understanding: Predicting Home and Vacation Locations from User's Online Photo Collections, AAAI International Conference on Weblogs and Social Media (ICWSM), May 2015. [PDF]
    7. Danning Zheng, Tianran Hu, Quanzeng You, Henry Kautz, and Jiebo Luo. Inferring Home Location from User's Photo Collections based on Visual Content and Mobility Patterns,ACM Multimedia Conference, Workshop on Geotagging in Multimedia (GeoMM), November 2014.
    8. Quanzeng You, Sumit Bhatia, Tong Sun, Jiebo Luo. The eyes of the beholder: Gender prediction using images posted in online social networks, IEEE International Conference on Data Mining, Workshop on Social Multimedia Data Mining, 2014.[PDF]
    9. Quanzeng You, John Krumm. Transit tomography using probabilistic time geography: planning routes without a road map, Journal of Location Based Services, 3(97):1-18, 2014. [PDF][PDF Proof Version]
    10. Junhuan Zhu, QuanzengYou, Jiebo Luo and John R. Smith. Towards Understanding the Effectiveness of Election Related Images in Social Media, IEEE International Conference on Data Mining (ICDM), Workshop on Domain-driven Data Mining, December 2013. [PDF]
    11. Jianbo Yuan, Quanzeng You, and Jiebo Luo, Are There Cultural Differences in Event Driven Information Propagation Over Social Media? ACM Multimedia Conference, International Workshop on Socially-Aware Multimedia (IWSAM), October 2013. [PDF]
    12. Quanzeng You and Jiebo Luo, Towards Social Imagematics: Sentiment Analysis in Social Multimedia, ACM SIGKDD, Workshop on Multimedia Data Mining, August 2013. [PDF]
    13. Jianbo Yuan, Quanzeng You, Sean McDonough, and Jiebo Luo, Sentribute: Image Sentiment Analysis from a Mid-level Perspetive, ACM SIGKDD, Workshop on Issues of Sentiment Discovery and Opinion Mining (WISDOM), August 2013. [PDF]
    14. Xianchao Zhang, Quanzeng You. Clusterability Analysis and Incremental Sampling for Nystrom Extension Based Spectral Clustering. ICDM, 942–951, 2011. [PDF]
    15. Xianchao Zhang,Quanzeng You. An Improved Spectral Clustering Based on Random Walk. Friontiers of Computer Science in China, vol. 5, no. 3, pp. 268-278, 2011. [PDF]

    Pixels and Patches

    From Prof. Jiebo Luo

    1. TED: Body Language Shapes Who You Are