URCS Banner

Photo Professor Jiebo Luo

Department of Computer Science
3101 Wegmans Hall 
University of Rochester
Rochester, NY 14627

Email: username -at- domain.edu
where username = jluo,
domain = cs.rochester.edu

Phone: 585-276-5784

Prospective Students
Computer Vision Urban Computing
Health/Wellness Analytics
Image Retrieval Image Segmentation
Scene Classification Big Data
Contextual Inference Machine
Learning  Vision+Language
Random Field Photo Collection
Multimedia    Video Analytics
Human-Centered Media & Interaction
Mobile Media Location-based service
Geo Tagging  Action Recognition
Heterogeneous Information Networks
Social Multimedia  Data Mining
Crowdsourcing 360D User Profiling



  09/21/2021: Professor Luo reaches a milestone of 100 in his h-index according to Google Scholar

  07/08/2021: Professor Luo delivers a keynote on "Vision and Language: The Past, Present and Future" at the 2021
                        IEEE International Conference on Multimedia and Expo (ICME). The slides are available in slideshare.net.
  06/25/2021: Congrats to newly minted Dr.
Tianlang Chen who has joined Amazon

  06/07/2021: Congrats to newly minted Dr. Zhengyuan Yang who has joined Microsoft Research

  05/26/2021: Congratulations to
Songyang Zhang for winning the NAACL Best Long Paper Award at the 2021 Annual                           Conference of the North American Chapter of the Association for Computational Linguistics (NAACL) for
                      the work on "Video-aided Unsupervised Grammar Induction"

  05/19/2021: In a new study, we dissect the public responses to the #StopAsianHate movement using large scale Twitter                       data and provide findings that can help design better ways of reducing tension and misunderstandings
                      between ethnic groups. The work is also covered by Rochester Beacon and Futurity.

  01/29/2021: U.S. Senate Majority Leader Charles E. Schumer and U.S. Senator Kirsten Gillibrand today announced
                      federal funding to support the research and development of oral disease detection and intervention
                      technology at the University of Rochester.

  12/15/2020: Congratulations to Yipeng Zhang, who is selected for Honorable Mention for the Computing Research                           Association's (CRA) Outstanding Undergraduate Researcher Award for 2021.

The latest CS Rankings data show that in the area of Computer Vision, Rochester ranks 8th  
 the United States for the year of 2020.

  11/27/2020: Data Skeptic, a popular data science podcast reaching 30k+ listeners nationwide per week, airs a full
                      episode on our recent work on the U.S. facemask sentiment analysis using Twitter data. The recording
                      is available online and via Spotify.
07/23/2020: Tech Xplore reports a series of our recent studies that show Twitter mirrors our attitudes and feelings
                      about COVID-19. These findings are shared in a lightning presentation for chairs of computer science

                      PhD-granting departments and heads of major industrial research labs at the Computing Research

                      Association (CRA) Virtual Conference.

  05/30/2020: Our work on analyzing the use of controversial terms of COVID-19 on Twitter is highlighted by
                      IEEE Spectrum, the flagship magazine and website of the IEEE. Incidentally, this story shares the
                      headlines with the story about the
successful launch of the SpaceX Dragon 2 spacecraft. Cool!
  04/27/2020: Congrats to newly minted Dr. Yang Feng who will join Google Cloud

  01/01/2020: Professor Luo begins his 3-year term as the Editor-in-Chief of the IEEE Transactions on Multimedia

  12/31/2019: The latest CS Rankings data show that in the area of Computer Vision, Rochester ranks in the Top 5   
 the United States for the year of 2019, trailing only CMU, Stanford, UCF and Berkeley, and right ahead
MIT and Cornell.

  12/12/2019: Congratulations to Zhengyuan Yang for winning the 2020 Twitch Research Fellowship to support his PhD
                      research on video and language. Twitch is the No. 1 live streaming video service for video games in the
operated by Twitch Interactive, a subsidiary of Amazon. In addition, it offers music broadcasts,
                      creative content, and more recently, "in real life" streams.

  11/08/2019: Congrats to newly minted Dr.
Haofu Liao who will join Amazon (AWS)

  10/23/2019: Congrats to Songyang Zhang for winning the 1st place in the HACS Action Localization Challenge at
                      ICCV 2019

  10/17/2019: Our team wins the 1st place in the Challenge on Automatic Generation of Cardiovascular Diagnostic Report
                      (AutoGen-CDR19) at

  10/08/2019: Congratulations to Haofu Liao for being selected as a finalist for MICCAI 2019 Young Scientist Award    
                      based his work on Artifact Disentanglement Network for Unsupervised Metal Artifact Reduction  
  09/13/2019: Congrats to newly minted Dr.
Jianbo Yuan who will join Amazon (AWS)

  08/08/2019: Congratulations to Weijian Li for being selected for a graduate student travel award on the basis of the score
                      obtained during the review process. Weijian will present papers at MICCAI 2019. Yipeng Zhang also        
                      receives an undergraduate student travel award.

  07/29/2019: Yipeng Zhang, a CS sophomore and a Xerox undergraduate engineering fellow in this summer, is featured   
                      in an Instagram post by our new University President Sarah C. Mangelsdorf. It includes a picture of Yipeng
                      with Sarah in front of Yipeng's poster on "A deep learning approach to early childhood caries prevention."

  06/18/2019: Congratulations to Yang Feng who participates in the CVPR 2019 Doctoral Consortium
  04/03/2019: Congrats to newly minted Dr. Tianran Hu who will join College of William and Mary as
                      Assistant Professor of Computer Science

  12/07/2018: Professor Luo is elevated to Fellow of AAAI (Association for Advancement of Artificial Intelligence) for                       "significant contributions to the fields of computer vision and data mining, and particularly pioneering work                           on multimodal understanding for sentiment analysis, computational social science, and digital health"

  11/01/2018: Professor Luo is elevated to Fellow of ACM (Association for Computing Machinery) for "contributions to                           multimedia content analysis and social multimedia informatics"

  10/03/2018: The University of Rochester has been selected as a Morris K. Udall Center of Excellence in Parkinson's
                      Disease Research by the National Institute of Neurological Disorders and Stroke (NINDS). The new
                      $9.2 million award brings together researchers from industry and multiple academic institutions to focus
                      on the development of digital tools to enhance understanding of the disease, engage broad
                      populations in research, and accelerate the development of new treatments for Parkinson's disease.    
                      Professor Luo will co-lead the Advanced Analytics Core that brings together a team of experts in 
                      biostatistics, computational science and mathematics from multiple institutions.

  09/15/2018: Professor Luo is the recipient of the 2018 IEEE Region 1 Technological Innovation in Academic Award
for "contributions in computer vision and data mining"

  08/24/2018: Congratulations to Zhengyuan Yang and Yixuan Zhang for winning Best Industrial Related Paper Award                       at ICPR 2018 for their paper on "End-to-end Multi-Modal Multi-Task Vehicle Control for Self-Driving Cars
                      with Visual Perception"

  08/13/2018: Congrats to newly minted Dr.
Yu Wang  who has joined Apple

  08/06/2018: Congratulations to Tianran Hu for being invited to the 2018 ACM Multimedia Doctoral Symposium

  06/29/2018: Congratulations to Haofu Liao for being "pre-selected for a student travel award on the
                      basis of the score your paper has obtained during the review process". Haofu will present
                      two papers (both with early acceptance) at MICCAI 2018.

  06/22/2017: Professor Luo is an invited speaker at CVPR 2018 Workshop on
                         Towards Automatic Understanding of Visual Advertisements

  06/21/2017: Professor Luo hosts the 3rd annual "The Vision Seeker" (视觉求索) gathering at CVPR 2018

                    Scan QR Code via WeChat 
                    to follow Official Account

  02/13/2018: Professor Luo and multidisciplinary team are featured in a report by the University of
                      Rochester Newscenter, "
App combines virtual reality with personalized psychotherapy"

  12/25/2017: Professor Luo is interviewed by Sixthtone in a feature
                        "Even China's Backwater Cities Are Going Smart" which reveals China's grand plans
                        for an artificial intelligence rollout of smart cities.

  11/22/2017: Prof. Homer Chen visits our lab

  10/13/2017: Congrats to newly minted Dr. Yuncheng Li  who has joined Snapchat Research

  08/29/2017: Congrats to newly minted Dr. Quanzeng You
  who is joining Microsoft Research AI

  08/21/2017: Professor Luo is quoted by Market Mogul  in a feature
                        "Here's How Big Data Transformation Will Sweep Information Sovereignty"

  08/14/2017: Professor Luo is interviewed by Bloomberg Technology in a feature
                        "China's Plan for World Domination in AI Isn't So Crazy After All"

  07/26/2017:  Professor Luo is an invited speaker at CVPR 2017 Workshop on
                         Medical Computer Vision and Health Informatics

Professor Luo is co-organizing Language and Vision Workshop at CVPR 2017  
  07/21/2017:  Professor Luo is co-teaching CVPR 2017 Tutorial (lecture notes online) on
                           Dealing with Reality: Low-Quality Visual Data Processing and Analytics

  05/29/2017:  Professor Luo is interviewed by Xinhua News Agency on the heels of AlphaGo's triumph over Ke Jie
                           Spotlight: Artificial intelligence fuels visions of how smart future can be

Our work on Detecting the Hate Code on Social Media is covered extensively
                           by Geek.com, Vice.com, Digital Trends, MSN, Thestack.com
                           Our work is especially timely given that
                           1) YouTube is facing a full-scale advertising boycott over hate speech, and
                           2) Tech Giants Vow to Tackle Online Hate Speech Within 24 Hours

   02/24/2017:  Professor Luo's Data Mining course was considered "favorite class taken at the University of Rochester"
                           in the Data Science program (Featured Article:
Data science for a better planet)

   02/11/2017:  National Science Foundation Research Experience for Undergraduates (NSF REU)
                           Computational Methods for Understanding Music, Media, and Minds
                           Please note that the projects are flexible and the current descriptions are meant as examples.

   11/07/2016: Professor Luo is a panelist on NPR Radio, WXXI Connections hosted by Evan Dawson
                           Monthly Science Roundtable  "Twitter, Social Media and The Election"

   10/21/2016: Our work on fine-grained recognition of East Asian faces is covered by Washington Post
                           You are welcome to take the Asian Face Challenge at http://www.vista-today.com/asianmyth
                           to help benchmark human recognition performance (currently at 49% with 400+ tests)
                           Another story on NextShark

   10/01/2016: Professor Luo speaks at the Huang Symposium @UIUC to celebrate the 80th birthday and
                           extraordinary career of Professor Thomas S. Huang

   08/29/2016: Congratulations to
Tianran Hu who receives a student travel scholarship to attend CIKM 2016.
   07/20/2016: URCS is highly ranked among the Top universities in Artificial Intelligence for the period of 2000-2016
                          by an objective measure of faculty publications

   07/19/2016: URCS is among the Top 20 Artificial Intelligence Engineering Schools in the U.S.

   07/01/2016: Congratulations to Quanzeng You
for being invited to the 2016 ACM Multimedia Doctoral Symposium
                          with a travel scholarship

   06/26/2016: Yiheng Zhou and Numair Sani, our undergraduate researchers, present their work on mining Instagram
                          for illicit drug use patterns at SBP-BRiMS 2016, supported by student travel scholarship

   06/09/2016: Our work on "Will Sanders Supporters Jump Ship to Trump?" is covered by Pacific Standard

   05/10/2016: Our work on using AI to hunt drug dealers on Instagram is covered by Daily Dot

Our work on "Voting with Feet: Who are leaving Hilary Clinton and Donald Trump"  is covered
AOL, Daily Dot, LipTV, Pivot America

   04/21/2016: Zhishen Pan, a Junior student in the Data Science program, won the Poster Presentation Award at the
                          2nd Annual Rochester Global Health Symposium & UNYTE Scientific Session: Innovative Solutions to
                          Combat Global Health Disparities for the poster "Towards Understanding How News Coverage Affects
                          Public Perception During Epidemic Outbreak."  Congratulations!

   04/18/2016: Yu Wang receives a student travel scholarship to attend ICWSM-2016

   03/29/2016: Congratulations to Yuncheng Li, who has been invited to the CVPR 2016 Doctoral Consortium

   03/20/2016: Our work on using Twitter user avatar facial analysis to study Trump and Clinton followers is covered by
                         MIT Technology Review, Digital Trends, Market Exclusive

   03/17/2016: Our
CVPR 2016 paper "Image Captioning with Semantic Attention" - describes the engine behind a
                         system that has been sitting atop the Leader Board for the Microsoft COCO (Common Objects in Context)
                         Image Captioning Challenge since November 2015, beating Google, Microsoft, Baidu/UCLA, Stanford,
                        UC Berkeley, University of Toronto/Montreal
, and other power houses. Full Story.

   03/16/2016: Our work on detecting drinking-while-tweeting patterns is covered by MIT Technology Review,  Gizmodo,
                         CBS News,  NPR Weekend Edition, Engadget, and more

   02/06/2016: Our work on estimating city air pollution from crowd-sourced photos is covered by New Scientist
                          Try our demo system.

   12/21/2015:  Quanzeng You is a Finalist for the inaugural Adobe Research Fellowship

   11/01/2015: Our work on using Instagram posts to determine underage drinking patterns has been covered by
                        Innovation Trail, Digital Trends, Democratic and Chronicle, TechRadar, Medical Daily,
                       The Science Explorer, iTech Post

   10/01/2015: Yu Wang and Tianran Hu
receive student travel scholarships to attend IEEE ICDM 2015

   10/02/2015: Data Science Faculty Search (2015-2016): neurally-inspired computing;
                         computer vision for medicine and humanities

    10/01/2015: Yu Wang
receives a student travel scholarship to attend IEEE BigData 2015

    08/28/2015: Our data-driven study on the influence of fashion shows on everyday trends
has been featured by
                         New York Post
, Science News, El Pais (major Spanish Newspaper), MIT Technology Review

    08/20/2015: Yuncheng Li et al. win the Best Paper Award at ICIMCS 2015 for the work on Using User Generated
                         Photos to Monitor Air Pollution in Cities

    07/20/2015: Deadline of the International Workshop on Social Multimedia Data Mining at ICDM 2015 (Atlantic City)

    07/14/2015: Quanzeng You is invited to the 2015 Microsoft Research Asia Ph.D. Forum among "30 of the best Asian
                         Ph.D. students from the Asia-Pacific region and the U.S."

    05/15/2015: Prof. Luo is named a Data Science CoE Distinguished Researcher @Goergen Institute for Data Science

    05/12/2015: Tianran Hu receives a student travel scholarship to attend ICWSM-2015

    02/15/2015 Our work on computational image sentiment analysis is covered by Tech TimesScience 2.0

    02/03/2015: Communications of ACM coverage of our Non-Obtrusive Mental Health Monitoring work; also Gizmag

    12/15/2014: ICDM Tutorial on "Social Multimedia as Sensors"
    12/14/2014: Workshop on Social Multimedia Data Mining at ICDM 2014

    12/07/2014: Quanzeng You receives a student travel scholarship to attend AAAI-2015

Prof. James Rehg visits our lab

    08/28/2014: Guess how many students I currently advise? 50

    07/15/2014: 2014 IEEE Multimedia Prize Paper Award

    06/28/2014: The New Big Three of Rochester (Democratic and Chronicle interview)

    05/01/2014: How Good is URCS? (a little known fact that puts us ahead of a perennial top 5 CS department)

    12/20/2013: Prof. Roland Goecke visits our lab
    10/25/2013: Prof. Bill Freeman visits our lab
RoCData II (Rochester Big Data Forum)
    10/17/2013: Prof. Ruslan Salakhutdinov visits our lab
    10/14/2013: Prof. Honglak Lee  visits  our lab
    08/29/2013: Prof. Eckehard Steinbach  visits  our lab
RoCData II (Rochester Big Data Forum)
The TMM Special Issue on "Social Media as Sensors" is complete and in press for August 2013
    04/08/2013: A 
New Publication highlighting Big Data research at the UR
    12/31/2012: URCS 
Faculty Recruiting in HCI and Big Data
RoCData (Rochester Big Data Forum, speaker list)
"Computer Vision with a Third Eye"

VIStA (Visual Intelligence & Social Multimedia Analytics) Research Group is formed


02/25/2012: Professor Luo will co-chair the IEEE CVPR 2012 Area Chair meeting in Long Beach, CA.

12/08/2011: Professor Luo will serve on the program committee for both the research track and industry track of the 2012 ACM SIGKDD conference.

09/06/2011: I am looking for two self-motivated PhD students to join my research group in Fall 2012 to work in the areas of  computer vision and social media data mining.  Applicants are expected to have strong skills in both programming and mathematics. Related research publications in ranked venues of computer vision, machine learning, or data mining is a plus . To apply, check http://www.cs.rochester.edu/education/phd-program.

09/01/2011: Professor Luo joined the CS Department after a prolific career of 15+ years at Kodak Research Labs.

09/01/2011: Professor Luo will co-chair the Third ACM SIGMM Workshop on Social Media (WSM2011) in conjunction with ACM Multimedia 2011.

09/01/2011: A feature article on "Aesthetics and Emotions in Images: A Computational Perspective" is published in the IEEE Signal Processing Magazine.

09/01/2011: A mini book on Interactive Co-segmentation of Objects in Image Collections (SpringerBriefs in Computer Science) by Dhruv Batra, Adarsh Kowdle, Devi Parikh, Jiebo Luo, and Tsuhan Chen is available for pre-order.

04/06/2011: A new book on Social Media Modeling and Computing by Steven C.H. Hoi, Jiebo Luo, Susanne Boll and Dong Xu is published by Springer
03/2011: iCoseg among top downloaded articles from IJCV in the last 30 days.
[ Springer Page | Preprint pdf | Project Page ]


Jiebo Luo joined the University of Rochester in Fall 2011 after over fifteen prolific years at Kodak Research Laboratories, where he was a Senior Principal Scientist leading research and advanced development. He has been involved in numerous technical conferences, including serving as the program co-chair of ACM Multimedia 2010, IEEE CVPR 2012 and IEEE ICIP 2017. He has served on the editorial boards of the IEEE Transactions on Pattern Analysis and Machine Intelligence, IEEE Transactions on Multimedia, IEEE Transactions on Circuits and Systems for Video Technology, ACM Transactions on Intelligent Systems and Technology, Pattern Recognition, Machine Vision and Applications, and Journal of Electronic Imaging.  Dr. Luo is the Editor-in-Chief of the IEEE Transactions on Multimedia for the 2020-2022 term. Dr. Luo is a Fellow of ACM, AAAI, IEEE, IAPR, and SPIE.

His research spans image processing, computer vision, machine learning, data mining, social media, computational social science, and digital health. He is a pioneer for contextual inference in semantic understanding of visual data and social multimedia data mining. He has published extensively in these fields with over 500 peer-reviewed technical papers and over 90 US patents. His Google Scholar h-index is currently 99. His research has been supported by federal and state agencies including NSF, NIH, ONR and New York State CoE, as well as various corporate sponsors.


Major Professional Services




Selected Recent Publications (Publications listed more comprehensively by DBLP)

My CitationsScholar Home


computer vision, NLP and media understanding






machine learning







web and social media data mining




      2017       2016

biomedical analytics and health informatics









human computer interaction

mobile and pervasive computing



Pixels and Patches (Bits and Bytes)

Pictures (Featured Big Picture Talks)



ACM DL   IEEE Xplore   SpringerLink

Research Themes [for example projects, check my PhD students' homepages]

VIStA Research Group Members:

Visiting Researchers

Prof. Jinsong Su
(Xiamen University)

PhD Students

Yuncheng Li             Quanzeng You
(Snapchat Research 2017-2019)  (Microsoft Research AI since 2017)
(Google Brain since 2019) 

 Tianran Hu                 Jianbo Yuan
(College of William & Mary)            (Amazon - AWS)  
Yu Wang (PSC)            Yang Feng          Haofu Liao 
(Apple Siri since 2018)                     (Goolge Cloud)                       (Amazon - AWS)       
  Tianlang Chen
     Zhengyuan Yang
     Wei Xiong         
                Weijian Li                  


  Songyang Zhang         
  Songyang Zhang                 Wei Zhu                      Haitian Zheng
          Jie An                         Zhaoyi Wan                    Yuqi Gao                      Hang Hua


      Hanjia Lyu
Visiting PhD Students
    Mingkun Yang                          

MS Students

Undergraduate Students



Prospective PhD Students

I'm always looking for self-motivated students and usually recruit two new PhD students per year. Applicants are expected to have strong skills in both programming and mathematics, as well as research experience in closely related areas. Grades alone won't cut it. "I worked on a gazillion of projects" (but have no evidence) is a no-no. Research publications in ranked venues of computer vision, machine learning, or data mining is a plus (and the only reason you need to contact me directly). Sorry but generic spams will be ignored.

To apply, check

Visiting Students

I normally have two to three self-funded visiting student positions per year. I do not provide any paid visiting or postdoc positions, and I do not consider any visits shorter than 3 months. It is expected that you have some minimum prior research experience. A recommendation letter via email directly from your research advisor is needed, if you have not personally met me.

Current UR Students

Current UR students (undergraduate or MS) interested in working with me are welcome to stop by my office during my office hours (see the posting outside my office). It is desirable that you have taken a course with me prior to starting any research in my lab. A resume through email in advance is recommended as opposed to a cold knock on the door.

Reference Letter Seekers

You must have your advisor/mentor vouch for you, if you have not personally worked with me. If you intend to work in my lab, producing meaningful or publishable results is the essence for the reference letter as a generic letter stating that you
worked in my lab would not help your graduate school application.

Internship Seekers

In general, we do not host summer interns unless there is a preexisting arrangement, or you have prior research product(s) to validate your seriousness.


The University of Rochester is a private institution that was founded in 1850. It is one of the smallest and most collegiate schools among the nation's top research universities. According to US News and World Report 2019, the University of Rochester's ranking in the Best National Universities is 29th. It is also one of only 25 schools named a "New Ivy" in the 2007 Kaplan/Newsweek "How to Get into College Guide".

The Department of Computer Science at the University of Rochester is a research-oriented department with a distinguished history of contributions in systems, theory, artificial intelligence, and HCI. Historically, a third of its PhD graduates have received tenure-track faculty positions, and its alumni include prominent leaders at major research laboratories such as Google, Microsoft, and IBM.

Research is a Journey not for the Faint-hearted

Do you have what it takes to be a successful PhD student? The initial threshold is 4 out of 7 and I hope you have all 7 at graduation.

Curious how I evalaute students?

Be the best you can be
. You can be the best.

Battle Hymns

Hall of Fame (The Script)



Prof. Eckehard Steinbach  (08/29/2013)

Prof. Honglak Lee

Ruslan Salakhutdinov (10/17/2013)

Prof. Bill Freeman (10/25/2013)

Prof. James Rehg (10/02/2014)

Free access and statistics provided by the ACM Digital Library

Back to the top