URCS Banner

Photo Professor Jiebo Luo

Department of Computer Science
611 Computer Studies Building  
University of Rochester
Rochester, NY 14627

Email: username -at- domain.edu
where username = jluo,
domain = cs.rochester.edu

Office: CSB 611
Phone: 585-276-5784
Computer Vision Urban Computing
Health & Wellness Analytics
Image Retrieval Image Segmentation
Scene Classification Big Data
Contextual Inference Machine
Learning  Vision+Language
Random Field Photo Collection
Multimedia    Video Analytics
Human-Centered Media & Interaction
Mobile Media Location-based service
Geo Tagging  Action Recognition
Heterogeneous Information Networks
Social Multimedia  Data Mining
Crowdsourcing Personal Analytics



  12/07/2018: Professor Luo is elevated to Fellow of AAAI (Association for Advancement of Artificial Intelligence) for                       “contributions to the fields of computer vision and data mining, and particularly pioneering work in                                       social media informatics.”

  11/01/2018: Professor Luo is elevated to Fellow of ACM (Association for Computing Machinery) for “contributions to                           multimedia content analysis and social multimedia informatics.”

  10/03/2018: The University of Rochester has been selected as a Morris K. Udall Center of Excellence in Parkinson's
                      Disease Research by the National Institute of Neurological Disorders and Stroke (NINDS). The new
                      $9.2 million award brings together researchers from industry and multiple academic institutions to focus
                      on the development of digital tools to enhance understanding of the disease, engage broad
                      populations in research, and accelerate the development of new treatments for Parkinson’s disease.    
                      Professor Luo will co-lead the Advanced Analytics Core that brings together a team of experts in 
                      biostatistics, computational science and mathematics from multiple institutions

  09/15/2018: Professor Luo is the recipient of the 2018 IEEE Region 1 Technological Innovation in Academic Award

  08/24/2018: Congratulations to Zhengyuan Yang and Yixuan Zhang for winning Best Industrial Related Paper Award                       at ICPR 2018 for their paper on “End-to-end Multi-Modal Multi-Task Vehicle Control for Self-Driving Cars
                      with Visual Perception

  08/06/2016: Congratulations to Tianran Hu for being invited to the 2018 ACM Multimedia Doctoral Symposium

  06/29/2018: Congratulations to Haofu Liao for being "pre-selected for a student travel award on the
                      basis of the score your paper has obtained during the review process". Haofu will present
                      two papers (both with early acceptance) at MICCAI 2018.

  06/22/2017: Professor Luo is an invited speaker at CVPR 2018 Workshop on
                         Towards Automatic Understanding of Visual Advertisements

  06/21/2017: Professor Luo hosts the 3rd annual "The Vision Seeker" (视觉求索) gathering at CVPR 2018

                    Scan QR Code via WeChat 
                    to follow Official Account

  02/13/2018: Professor Luo and multidisciplinary team are featured in a report by the University of
                      Rochester Newscenter, “
App combines virtual reality with personalized psychotherapy

  12/25/2017: Professor Luo is interviewed by Sixthtone in a feature
                        “Even China’s Backwater Cities Are Going Smart” which reveals China’s grand plans
                        for an artificial intelligence rollout of smart cities.

  11/22/2017: Prof. Homer Chen visits our lab

  10/13/2017: Congrats to newly minted Dr. Yuncheng Li,  who has joined Snapchat Research

  08/29/2017: Congrats to newly minted Dr. Quanzeng You,  who is joining Microsoft Research AI

  08/21/2017: Professor Luo is quoted by Market Mogul  in a feature
                        “Here's How Big Data Transformation Will Sweep Information Sovereignty"

  08/14/2017: Professor Luo is interviewed by Bloomberg Technology in a feature
                        “China’s Plan for World Domination in AI Isn’t So Crazy After All

  07/26/2017:  Professor Luo is an invited speaker at CVPR 2017 Workshop on
                         Medical Computer Vision and Health Informatics

Professor Luo is co-organizing Language and Vision Workshop at CVPR 2017  
  07/21/2017:  Professor Luo is co-teaching CVPR 2017 Tutorial (lecture notes online) on
                           Dealing with Reality: Low-Quality Visual Data Processing and Analytics

  05/29/2017:  Professor Luo is interviewed by Xinhua News Agency on the heels of AlphaGo's triumph over Ke Jie
                           Spotlight: Artificial intelligence fuels visions of how smart future can be

Our work on Detecting the Hate Code on Social Media is covered extensively
                           by Geek.com, Vice.com, Digital Trends, MSN, Thestack.com
                           Our work is especially timely given that
                           1) YouTube is facing a full-scale advertising boycott over hate speech, and
                           2) Tech Giants Vow to Tackle Online Hate Speech Within 24 Hours

   02/24/2017:  Professor Luo's Data Mining course was considered "favorite class taken at the University of Rochester"
                           in the Data Science program (Featured Article:
Data science for a better planet)

   02/11/2017:  National Science Foundation Research Experience for Undergraduates (NSF REU)
                           Computational Methods for Understanding Music, Media, and Minds
                           Please note that the projects are flexible and the current descriptions are meant as examples.

   11/07/2016: Professor Luo is a panelist on NPR Radio, WXXI Connections hosted by Evan Dawson
                           Monthly Science Roundtable  “Twitter, Social Media and The Election”

   10/21/2016: Our work on fine-grained recognition of East Asian faces is covered by Washington Post
                           You are welcome to take the Asian Face Challenge at http://www.vista-today.com/asianmyth
                           to help benchmark human recognition performance (currently at 49% with 400+ tests)
                           Another story on NextShark

   10/01/2016: Professor Luo speaks at the Huang Symposium @UIUC to celebrate the 80th birthday and
                           extraordinary career of Professor Thomas S. Huang

   08/29/2016: Congratulations to
Tianran Hu who receives a student travel scholarship to attend CIKM 2016.
   07/20/2016: URCS is highly ranked among the Top universities in Artificial Intelligence for the period of 2000-2016
                          by an objective measure of faculty publications

   07/19/2016: URCS is among the Top 20 Artificial Intelligence Engineering Schools in the U.S.

   07/01/2016: Congratulations to Quanzeng You
for being invited to the 2016 ACM Multimedia Doctoral Symposium
                          with a travel scholarship

   06/26/2016: Yiheng Zhou and Numair Sani, our undergraduate researchers, present their work on mining Instagram
                          for illicit drug use patterns at SBP-BRiMS 2016, supported by student travel scholarship

   06/09/2016: Our work on "Will Sanders Supporters Jump Ship to Trump?" is covered by Pacific Standard

   05/10/2016: Our work on using AI to hunt drug dealers on Instagram is covered by Daily Dot

Our work on "Voting with Feet: Who are leaving Hilary Clinton and Donald Trump"  is covered
AOL, Daily Dot, LipTV, Pivot America

   04/21/2016: Zhishen Pan, a Junior student in the Data Science program, won the Poster Presentation Award at the
                          2nd Annual Rochester Global Health Symposium & UNYTE Scientific Session: Innovative Solutions to
                          Combat Global Health Disparities for the poster “Towards Understanding How News Coverage Affects
                          Public Perception During Epidemic Outbreak.”  Congratulations!

   04/18/2016: Yu Wang receives a student travel scholarship to attend ICWSM-2016

   03/29/2016: Congratulations to Yuncheng Li, who has been invited to the CVPR 2016 Doctoral Consortium

   03/20/2016: Our work on using Twitter user avatar facial analysis to study Trump and Clinton followers is covered by
                         MIT Technology Review, Digital Trends, Market Exclusive

   03/17/2016: Our
CVPR 2016 paper “Image Captioning with Semantic Attention” - describes the engine behind a
                         system that has been sitting atop the Leader Board for the Microsoft COCO (Common Objects in Context)
                         Image Captioning Challenge since November 2015, beating Google, Microsoft, Baidu/UCLA, Stanford,
                        UC Berkeley, University of Toronto/Montreal
, and other power houses. Full Story.

   03/16/2016: Our work on detecting drinking-while-tweeting patterns is covered by MIT Technology Review,  Gizmodo,
                         CBS News,  NPR Weekend Edition, Engadget, and more

   02/06/2016: Our work on estimating city air pollution from crowd-sourced photos is covered by New Scientist
                          Try our demo system.

   12/21/2015:  Quanzeng You is a Finalist for the inaugural Adobe Research Fellowship

   11/01/2015: Our work on using Instagram posts to determine underage drinking patterns has been covered by
                        Innovation Trail, Digital Trends, Democratic and Chronicle, TechRadar, Medical Daily,
                       The Science Explorer, iTech Post

   10/01/2015: Yu Wang and Tianran Hu
receive student travel scholarships to attend IEEE ICDM 2015

   10/02/2015: Data Science Faculty Search (2015-2016): neurally-inspired computing;
                         computer vision for medicine and humanities

    10/01/2015: Yu Wang
receives a student travel scholarship to attend IEEE BigData 2015

    08/28/2015: Our data-driven study on the influence of fashion shows on everyday trends
has been featured by
                         New York Post
, Science News, El País (major Spanish Newspaper), MIT Technology Review

    08/20/2015: Yuncheng Li et al. win the Best Paper Award at ICIMCS 2015 for the work on Using User Generated
                         Photos to Monitor Air Pollution in Cities

    07/20/2015: Deadline of the International Workshop on Social Multimedia Data Mining at ICDM 2015 (Atlantic City)

    07/14/2015: Quanzeng You is invited to the 2015 Microsoft Research Asia Ph.D. Forum among "30 of the best Asian
                         Ph.D. students from the Asia-Pacific region and the U.S."

    05/15/2015: Prof. Luo is named a Data Science CoE Distinguished Researcher @Goergen Institute for Data Science

    05/12/2015: Tianran Hu receives a student travel scholarship to attend ICWSM-2015

    02/15/2015 Our work on computational image sentiment analysis is covered by Tech TimesScience 2.0

    02/03/2015: Communications of ACM coverage of our Non-Obtrusive Mental Health Monitoring work; also Gizmag

    12/15/2014: ICDM Tutorial on "Social Multimedia as Sensors"
    12/14/2014: Workshop on Social Multimedia Data Mining at ICDM 2014

    12/07/2014: Quanzeng You receives a student travel scholarship to attend AAAI-2015

Prof. James Rehg visits our lab

    08/28/2014: Guess how many students I currently advise? 50

    07/15/2014: 2014 IEEE Multimedia Prize Paper Award

    06/28/2014: The New Big Three of Rochester (Democratic and Chronicle interview)

    05/01/2014: How Good is URCS? (a little known fact that puts us ahead of a perennial top 5 CS department)

    12/20/2013: Prof. Roland Goecke visits our lab
    10/25/2013: Prof. Bill Freeman visits our lab
RoCData II (Rochester Big Data Forum)
    10/17/2013: Prof. Ruslan Salakhutdinov visits our lab
    10/14/2013: Prof. Honglak Lee  visits  our lab
    08/29/2013: Prof. Eckehard Steinbach  visits  our lab
RoCData II (Rochester Big Data Forum)
The TMM Special Issue on "Social Media as Sensors" is complete and in press for August 2013
    04/08/2013: A 
New Publication highlighting Big Data research at the UR
    12/31/2012: URCS 
Faculty Recruiting in HCI and Big Data
RoCData (Rochester Big Data Forum, speaker list)
"Computer Vision with a Third Eye"

VIStA (Visual Intelligence & Social Multimedia Analytics) Research Group is formed


02/25/2012: Professor Luo will co-chair the IEEE CVPR 2012 Area Chair meeting in Long Beach, CA.

12/08/2011: Professor Luo will serve on the program committee for both the research track and industry track of the 2012 ACM SIGKDD conference.

09/06/2011: I am looking for two self-motivated PhD students to join my research group in Fall 2012 to work in the areas of  computer vision and social media data mining.  Applicants are expected to have strong skills in both programming and mathematics. Related research publications in ranked venues of computer vision, machine learning, or data mining is a plus . To apply, check http://www.cs.rochester.edu/education/phd-program.

09/01/2011: Professor Luo joined the CS Department after a prolific career of 15+ years at Kodak Research Labs.

09/01/2011: Professor Luo will co-chair the Third ACM SIGMM Workshop on Social Media (WSM2011) in conjunction with ACM Multimedia 2011.

09/01/2011: A feature article on "Aesthetics and Emotions in Images: A Computational Perspective" is published in the IEEE Signal Processing Magazine.

09/01/2011: A mini book on Interactive Co-segmentation of Objects in Image Collections (SpringerBriefs in Computer Science) by Dhruv Batra, Adarsh Kowdle, Devi Parikh, Jiebo Luo, and Tsuhan Chen is available for pre-order.

04/06/2011: A new book on Social Media Modeling and Computing by Steven C.H. Hoi, Jiebo Luo, Susanne Boll and Dong Xu is published by Springer
03/2011: iCoseg among top downloaded articles from IJCV in the last 30 days.
[ Springer Page | Preprint pdf | Project Page ]


Jiebo Luo joined the University of Rochester in Fall 2011 after over fifteen prolific years at Kodak Research Laboratories, where he was a Senior Principal Scientist leading research and advanced development. He has been involved in numerous technical conferences, including serving as the program co-chair of ACM Multimedia 2010, IEEE CVPR 2012 and IEEE ICIP 2017. He has served on the editorial boards of the IEEE Transactions on Pattern Analysis and Machine Intelligence, IEEE Transactions on Multimedia, IEEE Transactions on Circuits and Systems for Video Technology, ACM Transactions on Intelligent Systems and Technology, Pattern Recognition, Machine Vision and Applications, and Journal of Electronic Imaging.  Dr. Luo is a Fellow of the SPIE, IAPR, IEEE, ACM, and AAAI. In addition, he is a Board Member of the Greater Rochester Data Science Industry Consortium.

His research spans image processing, computer vision, machine learning, data mining, social media, biomedical informatics, and ubiquitous computing. He is a pionneer for contextual inference in semantic understanding of visual data, and social multimedia data mining. He has published extensively in these fields with nearly 400 peer-reviewed technical papers and over 90 US patents. His H-Index is currently 76.



Major Professional Services




Selected Recent Publications (Publications listed more comprehensively by DBLP)

My CitationsScholar Home


computer vision, NLP and media understanding




machine learning




web and social media data mining


      2017       2016

biomedical analytics and health informatics





human computer interaction

mobile and pervasive computing



Pixels and Patches (Bits and Bytes)

Pictures (Featured Big Picture Talks)



ACM DL   IEEE Xplore   SpringerLink

Research Themes

VIStA Research Group Members:

Visiting Researchers

Prof. Jinsong Su (Xiamen University)
Prof. Yi Wang (DLUT)

PhD Students

 yli's picture                         
Yuncheng Li              Quanzeng You
(Snapchat Research since 2017)  (Microsoft Research AI since 2017)  

     Tianran Hu                         Jianbo Yuan

  Yu Wang (PSC)                   Yang Feng                      Haofu Liao 
(Facebook since 2018)
  Tianlang Chen
               Zhengyuan Yang
     Wei Xiong         
              Jie Chen                             Weijian Li       

  Songyang Zhang
   Songyang Zhang                  Wei Zhu                         Haitian Zheng

Visiting PhD Students

                Mengshi Qi                                  Wenbin Li

MS Students

Undergraduate Students



Special Notes:

- Class of 2018 students: Please use my URCS email to set up appointments with me.

- Prospective PhD Students:
Applicants are expected to have strong skills in both programming and mathematics, as well as research experience in closely related areas. Grades alone won't cut it. "I worked on a gazillion of projects" (but have no evidence) is a no-no. Research publications in ranked venues of computer vision, machine learning, or data mining is a plus (and the only reason you need to contact me directly). Sorry but generic spams will be ignored.

To apply, check

- Prospective Visitors (Faculty/PhD Student): You must have your advisor/mentor vouch for you, if you have not personally worked with me.

- Postdoc Applicants: There is NO opening at present.

- Reference Letter Seekers: You must have your advisor/mentor vouch for you, if you have not personally worked with me.

- Internship Seekers:  We do NOT host summer interns unless there is a pre-existing arrangement.

Research is a Journey not for the Faint-hearted

Do you have what it takes to be a successful PhD student? The initial threshold is 4 out of 7

Curious how I evalaute students?

Be the best you can be
. You can be the best.

Battle Hymns

Hall of Fame (The Script)



Prof. Eckehard Steinbach  (08/29/2013)

Prof. Honglak Lee

Ruslan Salakhutdinov (10/17/2013)

Prof. Bill Freeman (10/25/2013)

Prof. James Rehg (10/02/2014)

Free access and statistics provided by the ACM Digital Library

Back to the top