URCS Banner
 


Photo Professor Jiebo Luo

Department of Computer Science
611 Computer Studies Building  
University of Rochester
Rochester, NY 14627


Email: username -at- domain.edu
where username = jluo,
domain = cs.rochester.edu)


Office: CSB 611
Phone: 585-276-5784
Computer Vision Medical Imaging
Computational Photography 
Image Retrieval Image Segmentation
Scene Classification Big Data
Contextual Inference Machine
Learning      Vision+Language
Random Field Photo Collection
Multimedia    Video Analytics
Human-Centered Media & Interaction
Mobile Media Location-based service
Geo Tagging  Action Recognition
Heterogeneous Information Networks
Social Multimedia  Data Mining
Prediction Nowcasting Crowdsourcing
 

       www.cs.rochester.edu/u/jluo/#Service      

News

   06/09/2016: Our work on "Will Sanders Supporters Jump to Trump?" is covered by Pacific Standard

   05/10/2016: Our work on using AI to hunt drug dealers on Instagram is covered by Daily Dot

   05/04/2016:
Our work on "Voting with Feet: Who are leaving Hilary Clinton and Donald Trump"  is covered
                          by
AOL, Daily Dot, LipTV, Pivot America

   04/21/2016: Zhishen Pan, a Junior student in the Data Science program, won the Poster Presentation Award at the
                          2nd Annual Rochester Global Health Symposium & UNYTE Scientific Session: Innovative Solutions to
                          Combat Global Health Disparities for the poster “Towards Understanding How News Coverage Affects
                          Public Perception During Epidemic Outbreak.”  Congratulations!

   04/18/2016: Yu Wang receives a student travel scholarship to attend ICWSM-2016

   03/29/2016: Congratulations to Yuncheng Li, who has been admitted to the CVPR 2016 Doctoral Consortium

   03/20/2016: Our work on using Twitter user avatar facial analysis to study Trump and Clinton followers is covered by
                         MIT Technology Review, Digital Trends, Market Exclusive


   03/17/2016: Our
CVPR 2016 paper “Image Captioning with Semantic Attention” - describes the engine behind a
                         system that has been sitting atop the Leader Board for the Microsoft COCO (Common Objects in Context)
                         Image Captioning Challenge since November 2015, beating Google, Microsoft, Baidu/UCLA, Stanford,
                        UC Berkeley, University of Toronto/Montreal
, and other power houses. Full Story.

   03/16/2016: Our work on detecting drinking-while-tweeting patterns is covered by MIT Technology Review,  Gizmodo,
                         CBS News,  NPR Weekend Edition, Engadget, and more

   02/06/2016: Our work on estimating city air pollution from crowd-sourced photos is covered by New Scientist
                          Try our demo system.

   12/21/2015:  Quanzeng You is a Finalist for the inaugural Adobe Research Fellowship

   11/01/2015: Our work on using Instagram posts to determine underage drinking patterns has been covered by
                        Innovation Trail, Digital Trends, Democratic and Chronicle, TechRadar, Medical Daily,
                       The Science Explorer, iTech Post

   10/01/2015: Yu Wang and Tianran Hu
receive student travel scholarships to attend IEEE ICDM 2015

   10/02/2015: Data Science Faculty Search (2015-2016): neurally-inspired computing;
                         computer vision for medicine and humanities


    10/01/2015: Yu Wang
receives a student travel scholarship to attend IEEE BigData 2015

    08/28/2015: Our data-driven study on the influence of fashion shows on everyday trends
has been featured by
                         New York Post
, Science News, El País (major Spanish Newspaper), MIT Technology Review

    08/20/2015: Yuncheng Li et al. win the Best Paper Award at ICIMCS 2015 for the work on Using User Generated
                         Photos to Monitor Air Pollution in Cities

    07/20/2015: Deadline of the International Workshop on Social Multimedia Data Mining at ICDM 2015 (Atlantic City)

    07/14/2015: Quanzeng You is invited to the 2015 Microsoft Research Asia Ph.D. Forum among "30 of the best Asian
                         Ph.D. students from the Asia-Pacific region and the U.S."

    05/15/2015: Prof. Luo is named a Data Science CoE Distinguished Researcher @Goergen Institute for Data Science

    05/12/2015: Tianran Hu receives a student travel scholarship to attend ICWSM-2015

    02/15/2015 Our work on computational image sentiment analysis is covered by Tech TimesScience 2.0

    02/03/2015: Communications of ACM coverage of our Non-Obtrusive Mental Health Monitoring work; also Gizmag

    12/15/2014: ICDM Tutorial on "Social Multimedia as Sensors"
    12/14/2014: Workshop on Social Multimedia Data Mining at ICDM 2014

    12/07/2014: Quanzeng You receives a student travel scholarship to attend AAAI-2015

    10/02/2014:
Prof. James Rehg visits our lab

    08/28/2014: Guess how many students I currently advise? 50

    07/15/2014: 2014 IEEE Multimedia Prize Paper Award

    06/28/2014: The New Big Three of Rochester (Democratic and Chronicle interview)

    05/01/2014: How Good is URCS? (a little known fact that puts us ahead of a perennial top 5 CS department)

   
    12/20/2013: Prof. Roland Goecke visits our lab
    10/25/2013: Prof. Bill Freeman visits our lab
    10/18/2013:
RoCData II (Rochester Big Data Forum)
    10/17/2013: Prof. Ruslan Salakhutdinov visits our lab
    10/14/2013: Prof. Honglak Lee  visits  our lab
    08/29/2013: Prof. Eckehard Steinbach  visits  our lab
    10/18/2013:
RoCData II (Rochester Big Data Forum)
    05/15/2013:
The TMM Special Issue on "Social Media as Sensors" is complete and in press for August 2013
    04/08/2013: A 
New Publication highlighting Big Data research at the UR
    12/31/2012: URCS 
Faculty Recruiting in HCI and Big Data
    10/04/2012:
RoCData (Rochester Big Data Forum, speaker list)
    09/19/2012:
"Computer Vision with a Third Eye"

    09/10/2012:
VIStA (Visual Intelligence & Social Multimedia Analytics) Research Group is formed

 

02/25/2012: Professor Luo will co-chair the IEEE CVPR 2012 Area Chair meeting in Long Beach, CA.

12/08/2011: Professor Luo will serve on the program committee for both the research track and industry track of the 2012 ACM SIGKDD conference.

09/06/2011: I am looking for two self-motivated PhD students to join my research group in Fall 2012 to work in the areas of  computer vision and social media data mining.  Applicants are expected to have strong skills in both programming and mathematics. Related research publications in ranked venues of computer vision, machine learning, or data mining is a plus . To apply, check http://www.cs.rochester.edu/education/phd-program.

09/01/2011: Professor Luo joined the CS Department after a prolific career of 15+ years at Kodak Research Labs.

09/01/2011: Professor Luo will co-chair the Third ACM SIGMM Workshop on Social Media (WSM2011) in conjunction with ACM Multimedia 2011.

09/01/2011: A feature article on "Aesthetics and Emotions in Images: A Computational Perspective" is published in the IEEE Signal Processing Magazine.

09/01/2011: A mini book on Interactive Co-segmentation of Objects in Image Collections (SpringerBriefs in Computer Science) by Dhruv Batra, Adarsh Kowdle, Devi Parikh, Jiebo Luo, and Tsuhan Chen is available for pre-order.

04/06/2011: A new book on Social Media Modeling and Computing by Steven C.H. Hoi, Jiebo Luo, Susanne Boll and Dong Xu is published by Springer
 
03/2011: iCoseg among top downloaded articles from IJCV in the last 30 days.
[ Springer Page | Preprint pdf | Project Page ]


Biography

Jiebo Luo joined the University of Rochester in Fall 2011 after over fifteen prolific years at Kodak Research Laboratories, where he was a Senior Principal Scientist leading research and advanced development. He has been involved in numerous technical conferences, including serving as the program co-chair of ACM Multimedia 2010 and IEEE CVPR 2012. He is the Editor-in-Chief of the Journal of Multimedia, and has served on the editorial boards of the IEEE Transactions on Pattern Analysis and Machine Intelligence, IEEE Transactions on Multimedia, IEEE Transactions on Circuits and Systems for Video Technology, Pattern Recognition, Machine Vision and Applications, and Journal of Electronic Imaging.  Dr. Luo is a Fellow of the SPIE, IEEE, and IAPR.
IEEE Advancing Technology for Humanity                                

His research spans image processing, computer vision, machine learning, data mining, medical imaging, and ubiquitous computing. He has been an advocate for contextual inference in semantic understanding of visual data, and continues to push the frontiers in this area by incorporating geo-location context and social context. A recent research thrust focuses on exploiting social media for machine learning, data mining, and human-computer interaction, for example, mining the wisdom of crowds for social, political, and economic prediction and forecasting. He has published extensively in these fields with over 270 papers and 90 US patents.

Teaching


Research


Major Professional Services


Books

    

    


Selected Recent Publications (Publications listed more comprehensively by DBLP)

My CitationsScholar Home


survey

computer vision and media understanding

machine learning 

social media data mining

human computer interaction

biomedical analytics and informatics

mobile and pervasive computing

 

 





 


Pixels and Patches (Bits and Bytes)


Pictures (Featured Big Picture Talks)

 

Resources


ACM DL   IEEE Xplore   SpringerLink
cvpapers
   




Research Themes


VIStA Research Group Members:

Visiting Researchers

Prof. Weining Wang  
Dr. Kuan-Ting Chen



PhD Students

 yli's picture                         
      Yuncheng Li                     Quanzeng You                

                                    
  Tianran Hu                         Jianbo Yuan

                                                            
  Yu Wang (PSC)               Yang Feng 


    Haofu Liao                     Tianlang Chen


  Zhengyuan Yang            

          

Visiting PhD Students


    Xiangyang Xu
                Jesse Wang                       Zhiwei Jin
(Nanjin University)         (MD/PHD, URMC)                   (ICT)



MS Students

 

Undergraduate Students


Alumni

                     
 Dr.                 Prof. Jun Wu    
         


Prof. Tian-Liang Liu   
Prof. Congyan Lang 

          

Special Notes:

- Class of 2018 students: Please use my URCS email to set up appointments with me.

- Perspective PhD Students:
Applicants are expected to have strong skills in both programming and mathematics, as well as research experience in closely related areas. Grades alone won't cut it. "I worked on a gazillion of projects" (but have no evidence) is a no-no. Research publications in ranked venues of computer vision, machine learning, or data mining is a plus (and the only reason you may contact me directly). Sorry but generic spams will be ignored.

To apply, check
http://www.cs.rochester.edu/graduate/phd-program.

- Perspective Visitors (Faculty/PhD Student): You must have your advisor/mentor vouch for you, if you have not personally worked with me.

- Postdoc Applicants: There is NO opening at present.

- Reference Letter Seekers: You must have your advisor/mentor vouch for you, if you have not personally worked with me.

- Internship Seekers:  We do NOT host summer interns unless there is a pre-existing arrangement.



Research is a Journey not for the Faint-hearted



Curious how I evalaute students?
https://drive.google.com/file/d/0Byh2_bxvelahTmlERExreDJ5YW1iRUhIVU95TzZiY2U3WDNJ/view

Be the best you can be
.You can be the best.


Battle Hymns

Hall of Fame (The Script)


Thumbnail

Exchange

Prof. Eckehard Steinbach  (08/29/2013)


Prof. Honglak Lee
(10/14/2013)


Prof.
Ruslan Salakhutdinov (10/17/2013)


Prof. Bill Freeman (10/25/2013)


Prof. James Rehg (10/02/2014)


Free access and statistics provided by the ACM Digital Library

ACM DL Author-ize serviceCorrelated attribute transfer with multi-task graph-guided fusion
Yahong Han, Fei Wu, Xinyan Lu, Qi Tian, Yueting Zhuang, Jiebo Luo
MM '12 Proceedings of the 20th ACM international conference on Multimedia, 2012
ACM DL Author-ize serviceFinding perfect rendezvous on the go: accurate mobile visual localization and its applications to routing
Heng Liu, Tao Mei, Jiebo Luo, Houqiang Li, Shipeng Li
MM '12 Proceedings of the 20th ACM international conference on Multimedia, 2012
ACM DL Author-ize serviceAMIGO: accurate mobile image geotagging
Xiaobin Xu, Tao Mei, Wenjun Zeng, Nenghai Yu, Jiebo Luo
ICIMCS '12 Proceedings of the 4th International Conference on Internet Multimedia Computing and Service, 2012
ACM DL Author-ize serviceFinding geographically representative music via social media
Charles Parker, Dhiraj Joshi, Phoury Lei, Jiebo Luo
MIRUM '11 Proceedings of the 1st international ACM workshop on Music information retrieval with user-centered and multimodal strategies, 2011
ACM DL Author-ize servicePhoto stream alignment for collaborative photo collection and sharing in social media
Jianchao Yang, Jiebo Luo, Jie Yu, Thomas S. Huang
WSM '11 Proceedings of the 3rd ACM SIGMM international workshop on Social media, 2011
ACM DL Author-ize serviceSequence-kernel based sparse representation for amateur video summarization
Zheshen Wang, Mrityunjay Kumar, Jiebo Luo, Baoxin Li
J-MRE '11 Proceedings of the 2011 joint ACM workshop on Modeling and representing events, 2011
ACM DL Author-ize serviceExtracting key frames from consumer videos using bi-layer group sparsity
Zheshen Wang, Mrityunjay Kumar, Jiebo Luo, Baoxin Li
MM '11 Proceedings of the 19th ACM international conference on Multimedia, 2011
ACM DL Author-ize serviceACM international workshop on interactive multimedia on mobile and portable devices (IMMPD'11)
Jiebo Luo, Caifeng Shan, Ling Shao, Minoru Etoh
MM '11 Proceedings of the 19th ACM international conference on Multimedia, 2011
ACM DL Author-ize serviceDynamic media show drivable by semantics
Vivek K. Singh, Jiebo Luo, Dhiraj Joshi, Madirakshi Das, Phoury Lei, Peter Stubler
MM '11 Proceedings of the 19th ACM international conference on Multimedia, 2011
ACM DL Author-ize serviceWSM2011: third ACM workshop on social media
Steven Chu-Hong Hoi, Michal Jacovi, Ioannis Kompatsiaris, Jiebo Luo, Konstantinos Tserpes
MM '11 Proceedings of the 19th ACM international conference on Multimedia, 2011
ACM DL Author-ize serviceReliving on demand: a total viewer experience
Vivek K. Singh, Jiebo Luo, Dhiraj Joshi, Phoury Lei, Madirakshi Das, Peter Stubler
MM '11 Proceedings of the 19th ACM international conference on Multimedia, 2011
ACM DL Author-ize serviceLearning to produce 3D media from a captured 2D video
Minwoo Park, Jiebo Luo, Andrew Gallagher, Majid Rabbani
MM '11 Proceedings of the 19th ACM international conference on Multimedia, 2011
ACM DL Author-ize serviceIntroduction to special issue on social media
Susanne Boll, Ramesh Jain, Jiebo Luo, Dong Xu
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), 2011
ACM DL Author-ize serviceLikeMiner: a system for mining the power of 'like' in social media networks
Xin Jin, Chi Wang, Jiebo Luo, Xiao Yu, Jiawei Han
KDD '11 Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining, 2011
ACM DL Author-ize serviceEfficient manifold ranking for image retrieval
Bin Xu, Jiajun Bu, Chun Chen, Deng Cai, Xiaofei He, Wei Liu, Jiebo Luo
SIGIR '11 Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval, 2011
ACM DL Author-ize serviceCollection-based sparse label propagation and its application on social group suggestion from photos
Jie Yu, Xin Jin, Jiawei Han, Jiebo Luo
ACM Transactions on Intelligent Systems and Technology (TIST), 2011
ACM DL Author-ize serviceRich location-driven tag cloud suggestions based on public, community, and personal sources
Dhiraj Joshi, Jiebo Luo, Jie Yu, Phoury Lei, Andrew Gallagher
CMM '10 Proceedings of the 1st ACM international workshop on Connected multimedia, 2010
ACM DL Author-ize serviceVisual cube and on-line analytical processing of images
Xin Jin, Jiawei Han, Liangliang Cao, Jiebo Luo, Bolin Ding, Cindy Xide Lin
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management, 2010
ACM DL Author-ize serviceUnderstanding multimedia content using web scale social media data
Dong Xu, Lei Zhang, Jiebo Luo
MM '10 Proceedings of the international conference on Multimedia, 2010
ACM DL Author-ize serviceBeyond GPS: determining the camera viewing direction of a geotagged image
Minwoo Park, Jiebo Luo, Robert T. Collins, Yanxi Liu
MM '10 Proceedings of the international conference on Multimedia, 2010
ACM DL Author-ize serviceWSM'10: 2nd ACM workshop on social media
Susanne Boll, Steven C.H. Hoi, Roelof van Zwol, Jiebo Luo
MM '10 Proceedings of the international conference on Multimedia, 2010
ACM DL Author-ize serviceThe wisdom of social multimedia: using flickr for prediction and forecast
Xin Jin, Andrew Gallagher, Liangliang Cao, Jiebo Luo, Jiawei Han
MM '10 Proceedings of the international conference on Multimedia, 2010
ACM DL Author-ize serviceRankCompete: simultaneous ranking and clustering of web photos
Liangliang Cao, Andrey Del Pozo, Xin Jin, Jiebo Luo, Jiawei Han, Thomas S. Huang
WWW '10 Proceedings of the 19th international conference on World wide web, 2010
ACM DL Author-ize serviceiRIN: image retrieval in image-rich information networks
Xin Jin, Jiebo Luo, Jie Yu, Gang Wang, Dhiraj Joshi, Jiawei Han
WWW '10 Proceedings of the 19th international conference on World wide web, 2010
ACM DL Author-ize serviceSocial group suggestion from user image collections
Jie Yu, Xin Jin, Jiawei Han, Jiebo Luo
WWW '10 Proceedings of the 19th international conference on World wide web, 2010
ACM DL Author-ize serviceFirst ACM SIGMM international workshop onsocial media (WSM'09)
Susanne Boll, Steven C.H. Hoi, Jiebo Luo, Rong Jin, Irwin King, Dong Xu
MM '09 Proceedings of the 17th ACM international conference on Multimedia, 2009
ACM DL Author-ize serviceRanking with local regression and global alignment for cross media retrieval
Yi Yang, Dong Xu, Feiping Nie, Jiebo Luo, Yueting Zhuang
MM '09 Proceedings of the 17th ACM international conference on Multimedia, 2009
ACM DL Author-ize serviceUsing large-scale web data to facilitate textual query based retrieval of consumer photos
Yiming Liu, Dong Xu, Ivor W. Tsang, Jiebo Luo
MM '09 Proceedings of the 17th ACM international conference on Multimedia, 2009
ACM DL Author-ize serviceT-IRS: textual query based image retrieval system for consumer photos
Yiming Liu, Dong Xu, Ivor W. Tsang, Jiebo Luo
MM '09 Proceedings of the 17th ACM international conference on Multimedia, 2009
ACM DL Author-ize serviceEvent recognition from photo collections via PageRank
Naveed Imran, Jingen Liu, Jiebo Luo, Mubarak Shah
MM '09 Proceedings of the 17th ACM international conference on Multimedia, 2009
ACM DL Author-ize service1st ACM international workshop on interactive multimedia for consumer electronics (IMCE'09)
Ling Shao, Caifeng Shan, Jiebo Luo, Minoru Etoh
MM '09 Proceedings of the 17th ACM international conference on Multimedia, 2009
ACM DL Author-ize serviceEnhancing semantic and geographic annotation of web images via logistic canonical correlation regression
Liangliang Cao, Jie Yu, Jiebo Luo, Thomas S. Huang
MM '09 Proceedings of the 17th ACM international conference on Multimedia, 2009
ACM DL Author-ize serviceMobile media search: has media search finally found its perfect platform? part II
Berna Erol, Jiebo Luo, Shih-Fu Chang, Minoru Etoh, Hsiao-Wuen Hon, Qian Lin, Vidya Setlur
MM '09 Proceedings of the 17th ACM international conference on Multimedia, 2009
ACM DL Author-ize serviceMining GPS traces and visual words for event classification
Junsong Yuan, Jiebo Luo, Henry Kautz, Ying Wu
MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval, 2008
ACM DL Author-ize serviceEvent recognition: viewing the world with a third eye
Jiebo Luo, Jie Yu, Dhiraj Joshi, Wei Hao
MM '08 Proceedings of the 16th ACM international conference on Multimedia, 2008
ACM DL Author-ize serviceImage annotation using personal calendars as context
Andrew C. Gallagher, Carman G. Neustaedter, Liangliang Cao, Jiebo Luo, Tsuhan Chen
MM '08 Proceedings of the 16th ACM international conference on Multimedia, 2008
ACM DL Author-ize serviceAnnotating photo collections by label propagation according to multiple similarity cues
Liangliang Cao, Jiebo Luo, Thomas S. Huang
MM '08 Proceedings of the 16th ACM international conference on Multimedia, 2008
ACM DL Author-ize serviceLeveraging probabilistic season and location context models for scene understanding
Jie Yu, Jiebo Luo
CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval, 2008
ACM DL Author-ize serviceInferring generic activities and events from image content and bags of geo-tags
Dhiraj Joshi, Jiebo Luo
CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval, 2008
ACM DL Author-ize serviceNew challenges in multimedia research for the increasingly connected and fast growing digital society
Jia Li, Shih-Fu Chang, Michael Lesk, Rainer Lienhart, Jiebo Luo, Arnold W. M. Smeulders
MIR '07 Proceedings of the international workshop on Workshop on multimedia information retrieval, 2007
ACM DL Author-ize serviceKodak's consumer video benchmark data set: concept definition and annotation
Alexander Loui, Jiebo Luo, Shih-Fu Chang, Dan Ellis, Wei Jiang, Lyndon Kennedy, Keansub Lee, Akira Yanagawa
MIR '07 Proceedings of the international workshop on Workshop on multimedia information retrieval, 2007
ACM DL Author-ize serviceLarge-scale multimodal semantic concept detection for consumer video
Shih-Fu Chang, Dan Ellis, Wei Jiang, Keansub Lee, Akira Yanagawa, Alexander C. Loui, Jiebo Luo
MIR '07 Proceedings of the international workshop on Workshop on multimedia information retrieval, 2007

Back to the top