Jiebo Luo's Home Page

 


Photo Professor Jiebo Luo
Department of Computer Science
611 Computer Studies Building  
University of Rochester
Rochester, NY 14627


Email: username -at- domain.edu
where username = jluo,
domain = cs.rochester.edu)

Office: CSB 611
Phone: 585-276-5784
Computer Vision Medical Imaging
Computational Photography 
Image Retrieval Image Segmentation
Scene Classification Large Scale
Contextual Inference 
Machine
Learning
   Pattern Recognition 
Random Field Photo Collection
Multimedia    Content
Human-Centered Media 
Mobile Media 
Location-based service
Geo Tagging  Social Network
Heterogeneous Networks

Social Media  Data Mining
Prediction Forecast Crowdsourcing
   


                                         www.cs.rochester.edu/u/jluo/#Service                    



News

04/08/2013: A new publication highlighting Big Data research at the UR

12/31/2012:  URCS Faculty Recruiting in HCI and Big Data

10/04-06/2012: RoCData (Rochester Big Data Forum, speaker list)

09/19/2012: "Computer Vision with a Third Eye"

09/10/2012: VIStA (Visual Intelligence & Social Multimedia Analytics) Research Group is formed
 

02/25/2012: Professor Luo will co-chair the IEEE CVPR 2012 Area Chair meeting in Long Beach, CA.

12/08/2011: Professor Luo will serve on the program committee for both the research track and industry track of the 2012 ACM SIGKDD conference.

09/06/2011: I am looking for two self-motivated PhD students to join my research group in Fall 2012 to work in the areas of  computer vision and social media data mining.  Applicants are expected to have strong skills in both programming and mathematics. Related research publications in ranked venues of computer vision, machine learning, or data mining is a plus . To apply, check http://www.cs.rochester.edu/education/phd-program.

09/01/2011: Professor Luo joined the CS Department after a prolific career of 15+ years at Kodak Research Labs.

09/01/2011: Professor Luo will co-chair the Third ACM SIGMM Workshop on Social Media (WSM2011) in conjunction with ACM Multimedia 2011.

09/01/2011: A feature article on "Aesthetics and Emotions in Images: A Computational Perspective" is published in the IEEE Signal Processing Magazine.

09/01/2011: A mini book on Interactive Co-segmentation of Objects in Image Collections (SpringerBriefs in Computer Science) by Dhruv Batra, Adarsh Kowdle, Devi Parikh, Jiebo Luo, and Tsuhan Chen is available for pre-order.

04/06/2011: A new book on Social Media Modeling and Computing by Steven C.H. Hoi, Jiebo Luo, Susanne Boll and Dong Xu is published by Springer

 
03/2011: iCoseg among top downloaded articles from IJCV in the last 30 days.
[ Springer Page | Preprint pdf | Project Page ]


Biography

Jiebo Luo joined the University of Rochester in Fall 2011 after over fifteen years at Kodak Research Laboratories, where he was a Senior Principal Scientist leading research and advanced development. He has been involved in numerous technical conferences, including serving as the program co-chair of ACM Multimedia 2010 and IEEE CVPR 2012. He is the Editor-in-Chief of the Journal of Multimedia, and has served on the editorial boards of the IEEE Transactions on Pattern Analysis and Machine Intelligence, IEEE Transactions on Multimedia, IEEE Transactions on Circuits and Systems for Video Technology, Pattern Recognition, Machine Vision and Applications, and Journal of Electronic Imaging. He has authored over 200 technical papers and 70 US patents. Dr. Luo is a Fellow of the SPIE, IEEE, and IAPR.
IEEE Advancing Technology for Humanity                                

His research spans image processing, computer vision, machine learning, data mining, medical imaging, and ubiquitous computing. He has been an advocate for contextual inference in semantic understanding of visual data, and continues to push the frontiers in this area by incorporating geo-location context and social context. A recent research thrust focuses on exploiting social media for machine learning, data mining, and human-computer interaction, for example, mining the wisdom of crowds for social, political, and economic prediction and forecasting. He has published extensively in these fields with over 200 papers and 70 US patents.

Teaching

Research

  • Computer vision: recognition of objects, scenes, people, locations, actions and events from images and video
  • Machine learning: learning with large scale weakly labeled web data, cross-domain learning, active learning
  • Social media data mining: prediction, forecasting, suggestion, and recommendation using open source data
  • Human computer interaction: interactive visual recognition; integration of crowd and machine intelligence
  • Biomedical informatics: structural and topological analysis from 3D/4D imaging data; surgical video analysis
  • Mobile and pervasive computing: context-aware applications; multimodal inference from multiple sensors
  • Computational photography: computer vision-based 2D/3D enhancement; augmented/mobile photography 


Books

    

    
Selected Recent Publications (Publications Listed by DBLP)

My CitationsScholar Home
Citations to my articles

computer vision and media understanding

  • Yao Zhou and Jiebo Luo, "A Practical Method for Counting Arbitrary Target Objects in an Arbitrary Scene," IEEE ICME, July 2013.
  • Hua Wang, Dhiraj Joshi, Jiebo Luo, and Heng Huang, "Simultaneous Image Annotation and Geo-Tag Prediction via Correlation Guided Structured Multi-Task Learning," IEEE Symposium on Multimedia (ISM), December 2012.
  • Youjie Zhou, Jiebo Luo, " Geo-Location Inference on News Articles via Multimodal pLSA," ACM Multimedia Conference, Nara, Japan, October 2012. 
  • Xiaobin Xu, Tao Mei, Wenjun Zeng, Nenghai Yu, Jiebo Luo, "AMIGO: Accurate Mobile Image GeOtagging," ACM International Conference on Internet Multimedia Computing and Services, Wuhan, China, September 2012. (Best Paper)
  • Minwoo Park, Jiebo Luo, Andrew Gallagher, Majid Rabbani, “Learning to Produce 3D Media from a Captured 2D Video,” IEEE Trans. on Multimedia, to appear.
  • Minwoo Park, Jiebo Luo, Andrew Gallagher, “Towards Assessing and Improving the Quality of Stereo Images,”  Special Issue on Emerging Techniques in 3D, IEEE Journal of Selected Topics in Signal Processing, 6(5): 460 - 470, 2012.
  • Siyu Xia, Ming Shao, Jiebo Luo, and Yun Fu, “Understanding Kin Relationships in a Photo,” Special Issue on Learning Semantics from Multimedia Web Resources, IEEE Trans. on Multimedia, 14(4): 1046-1056, 2012.
  • Lin Chen, Dong Xu, Ivor W. Tsang, Jiebo Luo, “Tag-based Image Retrieval Improved by SVM with Augmented Features and Group-based Refinement,”  Special Issue on Learning Semantics from Multimedia Web Resources, IEEE Trans. on Multimedia, 14(4): 1057-1067, 2012.
  • Cong Yang, Junsong Yuan, Jiebo Luo, “Towards Scalable Summarization of Consumer Videos via Sparse Dictionary Selection,”  Special Issue on Object and Event Classification in Large-Scale Video Collections, IEEE Trans. on Multimedia, 14(1): 66-75, February 2012.
  • Dhiraj Joshi, Ritendra Datta, Elena Fedorovskaya, Jia Li, James Z. Wang, Jiebo Luo, “Computational inference of aesthetics, mood, and emotion in images,” IEEE Signal Processing Magazine, 28(5):  94-115, September 2011.
  • Yiming Liu, Dong Xu, Ivor Tsang, Jiebo Luo, "Textual query of personal photos facilitated by large-scale web data," IEEE Trans. on Pattern Analysis and Machine Intelligence, 33(5): 1022-1036, May 2011.
  • Minwoo Park, Jiebo Luo, Robert Collions, Yanxi Liu, "Beyond GPS: Determining the viewing direction of a geotagged image," ACM Multimedia Conference, Firenze, Italy, October 2010.
  • Xiaobai Liu, Shuicheng YanJiebo Luo, Jinhui Tang, ZhongYang Huang, Hai Jin, "Nonparametric Label-to-Region by Search," CVPR 2010.
  • Jingen Liu, Jiebo Luo, Mubarak Shah, "Recognizing Realistic Actions from Videos in the Wild," IEEE International Conference on Computer Vision and Pattern Recognition, Miami, FL, June 2009. (Oral Presentation) (Project Page)

machine learning

  • Liangliang CaoXin JinZhijun YinAndrey Del Pozo, Jiebo Luo, Jiawei HanThomas S. Huang, "RankCompete: Simultaneous ranking and clustering of information networks," Neurocomputing, 95: 98-104, 2012.
  • Yahong Han, Fei Wu, Qi Tian, Yueting Zhuang, Jiebo Luo, "Correlated Attribute Transfer with Multi-task Graph-Guided Fusion," ACM Multimedia Conference, Nara, Japan, October 2012. (Long paper)
  • Lixin Duan, Dong Xu, Ivor Tsang, Jiebo Luo, “Visual Event Recognition in Videos by Learning from Web Data,” IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, June 2010. (Best Student Paper)  (Project Page)
  • Liangliang Cao, Jiebo Luo, Feng Liang, Thomas S. Huang, "Heterogeneous feature machines for visual recognition," ICCV 2009.
  • Junsong Yuan, Jiebo Luo, Ying Wu, "Mining compositional features for boosting," CVPR 2008.

social media data mining

  • Ge Ma and Jiebo Luo, "Is A Social Picture Worth 1000 Votes? Analyzing the Sentiment of Election Related Photos," IEEE ICME, July 2013.
  • Xin Jin, Jie Yu, Jiawei Han, Jiebo Luo, “Reinforced retrieval in image-rich information networks via integration of link and content based similarities,” IEEE Trans. on Knowledge Discovery and Engineering, 25(2): pp 448-460, Feb. 2013.
  • Xin Jin, Cindy Lin, Jiebo Luo, Jiawei Han, “SocialSpamGuard: A Data Mining-based Spam Detection System for Social Media Networks,” Demo Paper, International Conference on Very Large Data Bases (VLDB), Seattle, WA, August 2011.
  • Xin Jin, Chi Wang, Jiebo Luo, Jiawei Han, “LikeMiner: A System for Mining the Power of ’Like’ in Social Media Networks,” Demo Paper, International Conference on Knowledge Discovery and Data Mining (KDD), San Diego, CA, August 2011.
  • Zhijun Yin, Liangliang Cao, Jiawei Han, Jiebo Luo, and Thomas Huang, “Diversified Trajectory Pattern Ranking in Geo-tagged Social Media,” SIAM Conference on Data Mining (SDM), Mesa, AZ, April 2011.
  • Xin Jin, Andrew Gallagher, Jiawei Han, Jiebo Luo, “Wisdom of Social Multimedia: Using Flickr for Prediction and Forecast,” ACM Multimedia Conference, Brave and New Ideas Track, Firenze, Italy, October 2010. (Long Paper)
  • Jie Yu, Xin Jin, Jiawei Han, Jiebo Luo, “Collection-based sparse label propagation and its application to social group suggestion from photos,” ACM Transactions on Intelligent Systems and Technology, 2(2): , February 2011.
  • Liangliang Cao, Jiebo Luo, Andrew Gallagher, Thomas Huang, “A Worldwide Tourism Recommendation System Based on Geotagged Web Photos,” IEEE International Conference on Acoustic, Speech and Signal Processing, Dallas, TX, April 2010.

human computer interaction

  • Vivek K. Singh, Jiebo Luo, Dhiraj Joshi, Phoury Lei, Madirakshi Das, Peter Stubler, "Reliving on demand: a total viewer experience," ACM international conference on Multimedia, November 2011.
  • Dhruv Batra, Adarsh Kowdle, Devi Parikh, Jiebo Luo, and Tsuhan Chen, "iCoSeg: Interactive Co-segmentation of Objects in Image Collections,"  IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, June 2010.

biomedical analytics and informatics

  • Tianli Yu, Jiebo Luo, Narendra Ahuja, "Search strategies for shape regularized active contour," Computer Vision and Image Understanding 113(10): 1053-1063, 2009.
  • Hui Luo, Jiebo Luo, "Robust online orientation correction for radiographs in PACS environments," IEEE Trans. Med. Imaging 25(10): 1370-1379, 2006.

mobile and pervasive computing

  • Heng Liu, Tao Mei, Jiebo Luo, Houqiang Li, Shipeng Li, "Finding Perfect Rendezvous On the Go: Accurate Mobile Visual Localization and Its Applications to Routing," ACM Multimedia Conference, Nara, Japan, October 2012. (Long paper, Best Paper Candidate)

 

 



Free access and statistics provided by the ACM Digital Library

ACM DL Author-ize serviceCorrelated attribute transfer with multi-task graph-guided fusion
Yahong Han, Fei Wu, Xinyan Lu, Qi Tian, Yueting Zhuang, Jiebo Luo
MM '12 Proceedings of the 20th ACM international conference on Multimedia, 2012
ACM DL Author-ize serviceAMIGO: accurate mobile image geotagging
Xiaobin Xu, Tao Mei, Wenjun Zeng, Nenghai Yu, Jiebo Luo
ICIMCS '12 Proceedings of the 4th International Conference on Internet Multimedia Computing and Service, 2012
ACM DL Author-ize serviceFinding geographically representative music via social media
Charles Parker, Dhiraj Joshi, Phoury Lei, Jiebo Luo
MIRUM '11 Proceedings of the 1st international ACM workshop on Music information retrieval with user-centered and multimodal strategies, 2011
ACM DL Author-ize servicePhoto stream alignment for collaborative photo collection and sharing in social media
Jianchao Yang, Jiebo Luo, Jie Yu, Thomas S. Huang
WSM '11 Proceedings of the 3rd ACM SIGMM international workshop on Social media, 2011
ACM DL Author-ize serviceSequence-kernel based sparse representation for amateur video summarization
Zheshen Wang, Mrityunjay Kumar, Jiebo Luo, Baoxin Li
J-MRE '11 Proceedings of the 2011 joint ACM workshop on Modeling and representing events, 2011
ACM DL Author-ize serviceExtracting key frames from consumer videos using bi-layer group sparsity
Zheshen Wang, Mrityunjay Kumar, Jiebo Luo, Baoxin Li
MM '11 Proceedings of the 19th ACM international conference on Multimedia, 2011
ACM DL Author-ize serviceACM international workshop on interactive multimedia on mobile and portable devices (IMMPD'11)
Jiebo Luo, Caifeng Shan, Ling Shao, Minoru Etoh
MM '11 Proceedings of the 19th ACM international conference on Multimedia, 2011
ACM DL Author-ize serviceDynamic media show drivable by semantics
Vivek K. Singh, Jiebo Luo, Dhiraj Joshi, Madirakshi Das, Phoury Lei, Peter Stubler
MM '11 Proceedings of the 19th ACM international conference on Multimedia, 2011
ACM DL Author-ize serviceWSM2011: third ACM workshop on social media
Steven Chu-Hong Hoi, Michal Jacovi, Ioannis Kompatsiaris, Jiebo Luo, Konstantinos Tserpes
MM '11 Proceedings of the 19th ACM international conference on Multimedia, 2011
ACM DL Author-ize serviceReliving on demand: a total viewer experience
Vivek K. Singh, Jiebo Luo, Dhiraj Joshi, Phoury Lei, Madirakshi Das, Peter Stubler
MM '11 Proceedings of the 19th ACM international conference on Multimedia, 2011
ACM DL Author-ize serviceLearning to produce 3D media from a captured 2D video
Minwoo Park, Jiebo Luo, Andrew Gallagher, Majid Rabbani
MM '11 Proceedings of the 19th ACM international conference on Multimedia, 2011
ACM DL Author-ize serviceIntroduction to special issue on social media
Susanne Boll, Ramesh Jain, Jiebo Luo, Dong Xu
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), 2011
ACM DL Author-ize serviceLikeMiner: a system for mining the power of 'like' in social media networks
Xin Jin, Chi Wang, Jiebo Luo, Xiao Yu, Jiawei Han
KDD '11 Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining, 2011
ACM DL Author-ize serviceEfficient manifold ranking for image retrieval
Bin Xu, Jiajun Bu, Chun Chen, Deng Cai, Xiaofei He, Wei Liu, Jiebo Luo
SIGIR '11 Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval, 2011
ACM DL Author-ize serviceRich location-driven tag cloud suggestions based on public, community, and personal sources
Dhiraj Joshi, Jiebo Luo, Jie Yu, Phoury Lei, Andrew Gallagher
CMM '10 Proceedings of the 1st ACM international workshop on Connected multimedia, 2010
ACM DL Author-ize serviceVisual cube and on-line analytical processing of images
Xin Jin, Jiawei Han, Liangliang Cao, Jiebo Luo, Bolin Ding, Cindy Xide Lin
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management, 2010
ACM DL Author-ize serviceUnderstanding multimedia content using web scale social media data
Dong Xu, Lei Zhang, Jiebo Luo
MM '10 Proceedings of the international conference on Multimedia, 2010
ACM DL Author-ize serviceBeyond GPS: determining the camera viewing direction of a geotagged image
Minwoo Park, Jiebo Luo, Robert T. Collins, Yanxi Liu
MM '10 Proceedings of the international conference on Multimedia, 2010
ACM DL Author-ize serviceWSM'10: 2nd ACM workshop on social media
Susanne Boll, Steven C.H. Hoi, Roelof van Zwol, Jiebo Luo
MM '10 Proceedings of the international conference on Multimedia, 2010
ACM DL Author-ize serviceRankCompete: simultaneous ranking and clustering of web photos
Liangliang Cao, Andrey Del Pozo, Xin Jin, Jiebo Luo, Jiawei Han, Thomas S. Huang
WWW '10 Proceedings of the 19th international conference on World wide web, 2010
ACM DL Author-ize serviceiRIN: image retrieval in image-rich information networks
Xin Jin, Jiebo Luo, Jie Yu, Gang Wang, Dhiraj Joshi, Jiawei Han
WWW '10 Proceedings of the 19th international conference on World wide web, 2010
ACM DL Author-ize serviceSocial group suggestion from user image collections
Jie Yu, Xin Jin, Jiawei Han, Jiebo Luo
WWW '10 Proceedings of the 19th international conference on World wide web, 2010
ACM DL Author-ize serviceFirst ACM SIGMM international workshop onsocial media (WSM'09)
Susanne Boll, Steven C.H. Hoi, Jiebo Luo, Rong Jin, Irwin King, Dong Xu
MM '09 Proceedings of the 17th ACM international conference on Multimedia, 2009
ACM DL Author-ize serviceRanking with local regression and global alignment for cross media retrieval
Yi Yang, Dong Xu, Feiping Nie, Jiebo Luo, Yueting Zhuang
MM '09 Proceedings of the 17th ACM international conference on Multimedia, 2009
ACM DL Author-ize serviceUsing large-scale web data to facilitate textual query based retrieval of consumer photos
Yiming Liu, Dong Xu, Ivor W. Tsang, Jiebo Luo
MM '09 Proceedings of the 17th ACM international conference on Multimedia, 2009
ACM DL Author-ize serviceT-IRS: textual query based image retrieval system for consumer photos
Yiming Liu, Dong Xu, Ivor W. Tsang, Jiebo Luo
MM '09 Proceedings of the 17th ACM international conference on Multimedia, 2009
ACM DL Author-ize serviceEvent recognition from photo collections via PageRank
Naveed Imran, Jingen Liu, Jiebo Luo, Mubarak Shah
MM '09 Proceedings of the 17th ACM international conference on Multimedia, 2009
ACM DL Author-ize service1st ACM international workshop on interactive multimedia for consumer electronics (IMCE'09)
Ling Shao, Caifeng Shan, Jiebo Luo, Minoru Etoh
MM '09 Proceedings of the 17th ACM international conference on Multimedia, 2009
ACM DL Author-ize serviceMining GPS traces and visual words for event classification
Junsong Yuan, Jiebo Luo, Henry Kautz, Ying Wu
MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval, 2008
ACM DL Author-ize serviceEvent recognition: viewing the world with a third eye
Jiebo Luo, Jie Yu, Dhiraj Joshi, Wei Hao
MM '08 Proceedings of the 16th ACM international conference on Multimedia, 2008
ACM DL Author-ize serviceImage annotation using personal calendars as context
Andrew C. Gallagher, Carman G. Neustaedter, Liangliang Cao, Jiebo Luo, Tsuhan Chen
MM '08 Proceedings of the 16th ACM international conference on Multimedia, 2008
ACM DL Author-ize serviceAnnotating photo collections by label propagation according to multiple similarity cues
Liangliang Cao, Jiebo Luo, Thomas S. Huang
MM '08 Proceedings of the 16th ACM international conference on Multimedia, 2008
ACM DL Author-ize serviceLeveraging probabilistic season and location context models for scene understanding
Jie Yu, Jiebo Luo
CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval, 2008
ACM DL Author-ize serviceInferring generic activities and events from image content and bags of geo-tags
Dhiraj Joshi, Jiebo Luo
CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval, 2008
ACM DL Author-ize serviceKodak's consumer video benchmark data set: concept definition and annotation
Alexander Loui, Jiebo Luo, Shih-Fu Chang, Dan Ellis, Wei Jiang, Lyndon Kennedy, Keansub Lee, Akira Yanagawa
MIR '07 Proceedings of the international workshop on Workshop on multimedia information retrieval, 2007
ACM DL Author-ize serviceLarge-scale multimodal semantic concept detection for consumer video
Shih-Fu Chang, Dan Ellis, Wei Jiang, Keansub Lee, Akira Yanagawa, Alexander C. Loui, Jiebo Luo
MIR '07 Proceedings of the international workshop on Workshop on multimedia information retrieval, 2007


Pixels and Patches (Bits and Bytes)


Pictures (Featured Big Picture Talks)

 

Resources


ACM DL   IEEE Xplore   SpringerLink
cvpapers
    Logo









Research Themes

  • Computer vision: recognition of objects, scenes, people, locations, actions and events from images and video
  • Social media data mining: prediction, forecasting, suggestion, and recommendation using open source data
  • Machine learning: learning with large scale loosely labeled web data, cross-domain learning, active learning
  • Human computer interaction: interactive visual recognition; integration of crowd and machine intelligence
  • Biomedical informatics: structural and topological analysis from 3D imaging data; surgical video analysis
  • Mobile / Pervasive computing: context-aware applications; multimodal inference from multiple sensors
  • Computational photography: computer vision-based 2D/3D enhancement; augmented/mobile photography 

VIStA Research Group Members:

PhD Students

ltran's picture                               yli's picture                              Photo missing               
               
Lam Tran (NSF Fellow)                                Yuncheng Li                                   Quanzeng You                               


MS Students

Junhuan Zhu                                    GE MA                     

Junhuan Zhu                                                 Ge Ma                                             Jianbo Yuan

             

Undergraduate Students

Simon Weber

Simon Weber                                             Andrew Lee  



Affilated Members

                                                

Iftekhar Naim                                  Roya Feizy                                  Andrew AbuMousa



Alumni

  Yao Zhou                                                  

Yao Zhou                                        Xiong Xiao                                     Yingru Tian


Research is a Journey not for the Faint-hearted



You don't have to be the best. Be the best you can be.

Battle Hymns



Back to the top