Computer Vision Medical Imaging
Image Retrieval Image Segmentation
Scene Classification Big Data Contextual Inference Machine
Random Field Photo Collection Multimedia Content Analysis
Mobile Media Location-based service Geo Tagging Social Network
Heterogeneous Information Networks Social Media Data Mining
Prediction Nowcasting Crowdsourcing
Jiebo Luo joined the University of Rochester in Fall 2011 after over fifteen years at Kodak Research Laboratories,
where he was a Senior Principal Scientist leading research and advanced
development. He has been involved in numerous technical conferences,
including serving as the program co-chair of ACM Multimedia 2010 and IEEE CVPR 2012.
He is the Editor-in-Chief of the Journal of Multimedia, and has served
on the editorial boards of the IEEE Transactions on Pattern Analysis
and Machine Intelligence, IEEE Transactions on Multimedia, IEEE
Transactions on Circuits and Systems for Video Technology, Pattern
Recognition, Machine Vision and Applications, and Journal of Electronic
Imaging. He has authored over 200 technical papers and 70 US patents.
Dr. Luo is a Fellow of the SPIE, IEEE, and IAPR.
His research spans image processing, computer vision, machine learning,
data mining, medical imaging, and ubiquitous computing. He has been an
advocate for contextual inference in semantic understanding of visual data, and continues to push the frontiers in this area by incorporating geo-location context and social context.
A recent research thrust focuses on exploiting social media for machine
learning, data mining, and human-computer interaction, for example,
mining the wisdom of crowds for social, political, and economic
prediction and forecasting. He has published extensively in these
fields with over 220 papers and 80 US patents
Jiebo Luo, Vincent Silenzio, Yun Zhou, Glenn Currier, and Henry Kautz,
"Tackling Mental Health by Integrating Unobtrusive Multimodal sensing,"
the Twenty-Ninth AAAI Conference on Artificial
Intelligence (AAAI), Austin, TX, January 25-30, 2015. [PDF]
Junhuan Zhu, Jiebo Luo, Yousuf Khalifar, "Computerized Grading of Cataract Surgery from Videos," Machine Vision and Applications, in press.
Wanying Ding, Junhuan Zhu, Lifan Guo, Xiaohua Hu, Jiebo Luo,
Haohong Wang, “Jointly Image Topic and Emotion Detection using
Multi-Modal Hierarchical Latent Dirichlet Allocation,” Journal of Multimedia Information System, in press.
Yang Cong, Ji Liu, Jiebo Luo, "Deep Sparse Feature Selection for Computer Aided Endoscopy Diagnosis," Pattern Recognition, in press.
Yang Cong, Ji Liu, Jiebo Luo, "Speeded up Low Rank Online Metric Learning for Object Tracking," IEEE Transactions on Circuits and Systems for Video Technology, in press.
Chol Song, Henry Kautz, James Allen, Mary Swift, Yuncheng Li, Jiebo
Luo, "A Markov Logic Framework for Recognizing Complex Events from
Multimodal Data," ACM International Conference on Multimodal
Interaction (ICMI), Sidney, Australia, December 2013.
Yao Zhou and Jiebo Luo, "A Practical Method for Counting Arbitrary Target Objects in an Arbitrary Scene," IEEE ICME, July 2013.
Congyan Lang, Jiashi Feng, Guangcan Liu, Jinghui Tang, Shuicheng Yan
and Jiebo Luo, "Improving Bottom-up Saliency Detection by Looking into
Neighbors," IEEE Transactions on Circuits and Systems for Video Technology, 23(6): 1016-1028, June 2013.
Minwoo Park, Jiebo Luo, Andrew Gallagher, Majid Rabbani, “Learning to Produce 3D Media from a Captured 2D Video,” IEEE Trans. on Multimedia, 15(7): 1569-1578, 2013.
Wang, Dhiraj Joshi, Jiebo Luo, and Heng Huang, "Simultaneous Image
Annotation and Geo-Tag Prediction via Correlation Guided Structured
Multi-Task Learning," IEEE Symposium on Multimedia (ISM), December 2012.
Jianchao Yang, Jiebo Luo, Jie Yu, Thomas. Huang, “Photo Stream
Alignment and Summarization for Collaborative Photo Collection and
Sharing,” IEEE Trans. on Multimedia, 14(6): 1642-1651, December 2012.
Youjie Zhou, Jiebo Luo, " Geo-Location Inference on News Articles via Multimodal pLSA," ACM Multimedia Conference, Nara, Japan, October 2012.
Xiaobin Xu, Tao Mei, Wenjun Zeng, Nenghai Yu, Jiebo Luo, "AMIGO: Accurate Mobile Image GeOtagging," ACM International Conference on Internet Multimedia Computing and Services, Wuhan, China, September 2012. (Best Paper)
Lin Chen, Dong Xu, Ivor Tsang, and Jiebo Luo for the paper entitled,
"Tag-Based Image Retrieval Improved by Augmented Features and
Group-Based Refinement", IEEE Transactions on
Multimedia, Volume 14, Number 4, August 2012 (2014 IEEE Multimedia Prize Paper Award).
Minwoo Park, Jiebo Luo, Andrew Gallagher, “Towards Assessing and
Improving the Quality of Stereo Images,” Special Issue on
Emerging Techniques in 3D,IEEE Journal of Selected Topics in Signal Processing, 6(5): 460 - 470, 2012.
Siyu Xia, Ming Shao, Jiebo Luo, and Yun Fu, “Understanding Kin
Relationships in a Photo,” Special Issue on Learning Semantics from
Multimedia Web Resources, IEEE Trans. on Multimedia, 14(4): 1046-1056, 2012.
Lin Chen, Dong Xu, Ivor W. Tsang, Jiebo Luo, “Tag-based Image Retrieval
Improved by SVM with Augmented Features and Group-based
Refinement,” Special Issue on Learning Semantics from Multimedia
Web Resources, IEEE Trans. on Multimedia, 14(4): 1057-1067, 2012.
Cong Yang, Junsong Yuan, Jiebo Luo, “Towards Scalable Summarization of
Consumer Videos via Sparse Dictionary Selection,” Special Issue
on Object and Event Classification in Large-Scale Video Collections, IEEE Trans. on Multimedia, 14(1): 66-75, February 2012.
Dhiraj Joshi, Ritendra Datta, Elena Fedorovskaya, Jia Li, James Z.
Wang, Jiebo Luo, “Computational inference of aesthetics, mood, and
emotion in images,” IEEE Signal Processing Magazine, 28(5): 94-115, September 2011.
Yiming Liu, Dong Xu, Ivor Tsang, Jiebo Luo, "Textual query of personal photos facilitated by large-scale web data," IEEE Trans. on Pattern Analysis and Machine Intelligence, 33(5): 1022-1036, May 2011.
Minwoo Park, Jiebo Luo, Robert Collions, Yanxi Liu, "Beyond GPS: Determining the viewing direction of a geotagged image," ACM Multimedia Conference, Firenze, Italy, October 2010.
Xiaobai Liu, Shuicheng Yan, Jiebo Luo, Jinhui Tang, ZhongYang Huang, Hai Jin, "Nonparametric Label-to-Region by Search," CVPR 2010.
Jingen Liu, Jiebo Luo, Mubarak Shah, "Recognizing Realistic Actions from Videos in the Wild," IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, June 2009. (Oral Presentation) (Project Page)
You, Jiebo Luo, Hailin Jin, and Jianchao Yang, "Robust Image Sentiment
Analysis using Progressively Trained and Domain Transferred Deep
Networks," the Twenty-Ninth AAAI Conference on Artificial
Intelligence (AAAI), Austin, TX, January 25-30, 2015. [PDF] [Project Page]
Naim, Young Song, Daniel Gildea, Qiguang Liu, Henry Kautz and Jiebo
Luo, "Unsupervised Alignment of Natural Language Instructions with
Video Segments," the Twenty-Eighth AAAI Conference on Artificial
Intelligence (AAAI), Quebec City, Canada, July 27-31, 2014.
Ji Liu, Junsong Yuan, Jiebo Luo, "Self-Supervised Online Metric Learning
With Low Rank Constraint for Scene Categorization." IEEE Transactions on Image Processing, 22(8): 3179-3191, 2013.
Liangliang Cao, Xin Jin, Zhijun Yin, Andrey Del Pozo, Jiebo Luo,Jiawei Han, Thomas S. Huang, "RankCompete: Simultaneous ranking and clustering of information networks," Neurocomputing, 95: 98-104, 2012.
Yahong Han, Fei Wu, Qi Tian, Yueting Zhuang, Jiebo Luo, "Correlated Attribute Transfer with Multi-task Graph-Guided Fusion," ACM Multimedia Conference, Nara, Japan, October 2012. (Long paper)
Lixin Duan, Dong Xu, Ivor Tsang, Jiebo Luo, “Visual Event Recognition in Videos by Learning from Web Data,” IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, June 2010. (Best Student Paper) (Project Page)
Liangliang Cao, Jiebo Luo, Feng Liang, Thomas S. Huang, "Heterogeneous feature machines for visual recognition," ICCV 2009.
Junsong Yuan, Jiebo Luo, Ying Wu, "Mining compositional features for boosting," CVPR 2008.
social media data mining
You, Sumit Bhatia, Jiebo Luo, "The eyes of the beholder: Gender
prediction using images posted in online social networks," IEEE International Conference on Data Mining, Workshop on Social Multimedia Data Mining, December 2014. [PDF]
Simon Weber, Jiebo Luo, “What Makes An Open Code Popular in Github”, IEEE International Conference on Data Mining, Workshop on Software Data Mining, December 2014.
Andrew Nocka, Danning Zheng, Tianran Hu, Jiebo Luo, "Moneyball
for Academia: Towards Measuring and Maximizing Faculty Performance and
Impact," IEEE International Conference on Data Mining, Workshop on Domain Dependent Data Mining, December 2014.
Zheng, Tianran Hu, Quanzeng You, and Jiebo Luo, "Inferring Home
Location from User's Photo Collections based on Visual Content and
Mobility Patterns," ACM Multimedia Conference, Workshop on Geotagging in Multimedia (GeoMM), November 2014.
Yuncheng Li, Jiebo Luo, Tao Mei, "Personalized Image Recommendation for Web Search Engine Users", IEEE ICME, July 2014.
Quanzeng You, Jiebo Luo and John R. Smith, "Towards Understanding the
Effectiveness of Election Related Images in Social Media," IEEE International Conference on Data Mining (ICDM), Workshop on Domain-driven Data Mining, December 2013. [PDF]
Jianbo Yuan, Quanzeng You, and Jiebo Luo,
"Are There Cultural Differences in Event Driven Information Propagation
Over Social Media?" ACM Multimedia Conference, International
Workshop on Socially-Aware Multimedia (IWSAM), October 2013. [PDF]
You and Jiebo Luo, "Towards Social Imagematics: Sentiment Analysis in
Social Multimedia," ACM SIGKDD, Workshop on Multimedia Data Mining, August
Jianbo Yuan, Quanzeng You, Sean McDonough, and Jiebo Luo,
"Sentribute: Image Sentiment Analysis from a Mid-level Perspective,"
ACM SIGKDD, Workshop on Issues of Sentiment Discovery and Opinion
Mining (WISDOM), August 2013. [PDF]
Ge Ma and Jiebo Luo, "Is A Social Picture Worth 1000 Votes? Analyzing
the Sentiment of Election Related Photos," IEEE ICME, July 2013.
Xin Jin, Jie Yu, Jiawei Han, Jiebo Luo, “Reinforced retrieval in
image-rich information networks via integration of link and content
based similarities,” IEEE Trans. on Knowledge Discovery and Engineering, 25(2): pp 448-460, Feb. 2013.
Xin Jin, Cindy Lin, Jiebo Luo, Jiawei Han, “SocialSpamGuard: A Data
Mining-based Spam Detection System for Social Media Networks,” Demo
Paper, International Conference on Very Large Data Bases (VLDB), Seattle, WA, August 2011.
Xin Jin, Chi Wang, Jiebo Luo, Jiawei Han, “LikeMiner: A System for
Mining the Power of ’Like’ in Social Media Networks,” Demo Paper, International Conference on Knowledge Discovery and Data Mining (KDD), San Diego, CA, August 2011.
Zhijun Yin, Liangliang Cao, Jiawei Han, Jiebo Luo, and Thomas Huang,
“Diversified Trajectory Pattern Ranking in Geo-tagged Social Media,” SIAM Conference on Data Mining (SDM), Mesa, AZ, April 2011.
Xin Jin, Andrew Gallagher, Jiawei Han, Jiebo Luo, “Wisdom of Social Multimedia: Using Flickr for Prediction and Forecast,” ACM Multimedia Conference, Brave and New Ideas Track, Firenze, Italy, October 2010. (Long Paper)
Jie Yu, Xin Jin, Jiawei Han, Jiebo Luo, “Collection-based sparse label
propagation and its application to social group suggestion from
photos,” ACM Transactions on Intelligent Systems and Technology, 2(2): , February 2011.
Liangliang Cao, Jiebo Luo, Andrew Gallagher, Thomas Huang, “A Worldwide
Tourism Recommendation System Based on Geotagged Web Photos,” IEEE International Conference on Acoustic, Speech and Signal Processing, Dallas, TX, April 2010.
human computer interaction
You, Jianbo Yuan, Jiaqi Wang, Philip Guo, Jiebo Luo. Snap n’ Shop:
Visual Search-Based Mobile Shopping Made a Breeze by Machine and Crowd
Intelligence, IEEE International Conference on Semantic Computing,
Singh, Jiebo Luo, Dhiraj Joshi, Phoury Lei, Madirakshi Das, Peter
Stubler, "Reliving on demand: a total viewer experience," ACM international conference on Multimedia, November 2011.
Dhruv Batra, Adarsh Kowdle, Devi Parikh, Jiebo Luo, and Tsuhan Chen, "iCoSeg: Interactive Co-segmentation of Objects in Image Collections," IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, June 2010.
biomedical analytics and informatics
Tianli Yu, Jiebo Luo, Narendra Ahuja, "Search strategies for shape regularized active contour," Computer Vision and Image Understanding 113(10): 1053-1063, 2009.
Hui Luo, Jiebo Luo, "Robust online orientation correction for radiographs in PACS environments," IEEE Trans. Med. Imaging 25(10): 1370-1379, 2006.
mobile and pervasive computing
Chol Song, Henry Kautz, James Allen, Mary Swift, Yuncheng Li, Jiebo
Luo, "A Markov Logic Framework for Recognizing Complex Events from
Multimodal Data," 15th ACM International Conference on Multimodal
Interaction, Sidney, Australia, December 2013.
Liu, Tao Mei, Jiebo Luo, Houqiang Li, Shipeng Li, "Finding Perfect
Rendezvous On the Go: Accurate Mobile Visual Localization and Its
Applications to Routing," ACM Multimedia Conference, Nara, Japan, October 2012. (Long paper, Best Paper Candidate)
Free access and statistics provided by the ACM Digital Library
Ma Yingru Tian Hacker
Jingwei Guo PhD student
Note to Class of 2018 students: Please use my URCS email to set up appointments with me.
Note to Perspetive Graduate Students: Applicants
are expected to
have strong skills in both programming and mathematics, as well as
research experience in closely related areas. Grades alone won't cut
it. "I worked on a gazillion of projects" (but have no evidence) is a no-no. Research publications in ranked venues of computer vision, machine learning, or data mining is a plus (and the only reason you may contact me directly). Sorry but generic spams will be ignored.