Chenliang Xu

pic

2020


Deep Grouping Model for Unified Perceptual Parsing
Zhiheng Li, Wenxuan Bao, Jiayang Zheng, and Chenliang Xu
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020
[ paper ]

Learning a Weakly-Supervised Video Actor-Action Segmentation Model with a Wise Selection
Jie Chen, Zhiheng Li, Jiebo Luo, and Chenliang Xu
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020
Oral Presentation
[ Coming soon ]

Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolution
Xiaoyu Xiang, Yapeng Tian, Yulun Zhang, Yun Fu, Jan Allebach, and Chenliang Xu
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020
[ paper | code | demo ]

TDAN: Temporally-Deformable Alignment Network for Video Super-Resolution
Yapeng Tian, Yulun Zhang, Yun Fu, and Chenliang Xu
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020
[ paper | code | demo ]

End-to-End Generation of Talking Faces from Noisy Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, and Zhiyao Duan
International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2020
[ Coming soon ]

TailorGAN: Making User-Defined Fashion Design
Lele Chen, Justin Tian, Guo Li, Cheng-Haw Wu, Erh-Kan King, Kuan-Ting Chen, Shao-Hang Hsieh, and Chenliang Xu
IEEE Winter Conference on Applications of Computer Vision (WACV), 2020
[ paper | project ]

Learning from Interventions with Hierarchical Policies for Safe Learning
Jing Bi, Vikas Dhiman, Tianyou Xiao, and Chenliang Xu
AAAI Conference on Artificial Intelligence (AAAI), 2020
Oral Presentation
[ paper | talk | poster ]

2019


3D Human Avatar Digitization from a Single Image
Zhong Li, Lele Chen, Celong Liu, Yu Gao, Yuanzhou Ha, Chenliang Xu, Shuxue Quan, and Yi Xu
ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry (VRCAI), 2019
Best Paper Award
[ paper ]

Hierarchical Cross-modal Talking Face Generation with Dynamic Pixel-wise Loss
Lele Chen, Ross K. Maddox, Zhiyao Duan, and Chenliang Xu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
[ paper | poster | code ]

Not All Frames Are Equal: Weakly-Supervised Video Grounding with Contextual Similarity and Visual Clustering Losses
Jing Shi, Jia Xu, Boqing Gong, and Chenliang Xu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
[ paper | poster | code ]

GAN-EM: GAN based EM Learning Framework
Wwentian Zhao, Shaojie Wang, Zhihuai Xie, Jing Shi, and Chenliang Xu
International Joint Conference on Artificial Intelligence (IJCAI), 2019
[ paper | supp | slides | poster | code ]

Dynamic Graph Modules for Modeling Object-Object Interactions in Activity Recognition
Hao Huang, Luowei Zhou, Wei Zhang, Jason J. Corso, and Chenliang Xu
British Machine Vision Conference (BMVC), 2019
[ project ]

Can Multisensory Training Aid Visual Learning?: A Computational Investigation
Robert A. Jacobs and Chenliang Xu
Journal of Vision (JOV), 2019
[ paper ]

Audio-Visual Event Localization in the Wild
Yapeng Tian, Jing Shi, Bochen Li, Zhiyao Duan, and Chenliang Xu
Sight and Sound Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPRW), 2019
Oral Presentation
[ paper ]

Audio-Visual Interpretable and Controllable Video Captioning
Yapeng Tian, Chenxiao Guan, Justin Goodman, Marc Moore, and Chenliang Xu
Sight and Sound Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPRW), 2019
[ paper ]

Sound to Visual: Hierarchical Cross-Modal Talking Face Video Generation
Lele Chen, Haitian Zheng, Ross K. Maddox, Zhiyao Duan, and Chenliang Xu
Sight and Sound Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPRW), 2019
[ paper ]

Single Image 3D Vehicle Pose Estimation for Augmented Reality
Yawen Lu, Sophia Kourian, Carl Salvaggio, Chenliang Xu, and Guoyu Lu
IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2019
[ paper ]

A Weakly Supervised Multi-Task Ranking Framework for Actor-Action Semantic Segmentation
Yan Yan, Chenliang Xu, Dawen Cai, and Jason J. Corso
International Journal of Computer Vision (IJCV), 2019
[ paper ]

Noise-resilient Training Method for Face Landmark Generation from Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, and Zhiyao Duan
IEEE/ACM Transcations on Audio, Speech and Language Processing (TASLP), 2019
[ paper ]

Online Audio-Visual Source Association for Chamber Music Performances
Bochen Li, Karthik Dinesh, Chenliang Xu, Gaurav Sharma, and Zhiyao Duan
Transcations of the International Society for Music Information Retrieval (TISMIR), 2019
[ paper ]

2018


Lip Movements Generation at a Glance
Lele Chen, Zhiheng Li, Ross K. Maddox, Zhiyao Duan, and Chenliang Xu
European Conference on Computer Vision (ECCV), 2018
[ paper | arXiv | demo | code ]
The system is also an accepted Demo at ECCV'18.

Audio-Visual Event Localization in Unconstrained Videos
Yapeng Tian, Jing Shi, Bochen Li, Zhiyao Duan, and Chenliang Xu
European Conference on Computer Vision (ECCV), 2018
[ paper | arXiv | project]

Weakly-Supervised Action Segmentation with Iterative Soft Boundary Assignment
Li Ding and Chenliang Xu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
[ paper | arXiv ]

Towards Automatic Learning of Procedures from Web Instructional Videos
Luowei Zhou, Chenliang Xu, and Jason J. Corso
AAAI Conference on Artificial Intelligence (AAAI), 2018
Oral Presentation
[ paper | YouCookII ]

Improving Text-based Person Search by Spatial Matching and Adaptive Threshold
Tianlang Chen, Chenliang Xu, and Jiebo Luo
IEEE Winter Conference on Applications of Computer Vision (WACV), 2018
[ paper ]

MRI Tumor Segmentation with Densely Connected 3D CNN
Lele Chen, Yue Wu, Adora M. DSouza, Anas Z. Abidin, Axel Wismüller, and Chenliang Xu
SPIE Conference on Medical Imaging (SPIE), 2018
Oral Presentation
[ paper | code | talk ]

Generating Talking Face Landmarks from Speech
Sefik Emre Eskimez, Ross K. Maddox, Chenliang Xu, and Zhiyao Duan
International Conference on Latent Variable Analysis and Signal Separation (LVA-ICA), 2018
[ arXiv ]

Encoding and Selecting Coarse-Grain Mapping Operators with Hierarchical Graphs
Maghesree Chakraborty, Chenliang Xu, and Andrew D. White
Journal of Chemical Physics (JCP), 2018
[ paper | arXiv ]

2017


Audio-Visual Source Association for String Ensembles through Multi-Modal Vibrato Analysis
Bochen Li, Chenliang Xu, and Zhiyao Duan
Sound and Music Computing (SMC), 2017
Best Paper Award
[ paper ]

Deep Cross-Modal Audio-Visual Generation
Lele Chen, Sudhanshu Srivastava, Zhiyao Duan, and Chenliang Xu
ACM International Conference on Multimedia Thematic Workshops (ACMMMW), 2017
[ paper ]

Watch What You Just Said: Image Captioning with Text-Conditional Attention
Luowei Zhou, Chenliang Xu, Parker Koch, and Jason J. Corso
ACM International Conference on Multimedia Thematic Workshops (ACMMMW), 2017
[ paper ]

Weakly Supervised Actor-Action Segmentation via Robust Multi-Task Ranking
Yan Yan, Chenliang Xu, Dawen Cai, and Jason J. Corso
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017
[ paper ]

One-Shot Video Object Segmentation with Iterative Online Fine-Tuning
Amos Newswanger and Chenliang Xu
The DAVIS Challenge on Video Object Segmentation, CVPR Workshop (CVPRW), 2017
[ paper | poster ]

TricorNet: A Hybrid Temporal Convolutional and Recurrent Network for Video Action Segmentation
Li Ding and Chenliang Xu
arXiv Report arXiv:1705.07818
[ paper ]

Action Understanding with Multiple Classes of Actors
Chenliang Xu, Caiming Xiong, and Jason J. Corso
arXiv Report arXiv:1704.08723
[ arXiv paper ]

Dancelets Mining for Video Recommendation Based on Dance Styles
Tingting Han, Hongxun Yao, Chenliang Xu, Xiaoshuai Sun, Yanhao Zhang and Jason J. Corso
IEEE Transactions on Multimedia (TMM), 2016
[ paper ]

2016 and Before


Scale-Adaptive Video Understanding
Chenliang Xu
PhD Thesis, University of Michigan, 2016
[ PDF ]

Actor-Action Semantic Segmentation with Grouping Process Models
Chenliang Xu and Jason J. Corso
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016
Spotlight Presentation (Acceptance Rate: 9.7%)
[ paper | video | poster ]

LIBSVX: A Supervoxel Library and Benchmark for Early Video Processing
Chenliang Xu and Jason J. Corso
International Journal of Computer Vision (IJCV), 2016
[ paper | Early version on arXiv | project ]

Can Humans Fly? Action Understanding with Multiple Classes of Actors
Chenliang Xu, Shao-Hang Hsieh, Caiming Xiong, and Jason J. Corso
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
[ paper | video | poster | data | code ]

A Study of Actor and Action Semantic Retention in Video Supervoxel Segmentation
Chenliang Xu, Richard F. Doell, Stephen José Hanson, Catherine Hanson, and Jason J. Corso
International Journal of Semantic Computing (IJSC), 2013
[ paper | Early version on arXiv ]

Flattening Supervoxel Hierarchies by the Uniform Entropy Slice
Chenliang Xu, Spencer Whitt, and Jason J. Corso
IEEE International Conference on Computer Vision (ICCV), 2013
[ paper | video | poster | project ]

Are Actor and Action Semantics Retained in Video Supervoxel Segmentation?
Chenliang Xu, Richard F. Doell, Stephen José Hanson, Catherine Hanson, and Jason J. Corso
IEEE International Conference on Semantic Computing (ICSC), 2013
[ paper | slides ]

A Thousand Frames in Just a Few Words: Lingual Description of Videos through Latent Topics and Sparse Object Stitching
Pradipto Das, Chenliang Xu, Richard F. Doell, and Jason J. Corso
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013
[ paper | poster | project ]

TRECVID 2013 GENIE: Multimedia Event Detection and Recounting
S. Oh, A. Perera, I. Kim, M. Pandey, K. Cannons, H. Hajimirsadeghi, A. Vahdat, G. Mori, B. Miller, S. McCloskey, Y.-C. Cheng, Z. Huang, C.-H. Lee, C. Xu, R. Kumar, W. Chen, J. Corso, L. Fei-Fei, D. Koller, V. Ramanathan, K. Tang, A. Joulin, A. Alahi
NIST TRECVID Workshop, 2013
[ paper ]

Streaming Hierarchical Video Segmentation
Chenliang Xu, Caiming Xiong, and Jason J. Corso
European Conference on Computer Vision (ECCV), 2012
Oral Presentation (Acceptance Rate: 2.8%)
[ paper | oral video | spotlight video | project ]

Evaluation of Super-Voxel Methods for Early Video Processing
Chenliang Xu and Jason J. Corso
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012
[ paper | poster | project ]

TRECVID 2012 GENIE: multimedia event detection and recounting
A. Perera, S. Oh, M. Pandey, T. Ma, A. Hoogs, A. Vahdat, K. Cannons, G. Mori, S. McCloskey, B. Miller, S. Venkatesh, P. Davalos, P. Das, C. Xu, J. Corso, R. Srihari, I. Kim, Y.-C. Cheng, Z. Huang, C.-H. Lee, K. Tang, L. Fei-Fei, D. Koller
NIST TRECVID Workshop, 2012
[ paper ]