Chenliang Xu

pic

2020


Learning from Interventions with Hierarchical Policies for Safe Learning
J. Bi, V. Dhiman, T. Xiao, and C. Xu
AAAI Conference on Artificial Intelligence (AAAI), 2020
Oral Presentation
[ paper | talk | poster ]

TailorGAN: Making User-Defined Fashion Design
L. Chen, J. Tian, C. Wu, E. King, K. Chen, S. Hsieh, and C. Xu
IEEE Winter Conference on Applications of Computer Vision (WACV), 2020
[ paper ]

2019


3D Human Avatar Digitization from a Single Image
Z. Li, L. Chen, C. Liu, Y. Gao, Y. Ha, C. Xu, S. Quan, and Y. Xu
ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry (VRCAI), 2019
Best Paper Award
[ paper ]

Hierarchical Cross-modal Talking Face Generation with Dynamic Pixel-wise Loss
L. Chen, R. Maddox, Z. Duan and C. Xu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
[ paper | poster | code ]

Not All Frames Are Equal: Weakly-Supervised Video Grounding with Contextual Similarity and Visual Clustering Losses
J. Shi, J. Xu, B. Gong and C. Xu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
[ paper | poster | code ]

GAN-EM: GAN based EM Learning Framework
W. Zhao, S. Wang, Z. Xie, J. Shi and C. Xu
International Joint Conference on Artificial Intelligence (IJCAI), 2019
[ paper | supp | slides | poster | code ]

Dynamic Graph Modules for Modeling Object-Object Interactions in Activity Recognition
H. Huang, L. Zhou, W. Zhang, J. J. Corso and C. Xu
British Machine Vision Conference (BMVC), 2019
[ paper ]

Can Multisensory Training Aid Visual Learning?: A Computational Investigation
R. A. Jacobs and C. Xu
Journal of Vision (JOV), 2019
[ paper ]

Audio-Visual Event Localization in the Wild
Y. Tian, J. Shi, B. Li, Z. Duan and C. Xu
Sight and Sound Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPRW), 2019
Oral Presentation
[ paper ]

Audio-Visual Interpretable and Controllable Video Captioning
Y. Tian, C. Guan, J. Goodman, M. Moore and C. Xu
Sight and Sound Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPRW), 2019
[ paper ]

Sound to Visual: Hierarchical Cross-Modal Talking Face Video Generation
L. Chen, H. Zheng, R. Maddox, Z. Duan and C. Xu
Sight and Sound Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPRW), 2019
[ paper ]

Single Image 3D Vehicle Pose Estimation for Augmented Reality
Y. Lu, S. Kourian, C. Salvaggio, C. Xu, and G. Lu
IEEE Global Conference on Signal and Information Processing (GlobalSIP), 2019
[ paper ]

A Weakly Supervised Multi-Task Ranking Framework for Actor-Action Semantic Segmentation
Y. Yan, C. Xu, D. Cai, and J. J. Corso
International Journal of Computer Vision (IJCV), 2019
[ paper ]

Noise-resilient Training Method for Face Landmark Generation from Speech
S. E. Eskimez, R. K. Maddox, C. Xu, and Z. Duan
IEEE/ACM Transcations on Audio, Speech and Language Processing (TASLP), 2019
[ paper ]

Online Audio-Visual Source Association for Chamber Music Performances
B. Li, K. Dinesh, C. Xu, G. Sharma and Z. Duan
Transcations of the International Society for Music Information Retrieval (TISMIR), 2019
[ paper ]

2018


Lip Movements Generation at a Glance
L. Chen, Z. Li, R. Maddox, Z. Duan and C. Xu
European Conference on Computer Vision (ECCV), 2018
[ paper | arXiv | demo | code ]
The system is also an accepted Demo at ECCV'18.

Audio-Visual Event Localization in Unconstrained Videos
Y. Tian, J. Shi, B. Li, Z. Duan and C. Xu
European Conference on Computer Vision (ECCV), 2018
[ paper | arXiv | project]

Weakly-Supervised Action Segmentation with Iterative Soft Boundary Assignment
L. Ding and C. Xu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
[ paper | arXiv ]

Towards Automatic Learning of Procedures from Web Instructional Videos
L. Zhou, C. Xu and J. J. Corso
AAAI Conference on Artificial Intelligence (AAAI), 2018
Oral Presentation
[ paper | YouCookII ]

Improving Text-based Person Search by Spatial Matching and Adaptive Threshold
T. Chen, C. Xu and J. Luo
IEEE Winter Conference on Applications of Computer Vision (WACV), 2018
[ paper ]

MRI Tumor Segmentation with Densely Connected 3D CNN
L. Chen, Y. Wu, A. M. DSouza, A. Z. Abidin, A. Wismüller, and C. Xu
SPIE Conference on Medical Imaging (SPIE), 2018
Oral Presentation
[ paper | code | talk ]

Generating Talking Face Landmarks from Speech
S. E. Eskimez, R. Maddox, C. Xu and Z. Duan
International Conference on Latent Variable Analysis and Signal Separation (LVA-ICA), 2018
[ arXiv ]

Encoding and Selecting Coarse-Grain Mapping Operators with Hierarchical Graphs
M. ChaKraborty, C. Xu and A. D. White
Journal of Chemical Physics (JCP), 2018
[ paper | arXiv ]

2017


Audio-Visual Source Association for String Ensembles through Multi-Modal Vibrato Analysis
B. Li, C. Xu and Z. Duan
Sound and Music Computing (SMC), 2017
Best Paper Award
[ paper ]

Deep Cross-Modal Audio-Visual Generation
L. Chen, S. Srivastava, Z. Duan and C. Xu
ACM International Conference on Multimedia Thematic Workshops (ACMMMW), 2017
[ paper ]

Watch What You Just Said: Image Captioning with Text-Conditional Attention
L. Zhou, C. Xu, P. Koch and J. J. Corso
ACM International Conference on Multimedia Thematic Workshops (ACMMMW), 2017
[ paper ]

Weakly Supervised Actor-Action Segmentation via Robust Multi-Task Ranking
Y. Yan, C. Xu, D. Cai and J. J. Corso
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017
[ paper ]

One-Shot Video Object Segmentation with Iterative Online Fine-Tuning
A. Newswanger and C. Xu
The DAVIS Challenge on Video Object Segmentation, CVPR Workshop (CVPRW), 2017
[ paper | poster ]

TricorNet: A Hybrid Temporal Convolutional and Recurrent Network for Video Action Segmentation
L. Ding and C. Xu
arXiv Report arXiv:1705.07818
[ paper ]

Action Understanding with Multiple Classes of Actors
C. Xu, C. Xiong, and J. J. Corso
arXiv Report arXiv:1704.08723
[ arXiv paper ]

Dancelets Mining for Video Recommendation Based on Dance Styles
T. Han, H. Yao, C. Xu, X. Sun, Y. Zhang and J. J. Corso
IEEE Transactions on Multimedia (TMM), 2016
[ paper ]

2016 and Before


Scale-Adaptive Video Understanding
C. Xu, PhD Thesis, University of Michigan, 2016
[ PDF ]

Actor-Action Semantic Segmentation with Grouping Process Models
C. Xu and J. J. Corso
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016
Spotlight Presentation (Acceptance Rate: 9.7%)
[ paper | video | poster ]

LIBSVX: A Supervoxel Library and Benchmark for Early Video Processing
C. Xu and J. J. Corso
International Journal of Computer Vision (IJCV), 2016
[ paper | Early version on arXiv | project ]

Can Humans Fly? Action Understanding with Multiple Classes of Actors
C. Xu, S.-H. Hsieh, C. Xiong, and J. J. Corso
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
[ paper | video | poster | data | code ]

A Study of Actor and Action Semantic Retention in Video Supervoxel Segmentation
C. Xu, R. F. Doell, S. J. Hanson, C. Hanson, and J. J. Corso
International Journal of Semantic Computing (IJSC), 2013
[ paper | Early version on arXiv ]

Flattening Supervoxel Hierarchies by the Uniform Entropy Slice
C. Xu, S. Whitt, and J. J. Corso
IEEE International Conference on Computer Vision (ICCV), 2013
[ paper | video | poster | project ]

Are Actor and Action Semantics Retained in Video Supervoxel Segmentation?
C. Xu, R. F. Doell, S. J. Hanson, C. Hanson, and J. J. Corso
IEEE International Conference on Semantic Computing (ICSC), 2013
[ paper | slides ]

A Thousand Frames in Just a Few Words: Lingual Description of Videos through Latent Topics and Sparse Object Stitching
P. Das, C. Xu, R. F. Doell, and J. J. Corso
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013
[ paper | poster | project ]

TRECVID 2013 GENIE: Multimedia Event Detection and Recounting
S. Oh, A. Perera, I. Kim, M. Pandey, K. Cannons, H. Hajimirsadeghi, A. Vahdat, G. Mori, B. Miller, S. McCloskey, Y.-C. Cheng, Z. Huang, C.-H. Lee, C. Xu, R. Kumar, W. Chen, J. Corso, L. Fei-Fei, D. Koller, V. Ramanathan, K. Tang, A. Joulin, A. Alahi
NIST TRECVID Workshop, 2013
[ paper ]

Streaming Hierarchical Video Segmentation
C. Xu, C. Xiong, and J. J. Corso
European Conference on Computer Vision (ECCV), 2012
Oral Presentation (Acceptance Rate: 2.8%)
[ paper | oral video | spotlight video | project ]

Evaluation of Super-Voxel Methods for Early Video Processing
C. Xu and J. J. Corso
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012
[ paper | poster | project ]

TRECVID 2012 GENIE: multimedia event detection and recounting
A. Perera, S. Oh, M. Pandey, T. Ma, A. Hoogs, A. Vahdat, K. Cannons, G. Mori, S. McCloskey, B. Miller, S. Venkatesh, P. Davalos, P. Das, C. Xu, J. Corso, R. Srihari, I. Kim, Y.-C. Cheng, Z. Huang, C.-H. Lee, K. Tang, L. Fei-Fei, D. Koller
NIST TRECVID Workshop, 2012
[ paper ]