Hajim School of Engineering and Applied Sciences Department of Computer Science
Thursday, March 30, 2017
3:30 PM
Meliora 203
Zhou Yu
Carnegie Mellon University
Situated Intelligent Interactive Systems

Goergen Institute for Data Science Presents: Zhou Yu

Abstract: Communication is an intricate dance, an ensemble of coordinated individual actions. Imagine a future where machines interact with us like humans, waking us up in the morning, navigating us to work, or discussing our daily schedules in a coordinated and natural manner. Current interactive systems being developed by Apple, Google, Microsoft, and Amazon attempt to reach this goal by combining a large set of single-task systems. However, products like Siri, Google Now, Cortana and Echo still follow pre-specified agendas that cannot transition between tasks smoothly, and track and adapt to different users naturally. My research draws on recent developments in speech and natural language processing, human-computer interaction, and machine learning to work towards the goal of developing situated intelligent interactive systems. These systems can coordinate with users to achieve effective and natural interactions. I have successfully applied the proposed concepts to various tasks, such as social conversation, job interview training and movie promotion. My team's proposal on engaging social conversation systems was selected to receive $100,000 from Amazon Inc. to compete in the Amazon Alexa Prize Challenge.

Bio: I am a graduating PhD student at the Language Technology Institute under School of Computer Science, Carnegie Mellon University, working with Prof. Alan W Black and Prof. Alexander I. Rudnicky. I interned with Prof. David Suendermann-Oeft in ETS San Francisco Office on cloud based mulitmodal dialog systems in 2015 summer and 2016 summer. I interned with Dan Bohus and Eric Horvitz in Microsoft Research on human-robot interaction in 2014 fall.

Prior to CMU, I received a B.S. in Computer Science and a B.A. in Linguistics from Zhejiang University in 2011. I worked with Prof. Xiaofei He and Prof. Deng Cai on Machine Learning and Computer Vision, and Prof. Yunhua Qu on Machine Translation.

Host: Henry Kautz, henry.kautz@rochester.edu

Seminars & Talks