Monday, February 20, 2012
11:00 AM
209 Computer Studies Building
Anne Marie Piper
University of California, San Diego
Cooperative Multimodal Interaction: Designing for Communication, Learning, and Social Behavior
Increasingly, our interactions with other people are mediated by technology. Even when collocated with another person, computer systems shape how we share information, coordinate our activities, and communicate. Systems that enable gestural interaction (i.e., through multitouch sensing or pen-based techniques) and speech input not only increase the expressiveness of computer interfaces, but also open up new avenues for augmenting how people work together and share digital information. My research in human-computer interaction focuses on multimodal computer interfaces to support collocated human activity. In this talk I will present several gesture- and speech-based interfaces I have designed with collaborators to address challenges in communication, learning, and social interaction. I apply theories of cognitive science to inform the design of multimodal systems, and in turn, develop new insights about human cognitive and social behavior through observations of system use. I examine how cooperative multimodal interaction promotes reflection on spoken and written information and increases one's ability to communicate with others. I will demonstrate how multimodal interfaces can bridge interaction challenges for individuals with a hearing, speech, or social disability as well as improve information access for people of all ages and abilities.
Bio: Anne Marie Piper is a lecturer and researcher in Cognitive Science at the University of California, San Diego. She teaches courses in human-computer interaction and interaction design. Anne Marie received her PhD in Cognitive Science from UCSD in 2011. Over the past ten years she has researched how new computer interfaces support learning activities and the communication needs of individuals with disabilities. Anne Marie received her bachelor’s degree in Computer Science from the Georgia Institute of Technology and her masters in Education from Stanford University. She is the recipient of an NSF Graduate Research Fellowship, the 2010 Best Student Paper Award at the ACM Conference on Computers and Accessibility (ASSETS), and a 2011 UCSD Interdisciplinary Scholar Award. Anne Marie has also worked as a user experience researcher at Microsoft and LeapFrog.