I work at the intersection of human-computer interaction, human computation, social computing and artificial intelligence. Much of my work aims to serve people with disabilities with realizable technical innovations, although my research tends to be broadly applicable and scientifically interesting. I've worked on the cloud-based screen reader WebAnywhere, which led me to Raising the Floor Consortium and the architecture committee for the Global Public Inclusive Infrastructure. I'm also the creator of VizWiz, an iPhone application that lets blind users take a picture, speak a question, and receive answers from the crowd quickly (usually in less than 30 seconds). Most recently we've been working on "closed-loop crowd control and support" that allow dynamic groups to act like highly-skilled individuals.
I work on many projects, including:
- real-time crowd control of existing user interfaces
- cloud-based access technology
- closed-loop crowd support for people with disabilities
- real-time captioning by non-experts
See the ROC HCI Project Page for more details.