Joel Tetreault: Research


I just joined Yahoo! Labs in NYC as a Senior Research Scientist where I'll be working with Inderjeet Mani and Amanda Stent on NLP problems related to discourse and dialogue processing.

Before joining the Yahoo! team I was Principal Manager of the Core Natural Language group at Nuance Communications, Inc. under Ron Kaplan where I worked on the research and development of NLP tools and components for the next generation of intelligent dialogue systems.

Prior to Nuance, I worked at Educational Testing Service for six years (2007-2012) as a Managing Senior Research Scientist where I led a group devoted to automatic essay scoring of the GRE and TOEFL. Specifically, I researched automated methods for detecting grammatical errors by native and non-native speakers, plagiarism detection, discourse coherence and opinion analysis. I also co-organize the "Innovative Use of NLP for Building Educational Applications" workshop with Jill Burstein and Claudia Leacock, now in it's ninth edition. My work on grammatical error correction at ETS led to a Morgan Claypool Synthesis Series book entitled Automated Grammatical Error Detection for Language Learners.

Before joining ETS in 2007, I was a postdoctoral fellow at the University of Pittsburgh's Learning and Research and Development Center (LRDC). I worked with Dr. Diane Litman on using Reinforcement Learning to develop better dialogue strategies for our spoken dialogue tutoring system (ITSPOKE).

I received my PhD in December 2004 in Computer Science at the University of Rochester, with a focus on Natural Language Processing and Computational Linguistics, a subfield of Artificial Intelligence (AI). My advisor was James Allen.

My dissertation, titled "Empirical Evaluations of Pronoun Resolution", focused on novel ways of improving pronoun resolution algorithms. Many systems today perform well, as high as 80% accuracy in some cases over news article domains, but resolving the other 20% requires additional complex information that isn't usually available to systems. In this project we investigated whether syntactic ranking preferences, discourse structure, and lexical semantics could improve an existing pronoun resolution system to close the ``20%'' gap. Our results showed that syntactic ranking preferences and lexical semantics can boost performance in the domains of well-editted text and spoken dialogue.

In addition to researching reference resolution, we also researched information-retrieval techniques to tag marriage-counseling transcripts for Center for Future Health.

I graduated from Harvard University in June 1998 with a degree in computer science. My thesis there was on centering theory, specifically plural pronouns, under the guidance of Professor Barbara Grosz.

Materials

2014 Activities

  • 9th Workshop on Innovative Use of NLP for Building Educational Applications (BEA9)
  • First Joint Workshop on Statistical Parsing of Morphologically Rich Languages and Syntactic Analysis of Non-Canonical Languages (SPMRL-SANCL 2014)
  • COLING 2014 Tutorial on Automated Grammatical Error Correction for Language Learners
  • NAACL Treasurer: if you are interested in reading up on how NAACL is doing financially and what we have accomplished in the last two years, check out the minutes from our meetings: NAACL News. Also, if you have any questions or recommendations on how to improve the organization and the conference, please feel free to email me!

2013 Activities

Research Links

Publications

    2014

  • Mohammad Sadegh Rasooli and Joel Tetreault. (EACL 2014): Non-Monotonic Parsing of Fluent Umm I mean Disfluent Sentences. In Proceedings of the 14th Conferfence of the European Chapter of the Association for Computational Linguistics. Gothenburg, Sweden. August 26-30, 2014.
  • Michael Gamon, Martin Chodorow, Claudia Leacock and Joel Tetreault. (2014): Using Learner Corpora for Automatic Error Detection and Correction. In Automatic Treatment and Analysis of Learner Corpus Data. Editors: Ana Diaz-Negrillo, Nicolas Ballier and Paul Thompson. John Benjamins Publishing Company, Studies in Corpus Linguistcs 59.

    2013

  • Mohammad Sadegh Rasooli and Joel Tetreault. (EMNLP 2013): Joint Parsing and Disfluency Detection in Linear Time. Seattle, WA, USA. Oct 19-21, 2013

  • Joel Tetreault, Martin Chodorow and Nitin Madnani. (2013): Bucking The Trend: Improved Evaluation and Annotation Practices for ESL Error Detection Systems. Language Resources and Evaluation Journal. July, 2013.

  • Hwee Tou Ng, Siew Mei Wu, Yuanbin Wu, Christian Hadiwinoto and Joel Tetreault. (CoNLL 2013): The CoNLL-2013 Shared Task on Grammatical Error Correction. In Proceedings of the Seventeenth Conference on Computational Natural Language Learning. Sofia, Bulgaria. August 08-09, 2013.

  • Joel Tetreault, Daniel Blanchard and Aoife Cahill. (BEA 2013): A Report on the First Native Language Identification Shared Task. In Proceedings of the 8th Workshop on Innovative Use of NLP for Building Educational Applications. Atlanta, GA, USA, June 13, 2013.

  • Jill Burstein, Joel Tetreault and Nitin Madnani. (2013): The E-rater® Automated Essay Scoring System. In Shermis, M.D., & Burstein, J. (Eds.), Handbook of Automated Essay Scoring: Current Applications and Future Directions. New York: Routledge.

  • Jill Burstein, Joel Tetreault, Martin Chodorow, Daniel Blanchard and Slava Andreyev. (2013). Automated Evaluation of Discourse Coherence Quality in Essay Writing. In Shermis, M.D., & Burstein, J. (Eds.), Handbook of Automated Essay Scoring: Current Applications and Future Directions. New York: Routledge.

  • Jill Burstein, Joel Tetreault and Martin Chodorow. Holistic Annotation of Discourse Coherence Quality in Noisy Essay Writing. In the Special issue of Dialogue and Discourse on: Beyond semantics: the challenges of annotating pragmatic and discourse phenomena (Eds. S. Dipper, H. Zinsmeister, and B. Webber).

  • Aoife Cahill, Nitin Madnani, Joel Tetreault and Diane Napolitano. (NAACL 2013): Robust Systems for Preposition Error Correction Using Wikipedia Revisions. In Proceedings of the 2013 Meeting of the North American Association for Computational Linguistics: Human Language Technologies. Atlanta, GA, USA, June 10-12, 2013.

    2012

  • Joel Tetreault, Daniel Blanchard, Aoife Cahill and Martin Chodorow. (COLING 2012): Native Tongues; Lost and Found: Resources and Empirical Evaluations in Native Language Identification. In Proceedings of the 24th International Conference on Computational Linguistics. Mumbai, India, December 08-15, 2012.

  • Martin Chodorow, Markus Dickinson, Ross Israel and Joel Tetreault. (COLING 2012): Problems in Evaluating Grammatical Error Detection Systems. In Proceedings of the 24th International Conference on Computational Linguistics. Mumbai, India, December 08-15, 2012. [ pdf ]

  • Michael Heilman, Aoife Cahill and Joel Tetreault. (HOO 2012): Precision Isn't Everything: A Hybrid Approach to Grammatical Error Detection. In Proceedings of the 7th Workshop on Innovative Use of Natural Language Processing for Building Educational Applications. Montreal, Canada, June 07, 2012.

  • Nitin Madnani, Joel Tetreault and Martin Chodorow. (BEA 2012): Exploring Grammatical Error Correction with Not-So-Crummy Machine Translation. In Proceedings of the 7th Workshop on Innovative Use of Natural Language Processing for Building Educational Applications. Montreal, Canada, June 07, 2012.

  • Nitin Madnani, Joel Tetreault and Martin Chodorow. (NAACL 2012): Re-examining Machine Translation Metrics for Paraphrase Identification. In Proceedings of the 2012 Meeting of the North American Association for Computational Linguistics: Human Language Technologies. Montreal, Canada, June 03-08, 2012.

  • Ross Israel, Joel Tetreault and Martin Chodorow. (NAACL 2012): Correcting Comma Errors in Learner Essays, and Restoring Commas in Newswire Text. In Proceedings of the 2012 Meeting of the North American Association for Computational Linguistics: Human Language Technologies. Montreal, Canada, June 03-08, 2012.

  • Nitin Madnani, Michael Heilman, Joel Tetreault and Martin Chodorow. (NAACL 2012): Identifying High-Level Organizational Elements in Argumentative Discourse. In Proceedings of the 2012 Meeting of the North American Association for Computational Linguistics: Human Language Technologies. Montreal, Canada, June 03-08, 2012.

  • Beata Beigman Klebanov, Jill Burstein, Nitin Madnani, Adam Faulkner and Joel Tetreault. 2012. Building Subjectivity Lexicon(s) From Scratch For Essay Data. CICLING '12, New Delhi, India.

    2011

  • Wei Xu, Joel Tetreault, Martin Chodorow, Ralph Grishman and Le Zhao. 2011. Exploiting Syntactic and Distributional Information for Spelling Correction with Web-Scale N-gram Models. EMNLP '11, Edinburgh, Scotland. [ pdf ]
  • Kristen Parton, Joel Tetreault, Nitin Madnani and Martin Chodorow. 2011. E-rating Machine Translation. WMT '11, Edinburgh, Scotland. [ pdf ]
  • Nitin Madnani, Joel Tetreault, Martin Chodorow and Alla Rozovskaya. 2011. They Can Help: Using Crowdsourcing to Improve the Evaluation of Grammatical Error Detection Systems. ACL '11, Portland, Oregon, USA. [ pdf ]

    2010

  • Claudia Leacock, Martin Chodorow, Michael Gamon and Joel Tetreault. 2010. Automated Grammatical Error Detection for Language Learners. Synthesis Lectures on Human Language Technologies, Vol 3., No. 1. [ publisher ] [ amazon ]
  • Joel Tetreault, Jennifer Foster and Martin Chodorow. 2010. Using Parse Features for Preposition Selection and Error Detection. ACL '10, Uppsala, Sweden. [ pdf ]
  • Jill Burstein, Joel Tetreault and Slava Andreyev. 2010. Using Entity-Based Features to Model Coherence in Student Essays. NAACL '10, Los Angeles, California. [ pdf ]
  • Joel Tetreault, Elena Filatova and Martin Chodorow. 2010. Rethinking Grammatical Error Annotation and Evaluation with the Amazon Mechanical Turk. NAACL-HLT 2010 Workshop on Innovative Use of NLP for Building Educational Applications (BEA-5), Los Angeles, California. [ pdf ]
  • Lei Chen, Joel Tetreault, and Xiaoming Xi. 2010. Towards Using Structural Events To Assess Non-native Speech. NAACL-HLT 2010 Workshop on Innovative Use of NLP for Building Educational Applications (BEA-5), Los Angeles, California. [ pdf ]
  • Na-Rae Han, Joel Tetreault, Soo-Hwa Lee and Jin-Young Ha. 2010. Using an Error-Annotated Learner Corpus to Develop and ESL/EFL Error Correction System. LREC '10, Malta. [ pdf ]
  • Martin Chodorow, Michael Gamon and Joel Tetreault. 2010. The Utility of Article and Preposition Error Correction Systems for English Language Learners: Feedback and Assessment Language Testing, Vol. 27, No. 3, pp. 419-436. [ link ]

    2009

  • Joel Tetreault and Martin Chodorow. 2009. Examining the Use of Region Web Counts for ESL Error Detection. Web as Corpus Workshop (WAC-5), San Sebastian, Spain. [ pdf ]
  • John Lee, Joel Tetreault and Martin Chodorow. 2009. Human Evaluation of Article and Noun Number Usage: Influences of Context and Construction Variability. Linguistic Annotation Workshop III (LAW3), Suntec, Singapore. [ pdf ]
  • John Lee, Joel Tetreault and Martin Chodorow. 2009. Human Judgment on Article and Noun Number Usage. CALICO Workshop on Automatic Analysis of Learner Language (AALL '09), Tempe, Arizona.
  • Joel Tetreault and Martin Chodorow. 2009. Towards Automatically Acquiring Models of ESL Errors. CALICO Workshop on Automatic Analysis of Learner Language (AALL '09), Tempe, Arizona.

    2008

  • Joel Tetreault and Martin Chodorow. 2008. The Ups and Downs of Preposition Error Detection. COLING, Manchester, UK. [ pdf ] [ ppt ]
  • Joel Tetreault and Martin Chodorow. 2008. Native Judgments of Non-Native Usage: Experiments in Preposition Error Detection. COLING Workshop on Human Judgments in Computational Linguistics, Manchester, UK. [ pdf ] [ ppt ]
  • Joel Tetreault and Diane Litman. 2008. A Reinforcement Learning Approach to Evaluating State Representations in Spoken Dialogue Systems. Special issue of the Journal of Speech Communication Volume 50, Issue 8-0, August 2008.
  • Joel Tetreault, Martin Chodorow and Yoko Futagi. 2008. Reliability of Human Annotation of Usage Errors in Learner Text. CALICO Workshop on Automatic Analysis of Learner Language: Bridging Foreign Language Teaching Needs and NLP Possibilities, San Francisco, CA, April.
  • Yoko Futagi, Paul Deane, Martin Chodorow and Joel Tetreault. 2008. A computational approach to detecting collocation errors in the writing of non-native speakers of English. Computer Assisted Language Learning Journal

    2007

  • Martin Chodorow, Joel Tetreault, Na-Rae Han. 2007. Detection of Grammatical Errors Involving Prepositions. Proceedings of the Fourth ACL-SIGSEM Workshop on Prepositions, Prague. [ pdf ]
  • Kate Forbes-Riley, Diane Litman, Amruta Purandare, Mihai Rotaru, and Joel Tetreault. 2007. Comparing Linguistic Features for Modeling Learning in Computer Dialogue Tutoring. Proceedings 13th International Conference on Artificial Intelligence in Education (AIED), Los Angeles, CA, July.
  • Joel R. Tetreault, Dan Bohus, and Diane J. Litman. 2007. Estimating the Reliability of MDP Policies: A Confidence Interval Approach. Proceedings Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT), Rochester, NY, April. [ pdf ]
  • Hua Ai, Joel R. Tetreault, and Diane J. Litman. 2007. Comparing User Simulation Models for Dialog Strategy Learning. Proceedings Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT), Rochester, NY, April. [ pdf ]
  • Kate Forbes-Riley, Mihai Rotaru, Diane J. Litman and Joel Tetreault. 2007. Exploring Affect-Context Dependencies for Adaptive System Development. Proceedings Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT), Rochester, NY, April. (late-breaking news award).

    2006

  • Kate Forbes-Riley, Diane Litman, Scott Silliman and Joel Tetreault. 2006. Comparing Synthesized versus Pre-Recorded Tutor Speech in an Intelligent Tutoring Spoken Dialogue System. Proceedings 19th International Conference of the Florida Artificial Intelligence Research Society (FLAIRS), Melbourne Beach, Florida. [ pdf ]
  • Joel Tetreault and Diane Litman. 2006. Using Reinforcement Learning to Build a Better Model of Dialogue State. Proceedings of the 11th Conference of the European Association for Computational Linguistics (EACL), Trento, Italy. [ pdf ] [ ppt ]
  • Joel Tetreault and Diane Litman. 2006. Comparing the Utility of State Features in Spoken Dialogue Using Reinforcement Learning. Proceedings of the Human Language Technology/North American Association for Computational Linguistics (HLT/NAACL '06). New York City. [ pdf ]
  • Hua Ai, Diane Litman, Kate Forbes-Riley, Mihai Rotaru, Joel Tetreault, and Amruta Purandare. 2006. Using System and User Performance Features to Improve Emotion Detection in Spoken Tutoring Dialogs. Interspeech '06 Pittsburgh. [ pdf ]

    2005

  • Nathanael Chambers, Joel Tetreault, and James Allen. Approaches forAutomatically Tagging Affect Computing Attitude and Affect in Text: Theory and Applications Editors: James G. Shanahan, Yan Qu, Janyce Wiebe; Spriner, December 2005. [ Buy book here from Amazon ]

    2004

  • Joel Tetreault. Decomposing Discourse To appear as book chapter in DAARC book 2004 [draft: MSword ] Order book here from John Benjamins Publishing Company.
  • Nathanael Chambers, Joel Tetreault, and James Allen. Approaches for Automatically Tagging Affect 2004 AAAI Spring Symposium of Exploring Affect and Attitude in Text Stanford, USA, March 25-27, 2004. [drafts: pdf ] [ ppt ]
  • Mary Swift, Myrosia Dzikovska, Joel Tetreault and James F. Allen. Semi-automatic syntactic and semantic corpus annotation with a deep parser LREC '04 Lisbon, Portugal, May, 2004. [ pdf ]
  • Joel Tetreault, Mary Swift, Preethum Prithviraj, Myroslava Dzikovska, James Allen. Discourse Annotation in the Monroe Corpus ACL workshop on Discourse Annotation Barcelona, Spain. July 25-26, 2004. [ pdf ] [ ps ] [ ppt ]
  • Joel Tetreault and James Allen. Semantics, Dialogue, and Pronoun Resolution CATALOG '04 Barcelona, Spain. July 19-21, 2004. [ pdf ] [ ppt ]
  • Scott Stoness, Joel Tetreault, and James Allen. Incremental Parsing with Reference Interaction ACL Workshop on Incremental Parsing Barcelona, Spain. July 25-26, 2004. [ pdf ] [ ps ]
  • Joel Tetreault and James Allen. Dialogue Structure and Pronoun Resolution To appear in DAARC'04 Azores. September 23-24, 2004. [ doc ] [ pdf ] [ ppt ]
  • Nathanael Chambers, Joel Tetreault, and James Allen. Approaches for Automatically Tagging Affect: Steps Toward an Effective and Efficient Tool Chapter version of AAAI paper (above) to appear in 2004 book on Exploring Affect and Attitude in Text [drafts: pdf ] [ doc ]

    2003

  • Joel Tetreault and James Allen. An Empirical Evaluation of Pronoun Resolution and Clausal Structure Proceedings of the 2003 International Symposium on Reference Resolution and its Applications to Question Answering and Summarization Venice, Italy, June 23-24, 2003. p. 1-8. [ pdf ] [ ppt ]

    2002

  • Joel R. Tetreault. Tense and Implicit Role Reference. Annotation Standards for Temporal Information in Natural Language, Workshop in LREC 2002 Las Palmas de Gran Canaria, May 27, 2002, p.61-64. [ pdf ] [ ps ] [ ppt ]
  • Joel R. Tetreault. Implicit Role Reference. 2002 International Symposium on Reference Resolution for Natural Language Processing. Alicante, Spain, June 3 - 4, 2002, p.109-115. [ pdf ] [ ps ]
  • Joel R. Tetreault. Clausal Structure and Pronoun Resolution. Proceedings of the 4th Discourse Anaphora and Anaphora Resolution Colloquium (DAARC). Lisbon, Portugal, September 18-20, 2002, p.217-220.

    2001

  • Joel R. Tetreault. A Corpus-Based Evaluation of Centering and Pronoun Resolution. Computational Linguistics. 27(4): p.507-520. [ pdf ] [ ps ]

    1999

  • Joel R. Tetreault. Analysis of Syntax Based Pronoun Resolution Methods. Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics (ACL'99) student session. [ pdf ] [ ps ]
  • Donna K. Byron and Joel R. Tetreault. A Flexible Architecture for Reference Resolution. Proceedings of the Ninth Conference of the European Chapter of the Association for Computational Linguistics (EACL-99). [ pdf ] [ ps ]
[ return ]





Joel Tetreault: JTetreault [at] ets.org