Research:

I am a member of the design rationale group. My thesis involves creating a bidirectional multimodal speech and sketching system. The system takes advantage of several insights I gained from user studies I conducted. These user studies examined how two humans interact when discussing simple electrical circuit diagrams and simple mechanical devices. The resulting system allows the user to speak and sketch about a simple mechanical device and the system will respond with multimodal questions that help clarify the uncertainties and ambiguities in the sketch. For more information about my research, check out my papers and thesis proposal.

In the past, I have also done research with the aire group, whose focus is pervasive computing applications for intelligent spaces.  

Here are links to my résumé and my Curriculum Vitae.

Publications:

Ph.D. thesis proposal

Adler, Aaron. Multimodal Interactive Digital Whiteboard. Ph.D. Thesis Proposal. MIT, Cambridge, MA. February 2007. [pdf] [BibTex]

Master's thesis

Adler, Aaron. Segmentation and Alignment of Speech and Sketching in a Design Environment. Master's Thesis. MIT, Cambridge, MA. February 2003. [pdf] [zip of ps] [BibTex]

Conference Papers

Adler, Aaron and Davis, Randall. Speech and Sketching: An Empirical Study of Multimodal Interaction. In Proceedings of Fourth Eurographics Conference on Sketch Based Interfaces and Modeling. Riverside, California, August 2-3 2007. [BibTeX] [PDF] [talk slides - pps]

Adler, Aaron and Eisenstein, Jacob and Oltmans Michael and Guttentag, Lisa and Davis, Randall. Building the Design Studio of the Future. In Proceedings of AAAI Fall Symposium: Making Pen-Based Interaction Intelligent and Natural, pp.1-7. Menlo Park, California, October 21-24 2004. [BibTeX] [PDF]

Eisenstein, Jacob; Adler, Aaron; Guttentag, Lisa. A Trimodal Dialogue Corpus: Speech, Gesture, and Sketching. Fourth Annual MIT CSAIL Student Oxygen Workshop, September 2004. [pdf] [BibTex]

Adler, Aaron and Davis, Randall. Speech and Sketching for Multimodal Design. In Proceedings of the 9th International Conference on Intelligent User Interfaces, pp. 214--216. ACM Press, 2004. [ps] [pdf] [BibTex]

Adler, Aaron. Creating a Multimodal Design Environment Using Speech and Sketching. MIT Student Oxygen Workshop, September 2003. [ps] [pdf] [BibTex] [talk slides - 1.6MB pps]

Oh, Alice; Fox, Harold; Van Kleek, Max; Adler, Aaron; Gajos, Krzysztof; Morency, Louis-Philippe, Morency; Darrell, Trevor. Evaluating Look-to-Talk: A Gaze-Aware Interface in a Collaborative Environment. ACM SIGCHI 2002. [ps] [pdf] [BibTex]

Lab Abstracts

Adler, Aaron and Davis, Randall. Using Speech and Sketching in a Design Environment. MIT Computer Science and Artificial Intelligence Laboratory Annual Research Abstract, February 2004. [pdf] [BibTex]

Adler, Aaron; Davis, Randall; and Shrobe, Howard. Mutual Disambiguation of Verbal and Sketching Inputs in a Design Environment. MIT Artificial Intelligence Laboratory Annual Abstract, September 2002. [ps] [pdf] [BibTex]

Davis, Randall; Adler, Aaron; Alvarado, Christine; Hammond, Tracy; Hitchcock, Rebecca; Oltmans, Michael; Sezgin, Tevfik Metin; and Veselova, Olya. Designs for the Future. MIT Artificial Intelligence Laboratory Annual Abstract, September 2002. [ps] [pdf] [BibTex]

Movie:

Video for Spring 2003 Oxygen Meeting. [6MB mpg]

About Me:

Here's a link to my (password protected) photos that are online.