Research

Impact Areas

Internet of Things

Lead

David Karger

Lea Verou

David Karger

Research Group

HCI Engineering Group

We work at the intersection of human computer interaction and personal fabrication tools.

Stefanie Mueller

Leads

Stefanie Mueller

Research Areas

Impact Areas

Lead

Stefanie Mueller

Research Group

Randall Davis

Fredo Durand

Daniel Jackson

David Karger

Rob Miller

Stefanie Mueller

Research Areas

Lead

Randall Davis

Fredo Durand

Daniel Jackson

David Karger

Rob Miller

Stefanie Mueller

Research Group

Imagination, Computation, and Expression Laboratory (ICE Lab)

We develop computing systems for creative expression, cultural analysis, and social change.

Peter Mawhorter

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Impact Areas

Lead

D. Fox Harrell

Peter Mawhorter

D. Fox Harrell

Research Group

Infolab

We investigate language in different contexts: from how it is learned, to how it is grounded in visual perception, all the way to how machines can readily interact with humans.

Boris Katz

Leads

Boris Katz

Research Areas

Impact Areas

Lead

Boris Katz

Research Group

Multimodal Understanding Group

Our objective is to build techniques, software, and hardware that enable natural interaction with
computation.

Randall Davis

Leads

Randall Davis

Research Areas

Impact Areas

Lead

Randall Davis

Research Group

Spoken Language Systems Group

Our goal is to create technology that makes it possible for everyone in the world to interact with with computers via natural spoken language.

Jim Glass

Leads

Jim Glass

Research Areas

Impact Areas

Lead

Jim Glass

Research Group

Led by Web inventor and Director, Tim Berners-Lee and CEO Jeff Jaffe, the W3C focus is on leading the World Wide Web to its full potential by developing standards, protocols and guidelines that ensure the long-term growth of the Web

Leads

Tim Berners-Lee

Jeffrey Jaffe

Judy Brewer

Research Areas

Impact Areas

Wireless

Lead

Tim Berners-Lee

Jeffrey Jaffe

Judy Brewer

Research Group

Software Design Group

Our goal is to find better ways to make software, and ways to make software better.

Daniel Jackson

Leads

Daniel Jackson

Research Areas

Impact Areas

Lead

Daniel Jackson

Research Group

Usable Programming Group

We design and study systems that improve the learnability, efficiency, and safety of software development.

Rob Miller

Leads

Rob Miller

Research Areas

Impact Areas

Lead

Rob Miller

Research Center

Internet Policy Research Initiative

Our mission is to work with policy makers and cybersecurity technologists to increase the trustworthiness and effectiveness of interconnected digital systems.

Leads

Daniel Weitzner

Hal Abelson

David Clark

Lalana Kagal

Karen Sollins

Gerald Sussman

Research Areas

Impact Areas

Lead

Daniel Weitzner

Hal Abelson

David Clark

Lalana Kagal

Karen Sollins

Gerald Sussman

Research Center

Center for Deployable Machine Learning (CDML)

The MIT Center for Deployable Machine Learning (CDML) works towards creating AI systems that are robust, reliable and safe for real-world deployment.

Aleksander Madry

Leads

Aleksander Madry

Research Areas

Impact Areas

Lead

Aleksander Madry

Community of Research

Cognitive AI Community of Research

This CoR aims to develop AI technology that synthesizes symbolic reasoning, probabilistic reasoning for dealing with uncertainty in the world, and statistical methods for extracting and exploiting regularities in the world, into an integrated picture of intelligence that is informed by computational insights and by cognitive science.

Howard Shrobe

Leads

Howard Shrobe

Research Areas

Impact Areas

Lead

Howard Shrobe

Community of Research

Computing & Society Community of Research

This community is interested in understanding and affecting the interaction between computing systems and society through engineering, computer science and public policy research, education, and public engagement.

Daniel Weitzner

Leads

Daniel Weitzner

Research Areas

Impact Areas

Lead

Daniel Weitzner

Community of Research

Human-Computer Interaction Community of Research

The focus of the HCI CoR is inventing new systems and technology that lie at the interface between people and computation, and understanding their design, implementation, and societal impact.

Stefanie Mueller

Leads

Stefanie Mueller

Research Areas

Impact Areas

Lead

Stefanie Mueller

Research Group

Visualization Group

We use visualization as a petri dish to study intelligence augmentation, or how can computational representations and software systems help amplify our cognition and creativity, while respecting our agency?

Arvind Satyanarayan

Leads

Arvind Satyanarayan

Research Areas

Impact Areas

Lead

Arvind Satyanarayan

49 Project Results matching all criteria

Project

Wikum: Bridging Discussion Systems and Wikis with Collective Summarization

We build tools to allow a community of people to collectively summarize large discussions online and manage knowledge embedded within these discussions.

David Karger

Leads

David Karger

Research Areas

Impact Areas

David Karger

Project

Squadbox: Combating Online Harassment using Friendsourced Moderation

Fight back against online harassment with a squad of friends.

David Karger

Leads

David Karger

Research Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

David Karger

Project

Developing the Impacts of Virtual Identity on Computational Learning Environments

Our goal is to develop an understanding of the impacts of virtual identities on users in educational environments.

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

D. Fox Harrell

Project

Wait-learning: Intelligent Systems for Making Productive Use of Wait Time

Wait-learning makes it easier for busy people to learn informally, by automatically detecting when they are waiting and delivering optional learning exercises that can be completed during wait time.

Rob Miller

Leads

Rob Miller

Research Areas

Impact Areas

Rob Miller

Project

Crowdsourcing in Graphics and Vision

Our goal is to develop new applications and algorithms that leverage the skills of distributed crowdworkers, notably for image and video processing applications.

Alexandre Kaspar

Leads

Alexandre Kaspar

Research Areas

Impact Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

Alexandre Kaspar

Project

Culturally-Grounded Virtual Identities: A Case Study in a Qatari Context

Mixed-methods qualitative (interviews and coding) and computational (AI) approach to understanding relationships between social identities, cultural values, and virtual identity technologies (e.g., online profiles and avatars).

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Impact Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

D. Fox Harrell

Project

AIRvatar System: A Framework for Analyzing Virtual Identities

AIRvatar is a system that telemetrically collects and analyzes fine-grained data on users’ virtual identities and the process used to create them.

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Impact Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

D. Fox Harrell

Project

Narra Ludens: Explaining Video Game Engagement Through Textual Analysis

This study aims to understand the behaviors, motivations, and gameplay types of videogame players through topic modelling, sentiment clusters, and valence analysis of videogame reviews.

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

D. Fox Harrell

Project

Changing Minds via Roleplay in Interactive Digital Media

We aim to study the impact of computer-supported roleplaying in changing social perspectives of digital media users. Such media could take the form of videogames, VR systems, training software, and other types of interactive narrative technology.

Pablo Jose Ortiz-Lampier

D. Fox Harrell

Leads

Pablo Jose Ortiz-Lampier

D. Fox Harrell

Research Areas

Impact Areas

Model-Based Embedded and Robotics Systems Group

Pablo Jose Ortiz-Lampier

D. Fox Harrell

Project

Uhura: Personal Assistant that Manages Risk

Computation Structures Group

Uhura is an autonomous system that collaborates with humans in planning and executing complex tasks, especially under over-subscribed and risky situations.

Leads

Yuening Zhang

Brian Williams

Howard Shrobe

Research Areas

Impact Areas

Decentralized Information Group

Project

The Car Can Explain!

Developing techniques to allow self-driving cars and other AI-driven systems to explain behaviors and failures.

Gerald Sussman

Lalana Kagal

Leads

Gerald Sussman

Lalana Kagal

Research Areas

Impact Areas

Learning and Intelligent Systems

Gerald Sussman

Lalana Kagal

Project

Active Learning of Models for Planning

Machine Learning

We aim to develop a systematic framework for robots to build models of the world and to use these to make effective and safe choices of actions to take in complex scenarios.

Leslie Kaelbling

Tomas Lozano-Perez

Leads

Leslie Kaelbling

Tomas Lozano-Perez

Research Areas

Impact Areas

Leslie Kaelbling

Tomas Lozano-Perez

Project

Rethinking Software Design

What is design thinking in the context of software? We're developing a new approach to software design that achieves usability and robustness by going deeper than the user interface.

Daniel Jackson

Leads

Daniel Jackson

Research Areas

Daniel Jackson

Project

New Interaction Models for Personal Fabrication Interfaces

Inspired by the history of the user interface for personal computing, we are developing new interaction models for personal fabrication.

Stefanie Mueller

Leads

Stefanie Mueller

Research Areas

Impact Areas

Stefanie Mueller

Project

SoFi - The Soft Robotic Fish

Exploration of underwater life with an acoustically controlled soft robotic fish

Joseph DelPreto

Leads

Joseph DelPreto

Research Areas

Impact Areas

Joseph DelPreto

Project

Wearable Blind Navigation

We enable independent navigation for visually impaired users through a wearable feedback system using time-of-light sensors or depth cameras.

Leads

Research Areas

Impact Areas

Project

Supervising Robots with Muscle and Brain Signals

What if we could control robots more intuitively, using just hand gestures and brainwaves?

Joseph DelPreto

Leads

Joseph DelPreto

Research Areas

Impact Areas

Joseph DelPreto

Project

Wearable Ultrasonic Echolocation

Vision Group

The goal of this project is to develop and test a wearable ultrasonic echolocation aid for people who are blind and visually impaired. We combine concepts from engineering, acoustic physics, and neuroscience to make echolocation accessible as a research tool and mobility aid.

Santani Teng

Leads

Santani Teng

Research Areas

Impact Areas

Santani Teng

Project

InstantCAD: Interactive Design Exploration/Optimization for CAD Models

Almost every object we use is developed with computer-aided design (CAD). While CAD programs are good for creating designs, using them to actually improve existing designs can be difficult and time-consuming.

Leads

Research Areas

Impact Areas

Project

CilkPride

CilkPride is a programming environment that aims to make performance and safety information always available and appropriately visible to the programmer.

Charles E. Leiserson

Rob Miller

Leads

Charles E. Leiserson

Rob Miller

Research Areas

Charles E. Leiserson

Rob Miller

Project

Mavo: Creating Interactive Data-Driven Web Applications by Authoring HTML

Mavo is a language that lets anyone turn a static HTML document into a fully functioning reactive web application with data presentation, editing, storage and lightweight computation, all without writing a single line of Javascript or other programming code.

David Karger

Lea Verou

Leads

David Karger

Lea Verou

Research Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

David Karger

Lea Verou

Project

Enriching Virtual Reality (VR) Narratives with Embodied and Gestural Interaction

Building embodied and gestural interfaces to enrich interaction in VR narratives.

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

D. Fox Harrell

Project

Natural language Understanding for Human-Robot Interaction

Our goal is to enable robots to understand and execute natural language commands from human agents. We develop algorithms that allow a robot to interpret, learn and reason about semantic concepts embedded in language in the context of low-level metric representations perceived from sensors.

Nicole Glabinski

Subhro Roy

Leads

Subhro Roy

Research Areas

Geometric Data Processing Group

Nicole Glabinski

Subhro Roy

Project

Political Geometry: Establishing Fair Mathematical Standards for Political Redistricting

Gerrymandering is a direct threat to our democracy, undermining founding principles like equal protection under the law and eroding public confidence in elections.

Justin Solomon

Leads

Justin Solomon

Research Areas

Impact Areas

Justin Solomon

28 People Results matching all criteria

Murad Abu-Khalaf

Program Manager, Toyota-CSAIL Joint Research Center

E murad@mit.edu

T 452-2859

PI
Core/Dual

Randall Davis

Professor

Human-computer interaction, systems, classic AI

E davis@csail.mit.edu

T 253-5879

Lead

Multimodal Understanding Group

Member

Supervising Robots with Muscle and Brain Signals

Human-computer interaction, systems, classic AI

Joseph DelPreto

Graduate Student

Works on human-robot interaction using muscle and brain signals.

E delpreto@csail.mit.edu

RM 32-376A

Lead

Brain-Controlled Robots

Distributed Robot Garden

Robot Compiler

SoFi - The Soft Robotic Fish

Soft Robotic Hand

Using Muscle Signals to Lift Objects with Robots

Controlling drones and other robots with gestures

Helping robots learn using demonstrations

Member

Works on human-robot interaction using muscle and brain signals.

Mustafa Doga Dogan

Graduate Student

E doga@mit.edu

Member

Sue Felshin

Research Scientist

E sfelshin@csail.mit.edu

T 253-2965

Lead

Member

PI
Core/Dual

Jim Glass

Senior Research Scientist

speech and language processing

E glass@mit.edu

T 253-1640

Lead

Designing Information-Rich Embedding Spaces

Unsupervised Learning of Interpretable Representations from Sequential Data

Fact-Checking and Reasoning

Speaker Verification and Diarization

Using Computers to Eat Healthier

Member

Low-Power Speech Processing Circuits

Crossing the Vision-Language Boundary

Arabic Language Processing

Health-related Biomarkers from Speech

Community Question Answering

Understanding Language Representations in Deep Learning Models

speech and language processing

Lelia Hampton

Graduate Student

Ph.D. Student

E lelia@mit.edu

Ph.D. Student

PI
Core/Dual

Daniel Jackson

Professor

Software design, programming, systems

E dnj@csail.mit.edu

T 258-8471

Lead

Rethinking Software Design

Gitless: a simple version control system built on top of Git

Déjà Vu: Constructing Apps from Concepts

Security by Design for Cyberphysical Systems

Poirot: Secure Protocol Implementation by Design

An Interlock for Self Driving Cars

Alloy

Member

Espalier

Software design, programming, systems

PI
Core/Dual

David Karger

Professor

Helping people manage information

E karger@csail.mit.edu

T 258-6167

Lead

Mavo: Creating Interactive Data-Driven Web Applications by Authoring HTML

Algorithms Group

Wikum: Bridging Discussion Systems and Wikis with Collective Summarization

Squadbox: Combating Online Harassment using Friendsourced Moderation

Eyebrowse: Social and Public Web Browsing

Talkademic: Motivating Online Academic Discourse

Member

Crowdsourcing in Graphics and Vision

Helping people manage information

Alexandre Kaspar

Graduate Student

Graphics, crowdsourcing and hybrid fabrication.

E akaspar@mit.edu

Lead

Computational Knitting: Patterning and Shaping for Everyone

Graphics, crowdsourcing and hybrid fabrication.

PI
Core/Dual

Boris Katz

Principal Research Scientist

Natural language processing

E boris@csail.mit.edu

T 253-6032

Lead

Semantic Parsing using Vision

Generating Plans for Agents using Video and Language

Inferring “Theory of Mind” with vision and language

Artificial Social Intelligence for Successful Teams (ASIST)

Member

Center for Brains, Minds and Machines

Natural language processing

Sameer Khurana

Graduate Student

unsupervised speech processing, automatic speech recognition

E skhurana@mit.edu

Lead

Member

unsupervised speech processing, automatic speech recognition

Kimberle Koile

Lecturer

E kkoile@csail.mit.edu

Henry Lieberman

Research Scientist

Henry Lieberman is a Research Scientist at MIT CSAIL, in AI and HCI.

E lieber@MEDIA.MIT.EDU

Henry Lieberman is a Research Scientist at MIT CSAIL, in AI and HCI.

Jamie Macbeth

Research Affiliate

In-Depth Natural Language Understanding, Human-Computer Interaction

E jmacbeth@mit.edu

In-Depth Natural Language Understanding, Human-Computer Interaction

PI
Core/Dual

Wojciech Matusik

Professor

Graphics, vision, fabrication, robotics, hci

E wojciech@csail.mit.edu

T 324-8432

Lead

Computational Multicopter Design

Computer Graphics Group

Member

Simit: A Language for Computing on Sparse Systems

InstantCAD: Interactive Design Exploration/Optimization for CAD Models

Visual Computing Community of Research

Graphics, vision, fabrication, robotics, hci

PI
Core/Dual

Rob Miller

Professor

Human-computer interaction, online education, software development

E rcm@csail.mit.edu

T 324-6028

Lead

Wait-learning: Intelligent Systems for Making Productive Use of Wait Time

CilkPride

Member

Human-computer interaction, online education, software development

PI
Core/Dual

Stefanie Mueller

Assistant Professor

Human-computer interaction, fabrication, hardware, robotics.

E stefanie.mueller@mit.edu

T 715-5831

Lead

New Interaction Models for Personal Fabrication Interfaces

Human-computer interaction, fabrication, hardware, robotics.

Martin Nisser

Graduate Student

E nisser@mit.edu

Member

Soyun Park

Graduate Student

Human-Computer Interaction(HCI), personal information retrieval

E soya@mit.edu

Member

Human-Computer Interaction(HCI), personal information retrieval

PI
Core/Dual

Arvind Satyanarayan

Assistant Professor

E arvindsatya@mit.edu

Lead

Center for Deployable Machine Learning (CDML)

Member

Nouran Soliman

Graduate Student

Nouran is a PhD Student in EECS at MIT working with David Karger.

E nouran@mit.edu

Nouran is a PhD Student in EECS at MIT working with David Karger.

Dishita Turakhia

Graduate Student

PhD student in HCIE group at CSAIL

E dishita@mit.edu

Member

PhD student in HCIE group at CSAIL

Michailia Verou

Graduate Student

E leaverou@mit.edu

26 News Results matching all criteria

Human-Computer Interaction Programming Languages & Software Engineering Big Data

February 22 '21

Helping data journalists create interactive graphics

Graphics & Vision Human-Computer Interaction Entertainment Manufacturing

February 18 '21

Less-wasteful laser-cutting

Fabricaide, developed at MIT CSAIL, provides live design feedback to help users reduce leftover material.

Less-wasteful laser-cutting

Human-Computer Interaction Manufacturing

February 08 '21

Fabricating fully functional drones

CSAIL's “LaserFactory” system automates the full process for making functional devices in one system.

Fabricating fully functional drones

Human-Computer Interaction

October 21 '20

Electronic design tool morphs interactive objects

A new system lets users digitally model an object’s form and electronic function in one integrated space

Electronic design tool morphs interactive objects

Human-Computer Interaction

April 20 '20

Satyanarayan selected for NSF career award

This week it was announced that MIT assistant professor Arvind Satyanarayan has been awarded the distinguished NSF career award for his project “Effective Interaction Design for Data Visualization.”

Satyanarayan selected for NSF career award

Human-Computer Interaction Energy Manufacturing

April 17 '20

Mueller named 2020 Microsoft Research Faculty Fellow

Graphics & Vision Human-Computer Interaction Manufacturing

April 08 '20

Sprayable user interfaces

SprayableTech system lets users create large-scale interactive surfaces with sensors and displays using airbrushed inks

Sprayable user interfaces

Human-Computer Interaction Manufacturing

March 05 '20

Integrating electronics onto physical prototypes

In place of flat “breadboards,” 3D-printed CurveBoards enable easier testing of circuit design on electronics products.

Integrating electronics onto physical prototypes

Carbin and Mueller named 2020 Sloan Research Fellows 1

Human-Computer Interaction Systems & Networking

February 14 '20

Carbin and Mueller named 2020 Sloan Research Fellows

Human-Computer Interaction Energy Entertainment Manufacturing

September 10 '19

Objects can now change colors like a chameleon

Computer Science and Artificial Intelligence Laboratory team creates new reprogrammable ink that lets objects change colors using light.

Objects can now change colors like a chameleon

Algorithms & Theory AI & ML Computational Biology Computer Architecture Graphics & Vision Human-Computer Interaction Programming Languages & Software Engineering Robotics Security & Cryptography Systems & Networking Cybersecurity Education Energy Entertainment Health Care Manufacturing Transportation Wireless

June 27 '19

CSAIL hosts first-ever TEDxMIT

Speakers — all women — discuss everything from gravitational waves to robot nurses

CSAIL hosts first-ever TEDxMIT

Human-Computer Interaction Systems & Networking

April 29 '19

Better email automation

CSAIL team studies what email users want for better automating email — and proposes "YouPS" filtering tool.

Better email automation

Human-Computer Interaction

September 12 '18

Muddied Waters: Online Disinformation During Crisis Events - Prof. Kate Starbird

September 12, 2018 - Kate Starbird of the University of Washington gave a Hot Topics in Computing Lecture titled "Muddied Waters: Online Disinformation During Crisis Events."

Muddied Waters: Online Disinformation During Crisis Events - Prof. Kate Starbird

Human-Computer Interaction Security & Cryptography Cybersecurity

April 13 '18

MIT experts discuss online security and protecting data in a “public-private” Internet age

Last week CSAIL hosted the fourth “Hot Topics in Computing” speaker series, a monthly forum where experts hold discussions with community members on various hot-button tech topics.

MIT experts discuss online security and protecting data in a “public-private” Internet age

Human-Computer Interaction Entertainment Manufacturing

January 31 '18

Changing the color of 3-D printed objects

CSAIL system uses custom ink and ultraviolet light to repeatedly change an object's color.

Changing the color of 3-D printed objects

AI & ML Human-Computer Interaction Big Data Education Entertainment Health Care Internet of Things

December 11 '17

Reading a neural network’s mind

Neural networks, which learn to perform computational tasks by analyzing huge sets of training data, have been responsible for the most impressive recent advances in artificial intelligence, including speech-recognition and automatic-translation systems.

Reading a neural network’s mind

PhD student Danielle Olson believes we can make digital information-sharing more natural and interpersonal, by creating immersive media to better understand each other’s feelings and backgrounds.

AI & ML Human-Computer Interaction Entertainment

May 30 '17

Danielle Olson: Building empathy through computer science and art

Communicating through computers has become an extension of our daily reality. But as speaking via screens has become commonplace, our exchanges are losing inflection, body language, and empathy. Danielle Olson ’14, a first-year PhD student at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL), believes we can make digital information-sharing more natural and interpersonal, by creating immersive media to better understand each other’s feelings and backgrounds.

Danielle Olson: Building empathy through computer science and art

CSAIL’s open-source Mavo language lets you edit a website right in your browser

Human-Computer Interaction Systems & Networking

May 17 '17

Creating interactive websites, apps with HTML

Ever wish your website could be edited right from the browser?A CSAIL team has developed “Mavo,” a language that lets you create and edit interactive websites and apps with nothing more than HTML.

Creating interactive websites, apps with HTML

MIT doctoral candidate Claudia Pérez-D'Arpino discusses her work teaching the Optimus robot to perform various tasks, including picking up a bottle.

AI & ML Human-Computer Interaction Robotics Manufacturing

May 10 '17

Teaching robots to teach other robots

Most robots are programmed using one of two methods: learning from demonstration, in which they watch a task being done and then replicate it, or via motion-planning techniques such as optimization or sampling, which require a programmer to explicitly specify a task’s goals and constraints.

Teaching robots to teach other robots

WaitSuite opens up new possibilities for "micro-learning," leveraging idle moments like when you're waiting to connect to WiFi or refresh your email.

AI & ML Human-Computer Interaction Education Internet of Things

April 18 '17

Learn a language while you wait for WiFi

Hyper-connectivity has changed the way we communicate, wait, and productively use our time. Even in a world of 5G wireless and “instant” messaging, there are countless moments throughout the day when we’re waiting for messages, texts, and Snapchats to refresh. But our frustrations with waiting a few extra seconds for our emails to push through doesn’t mean we have to simply stand by.

Learn a language while you wait for WiFi

Researchers at MIT’s Microsystems Technology Laboratories have built a low-power chip specialized for automatic speech recognition. With power savings of 90 to 99 percent, it could make voice control practical for relatively simple electronic devices.

AI & ML Human-Computer Interaction Energy Internet of Things Manufacturing

February 13 '17

Voice control everywhere

The butt of jokes as little as 10 years ago, automatic speech recognition is now on the verge of becoming people’s chief means of interacting with their principal computing devices. In anticipation of the age of voice-controlled electronics, MIT researchers have built a low-power chip specialized for automatic speech recognition. Whereas a cellphone running speech-recognition software might require about 1 watt of power, the new chip requires between 0.2 and 10 milliwatts, depending on the number of words it has to recognize.

Voice control everywhere

Human-Computer Interaction Education Health Care

February 08 '17

Frugal Innovations for a Developing World

February 8, 2017 - Bill Thies of Microsoft Research India gave a Dertouzos Distinguished Lecture titled "Frugal Innovations for a Developing World."

Frugal Innovations for a Developing World

MIT researchers have developed a new approach to training speech-recognition systems that doesn’t depend on transcription. Instead, their system analyzes correspondences between images and spoken descriptions of those images, as captured in a large collection of audio recordings.

AI & ML Human-Computer Interaction Big Data

December 06 '16

Learning words from pictures

Speech recognition systems, such as those that convert speech to text on cellphones, are generally the result of machine learning. A computer pores through thousands or even millions of audio files and their transcriptions, and learns which acoustic features correspond to which typed words.But transcribing recordings is costly, time-consuming work, which has limited speech recognition to a small subset of languages spoken in wealthy nations.

Learning words from pictures

A prototype of a new speech-controlled nutrition-logging system allows users to verbally describe the contents of a meal. The system then parses the description and automatically retrieves the pertinent nutritional data.

AI & ML Human-Computer Interaction Health Care

March 24 '16

Voice-controlled calorie counter

For people struggling with obesity, logging calorie counts and other nutritional information at every meal is a proven way to lose weight. The technique does require consistency and accuracy, however, and when it fails, it’s usually because people don't have the time to find and record all the information they need.A few years ago, a team of nutritionists from Tufts University who had been experimenting with mobile-phone apps for recording caloric intake approached members of the Spoken Language Systems Group at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL), with the idea of a spoken-language application that would make meal logging even easier.

Voice-controlled calorie counter

16 Group Results

Research Center

Center for Deployable Machine Learning (CDML)

The MIT Center for Deployable Machine Learning (CDML) works towards creating AI systems that are robust, reliable and safe for real-world deployment.

Aleksander Madry

Leads

Aleksander Madry

Research Areas

Impact Areas

Lead

Aleksander Madry

Community of Research

Cognitive AI Community of Research

Howard Shrobe

Leads

Howard Shrobe

Research Areas

Impact Areas

Lead

Howard Shrobe

Community of Research

Computing & Society Community of Research

Daniel Weitzner

Leads

Daniel Weitzner

Research Areas

Impact Areas

Lead

Daniel Weitzner

Research Group

Haystack Group

We are an interdisciplinary group of researchers blending approaches from human-computer interaction, social computing, databases, information management, and databases.

Lea Verou

David Karger

Leads

David Karger

Research Areas

Impact Areas

Internet of Things

Lead

David Karger

Lea Verou

David Karger

Research Group

HCI Engineering Group

We work at the intersection of human computer interaction and personal fabrication tools.

Stefanie Mueller

Leads

Stefanie Mueller

Research Areas

Impact Areas

Lead

Stefanie Mueller

Community of Research

Human-Computer Interaction Community of Research

The focus of the HCI CoR is inventing new systems and technology that lie at the interface between people and computation, and understanding their design, implementation, and societal impact.

Stefanie Mueller

Leads

Stefanie Mueller

Research Areas

Impact Areas

Lead

Stefanie Mueller

Research Group

Human-Computer Interaction

HCI faculty and researchers in CSAIL.

Leads

Randall Davis

Fredo Durand

Daniel Jackson

David Karger

Rob Miller

Stefanie Mueller

Research Areas

Lead

Randall Davis

Fredo Durand

Daniel Jackson

David Karger

Rob Miller

Stefanie Mueller

Research Group

Imagination, Computation, and Expression Laboratory (ICE Lab)

We develop computing systems for creative expression, cultural analysis, and social change.

Peter Mawhorter

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Impact Areas

Lead

D. Fox Harrell

Peter Mawhorter

D. Fox Harrell

Research Group

Infolab

We investigate language in different contexts: from how it is learned, to how it is grounded in visual perception, all the way to how machines can readily interact with humans.

Boris Katz

Leads

Boris Katz

Research Areas

Impact Areas

Lead

Boris Katz

Research Center

Internet Policy Research Initiative

Our mission is to work with policy makers and cybersecurity technologists to increase the trustworthiness and effectiveness of interconnected digital systems.

Leads

Daniel Weitzner

Hal Abelson

David Clark

Lalana Kagal

Karen Sollins

Gerald Sussman

Research Areas

Impact Areas

Lead

Daniel Weitzner

Hal Abelson

David Clark

Lalana Kagal

Karen Sollins

Gerald Sussman

Research Group

Multimodal Understanding Group

Our objective is to build techniques, software, and hardware that enable natural interaction with
computation.

Randall Davis

Leads

Randall Davis

Research Areas

Impact Areas

Lead

Randall Davis

Research Group

Software Design Group

Our goal is to find better ways to make software, and ways to make software better.

Daniel Jackson

Leads

Daniel Jackson

Research Areas

Impact Areas

Lead

Daniel Jackson

Research Group

Spoken Language Systems Group

Our goal is to create technology that makes it possible for everyone in the world to interact with with computers via natural spoken language.

Jim Glass

Leads

Jim Glass

Research Areas

Impact Areas

Lead

Jim Glass

Research Group

Usable Programming Group

We design and study systems that improve the learnability, efficiency, and safety of software development.

Rob Miller

Leads

Rob Miller

Research Areas

Impact Areas

Lead

Rob Miller

Research Group

Visualization Group

Arvind Satyanarayan

Leads

Arvind Satyanarayan

Research Areas

Impact Areas

Lead

Arvind Satyanarayan

Research Group

World Wide Web Consortium

Leads

Tim Berners-Lee

Jeffrey Jaffe

Judy Brewer

Research Areas

Impact Areas

Learning and Intelligent Systems

Wireless

Lead

Tim Berners-Lee

Jeffrey Jaffe

Judy Brewer

49 Project Results

Project

Active Learning of Models for Planning

Machine Learning

We aim to develop a systematic framework for robots to build models of the world and to use these to make effective and safe choices of actions to take in complex scenarios.

Leslie Kaelbling

Tomas Lozano-Perez

Leads

Leslie Kaelbling

Tomas Lozano-Perez

Research Areas

Impact Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

Leslie Kaelbling

Tomas Lozano-Perez

Project

AIRvatar System: A Framework for Analyzing Virtual Identities

AIRvatar is a system that telemetrically collects and analyzes fine-grained data on users’ virtual identities and the process used to create them.

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Impact Areas

D. Fox Harrell

Project

Alloy

Alloy is a language for describing structures and a tool for exploring them. It has been used in a wide range of applications from finding holes in security mechanisms to designing telephone switching networks. Hundreds of projects have used Alloy for design analysis, for verification, for simulation, and as a backend for many other kinds of analysis and synthesis tools, and Alloy is currently being taught in courses worldwide.

Daniel Jackson

Leads

Daniel Jackson

Research Areas

Impact Areas

Daniel Jackson

Project

An Interlock for Self Driving Cars

Computer-Aided Programming

Vertical AI Community of Research

Self-driving cars are likely to be safer, on average, than human-driven cars. But they may fail in new and catastrophic ways that a human driver could prevent. This project is designing a new architecture for a highly dependable self-driving car.

Daniel Jackson

Armando Solar-Lezama

Leads

Daniel Jackson

Armando Solar-Lezama

Research Areas

Impact Areas

Daniel Jackson

Armando Solar-Lezama

Project

Arabic Language Processing

The Arabic language is spoken by over one billion people around the world. Arabic presents a variety of challenges for speech and language processing technologies. In our group, we have several research topics examining Arabic, including dialect identification, speech recognition, machine translation, and language processing.

Mitra Mohtarami

Leads

Mitra Mohtarami

Research Areas

Computation Structures Group

Mitra Mohtarami

Project

Artificial Social Intelligence for Successful Teams (ASIST)

Computational Cognitive Science Group

Model-Based Embedded and Robotics Systems Group

Our goal is to develop a socially intelligent team coacher agent that helps humans communicate, strategize, and work together efficiently.

Leads

Howard Shrobe

Brian Williams

Boris Katz

Zhutian Yang

Research Areas

Computer Architecture

Impact Areas

Wireless

Project

Automatic Speech Recognition

Automatic speech recognition (ASR) has been a grand challenge machine learning problem for decades. Our ongoing research in this area examines the use of deep learning models for distant and noisy recording conditions, multilingual, and low-resource scenarios.

Sameer Khurana

Jim Glass

Leads

Sameer Khurana

Jim Glass

Research Areas

Impact Areas

Sameer Khurana

Jim Glass

Project

Brain-Controlled Robots

This project aims to let people correct robot mistakes with nothing more than their brain signals - to allow robots to adapt to humans rather than the other way around

Frank H. Guenther

Daniela Rus

Joseph DelPreto

Leads

Daniela Rus

Joseph DelPreto

Research Areas

Decentralized Information Group

Frank H. Guenther

Daniela Rus

Joseph DelPreto

Project

The Car Can Explain!

Developing techniques to allow self-driving cars and other AI-driven systems to explain behaviors and failures.

Gerald Sussman

Lalana Kagal

Leads

Gerald Sussman

Lalana Kagal

Research Areas

Impact Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

Gerald Sussman

Lalana Kagal

Project

Changing Minds via Roleplay in Interactive Digital Media

Pablo Jose Ortiz-Lampier

D. Fox Harrell

Leads

Pablo Jose Ortiz-Lampier

D. Fox Harrell

Research Areas

Impact Areas

Pablo Jose Ortiz-Lampier

D. Fox Harrell

Project

CilkPride

CilkPride is a programming environment that aims to make performance and safety information always available and appropriately visible to the programmer.

Charles E. Leiserson

Rob Miller

Leads

Charles E. Leiserson

Rob Miller

Research Areas

Charles E. Leiserson

Rob Miller

Project

Computational Knitting: Patterning and Shaping for Everyone

Knitting is the new 3d printing. It has become popular again with the widespread availability of patterns and templates, together with the maker movements. Lower-cost industrial knitting machines are starting to emerge, but we are still missing the corresponding design tools. Our goal is to fill this gap.

Alexandre Kaspar

Leads

Alexandre Kaspar

Research Areas

Impact Areas

Alexandre Kaspar

Project

Controlling drones and other robots with gestures

Interact with robots and other devices by gesturing, using wearable muscle and motion sensors

Joseph DelPreto

Leads

Joseph DelPreto

Research Areas

Joseph DelPreto

Project

Crowdsourcing in Graphics and Vision

Our goal is to develop new applications and algorithms that leverage the skills of distributed crowdworkers, notably for image and video processing applications.

Alexandre Kaspar

Leads

Alexandre Kaspar

Research Areas

Impact Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

Alexandre Kaspar

Project

Culturally-Grounded Virtual Identities: A Case Study in a Qatari Context

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Impact Areas

D. Fox Harrell

Project

Determining Wikipedia's Influence on Science

Supertech Research Group

Wikipedia is one of the most widely accessed encyclopedia sites in the world, including by scientists. Our project aims to investigate just how far Wikipedia’s influence goes in shaping science.

Neil Thompson

Charles E. Leiserson

Leads

Neil Thompson

Charles E. Leiserson

Research Areas

Impact Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

Neil Thompson

Charles E. Leiserson

Project

Developing the Impacts of Virtual Identity on Computational Learning Environments

Our goal is to develop an understanding of the impacts of virtual identities on users in educational environments.

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

D. Fox Harrell

Project

Distributed Robot Garden

The robot garden provides an aesthetically pleasing educational platform that can visualize computer science concepts and encourage young students to pursue programming and robotics.

Leads

Joseph DelPreto

Lindsay Sanneman

Daniela Rus

Research Areas

Impact Areas

Project

Déjà Vu: Constructing Apps from Concepts

Déjà Vu is a new platform for end-user development of apps with rich functionality. It features a novel theory of modularity for binding concepts; an extensive library of reusable concepts; and a WYSIWYG tool for specifying bindings and customizing visual layout

Daniel Jackson

Leads

Daniel Jackson

Research Areas

Interactive Robotics Group

Daniel Jackson

Project

Efficient Communication for Human-Machine Teams

Our goal is to develop collaborative agents (software or robots) that can efficiently communicate with their human teammates. Key threads involve designing algorithms for inferring human behavior and for decision-making under uncertainty.

X. Jessie Yang

Julie Shah

Leads

Julie Shah

Research Areas

Impact Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

X. Jessie Yang

Julie Shah

Project

Enriching Virtual Reality (VR) Narratives with Embodied and Gestural Interaction

Building embodied and gestural interfaces to enrich interaction in VR narratives.

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

D. Fox Harrell

Project

Eyebrowse: Social and Public Web Browsing

Eyebrowse aims to create a social outdoors for your web browsing.

David Karger

Leads

David Karger

Research Areas

Impact Areas

David Karger

Project

Gitless: a simple version control system built on top of Git

Gitless is a conceptual redesign of Git which attempts to make Git easier to learn and use

Daniel Jackson

Leads

Daniel Jackson

Research Areas

Daniel Jackson

Project

Helping robots learn using demonstrations

Help robots learn faster by providing demonstrations when they need help

Joseph DelPreto

Leads

Joseph DelPreto

Research Areas

Impact Areas

Joseph DelPreto

28 People Results

Murad Abu-Khalaf

Program Manager, Toyota-CSAIL Joint Research Center

E murad@mit.edu

T 452-2859

PI
Core/Dual

Randall Davis

Professor

Human-computer interaction, systems, classic AI

E davis@csail.mit.edu

T 253-5879

Lead

Multimodal Understanding Group

Member

Supervising Robots with Muscle and Brain Signals

Human-computer interaction, systems, classic AI

Joseph DelPreto

Graduate Student

Works on human-robot interaction using muscle and brain signals.

E delpreto@csail.mit.edu

RM 32-376A

Lead

Brain-Controlled Robots

Distributed Robot Garden

Robot Compiler

SoFi - The Soft Robotic Fish

Soft Robotic Hand

Using Muscle Signals to Lift Objects with Robots

Controlling drones and other robots with gestures

Helping robots learn using demonstrations

Member

Works on human-robot interaction using muscle and brain signals.

Mustafa Doga Dogan

Graduate Student

E doga@mit.edu

Member

Sue Felshin

Research Scientist

E sfelshin@csail.mit.edu

T 253-2965

Lead

Member

PI
Core/Dual

Jim Glass

Senior Research Scientist

speech and language processing

E glass@mit.edu

T 253-1640

Lead

Designing Information-Rich Embedding Spaces

Unsupervised Learning of Interpretable Representations from Sequential Data

Fact-Checking and Reasoning

Speaker Verification and Diarization

Using Computers to Eat Healthier

Member

Low-Power Speech Processing Circuits

Crossing the Vision-Language Boundary

Arabic Language Processing

Health-related Biomarkers from Speech

Community Question Answering

Understanding Language Representations in Deep Learning Models

speech and language processing

Lelia Hampton

Graduate Student

Ph.D. Student

E lelia@mit.edu

Ph.D. Student

PI
Core/Dual

Daniel Jackson

Professor

Software design, programming, systems

E dnj@csail.mit.edu

T 258-8471

Lead

Rethinking Software Design

Gitless: a simple version control system built on top of Git

Déjà Vu: Constructing Apps from Concepts

Security by Design for Cyberphysical Systems

Poirot: Secure Protocol Implementation by Design

An Interlock for Self Driving Cars

Alloy

Member

Espalier

Software design, programming, systems

PI
Core/Dual

David Karger

Professor

Helping people manage information

E karger@csail.mit.edu

T 258-6167

Lead

Mavo: Creating Interactive Data-Driven Web Applications by Authoring HTML

Algorithms Group

Wikum: Bridging Discussion Systems and Wikis with Collective Summarization

Squadbox: Combating Online Harassment using Friendsourced Moderation

Eyebrowse: Social and Public Web Browsing

Talkademic: Motivating Online Academic Discourse

Member

Crowdsourcing in Graphics and Vision

Helping people manage information

Alexandre Kaspar

Graduate Student

Graphics, crowdsourcing and hybrid fabrication.

E akaspar@mit.edu

Lead

Computational Knitting: Patterning and Shaping for Everyone

Graphics, crowdsourcing and hybrid fabrication.

PI
Core/Dual

Boris Katz

Principal Research Scientist

Natural language processing

E boris@csail.mit.edu

T 253-6032

Lead

Semantic Parsing using Vision

Generating Plans for Agents using Video and Language

Inferring “Theory of Mind” with vision and language

Artificial Social Intelligence for Successful Teams (ASIST)

Member

Center for Brains, Minds and Machines

Natural language processing

Sameer Khurana

Graduate Student

unsupervised speech processing, automatic speech recognition

E skhurana@mit.edu

Lead

Member

unsupervised speech processing, automatic speech recognition

Kimberle Koile

Lecturer

E kkoile@csail.mit.edu

Henry Lieberman

Research Scientist

Henry Lieberman is a Research Scientist at MIT CSAIL, in AI and HCI.

E lieber@MEDIA.MIT.EDU

Henry Lieberman is a Research Scientist at MIT CSAIL, in AI and HCI.

Jamie Macbeth

Research Affiliate

In-Depth Natural Language Understanding, Human-Computer Interaction

E jmacbeth@mit.edu

In-Depth Natural Language Understanding, Human-Computer Interaction

PI
Core/Dual

Wojciech Matusik

Professor

Graphics, vision, fabrication, robotics, hci

E wojciech@csail.mit.edu

T 324-8432

Lead

Computational Multicopter Design

Computer Graphics Group

Member

Simit: A Language for Computing on Sparse Systems

InstantCAD: Interactive Design Exploration/Optimization for CAD Models

Visual Computing Community of Research

Graphics, vision, fabrication, robotics, hci

PI
Core/Dual

Rob Miller

Professor

Human-computer interaction, online education, software development

E rcm@csail.mit.edu

T 324-6028

Lead

Wait-learning: Intelligent Systems for Making Productive Use of Wait Time

CilkPride

Member

Human-computer interaction, online education, software development

PI
Core/Dual

Stefanie Mueller

Assistant Professor

Human-computer interaction, fabrication, hardware, robotics.

E stefanie.mueller@mit.edu

T 715-5831

Lead

New Interaction Models for Personal Fabrication Interfaces

Human-computer interaction, fabrication, hardware, robotics.

Martin Nisser

Graduate Student

E nisser@mit.edu

Member

Soyun Park

Graduate Student

Human-Computer Interaction(HCI), personal information retrieval

E soya@mit.edu

Member

Human-Computer Interaction(HCI), personal information retrieval

PI
Core/Dual

Arvind Satyanarayan

Assistant Professor

E arvindsatya@mit.edu

Lead

Center for Deployable Machine Learning (CDML)

Member

Nouran Soliman

Graduate Student

Nouran is a PhD Student in EECS at MIT working with David Karger.

E nouran@mit.edu

Nouran is a PhD Student in EECS at MIT working with David Karger.

Dishita Turakhia

Graduate Student

PhD student in HCIE group at CSAIL

E dishita@mit.edu

Member