Research

Impact Areas
Research Areas

Filter options

1 People Results matching all criteria

Henry Lieberman

Research Scientist

Henry Lieberman is a Research Scientist at MIT CSAIL, in AI and HCI.

E lieber@MEDIA.MIT.EDU

Henry Lieberman is a Research Scientist at MIT CSAIL, in AI and HCI.

1 News Results matching all criteria

Barbara Liskov 2

Algorithms & Theory AI & ML Computational Biology Computer Architecture Graphics & Vision Human-Computer Interaction Programming Languages & Software Engineering Robotics Security & Cryptography Systems & Networking Cybersecurity Education Energy Entertainment Health Care Manufacturing Transportation Wireless

June 27 '19

CSAIL hosts first-ever TEDxMIT

Speakers — all women — discuss everything from gravitational waves to robot nurses

CSAIL hosts first-ever TEDxMIT

18 Group Results

Community of Research

Applied Machine Learning Community of Research

This CoR brings together researchers at CSAIL working across a broad swath of application domains. Within these lie novel and challenging machine learning problems serving science, social science and computer science.

+6

Una-May O'Reilly

Leads

Una-May O'Reilly

Research Areas

Computational Biology

Programming Languages & Software Engineering

Impact Areas

Lead

Una-May O'Reilly

Una-May O'Reilly

Community of Research

Cognitive AI Community of Research

This CoR aims to develop AI technology that synthesizes symbolic reasoning, probabilistic reasoning for dealing with uncertainty in the world, and statistical methods for extracting and exploiting regularities in the world, into an integrated picture of intelligence that is informed by computational insights and by cognitive science.

+6

Howard Shrobe

Leads

Howard Shrobe

Research Areas

Human-Computer Interaction

Security & Cryptography

Systems & Networking

Impact Areas

Lead

Howard Shrobe

Howard Shrobe

Community of Research

Computing & Society Community of Research

This community is interested in understanding and affecting the interaction between computing systems and society through engineering, computer science and public policy research, education, and public engagement.

+8

Daniel Weitzner

Leads

Daniel Weitzner

Research Areas

Algorithms & Theory

Human-Computer Interaction

Security & Cryptography

Systems & Networking

Impact Areas

Internet of Things

Lead

Daniel Weitzner

Daniel Weitzner

Research Group

Decentralized Information Group

We are investigating decentralized technologies that affect social change.

+5

Lalana Kagal

Tim Berners-Lee

Leads

Lalana Kagal

Tim Berners-Lee

Research Areas

Algorithms & Theory

Programming Languages & Software Engineering

Systems & Networking

Impact Areas

Internet of Things

Lead

Lalana Kagal

Tim Berners-Lee

Lalana Kagal

Tim Berners-Lee

Research Group

Haystack Group

We are an interdisciplinary group of researchers blending approaches from human-computer interaction, social computing, databases, information management, and databases.

Lea Verou

+2

David Karger

Leads

David Karger

Research Areas

Algorithms & Theory

Human-Computer Interaction

Programming Languages & Software Engineering

Impact Areas

Internet of Things

Lead

David Karger

Lea Verou

David Karger

Research Group

HCI Engineering Group

We work at the intersection of human computer interaction and personal fabrication tools.

+2

Stefanie Mueller

Leads

Stefanie Mueller

Research Areas

Human-Computer Interaction

Impact Areas

Internet of Things

Lead

Stefanie Mueller

Stefanie Mueller

Community of Research

Human-Computer Interaction Community of Research

The focus of the HCI CoR is inventing new systems and technology that lie at the interface between people and computation, and understanding their design, implementation, and societal impact.

+4

Stefanie Mueller

Leads

Stefanie Mueller

Research Areas

Graphics & Vision

Human-Computer Interaction

Programming Languages & Software Engineering

Impact Areas

Lead

Stefanie Mueller

Stefanie Mueller

Research Group

Imagination, Computation, and Expression Laboratory (ICE Lab)

We develop computing systems for creative expression, cultural analysis, and social change.

Peter Mawhorter

+1

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Human-Computer Interaction

Impact Areas

Lead

D. Fox Harrell

Peter Mawhorter

D. Fox Harrell

Research Group

Infolab

We investigate language in different contexts: from how it is learned, to how it is grounded in visual perception, all the way to how machines can readily interact with humans.

+2

Boris Katz

Leads

Boris Katz

Research Areas

Human-Computer Interaction

Impact Areas

Internet of Things

Lead

Boris Katz

Boris Katz

Research Group

MIT App Inventor

MIT App Inventor is an intuitive, visual programming environment that allows everyone – even children – to build fully functional apps for smartphones and tablets.

Hal Abelson

Leads

Hal Abelson

Research Areas

Programming Languages & Software Engineering

Systems & Networking

Impact Areas

Internet of Things

Lead

Hal Abelson

Hal Abelson

Research Group

Multimodal Understanding Group

Our objective is to build techniques, software, and hardware that enable natural interaction with
computation.

Randall Davis

Leads

Randall Davis

Research Areas

Algorithms & Theory

Human-Computer Interaction

Impact Areas

Lead

Randall Davis

Randall Davis

Research Group

Programming Languages and Software Engineering

We research programming languages, software engineering, and related work in human-computer interaction.

Leads

Research Areas

Programming Languages & Software Engineering

Impact Areas

Research Group

Software Design Group

Our goal is to find better ways to make software, and ways to make software better.

Daniel Jackson

Leads

Daniel Jackson

Research Areas

Human-Computer Interaction

Programming Languages & Software Engineering

Security & Cryptography

Impact Areas

Lead

Daniel Jackson

Daniel Jackson

Research Group

Spoken Language Systems Group

Our goal is to create technology that makes it possible for everyone in the world to interact with with computers via natural spoken language.

+7

Jim Glass

Leads

Jim Glass

Research Areas

Human-Computer Interaction

Impact Areas

Internet of Things

Lead

Jim Glass

Jim Glass

Research Group

Sussman Lab

We focus on understanding the problem-solving strategies used by scientists and engineers, with the goals of automating parts of the process and formalizing educational methods.

Gerald Sussman

Leads

Gerald Sussman

Research Areas

Programming Languages & Software Engineering

Systems & Networking

Impact Areas

Lead

Gerald Sussman

Gerald Sussman

Research Group

Usable Programming Group

We design and study systems that improve the learnability, efficiency, and safety of software development.

Rob Miller

Leads

Rob Miller

Research Areas

Human-Computer Interaction

Programming Languages & Software Engineering

Systems & Networking

Impact Areas

Lead

Rob Miller

Rob Miller

Community of Research

Vertical AI Community of Research

This CoR takes a unified approach to cover the full range of research areas required for success in artificial intelligence, including hardware, foundations, software systems, and applications.

+7

Martin Rinard

Leads

Martin Rinard

Research Areas

Algorithms & Theory

Graphics & Vision

Programming Languages & Software Engineering

Security & Cryptography

Systems & Networking

Impact Areas

Internet of Things

Lead

Martin Rinard

Martin Rinard

Research Group

Visualization Group

We use visualization as a petri dish to study intelligence augmentation, or how can computational representations and software systems help amplify our cognition and creativity, while respecting our agency?

+3

Arvind Satyanarayan

Leads

Arvind Satyanarayan

Research Areas

Human-Computer Interaction

Programming Languages & Software Engineering

Impact Areas

Lead

Arvind Satyanarayan

Arvind Satyanarayan

23 Project Results

Project

Active Learning of Models for Planning

Learning and Intelligent Systems

Machine Learning

We aim to develop a systematic framework for robots to build models of the world and to use these to make effective and safe choices of actions to take in complex scenarios.

Leslie Kaelbling

Tomas Lozano-Perez

Leads

Leslie Kaelbling

Tomas Lozano-Perez

Research Areas

Algorithms & Theory

Human-Computer Interaction

Impact Areas

Leslie Kaelbling

Tomas Lozano-Perez

Project

AIRvatar System: A Framework for Analyzing Virtual Identities

Imagination, Computation, and Expression Laboratory (ICE Lab)

Human-Computer Interaction Community of Research

AIRvatar is a system that telemetrically collects and analyzes fine-grained data on users’ virtual identities and the process used to create them.

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Graphics & Vision

Human-Computer Interaction

Impact Areas

D. Fox Harrell

Project

Alloy

Software Design Group

Human-Computer Interaction Community of Research

Alloy is a language for describing structures and a tool for exploring them. It has been used in a wide range of applications from finding holes in security mechanisms to designing telephone switching networks. Hundreds of projects have used Alloy for design analysis, for verification, for simulation, and as a backend for many other kinds of analysis and synthesis tools, and Alloy is currently being taught in courses worldwide.

Daniel Jackson

Leads

Daniel Jackson

Research Areas

Human-Computer Interaction

Programming Languages & Software Engineering

Security & Cryptography

Impact Areas

Daniel Jackson

Project

Artificial Social Intelligence for Successful Teams (ASIST)

Computation Structures Group

Computational Cognitive Science Group

Model-Based Embedded and Robotics Systems Group

Our goal is to develop a socially intelligent team coacher agent that helps humans communicate, strategize, and work together efficiently.

Leads

Howard Shrobe

Brian Williams

Boris Katz

Zhutian Yang

Research Areas

Computer Architecture

Human-Computer Interaction

Impact Areas

Project

Automatic Speech Recognition

Spoken Language Systems Group

Automatic speech recognition (ASR) has been a grand challenge machine learning problem for decades. Our ongoing research in this area examines the use of deep learning models for distant and noisy recording conditions, multilingual, and low-resource scenarios.

Sameer Khurana

Jim Glass

Leads

Sameer Khurana

Jim Glass

Research Areas

Human-Computer Interaction

Impact Areas

Internet of Things

Sameer Khurana

Jim Glass

Project

The Car Can Explain!

Decentralized Information Group

Cognitive AI Community of Research

Computing & Society Community of Research

Developing techniques to allow self-driving cars and other AI-driven systems to explain behaviors and failures.

Gerald Sussman

Lalana Kagal

Leads

Gerald Sussman

Lalana Kagal

Research Areas

Human-Computer Interaction

Systems & Networking

Impact Areas

Gerald Sussman

Lalana Kagal

Project

Changing Minds via Roleplay in Interactive Digital Media

Imagination, Computation, and Expression Laboratory (ICE Lab)

Human-Computer Interaction Community of Research

We aim to study the impact of computer-supported roleplaying in changing social perspectives of digital media users. Such media could take the form of videogames, VR systems, training software, and other types of interactive narrative technology.

Pablo Jose Ortiz-Lampier

D. Fox Harrell

Leads

Pablo Jose Ortiz-Lampier

D. Fox Harrell

Research Areas

Human-Computer Interaction

Impact Areas

Pablo Jose Ortiz-Lampier

D. Fox Harrell

Project

Crowdsourcing in Graphics and Vision

Computational Design and Fabrication Group

Our goal is to develop new applications and algorithms that leverage the skills of distributed crowdworkers, notably for image and video processing applications.

Alexandre Kaspar

Leads

Alexandre Kaspar

Research Areas

Graphics & Vision

Human-Computer Interaction

Impact Areas

Alexandre Kaspar

Project

Culturally-Grounded Virtual Identities: A Case Study in a Qatari Context

Imagination, Computation, and Expression Laboratory (ICE Lab)

Human-Computer Interaction Community of Research

Mixed-methods qualitative (interviews and coding) and computational (AI) approach to understanding relationships between social identities, cultural values, and virtual identity technologies (e.g., online profiles and avatars).

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Human-Computer Interaction

Impact Areas

D. Fox Harrell

Project

Determining Wikipedia's Influence on Science

Supertech Research Group

Wikipedia is one of the most widely accessed encyclopedia sites in the world, including by scientists. Our project aims to investigate just how far Wikipedia’s influence goes in shaping science.

Neil Thompson

Charles E. Leiserson

Leads

Neil Thompson

Charles E. Leiserson

Research Areas

Algorithms & Theory

Human-Computer Interaction

Programming Languages & Software Engineering

Impact Areas

Neil Thompson

Charles E. Leiserson

Project

Distributed Robot Garden

Distributed Robotics Laboratory

The robot garden provides an aesthetically pleasing educational platform that can visualize computer science concepts and encourage young students to pursue programming and robotics.

Leads

Joseph DelPreto

Lindsay Sanneman

Daniela Rus

Research Areas

Algorithms & Theory

Human-Computer Interaction

Programming Languages & Software Engineering

Impact Areas

Project

Low-Power Speech Processing Circuits

Spoken Language Systems Group

The creation of low-power circuits capable of speech recognition and speaker verification will enable spoken interaction on a wide variety of devices in the era of Internet of Things.

Leads

Research Areas

Computer Architecture

Human-Computer Interaction

Impact Areas

Internet of Things

Project

Robot Compiler

Distributed Robotics Laboratory

The Robot Compiler allows non-engineering users to rapidly fabricate customized robots, facilitating the proliferation of robots in everyday life. It thereby marks an important step towards the realization of personal robots that have captured imaginations for decades.

Leads

Joseph DelPreto

Andrew Spielberg

Daniela Rus

Research Areas

Algorithms & Theory

Human-Computer Interaction

Impact Areas

Internet of Things

Project

Solid: Social Linked Data

Decentralized Information Group

Cognitive AI Community of Research

Computing & Society Community of Research

Solid aims to radically change the way Web applications work today, resulting in true data ownership as well as improved privacy.

Tim Berners-Lee

Lalana Kagal

Leads

Tim Berners-Lee

Lalana Kagal

Research Areas

Programming Languages & Software Engineering

Systems & Networking

Impact Areas

Internet of Things

Tim Berners-Lee

Lalana Kagal

Project

Supervising Robots with Muscle and Brain Signals

Distributed Robotics Laboratory

What if we could control robots more intuitively, using just hand gestures and brainwaves?

Joseph DelPreto

Leads

Joseph DelPreto

Research Areas

Human-Computer Interaction

Impact Areas

Joseph DelPreto

Project

Talkademic: Motivating Online Academic Discourse

Human-Computer Interaction Community of Research

This research aims to build a system to facilitate online academic conversations.

David Karger

Leads

David Karger

Research Areas

Human-Computer Interaction

Impact Areas

David Karger

Project

Tiramisu Compiler

A polyhedral compiler for expressing image processing, DNN, and linear/tensor algebra applications

Saman Amarasinghe

Leads

Saman Amarasinghe

Research Areas

Computer Architecture

Programming Languages & Software Engineering

Systems & Networking

Impact Areas

Internet of Things

Saman Amarasinghe

Project

Uhura: Personal Assistant that Manages Risk

Model-Based Embedded and Robotics Systems Group

Computation Structures Group

Uhura is an autonomous system that collaborates with humans in planning and executing complex tasks, especially under over-subscribed and risky situations.

Leads

Yuening Zhang

Brian Williams

Howard Shrobe

Research Areas

Algorithms & Theory

Human-Computer Interaction

Impact Areas

Project

Unsupervised Speech Processing

Spoken Language Systems Group

All humans process vast quantities of unannotated speech and manage to learn phonetic inventories, word boundaries, etc., and can use these abilities to acquire new word. Why can't ASR technology have similar capabilities? Our goal in this research project is to build speech technology using unannotated speech corpora.

Yu-An Chung

Sameer Khurana

Leads

Yu-An Chung

Sameer Khurana

Research Areas

Human-Computer Interaction

Impact Areas

Yu-An Chung

Sameer Khurana

Project

Wait-learning: Intelligent Systems for Making Productive Use of Wait Time

Usable Programming Group

Human-Computer Interaction Community of Research

Wait-learning makes it easier for busy people to learn informally, by automatically detecting when they are waiting and delivering optional learning exercises that can be completed during wait time.

Rob Miller

Leads

Rob Miller

Research Areas

Human-Computer Interaction

Impact Areas

Rob Miller

Project

Wearable Blind Navigation

Distributed Robotics Laboratory

We enable independent navigation for visually impaired users through a wearable feedback system using time-of-light sensors or depth cameras.

Leads

Research Areas

Graphics & Vision

Human-Computer Interaction

Impact Areas

Project

Wearable Ultrasonic Echolocation

The goal of this project is to develop and test a wearable ultrasonic echolocation aid for people who are blind and visually impaired. We combine concepts from engineering, acoustic physics, and neuroscience to make echolocation accessible as a research tool and mobility aid.

Santani Teng

Leads

Santani Teng

Research Areas

Human-Computer Interaction

Impact Areas

Santani Teng

Project

Wikum: Bridging Discussion Systems and Wikis with Collective Summarization

Human-Computer Interaction Community of Research

Theory of Computation Community of Research

We build tools to allow a community of people to collectively summarize large discussions online and manage knowledge embedded within these discussions.

David Karger

Leads

David Karger

Research Areas

Human-Computer Interaction

Impact Areas

David Karger

20 People Results

Mustafa Doga Dogan

Graduate Student

E doga@mit.edu

RM

Member

HCI Engineering Group

PI
Core/Dual

Fredo Durand

Professor

Vision, graphics, computational photography

E fredo@csail.mit.edu

T 253-7223

RM

Lead

Computer Graphics Group

Human-Computer Interaction

Computational Understanding of Visualizations and Graphic Designs

Member

Computational Bounce Flash for Indoor Portraits

Visual Computing Community of Research

Vision, graphics, computational photography

R. David Edelman

Director, Project on Technology, Economy & National Security

Machine learning, cybersecurity, governance

E rde@mit.edu

T 258-6389

Machine learning, cybersecurity, governance

Sue Felshin

Research Scientist

E sfelshin@csail.mit.edu

T 253-2965

RM

Lead

Member

PI
Core/Dual

Jim Glass

Senior Research Scientist

speech and language processing

E glass@mit.edu

T 253-1640

RM

Lead

Spoken Language Systems Group

Designing Information-Rich Embedding Spaces

Unsupervised Learning of Interpretable Representations from Sequential Data

Fact-Checking and Reasoning

Speaker Verification and Diarization

Automatic Speech Recognition

Language and Dialect Identification

Member

Using Computers to Eat Healthier

Low-Power Speech Processing Circuits

Crossing the Vision-Language Boundary

Unsupervised Speech Processing

Arabic Language Processing

Health-related Biomarkers from Speech

Community Question Answering

Understanding Language Representations in Deep Learning Models

Embodied Intelligence Community of Research

speech and language processing

Lelia Hampton

Graduate Student

Ph.D. Student

E lelia@mit.edu

Ph.D. Student

PI
Core/Dual

Daniel Jackson

Professor

Software design, programming, systems

E dnj@csail.mit.edu

T 258-8471

RM

Lead

Human-Computer Interaction

Software Design Group

Rethinking Software Design

Gitless: a simple version control system built on top of Git

Déjà Vu: Constructing Apps from Concepts

Security by Design for Cyberphysical Systems

Poirot: Secure Protocol Implementation by Design

An Interlock for Self Driving Cars

Member

Human-Computer Interaction Community of Research

Systems Community of Research

Software design, programming, systems

PI
Core/Dual

David Karger

Professor

Helping people manage information

E karger@csail.mit.edu

T 258-6167

RM

Lead

Human-Computer Interaction

Algorithms Group

Mavo: Creating Interactive Data-Driven Web Applications by Authoring HTML

Wikum: Bridging Discussion Systems and Wikis with Collective Summarization

Squadbox: Combating Online Harassment using Friendsourced Moderation

Eyebrowse: Social and Public Web Browsing

Talkademic: Motivating Online Academic Discourse

Member

Human-Computer Interaction Community of Research

Theory of Computation Community of Research

Systems Community of Research

Helping people manage information

PI
Core/Dual

Boris Katz

Principal Research Scientist

Natural language processing

E boris@csail.mit.edu

T 253-6032

RM

Lead

Semantic Parsing using Vision

Generating Plans for Agents using Video and Language

Inferring “Theory of Mind” with vision and language

Artificial Social Intelligence for Successful Teams (ASIST)

Member

Center for Brains, Minds and Machines

Cognitive AI Community of Research

Natural language processing

Sameer Khurana

Graduate Student

unsupervised speech processing, automatic speech recognition

E skhurana@mit.edu

RM

Lead

Automatic Speech Recognition

Unsupervised Speech Processing

Language and Dialect Identification

Member

Spoken Language Systems Group

unsupervised speech processing, automatic speech recognition

Kimberle Koile

Research Scientist

E kkoile@csail.mit.edu

RM

Henry Lieberman

Research Scientist

Henry Lieberman is a Research Scientist at MIT CSAIL, in AI and HCI.

E lieber@MEDIA.MIT.EDU

Henry Lieberman is a Research Scientist at MIT CSAIL, in AI and HCI.

PI
Core/Dual

Albert R. Meyer

Professor Emeritus

Programming languages, theory, complexity, online education

E meyer@csail.mit.edu

T 253-6024

RM

Programming languages, theory, complexity, online education

PI
Core/Dual

Rob Miller

Professor

Human-computer interaction, online education, software development

E rcm@csail.mit.edu

T 324-6028

RM

Lead

Human-Computer Interaction

Usable Programming Group

Wait-learning: Intelligent Systems for Making Productive Use of Wait Time

Member

Human-Computer Interaction Community of Research

Human-computer interaction, online education, software development

Nouran Soliman

Graduate Student

Nouran is a PhD Student in EECS at MIT working with David Karger.

E nouran@mit.edu

Nouran is a PhD Student in EECS at MIT working with David Karger.

PI
Core/Dual

Gerald Sussman

Professor

Artificial intelligence, supercomputers

E gjs@csail.mit.edu

T 253-5874

RM 32/ 32-G508/ G514

Lead

The Car Can Explain!

Internet Policy Research Initiative

Member

Cognitive AI Community of Research

Computing & Society Community of Research

Artificial intelligence, supercomputers

Dishita Turakhia

Graduate Student

PhD student in HCIE group at CSAIL

E dishita@mit.edu

RM

Member

HCI Engineering Group

PhD student in HCIE group at CSAIL

Victor Ying

Graduate Student

Computer architecture, parallel computing, programming models

E victory@mit.edu

RM

Lead

Pervasive Parallelism with the Swarm Architecture

Computer architecture, parallel computing, programming models

Junyi Zhu

Graduate Student

E junyizhu@mit.edu

RM

Member

HCI Engineering Group

PI
Core/Dual

Victor Zue

Professor

Spoken language systems, human language technologies

E zue@csail.mit.edu

T 253-8513

RM

Member

Spoken Language Systems Group

Spoken language systems, human language technologies

8 News Results

Barbara Liskov 2

Algorithms & Theory AI & ML Computational Biology Computer Architecture Graphics & Vision Human-Computer Interaction Programming Languages & Software Engineering Robotics Security & Cryptography Systems & Networking Cybersecurity Education Energy Entertainment Health Care Manufacturing Transportation Wireless

June 27 '19

CSAIL hosts first-ever TEDxMIT

Speakers — all women — discuss everything from gravitational waves to robot nurses

CSAIL hosts first-ever TEDxMIT

Amy zhang

Programming Languages & Software Engineering Systems & Networking Education

April 05 '18

Using friends to fight online harassment

CSAIL’s “Squadbox” uses “friendsourcing” to better support targets of cyberbullying.

Using friends to fight online harassment

F. Harrell

AI & ML Programming Languages & Software Engineering Education Entertainment

January 31 '18

3Q: D. Fox Harrell on his video game for the #MeToo era

The Imagination, Computation, and Expression Laboratory at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) has released a new video game called Grayscale, which is designed to sensitize players to problems of sexism, sexual harassment, and sexual assault in the workplace.

3Q: D. Fox Harrell on his video game for the #MeToo era

neural nets

AI & ML Human-Computer Interaction Big Data Education Entertainment Health Care Internet of Things

December 11 '17

Reading a neural network’s mind

Neural networks, which learn to perform computational tasks by analyzing huge sets of training data, have been responsible for the most impressive recent advances in artificial intelligence, including speech-recognition and automatic-translation systems.

Reading a neural network’s mind

WaitSuite opens up new possibilities for "micro-learning," leveraging idle moments like when you're waiting to connect to WiFi or refresh your email.

AI & ML Human-Computer Interaction Education Internet of Things

April 18 '17

Learn a language while you wait for WiFi

Hyper-connectivity has changed the way we communicate, wait, and productively use our time. Even in a world of 5G wireless and “instant” messaging, there are countless moments throughout the day when we’re waiting for messages, texts, and Snapchats to refresh. But our frustrations with waiting a few extra seconds for our emails to push through doesn’t mean we have to simply stand by.

Learn a language while you wait for WiFi

Bill Thies

Human-Computer Interaction Education Health Care

February 08 '17

Frugal Innovations for a Developing World

February 8, 2017 - Bill Thies of Microsoft Research India gave a Dertouzos Distinguished Lecture titled "Frugal Innovations for a Developing World."

Frugal Innovations for a Developing World

A prototype of a new speech-controlled nutrition-logging system allows users to verbally describe the contents of a meal. The system then parses the description and automatically retrieves the pertinent nutritional data.

AI & ML Human-Computer Interaction Health Care

March 24 '16

Voice-controlled calorie counter

For people struggling with obesity, logging calorie counts and other nutritional information at every meal is a proven way to lose weight. The technique does require consistency and accuracy, however, and when it fails, it’s usually because people don't have the time to find and record all the information they need.A few years ago, a team of nutritionists from Tufts University who had been experimenting with mobile-phone apps for recording caloric intake approached members of the Spoken Language Systems Group at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL), with the idea of a spoken-language application that would make meal logging even easier.

Voice-controlled calorie counter

System that learns to distinguish words’ phonemes could aid development of speech-processing systems for under-studied languages

AI & ML Human-Computer Interaction Big Data Education Entertainment Internet of Things

September 14 '15

Learning spoken language

Every language has its own collection of phonemes, or the basic phonetic units from which spoken words are composed. Depending on how you count, English has somewhere between 35 and 45. Knowing a language’s phonemes can make it much easier for automated systems to learn to interpret speech.In the 2015 volume of Transactions of the Association for Computational Linguistics, CSAIL researchers describe a new machine-learning system that, like several systems before it, can learn to distinguish spoken words. But unlike its predecessors, it can also learn to distinguish lower-level phonetic units, such as syllables and phonemes.

Learning spoken language