Research

Impact Areas

Lead

Justin Solomon

Community of Research

Human-Computer Interaction Community of Research

The focus of the HCI CoR is inventing new systems and technology that lie at the interface between people and computation, and understanding their design, implementation, and societal impact.

Stefanie Mueller

Leads

Stefanie Mueller

Research Areas

Programming Languages & Software Engineering

Impact Areas

Lead

Stefanie Mueller

Community of Research

Vertical AI Community of Research

This CoR takes a unified approach to cover the full range of research areas required for success in artificial intelligence, including hardware, foundations, software systems, and applications.

Martin Rinard

Leads

Martin Rinard

Research Areas

Algorithms & Theory

Programming Languages & Software Engineering

Security & Cryptography

Systems & Networking

Impact Areas

Lead

Martin Rinard

Research Group

Vision Group

Our researchers create state-of-the-art systems to better recognize objects, people, scenes, behaviors and more, with applications in health-care, gaming, tagging systems and more.

Leads

Ted Adelson

Fredo Durand

John Fisher

William Freeman

Polina Golland

Eric Grimson

Berthold Horn

Aude Oliva

Antonio Torralba

Research Areas

Impact Areas

Lead

Ted Adelson

Fredo Durand

John Fisher

William Freeman

Polina Golland

Eric Grimson

Berthold Horn

Aude Oliva

Antonio Torralba

Community of Research

Visual Computing Community of Research

The shared mission of Visual Computing is to connect images and computation, spanning topics such as image and video generation and analysis, photography, human perception, touch, applied geometry, and more.

+10

William Freeman

Leads

William Freeman

Research Areas

Impact Areas

Lead

William Freeman

+10

William Freeman

16 Project Results

Project

3D Generative Adversarial Networks

Cognitive AI Community of Research

We study the problem of 3D object generation. We propose a novel framework, 3D Generative Adversarial Network (3D-GAN), leveraging recent advances in volumetric convolutional networks and generative adversarial nets.

Leads

Research Areas

Impact Areas

Computational Cognitive Science Group

Project

A Counterfactual Simulation Model of Causal Judgment

Cognitive AI Community of Research

We develop a computational model that explains how people make causal judgments in physical scenes by mentally simulating counterfactual outcomes and comparing those to what actually happened.

Leads

Research Areas

Impact Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

Project

AIRvatar System: A Framework for Analyzing Virtual Identities

Human-Computer Interaction Community of Research

AIRvatar is a system that telemetrically collects and analyzes fine-grained data on users’ virtual identities and the process used to create them.

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Impact Areas

D. Fox Harrell

Project

Artificial Co-driver

By observing driver in real road situations, we learn a computer assistant that can make driving easier, safer and more enjoyable.

Leads

Research Areas

Impact Areas

Project

Characterizing the Sensitivity of Vision-in-the-Loop Driving Controllers Using CG

We work on understanding and improving vision algorithms used for self driving cars, by introducing synthetic data-sets to the loop.

Leads

Research Areas

Impact Areas

Computational Design and Fabrication Group

Project

Computational Knitting: Patterning and Shaping for Everyone

Knitting is the new 3d printing. It has become popular again with the widespread availability of patterns and templates, together with the maker movements. Lower-cost industrial knitting machines are starting to emerge, but we are still missing the corresponding design tools. Our goal is to fill this gap.

Alexandre Kaspar

Leads

Alexandre Kaspar

Research Areas

Impact Areas

Alexandre Kaspar

Project

Computational Multicopter Design

A system that can help you to design our own drone!

Tao Du

Leads

Tao Du

Research Areas

Robotics

Impact Areas

Energy

Computational Design and Fabrication Group

Tao Du

Project

Crowdsourcing in Graphics and Vision

Our goal is to develop new applications and algorithms that leverage the skills of distributed crowdworkers, notably for image and video processing applications.

Alexandre Kaspar

Leads

Alexandre Kaspar

Research Areas

Impact Areas

Big Data

Alexandre Kaspar

Project

Driver-Friendly Bilateral Control for Suppressing Traffic Instabilities

We are studying how best to implement bilateral control and make it acceptable to drivers

Berthold Horn

Leads

Berthold Horn

Research Areas

Robotics

Systems & Networking

Impact Areas

Berthold Horn

Project

Foundry: Design for Multi-Material 3-D Printing

A new approach for designs in multi-material fabrication

Leads

Research Areas

Impact Areas

Project

InstantCAD: Interactive Design Exploration/Optimization for CAD Models

Almost every object we use is developed with computer-aided design (CAD). While CAD programs are good for creating designs, using them to actually improve existing designs can be difficult and time-consuming.

Leads

Research Areas

Impact Areas

Project

Peripheral Vision and Driver Behavior

Our goal is to understand what drivers can perceive when they are not attending to the road ahead and the consequences of their perceptions for safety.

Leads

Research Areas

Impact Areas

Project

Sensible Deep Learning for 3D Data

Machine Learning

Developing state-of-the-art deep learning algorithms for analyzing and modeling 3D geometry

Justin Solomon

Leads

Justin Solomon

Research Areas

Impact Areas

Big Data

Justin Solomon

Project

Single-Image 3D Interpreter Network

Cognitive AI Community of Research

We aim to understand 3D object structure from a single image. We propose an end-to-end framework which sequentially estimates 2D keypoint heatmaps and 3D object structure, by training it on both real 2D-annotated images and synthetic 3D data and by integrating a 3D-to-2D projection layer.

Leads

Research Areas

Impact Areas

Distributed Robotics Laboratory

Project

Wearable Blind Navigation

We enable independent navigation for visually impaired users through a wearable feedback system using time-of-light sensors or depth cameras.

Leads

Research Areas

Robotics

Impact Areas

Project

Where Are They Looking?

Our goal is to build a system that predicts where people are looking in images. Given an image and the location of a head, our approach follows the gaze of the person and identifies the object being looked at.

Leads

Research Areas

Impact Areas

19 People Results

PI
Core/Dual

Ted Adelson

Professor

Vision, touch sensing, robotics

E adelson@csail.mit.edu

T 253-0645

Lead

Blood Pressure Imager

Member

Computational Multicopter Design

Vision, touch sensing, robotics

Mustafa Doga Dogan

Graduate Student

E doga@mit.edu

Member

HCI Engineering Group

Tao Du

Graduate Student

CS PhD student

E taodu@csail.mit.edu

Lead

CS PhD student

PI
Core/Dual

Fredo Durand

Professor

Vision, graphics, computational photography

E fredo@csail.mit.edu

T 253-7223

Lead

Computational Understanding of Visualizations and Graphic Designs

Member

Computational Bounce Flash for Indoor Portraits

Halide

Vision, graphics, computational photography

Michael Foshey

Mechanical Engineer/Project Manager

Additive Manufacturing, Robotics, Digital Fabrication

E mfoshey@mit.edu

Additive Manufacturing, Robotics, Digital Fabrication

PI
Core/Dual

William Freeman

Professor

Vision, machine learning, Bayesian modeling

E billf@csail.mit.edu

T 253-8828

Lead

Single-Image 3D Interpreter Network

Member

Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks

Learning the Arrow of Time from Videos

3D Generative Adversarial Networks

Vision, machine learning, Bayesian modeling

PI
Core/Dual

Berthold Horn

Professor

Vision, computational imaging

E bkph@csail.mit.edu

T 253-5863

Lead

Driver-Friendly Bilateral Control for Suppressing Traffic Instabilities

Member

Learning and Intelligent Systems

Vision, computational imaging

PI
Core/Dual

Leslie Kaelbling

Professor

Robotics, machine learning, motion planning

E lpk@csail.mit.edu

T 258-9695

Lead

Machine Learning

Learning and Optimization

Robotic Planning and Manipulation with Force Information

Reliable Robotic Construction of Multi-object Arrangements

Learning and Planning with Compressed Linear Expectation Models

Active Learning of Models for Planning

Task and Motion Planning for Autonomous Robots

Member

Crowdsourcing in Graphics and Vision

Robotics, machine learning, motion planning

Alexandre Kaspar

Graduate Student

Graphics, crowdsourcing and hybrid fabrication.

E akaspar@mit.edu

Lead

Computational Knitting: Patterning and Shaping for Everyone

Graphics, crowdsourcing and hybrid fabrication.

Fern Keniston

Senior Administrative Assistant

Research and Education Support

E fern@csail.mit.edu

T 253-5860

RM 32/ 32-250A/ 391

Member

Clinical Decision-Making Group

Research and Education Support

PI
Core/Dual

John Leonard

Professor

Robotics, navigation/mapping, self-driving cars

E jleonard@csail.mit.edu

T 253-5305

Lead

Marine Robotics Group

Self-Driving Vehicles

Member

Learning and Intelligent Systems

Robotics, navigation/mapping, self-driving cars

PI
Core/Dual

Tomas Lozano-Perez

Professor

Robotics, artificial intelligence

E tlp@csail.mit.edu

T 253-7889

Lead

Learning and Optimization

Robotic Planning and Manipulation with Force Information

Reliable Robotic Construction of Multi-object Arrangements

Learning and Planning with Compressed Linear Expectation Models

Active Learning of Models for Planning

Task and Motion Planning for Autonomous Robots

Member

Computational Design and Fabrication Group

Robotics, artificial intelligence

PI
Core/Dual

Wojciech Matusik

Professor

Graphics, vision, fabrication, robotics, hci

E wojciech@csail.mit.edu

T 324-8432

Lead

Computational Multicopter Design

Member

Simit: A Language for Computing on Sparse Systems

InstantCAD: Interactive Design Exploration/Optimization for CAD Models

Graphics, vision, fabrication, robotics, hci

Dmitriy Smirnov

Graduate Student

https://people.csail.mit.edu/smirnov/

E smirnov@mit.edu

RM 32-D475B

Member

Sensible Deep Learning for 3D Data

https://people.csail.mit.edu/smirnov/

PI
Core/Dual

Justin Solomon

Assistant Professor

Geometry, graphics, vision, machine learning, optimization.

E jsolomon@mit.edu

Lead

Geometry in Large-Scale Machine Learning

Political Geometry: Establishing Fair Mathematical Standards for Political Redistricting

Sensible Deep Learning for 3D Data

Optimal transport for statistics and machine learning

Geometry and topology for scientific computing and shape analysis

Member

Task-Driven Co-Optimization Of Articulated Robots

Geometry, graphics, vision, machine learning, optimization.

Andrew Spielberg

Graduate Student

E aespielberg@gmail.com

Lead

Robot Compiler

Member

Distributed Robotics Laboratory

PI
Core/Dual

Antonio Torralba

Professor

Vision, graphics, perception, machine learning

E torralba@csail.mit.edu

T 324-0900

RM 32-386G

Lead

Understanding Light via Deep Neural Networks

Understandable Deep Networks

Understanding Food images

Member

Predictive Vision

Where Are They Looking?

Single-Image 3D Interpreter Network

VirtualHome: Representing Activities as Programs

Places Database for Scene Recognition

Semantic Scene Understanding through ADE20K dataset

Crossing the Vision-Language Boundary

Center for Deployable Machine Learning (CDML)

Vision, graphics, perception, machine learning

Dishita Turakhia

Graduate Student

PhD student in HCIE group at CSAIL

E dishita@mit.edu

Member

HCI Engineering Group

PhD student in HCIE group at CSAIL

Yu Wang

Graduate Student

E wangyu9@mit.edu

RM 32-D475A

Member