Research

Impact Areas

Lead

Justin Solomon

Research Group

Vision Group

Our researchers create state-of-the-art systems to better recognize objects, people, scenes, behaviors and more, with applications in health-care, gaming, tagging systems and more.

Leads

Ted Adelson

Fredo Durand

John Fisher

William Freeman

Polina Golland

Eric Grimson

Berthold Horn

Aude Oliva

Ruth Rosenholtz

Antonio Torralba

Research Areas

Impact Areas

Entertainment

Health Care

Lead

Ted Adelson

Fredo Durand

John Fisher

William Freeman

Polina Golland

Eric Grimson

Berthold Horn

Aude Oliva

Ruth Rosenholtz

Antonio Torralba

11 Project Results

Project

3D Generative Adversarial Networks

We study the problem of 3D object generation. We propose a novel framework, 3D Generative Adversarial Network (3D-GAN), leveraging recent advances in volumetric convolutional networks and generative adversarial nets.

Leads

Research Areas

Impact Areas

Project

Artificial Co-driver

By observing driver in real road situations, we learn a computer assistant that can make driving easier, safer and more enjoyable.

Leads

Research Areas

Impact Areas

Project

Characterizing the Sensitivity of Vision-in-the-Loop Driving Controllers Using CG

We work on understanding and improving vision algorithms used for self driving cars, by introducing synthetic data-sets to the loop.

Leads

Research Areas

Impact Areas

Computational Fabrication Group

Project

Computational Knitting: Patterning and Shaping for Everyone

Knitting is the new 3d printing. It has become popular again with the widespread availability of patterns and templates, together with the maker movements. Lower-cost industrial knitting machines are starting to emerge, but we are still missing the corresponding design tools. Our goal is to fill this gap.

Alexandre Kaspar

Leads

Alexandre Kaspar

Research Areas

Impact Areas

Entertainment

Alexandre Kaspar

Project

Computational Multicopter Design

A system that can help you to design our own drone!

Tao Du

Leads

Tao Du

Research Areas

Robotics

Impact Areas

Energy

Tao Du

Project

Driver-Friendly Bilateral Control for Suppressing Traffic Instabilities

We are studying how best to implement bilateral control and make it acceptable to drivers

Berthold Horn

Leads

Berthold Horn

Research Areas

Robotics

Systems & Networking

Impact Areas

Berthold Horn

Project

Foundry: Design for Multi-Material 3-D Printing

A new approach for designs in multi-material fabrication

Leads

Research Areas

Impact Areas

Project

InstantCAD: Interactive Design Exploration/Optimization for CAD Models

Almost every object we use is developed with computer-aided design (CAD). While CAD programs are good for creating designs, using them to actually improve existing designs can be difficult and time-consuming.

Leads

Research Areas

Impact Areas

Project

Peripheral Vision and Driver Behavior

Our goal is to understand what drivers can perceive when they are not attending to the road ahead and the consequences of their perceptions for safety.

Leads

Research Areas

Impact Areas

Project

Single-Image 3D Interpreter Network

We aim to understand 3D object structure from a single image. We propose an end-to-end framework which sequentially estimates 2D keypoint heatmaps and 3D object structure, by training it on both real 2D-annotated images and synthetic 3D data and by integrating a 3D-to-2D projection layer.

Leads

Research Areas

Impact Areas

Distributed Robotics Laboratory

Project

Wearable Blind Navigation

We enable independent navigation for visually impaired users through a wearable feedback system using time-of-light sensors or depth cameras.

Leads

Research Areas

Robotics

Impact Areas

Health Care

18 People Results

PI
Core/Dual

Ted Adelson

Professor

Vision, touch sensing, robotics

E adelson@csail.mit.edu

T 253-0645

Lead

Blood Pressure Imager

Member

Computational Multicopter Design

Vision, touch sensing, robotics

Mustafa Doga Dogan

Graduate Student

E doga@mit.edu

Member

HCI Engineering Group

Tao Du

Graduate Student

CS PhD student

E taodu@csail.mit.edu

Lead

Member

CS PhD student

PI
Core/Dual

Fredo Durand

Professor

Vision, graphics, computational photography

E fredo@csail.mit.edu

T 253-7223

Lead

Computational Understanding of Visualizations and Graphic Designs

Member

Computational Bounce Flash for Indoor Portraits

Halide

Vision, graphics, computational photography

PI
Core/Dual

William Freeman

Professor

Vision, machine learning, Bayesian modeling

E billf@csail.mit.edu

T 253-8828

Lead

Single-Image 3D Interpreter Network

Member

Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks

Learning the Arrow of Time from Videos

3D Generative Adversarial Networks

Crossing the Vision-Language Boundary

Vision, machine learning, Bayesian modeling

David Harwath

Research Scientist

E dharwath@csail.MIT.EDU

Lead

Automatic Speech Recognition

Unsupervised Speech Processing

Member

Spoken Language Systems Group

PI
Core/Dual

Berthold Horn

Professor

Vision, computational imaging

E bkph@csail.mit.edu

T 253-5863

Lead

Driver-Friendly Bilateral Control for Suppressing Traffic Instabilities

Vision, computational imaging

PI
Core/Dual

Leslie Kaelbling

Professor

Robotics, machine learning, motion planning

E lpk@csail.mit.edu

T 258-9695

Lead

Learning and Intelligent Systems

Machine Learning

Learning and Optimization

Robotic Planning and Manipulation with Force Information

Reliable Robotic Construction of Multi-object Arrangements

Learning and Planning with Compressed Linear Expectation Models

Active Learning of Models for Planning

Task and Motion Planning for Autonomous Robots

Member

Crowdsourcing in Graphics and Vision

Robotics, machine learning, motion planning

Alexandre Kaspar

Graduate Student

Graphics, crowdsourcing and hybrid fabrication.

E akaspar@mit.edu

Lead

Computational Knitting: Patterning and Shaping for Everyone

Member

Graphics, crowdsourcing and hybrid fabrication.

PI
Core/Dual

John Leonard

Professor

Robotics, navigation/mapping, self-driving cars

E jleonard@csail.mit.edu

T 253-5305

Lead

Marine Robotics Group

Self-Driving Vehicles

Member

Learning and Intelligent Systems

Robotics, navigation/mapping, self-driving cars

PI
Core/Dual

Tomas Lozano-Perez

Professor

Robotics, artificial intelligence

E tlp@csail.mit.edu

T 253-7889

Lead

Learning and Optimization

Robotic Planning and Manipulation with Force Information

Reliable Robotic Construction of Multi-object Arrangements

Learning and Planning with Compressed Linear Expectation Models

Active Learning of Models for Planning

Task and Motion Planning for Autonomous Robots

Member

Computational Fabrication Group

Robotics, artificial intelligence

PI
Core/Dual

Wojciech Matusik

Professor

Graphics, vision, fabrication, robotics, hci

E wojciech@csail.mit.edu

T 324-8432

Lead

Computational Multicopter Design

Member

Simit: A Language for Computing on Sparse Systems

InstantCAD: Interactive Design Exploration/Optimization for CAD Models

Graphics, vision, fabrication, robotics, hci

PI
Core/Dual

Ruth Rosenholtz

Principal Research Scientist

Vision, predictive models, image compression, user interfaces

E rruth@csail.mit.edu

T 324-0269

Lead

Task-Driven Co-Optimization Of Articulated Robots

Vision, predictive models, image compression, user interfaces

Andrew Spielberg

Graduate Student

E aespielberg@gmail.com

Lead

Robot Compiler

Member

Distributed Robotics Laboratory

PI
Core/Dual

Antonio Torralba

Professor

Vision, graphics, perception, machine learning

E torralba@csail.mit.edu

T 324-0900

RM 32-386G

Lead

Understanding Light via Deep Neural Networks

Understandable Deep Networks

Understanding Health Habits from Social Media Pictures

Member

Predictive Vision

Neural Physics Engine

Where Are They Looking?

Single-Image 3D Interpreter Network