Research

Impact Areas

Lead

Fredo Durand

William Freeman

Wojciech Matusik

Justin Solomon

+15

Research Group

Medical Vision Group

We develop new algorithms for medical image analysis and visualization of medical imagery.

+10

Polina Golland

Leads

Polina Golland

Research Areas

Computational Biology

Impact Areas

Lead

Polina Golland

+10

Polina Golland

Research Group

Vision Group

Our researchers create state-of-the-art systems to better recognize objects, people, scenes, behaviors and more, with applications in health-care, gaming, tagging systems and more.

Leads

Ted Adelson

Fredo Durand

John Fisher

William Freeman

Polina Golland

Eric Grimson

Berthold Horn

Aude Oliva

Ruth Rosenholtz

Antonio Torralba

Research Areas

Impact Areas

Lead

Ted Adelson

Fredo Durand

John Fisher

William Freeman

Polina Golland

Eric Grimson

Berthold Horn

Aude Oliva

Ruth Rosenholtz

Antonio Torralba

Research Group

Geometric Data Processing Group

Our group studies geometric problems in computer graphics, computer vision, machine learning, optimization, and other disciplines.

Justin Solomon

Leads

Justin Solomon

Research Areas

Impact Areas

Lead

Justin Solomon

Research Group

Sensing, Learning and Inference

We focus on the analysis of complex, high-dimensional data.

John Fisher

Leads

John Fisher

Research Areas

Impact Areas

Internet of Things

Lead

John Fisher

49 Project Results matching all criteria

Project

Driver-Friendly Bilateral Control for Suppressing Traffic Instabilities

We are studying how best to implement bilateral control and make it acceptable to drivers

Berthold Horn

Leads

Berthold Horn

Research Areas

Systems & Networking

Impact Areas

Berthold Horn

Project

Computational Bounce Flash for Indoor Portraits

To achieve high-quality photo lighting in challenging environments, our prototype camera dynamically reconstructs a 3D scene model and directs a motor-controlled flash head at nearby walls and ceilings for soft indirect illumination.

Lukas Murmann

Leads

Lukas Murmann

Research Areas

Impact Areas

Lukas Murmann

Project

Predictive Vision

We've developed an algorithm to anticipate visual events that may happen in the future

Leads

Research Areas

Computational Cognitive Science Group

Project

A Counterfactual Simulation Model of Causal Judgment

We develop a computational model that explains how people make causal judgments in physical scenes by mentally simulating counterfactual outcomes and comparing those to what actually happened.

Leads

Research Areas

Impact Areas

Project

Artificial Co-driver

By observing driver in real road situations, we learn a computer assistant that can make driving easier, safer and more enjoyable.

Leads

Research Areas

Impact Areas

Project

SoundNet

This project focuses on learning sound representations from unlabeled video

Leads

Research Areas

Project

Where Are They Looking?

Our goal is to build a system that predicts where people are looking in images. Given an image and the location of a head, our approach follows the gaze of the person and identifies the object being looked at.

Leads

Research Areas

Impact Areas

Project

Single-Image 3D Interpreter Network

We aim to understand 3D object structure from a single image. We propose an end-to-end framework which sequentially estimates 2D keypoint heatmaps and 3D object structure, by training it on both real 2D-annotated images and synthetic 3D data and by integrating a 3D-to-2D projection layer.

Leads

Research Areas

Impact Areas

Project

Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks

In our work we developed a model that is able to synthesize many probable future frames with just a single image as input.

Leads

Research Areas

Project

Deep Inverse Planning

Deep inverse planning for learning from high-dimensional demonstrations

Leads

Research Areas

Project

Monitoring Fetal Health

We develop algorithms for fetal MRI interpretation, to enable noninvasive fetal monitoring from MRI.

Polina Golland

Leads

Polina Golland

Research Areas

Impact Areas

Polina Golland

Project

Learning the Arrow of Time from Videos

We train machines to visually detect the arrow of time, if a video is playing forward or backward, by watching millions of online clips.

Leads

Research Areas

Project

Computational Multicopter Design

A system that can help you to design our own drone!

Tao Du

Leads

Tao Du

Research Areas

Impact Areas

Energy

Tao Du

Project

Understanding Light via Deep Neural Networks

Our goal is to understand the illumination of an environment. By disentangling the illumination effect from other intrinsic properties (e.g. geometry, texture, color), we can better understand how human perceive the world. It also has several applications such as single image relighting, color editing, etc.

Wei-Chiu Ma

Antonio Torralba

Leads

Wei-Chiu Ma

Antonio Torralba

Research Areas

Wei-Chiu Ma

Antonio Torralba

Project

Characterizing the Sensitivity of Vision-in-the-Loop Driving Controllers Using CG

We work on understanding and improving vision algorithms used for self driving cars, by introducing synthetic data-sets to the loop.

Leads

Research Areas

Impact Areas

Center for Brains, Minds and Machines

Project

Orbit Metric Learning: Weak Supervision for Invariant Representations

Visual recognition is affected by changes in visual appearance (pose, scale, rotation) that do not affect a scene’s semantic category. We introduce a method for using sets of traNational Science Foundationorming examples, to learn representations that are robust to these changes.

Leads

Research Areas

Center for Brains, Minds and Machines

Project

Spatio-temporal Convolutional Networks Explain Neural Representations of Human Action

Spatio-temporal convolutional networks are a good model of how visual cortex represents the actions of others, and thinking about robustness to complex transformations, is key to uncovering how human visual cortex is organized.

Leads

Research Areas

Project

3D Generative Adversarial Networks

We study the problem of 3D object generation. We propose a novel framework, 3D Generative Adversarial Network (3D-GAN), leveraging recent advances in volumetric convolutional networks and generative adversarial nets.

Leads

Research Areas

Impact Areas

Project

Crowdsourcing in Graphics and Vision

Our goal is to develop new applications and algorithms that leverage the skills of distributed crowdworkers, notably for image and video processing applications.

Alexandre Kaspar

Leads

Alexandre Kaspar

Research Areas

Impact Areas

Alexandre Kaspar

Project

Peripheral Vision and Driver Behavior

Our goal is to understand what drivers can perceive when they are not attending to the road ahead and the consequences of their perceptions for safety.

Leads

Research Areas

Impact Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

Project

AIRvatar System: A Framework for Analyzing Virtual Identities

AIRvatar is a system that telemetrically collects and analyzes fine-grained data on users’ virtual identities and the process used to create them.

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Impact Areas

Geometric Data Processing Group

D. Fox Harrell

Project

Graph Matching with Quadratic Transportation Costs

Develop optimization methods for graph matching where the cost scales quadratically with distance.

Sebastian Claici

Justin Solomon

Leads

Sebastian Claici

Justin Solomon

Research Areas

Sebastian Claici

Justin Solomon

Project

Learning Vision in Synthetic Environments

We aim to create a virtual environment to improve models for action recognition

Xavier Puig Fernandez

Leads

Xavier Puig Fernandez

Research Areas

Distributed Robotics Laboratory

Xavier Puig Fernandez

Project

Task-Driven Co-Optimization Of Articulated Robots

A robot's physical form and its motion are innately coupled - in order to change its physical design, one must often change the way it moves, and vice versa. Can computers automatically and simultaneously design robot structure and motion?

Andrew Spielberg

Leads

Andrew Spielberg

Research Areas

Andrew Spielberg

36 People Results matching all criteria

Mazdak Abulnaga

Graduate Student

medical vision

E abulnaga@mit.edu

Member

Monitoring Fetal Health

medical vision

PI
Core/Dual

Ted Adelson

Professor

Vision, touch sensing, robotics

E adelson@csail.mit.edu

T 253-0645

Lead

Blood Pressure Imager

Member

Natural Language Processing Group

Vision, touch sensing, robotics

PI
Core/Dual

Regina Barzilay

Professor

Natural language processing, machine learning

E regina@csail.mit.edu

T 258-5706

Lead

Aspect-Augmented Adversarial Networks for Domain Adaptation

Member

Aspect-Augmented Adversarial Networks for Domain Adaptation

Natural language processing, machine learning

Yu-An Chung

Graduate Student

Speech and language processing, machine learning

E andyyuan@mit.edu

Lead

Unsupervised Speech Processing

Member

Spoken Language Systems Group

Speech and language processing, machine learning

Adrian Dalca

Research Affiliate

E adalca@csail.mit.edu

Member

Computational Multicopter Design

Clinical Neuroimaging

Mustafa Doga Dogan

Graduate Student

E doga@mit.edu

Member

HCI Engineering Group

Tao Du

Graduate Student

CS PhD student

E taodu@csail.mit.edu

Lead

Member

CS PhD student

PI
Core/Dual

Fredo Durand

Professor

Vision, graphics, computational photography

E fredo@csail.mit.edu

T 253-7223

Lead

Computational Understanding of Visualizations and Graphic Designs

Member

Computational Bounce Flash for Indoor Portraits

Halide

Vision, graphics, computational photography

Rongyao Fang

Visiting Student

E rongyao@csail.mit.edu

PI
Core/Dual

William Freeman

Professor

Vision, machine learning, Bayesian modeling

E billf@csail.mit.edu

T 253-8828

Lead

Single-Image 3D Interpreter Network

Member

Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks

Learning the Arrow of Time from Videos

3D Generative Adversarial Networks

Vision, machine learning, Bayesian modeling

PI
Core/Dual

Polina Golland

Professor

Vision, medical imaging, statistical inference

E polina@csail.mit.edu

T 253-8005

Lead

Crossing the Vision-Language Boundary

Monitoring Fetal Health

Cardiac MRI analysis

Clinical Neuroimaging

Chest X-Ray Analysis

Vision, medical imaging, statistical inference

David Harwath

Research Scientist

E dharwath@csail.MIT.EDU

Lead

Automatic Speech Recognition

Unsupervised Speech Processing

Member

Spoken Language Systems Group

PI
Core/Dual

Berthold Horn

Professor

Vision, computational imaging

E bkph@csail.mit.edu

T 253-5863

Lead

Driver-Friendly Bilateral Control for Suppressing Traffic Instabilities

Vision, computational imaging

PI
Core/Dual

Leslie Kaelbling

Professor

Robotics, machine learning, motion planning

E lpk@csail.mit.edu

T 258-9695

Lead

Learning and Intelligent Systems

Machine Learning

Learning and Optimization

Robotic Planning and Manipulation with Force Information

Reliable Robotic Construction of Multi-object Arrangements

Learning and Planning with Compressed Linear Expectation Models

Active Learning of Models for Planning

Task and Motion Planning for Autonomous Robots

Member

Crowdsourcing in Graphics and Vision

Robotics, machine learning, motion planning

Alexandre Kaspar

Graduate Student

Graphics, crowdsourcing and hybrid fabrication.

E akaspar@mit.edu

Lead

Computational Knitting: Patterning and Shaping for Everyone

Member

Clinical Decision-Making Group

Graphics, crowdsourcing and hybrid fabrication.

Fern Keniston

Senior Administrative Assistant

Research support

E fern@csail.mit.edu

T 253-5860

RM 32/ 32-250A/ 391

Member

Research support

Mina Konakovic Lukovic

Postdoctoral Fellow

E mina@csail.mit.edu

PI
Core/Dual

John Leonard

Professor

Robotics, navigation/mapping, self-driving cars

E jleonard@csail.mit.edu

T 253-5305

Lead

Marine Robotics Group

Self-Driving Vehicles

Member

Robotics, navigation/mapping, self-driving cars

Ruizhi Liao

Graduate Student

E ruizhi@mit.edu

Member

Monitoring Fetal Health

Learning and Intelligent Systems

Chest X-Ray Analysis

Yang Liu

Graduate Student

computational imaging/photography, machine learning

E yliu@csail.mit.edu

computational imaging/photography, machine learning

PI
Core/Dual

Tomas Lozano-Perez

Professor

Robotics, artificial intelligence

E tlp@csail.mit.edu

T 253-7889

Lead

Learning and Optimization

Robotic Planning and Manipulation with Force Information

Reliable Robotic Construction of Multi-object Arrangements

Learning and Planning with Compressed Linear Expectation Models

Active Learning of Models for Planning

Task and Motion Planning for Autonomous Robots

Member

Robotics, artificial intelligence

Razvan Marinescu

Postdoctoral Associate

Postdoctoral Associate working with Polina Golland on neuroimaging.

E razvan@csail.mit.edu

RM 32-D475B

Member

Clinical Neuroimaging

Postdoctoral Associate working with Polina Golland on neuroimaging.

PI
Core/Dual

Wojciech Matusik

Professor

Graphics, vision, fabrication, robotics, hci

E wojciech@csail.mit.edu

T 324-8432

Lead

Computational Multicopter Design

Member

Simit: A Language for Computing on Sparse Systems

InstantCAD: Interactive Design Exploration/Optimization for CAD Models

Graphics, vision, fabrication, robotics, hci

David Palmer

Graduate Student

E drp@csail.mit.edu

13 News Results matching all criteria

Algorithms & Theory AI & Machine Learning Graphics & Vision

August 22 '19

Why did my classifier just mistake a turtle for a rifle?

Two longtime friends explore how computer vision systems go awry.

Why did my classifier just mistake a turtle for a rifle?

Algorithms & Theory Graphics & Vision Robotics Manufacturing

July 22 '19

Automated system generates robotic parts for novel tasks

When designing actuators involves too many variables for humans to test by hand, this system can step in.

Automated system generates robotic parts for novel tasks

Algorithms & Theory AI & Machine Learning Computational Biology Computer Architecture Graphics & Vision Human-Computer Interaction Programming Languages & Software Engineering Robotics Security & Cryptography Systems & Networking Cybersecurity Education Energy Entertainment Health Care Manufacturing Transportation Wireless

June 27 '19

CSAIL hosts first-ever TEDxMIT

Speakers — all women — discuss everything from gravitational waves to robot nurses

CSAIL hosts first-ever TEDxMIT

AI & Machine Learning Graphics & Vision Systems & Networking Health Care Manufacturing

June 18 '19

Teaching artificial intelligence to connect senses like vision and touch

MIT CSAIL system can learn to see by touching and feel by seeing, suggesting future where robots can more easily grasp and recognize objects.

Teaching artificial intelligence to connect senses like vision and touch

Algorithms & Theory AI & Machine Learning Graphics & Vision Energy Entertainment Manufacturing

December 10 '18

Teaching machines to see in 3-D

CSAIL’s approach uses algorithms and “2.5-D” sketches to let computers visualize images from any perspective

Teaching machines to see in 3-D

Graphics & Vision

December 03 '18

MIT Professor Ted Adelson named IEEE Fellow

Machines that learn language more like kids do 2

AI & Machine Learning Graphics & Vision Robotics

October 31 '18

Machines that learn language more like kids do

Computer model could improve human-machine interaction, provide insight into how children learn language.

Machines that learn language more like kids do

Algorithms & Theory AI & Machine Learning Graphics & Vision Health Care

September 19 '18

Machine-learning system tackles speech and object recognition, all at once

Model learns to pick out objects within an image, using spoken descriptions.

Machine-learning system tackles speech and object recognition, all at once

Algorithms & Theory Graphics & Vision Robotics Manufacturing

September 10 '18

Robots can now pick up any object after inspecting it

Breakthrough CSAIL system suggests robots could one day be able to see well enough to be useful in people’s homes and offices.

Robots can now pick up any object after inspecting it

Given an image of someone doing yoga, the system can generate an image of them doing golf (and vice versa)

AI & Machine Learning Graphics & Vision Education

June 18 '18

Put any person in any pose

MIT CSAIL neural network could be used by coaches to help players see themselves using the correct form

Put any person in any pose

Professor Berthold Horn and postdoctoral associate Liang Wang

Algorithms & Theory Graphics & Vision Transportation

December 14 '17

Improving traffic - by tailgating less

New CSAIL work shows that traffic would flow faster if drivers kept an equal distance between cars

Improving traffic - by tailgating less

A new system from MIT's Computer Science and Artificial Intelligence Laboratory works by analyzing light at the edge of walls, which is impacted by the reflections of objects around the corner from the camera.

AI & Machine Learning Graphics & Vision Transportation

October 09 '17

An algorithm for your blind spot

Light lets us see the things that surround us, but what if we could also use it to see things hidden around corners? It sounds like science fiction, but that’s the idea behind a new algorithm out of MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) — and its discovery has implications for everything from emergency response to self-driving cars.

An algorithm for your blind spot

System directs camera-equipped drones to maintain framing of an aerial shot.

Algorithms & Theory AI & Machine Learning Graphics & Vision Robotics Entertainment Transportation

May 17 '17

Cinematography on the fly

In recent years, a host of Hollywood blockbusters — including “The Fast and the Furious 7,” “Jurassic World,” and “The Wolf of Wall Street” — have included aerial tracking shots provided by drone helicopters outfitted with cameras. Those shots required separate operators for the drones and the cameras, and careful planning to avoid collisions. But a team of researchers from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) and ETH Zurich hope to make drone cinematography more accessible, simple, and reliable.

Cinematography on the fly

5 Group Results

Research Group

Computer Graphics Group

Our group focuses on synthetic image generation and computational photography.

+15

Leads

Fredo Durand

William Freeman

Wojciech Matusik

Justin Solomon

Research Areas

Impact Areas

Lead

Fredo Durand

William Freeman

Wojciech Matusik

Justin Solomon

+15

Research Group

Geometric Data Processing Group

Our group studies geometric problems in computer graphics, computer vision, machine learning, optimization, and other disciplines.

Justin Solomon

Leads

Justin Solomon

Research Areas

Impact Areas

Lead

Justin Solomon

Research Group

Medical Vision Group

We develop new algorithms for medical image analysis and visualization of medical imagery.

+10

Polina Golland

Leads

Polina Golland

Research Areas

Computational Biology

Impact Areas

Lead

Polina Golland

+10

Polina Golland

Research Group

Sensing, Learning and Inference

We focus on the analysis of complex, high-dimensional data.

John Fisher

Leads

John Fisher

Research Areas

Impact Areas

Internet of Things

Lead

John Fisher

Research Group

Vision Group

Our researchers create state-of-the-art systems to better recognize objects, people, scenes, behaviors and more, with applications in health-care, gaming, tagging systems and more.

Leads

Ted Adelson

Fredo Durand

John Fisher

William Freeman

Polina Golland

Eric Grimson

Berthold Horn

Aude Oliva

Ruth Rosenholtz

Antonio Torralba

Research Areas

Impact Areas

Lead

Ted Adelson

Fredo Durand

John Fisher

William Freeman

Polina Golland

Eric Grimson

Berthold Horn

Aude Oliva

Ruth Rosenholtz

Antonio Torralba

49 Project Results

Project

3D Generative Adversarial Networks

Leads

Research Areas

Impact Areas

Computational Cognitive Science Group

Project

A Counterfactual Simulation Model of Causal Judgment

We develop a computational model that explains how people make causal judgments in physical scenes by mentally simulating counterfactual outcomes and comparing those to what actually happened.

Leads

Research Areas

Impact Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

Project

AIRvatar System: A Framework for Analyzing Virtual Identities

AIRvatar is a system that telemetrically collects and analyzes fine-grained data on users’ virtual identities and the process used to create them.

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Impact Areas

D. Fox Harrell

Project

Analyzing Player Profile Data

Developing new methods for analyzing large quantities of player profile data, such as hundreds of thousands of profile images or chat logs.

D. Fox Harrell

Peter Mawhorter

Leads

D. Fox Harrell

Peter Mawhorter

Research Areas

D. Fox Harrell

Peter Mawhorter

Project

Artificial Co-driver

By observing driver in real road situations, we learn a computer assistant that can make driving easier, safer and more enjoyable.

Leads

Research Areas

Impact Areas

Project

Blood Pressure Imager

Development of affordable wearable continuous blood pressure monitor based on radial arterial pulse imaged from the skin surface of human wrist

Mumin Jin

Aya G. Halawi

Jianhua Li

Leads

Abhijit Biswas

Ted Adelson

Mandayam A. Srinivasan

Mohan Thanikachalam

Research Areas

Computational Biology

Geometric Data Processing Group

Mumin Jin

Aya G. Halawi

Jianhua Li

Project

Boundary Element Method for Shape Analysis and Geometry Processing

We are working on methods to analyze and process 3D shapes from representations of their boundaries; we focus on extrinsic geometry, that is, how the surface curves and bends through surrounding space.

Mirela Ben-Chen

Iosif Polterovich

Yu Wang

Justin Solomon

Leads

Yu Wang

Justin Solomon

Research Areas

Mirela Ben-Chen

Iosif Polterovich

Yu Wang

Justin Solomon

Project

Cardiac MRI analysis

We develop image analysis algorithms for whole-heart cardiac MRI in patients with severe congenital heart disease.

Polina Golland

Leads

Polina Golland

Research Areas

Impact Areas

Polina Golland

Project

Characterizing the Sensitivity of Vision-in-the-Loop Driving Controllers Using CG

We work on understanding and improving vision algorithms used for self driving cars, by introducing synthetic data-sets to the loop.

Leads

Research Areas

Impact Areas

Project

Chest X-Ray Analysis

We develop machine learning algorithms to automatically quantify the severity of pulmonary edema from chest x-rays.

Polina Golland

Leads

Polina Golland

Research Areas

Impact Areas

Polina Golland

Project

Clinical Neuroimaging

We develop novel algorithms for neuroimage segmentation, registration, and joint modeling of brain structure with clinical and genetic data.

Polina Golland

Leads

Polina Golland

Research Areas

Impact Areas

Polina Golland

Project

Computational Bounce Flash for Indoor Portraits

Lukas Murmann

Leads

Lukas Murmann

Research Areas

Impact Areas

Lukas Murmann

Project

Computational Knitting: Patterning and Shaping for Everyone

Knitting is the new 3d printing. It has become popular again with the widespread availability of patterns and templates, together with the maker movements. Lower-cost industrial knitting machines are starting to emerge, but we are still missing the corresponding design tools. Our goal is to fill this gap.

Alexandre Kaspar

Leads

Alexandre Kaspar

Research Areas

Impact Areas

Alexandre Kaspar

Project

Computational Multicopter Design

A system that can help you to design our own drone!

Tao Du

Leads

Tao Du

Research Areas

Impact Areas

Energy

Tao Du

Project

Crowdsourcing in Graphics and Vision

Our goal is to develop new applications and algorithms that leverage the skills of distributed crowdworkers, notably for image and video processing applications.

Alexandre Kaspar

Leads

Alexandre Kaspar

Research Areas

Impact Areas

Alexandre Kaspar

Project

Deep Inverse Planning

Deep inverse planning for learning from high-dimensional demonstrations

Leads

Research Areas

Project

Detailed Interpretation of Object Images

Infolab

The goal of this project is to model the process of ‘full interpretation’ of object images, namely the ability to identify and localize all semantic features and parts that are recognized by human observers.

Leads

Research Areas

Project

Driver-Friendly Bilateral Control for Suppressing Traffic Instabilities

We are studying how best to implement bilateral control and make it acceptable to drivers

Berthold Horn

Leads

Berthold Horn

Research Areas

Systems & Networking

Impact Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

Berthold Horn

Project

Enriching Virtual Reality (VR) Narratives with Embodied and Gestural Interaction

Building embodied and gestural interfaces to enrich interaction in VR narratives.

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

D. Fox Harrell

Project

Fast Lightweight Autonomy

The goal of the FLA program is to explore non-traditional perception and autonomy methods that could enable a new class of algorithms for minimalistic high-speed navigation in cluttered environments.

John Carter

Jake Ware

Leads

John Carter

Jake Ware

Research Areas

John Carter

Jake Ware

Project

Foundry: Design for Multi-Material 3-D Printing

A new approach for designs in multi-material fabrication

Leads

Research Areas

Impact Areas

Project

Geometry in Large-Scale Machine Learning

Machine Learning

Data often has geometric structure which can enable better inference; this project aims to scale up geometry-aware techniques for use in machine learning settings with lots of data, so that this structure may be utilized in practice.

Leads

Justin Solomon

Stefanie Jegelka

Sebastian Claici

Matthew Staib

Research Areas

Impact Areas