Research

Impact Areas

Lead

Fredo Durand

William Freeman

Wojciech Matusik

Justin Solomon

Research Group

Geometric Data Processing Group

Our group studies geometric problems in computer graphics, computer vision, machine learning, optimization, and other disciplines.

Justin Solomon

Leads

Justin Solomon

Research Areas

Algorithms & Theory

Impact Areas

Lead

Justin Solomon

Community of Research

Human-Computer Interaction Community of Research

The focus of the HCI CoR is inventing new systems and technology that lie at the interface between people and computation, and understanding their design, implementation, and societal impact.

Stefanie Mueller

Leads

Stefanie Mueller

Research Areas

Programming Languages & Software Engineering

Impact Areas

Lead

Stefanie Mueller

Community of Research

Visual Computing Community of Research

The shared mission of Visual Computing is to connect images and computation, spanning topics such as image and video generation and analysis, photography, human perception, touch, applied geometry, and more.

+10

Ruth Rosenholtz

Leads

Ruth Rosenholtz

Research Areas

Impact Areas

Lead

Ruth Rosenholtz

+10

Ruth Rosenholtz

Research Group

Vision Group

Our researchers create state-of-the-art systems to better recognize objects, people, scenes, behaviors and more, with applications in health-care, gaming, tagging systems and more.

Leads

Ted Adelson

Fredo Durand

John Fisher

William Freeman

Polina Golland

Berthold Horn

Aude Oliva

Antonio Torralba

Eric Grimson

Research Areas

Impact Areas

Health Care

Lead

Ted Adelson

Fredo Durand

John Fisher

William Freeman

Polina Golland

Berthold Horn

Aude Oliva

Antonio Torralba

Eric Grimson

5 Project Results matching all criteria

Project

Computational Bounce Flash for Indoor Portraits

To achieve high-quality photo lighting in challenging environments, our prototype camera dynamically reconstructs a 3D scene model and directs a motor-controlled flash head at nearby walls and ceilings for soft indirect illumination.

Lukas Murmann

Leads

Lukas Murmann

Research Areas

Impact Areas

Lukas Murmann

Project

Where Are They Looking?

Our goal is to build a system that predicts where people are looking in images. Given an image and the location of a head, our approach follows the gaze of the person and identifies the object being looked at.

Leads

Research Areas

Impact Areas

Health Care

Project

Crowdsourcing in Graphics and Vision

Our goal is to develop new applications and algorithms that leverage the skills of distributed crowdworkers, notably for image and video processing applications.

Alexandre Kaspar

Leads

Alexandre Kaspar

Research Areas

Impact Areas

Big Data

Imagination, Computation, and Expression Laboratory (ICE Lab)

Alexandre Kaspar

Project

AIRvatar System: A Framework for Analyzing Virtual Identities

Human-Computer Interaction Community of Research

AIRvatar is a system that telemetrically collects and analyzes fine-grained data on users’ virtual identities and the process used to create them.

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Impact Areas

D. Fox Harrell

Project

Computational Knitting: Patterning and Shaping for Everyone

Knitting is the new 3d printing. It has become popular again with the widespread availability of patterns and templates, together with the maker movements. Lower-cost industrial knitting machines are starting to emerge, but we are still missing the corresponding design tools. Our goal is to fill this gap.

Alexandre Kaspar

Leads

Alexandre Kaspar

Research Areas

Impact Areas

Alexandre Kaspar

9 People Results matching all criteria

PI
Core/Dual

Fredo Durand

Professor

Vision, graphics, computational photography

E fredo@csail.mit.edu

T 253-7223

Lead

Computational Understanding of Visualizations and Graphic Designs

Member

Computational Bounce Flash for Indoor Portraits

Halide

Vision, graphics, computational photography

Michael Foshey

Mechanical Engineer/Project Manager

Additive Manufacturing, Robotics, Digital Fabrication

E mfoshey@mit.edu

Additive Manufacturing, Robotics, Digital Fabrication

PI
Core/Dual

William Freeman

Professor

Vision, machine learning, Bayesian modeling

E billf@csail.mit.edu

T 253-8828

Lead

Single-Image 3D Interpreter Network

Member

Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks

Learning the Arrow of Time from Videos

3D Generative Adversarial Networks

Embodied Intelligence Community of Research

Crowdsourcing in Graphics and Vision

Vision, machine learning, Bayesian modeling

Alexandre Kaspar

Graduate Student

Graphics, crowdsourcing and hybrid fabrication.

E akaspar@mit.edu

Lead

Computational Knitting: Patterning and Shaping for Everyone

Graphics, crowdsourcing and hybrid fabrication.

PI
Core/Dual

Wojciech Matusik

Professor

Graphics, vision, fabrication, robotics, hci

E wojciech@csail.mit.edu

T 324-8432

Lead

Computational Multicopter Design

Member

Simit: A Language for Computing on Sparse Systems

InstantCAD: Interactive Design Exploration/Optimization for CAD Models

Embodied Intelligence Community of Research

Graphics, vision, fabrication, robotics, hci

PI
Core/Dual

Justin Solomon

Assistant Professor

Geometry, graphics, vision, machine learning, optimization.

E jsolomon@mit.edu

Lead

Geometric Data Processing Group

Geometry in Large-Scale Machine Learning

Political Geometry: Establishing Fair Mathematical Standards for Political Redistricting

Sensible Deep Learning for 3D Data

Optimal transport for statistics and machine learning

Geometry and topology for scientific computing and shape analysis

Member

Geometry, graphics, vision, machine learning, optimization.

PI
Core/Dual

Antonio Torralba

Professor

Vision, graphics, perception, machine learning

E torralba@csail.mit.edu

T 324-0900

RM 32-386G

Lead

Understanding Light via Deep Neural Networks

Understandable Deep Networks

Understanding Food images

Member

Predictive Vision

Where Are They Looking?

Single-Image 3D Interpreter Network

VirtualHome: Representing Activities as Programs

Places Database for Scene Recognition

Semantic Scene Understanding through ADE20K dataset

Crossing the Vision-Language Boundary

Center for Deployable Machine Learning (CDML)

Embodied Intelligence Community of Research

Vision, graphics, perception, machine learning

Yu Wang

Graduate Student

E wangyu9@mit.edu

RM 32-D475A

Member

Geometric Data Processing Group

Geometry and topology for scientific computing and shape analysis

Paul Zhang

Graduate Student

I study meshing, PDE and manifold constrained optimization.

E pzpzpzp1@mit.edu

Member

Geometric Data Processing Group

Geometry and topology for scientific computing and shape analysis

I study meshing, PDE and manifold constrained optimization.

10 News Results matching all criteria

Graphics & Vision Human-Computer Interaction Entertainment Manufacturing

February 18 '21

Less-wasteful laser-cutting

Fabricaide, developed at MIT CSAIL, provides live design feedback to help users reduce leftover material.

Less-wasteful laser-cutting

An MIT-invented algorithm automatically produces a “portamento” effect — a pitch sliding from one note to another — between any two audio signals in real time. The algorithm finds the optimal way to move pitches from one signal into another to produce a smooth transition between sounds (shown here).

AI & ML Graphics & Vision Systems & Networking Entertainment

September 27 '19

Using math to blend musical notes seamlessly

Algorithm enables one audio signal to glide into another, recreating the “portamento” effect of some musical instruments.

Using math to blend musical notes seamlessly

Algorithms & Theory AI & ML Graphics & Vision Programming Languages & Software Engineering Systems & Networking Entertainment Manufacturing

August 05 '19

Computer-aided knitting

New CSAIL research uses machine learning to customize clothing designs

Computer-aided knitting

Algorithms & Theory AI & ML Computational Biology Computer Architecture Graphics & Vision Human-Computer Interaction Programming Languages & Software Engineering Robotics Security & Cryptography Systems & Networking Cybersecurity Education Energy Entertainment Health Care Manufacturing Transportation Wireless

June 27 '19

CSAIL hosts first-ever TEDxMIT

Speakers — all women — discuss everything from gravitational waves to robot nurses

CSAIL hosts first-ever TEDxMIT

Algorithms & Theory AI & ML Graphics & Vision Energy Entertainment Manufacturing

December 10 '18

Teaching machines to see in 3-D

CSAIL’s approach uses algorithms and “2.5-D” sketches to let computers visualize images from any perspective

Teaching machines to see in 3-D

Graphics & Vision Education Entertainment

September 19 '18

Creating 3-D-printed “motion sculptures” from 2-D videos

CSAIL system could help athletes, dancers, and others better analyze how they move

Creating 3-D-printed “motion sculptures” from 2-D videos

Algorithms & Theory AI & ML Graphics & Vision Entertainment

September 11 '18

Smoothing out sketches’ rough edges

MIT-developed tool improves automated image vectorization, saving digital artists time and effort.

Smoothing out sketches’ rough edges

AI & ML Graphics & Vision Entertainment

July 05 '18

An AI for editing music in videos

Given a video of a musical performance, CSAIL system can make specific instruments louder or softer

An AI for editing music in videos

Graphics & Vision Entertainment

July 12 '17

Watch 3-D movies at home, sans glasses

While 3-D movies continue to be popular in theaters, they haven’t made the leap to our homes just yet — and the reason rests largely on the ridge of your nose.

Watch 3-D movies at home, sans glasses

System directs camera-equipped drones to maintain framing of an aerial shot.

Algorithms & Theory AI & ML Graphics & Vision Robotics Entertainment Transportation

May 17 '17

Cinematography on the fly

In recent years, a host of Hollywood blockbusters — including “The Fast and the Furious 7,” “Jurassic World,” and “The Wolf of Wall Street” — have included aerial tracking shots provided by drone helicopters outfitted with cameras. Those shots required separate operators for the drones and the cameras, and careful planning to avoid collisions. But a team of researchers from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) and ETH Zurich hope to make drone cinematography more accessible, simple, and reliable.

Cinematography on the fly

5 Group Results

Research Group

Computer Graphics Group

Our group focuses on synthetic image generation, computational photography, digital manufacturing, and geometry.

Leads

Fredo Durand

William Freeman

Wojciech Matusik

Justin Solomon

Research Areas

Impact Areas

Lead

Fredo Durand

William Freeman

Wojciech Matusik

Justin Solomon

Research Group

Geometric Data Processing Group

Our group studies geometric problems in computer graphics, computer vision, machine learning, optimization, and other disciplines.

Justin Solomon

Leads

Justin Solomon

Research Areas

Algorithms & Theory

Impact Areas

Lead

Justin Solomon

Community of Research

Human-Computer Interaction Community of Research

The focus of the HCI CoR is inventing new systems and technology that lie at the interface between people and computation, and understanding their design, implementation, and societal impact.

Stefanie Mueller

Leads

Stefanie Mueller

Research Areas

Programming Languages & Software Engineering

Impact Areas

Lead

Stefanie Mueller

Research Group

Vision Group

Our researchers create state-of-the-art systems to better recognize objects, people, scenes, behaviors and more, with applications in health-care, gaming, tagging systems and more.

Leads

Ted Adelson

Fredo Durand

John Fisher

William Freeman

Polina Golland

Berthold Horn

Aude Oliva

Antonio Torralba

Eric Grimson

Research Areas

Impact Areas

Health Care

Lead

Ted Adelson

Fredo Durand

John Fisher

William Freeman

Polina Golland

Berthold Horn

Aude Oliva

Antonio Torralba

Eric Grimson

Community of Research

Visual Computing Community of Research

+10

Ruth Rosenholtz

Leads

Ruth Rosenholtz

Research Areas

Impact Areas

Imagination, Computation, and Expression Laboratory (ICE Lab)

Lead

Ruth Rosenholtz

+10

Ruth Rosenholtz

5 Project Results

Project

AIRvatar System: A Framework for Analyzing Virtual Identities

Human-Computer Interaction Community of Research

AIRvatar is a system that telemetrically collects and analyzes fine-grained data on users’ virtual identities and the process used to create them.

D. Fox Harrell

Leads

D. Fox Harrell

Research Areas

Impact Areas

D. Fox Harrell

Project

Computational Bounce Flash for Indoor Portraits

Lukas Murmann

Leads

Lukas Murmann

Research Areas

Impact Areas

Lukas Murmann

Project

Computational Knitting: Patterning and Shaping for Everyone

Alexandre Kaspar

Leads

Alexandre Kaspar

Research Areas

Impact Areas

Alexandre Kaspar

Project

Crowdsourcing in Graphics and Vision