left image

electrical engineering

Hearing by seeing: “visual mic” uses potato-chip bag to recover sound from video footage

Hearing by seeing: “visual mic” uses potato-chip bag to recover sound from video footage

Researchers at MIT CSAIL, Microsoft, and Adobe have developed an algorithm that can reconstruct an audio signal by analyzing minute vibrations of objects depicted in video. In one set of experiments, they were able to recover intelligible speech from the vibrations of a potato-chip bag photographed from 15 feet away through soundproof glass.