CSAIL Team Honored for 'Revealing Invisible Changes'

Bookmark and Share
The National Science Foundation (NSF), along with the journal Science, has honored a team of CSAIL researchers for their work in the 10th annual International Science & Technology Visualization Challenge. CSAIL graduate students Michael Rubinstein, Neal Wadhwa and MIT alumni Eugene Shih and Hao-Yu Wu, along with Professor Frédo Durand, Professor William T. Freeman, and Professor John Guttag were honored with an honorable mention for their work on the video Revealing Invisible Changes In The World.
The International Science & Technology Visualization Challenge invites researchers, illustrators, photographers, computer programmers, videographers and graphics specialists from around the world to submit creative illustrations, information graphics, interactive visualizations and videos that intrigue, explain and educate others about science. The Feb. 1, 2013 issue of Science will feature the winning submissions, which will be available online at the NSF’s website.
In Revealing Invisible Changes In The World, CSAIL researchers demonstrated their work developing an algorithm that amplifies and allows for analysis of subtle movements and variations in color in ordinary videos. “Imagine you had special glasses that allowed you to see subtle changes that cannot be seen with the naked eye,” said Freeman, the video’s narrator, of the research.


By applying this algorithm to seemingly static videos, researchers were able to reveal previously hidden motions, such as a baby’s breathing, a construction crane swaying and blood pulsing through arteries in a human wrist.
The algorithm is able to amplify movements by analyzing color variations for each pixel in a video over time. The algorithm then amplifies the variation, resulting in a video that highlights subtle color changes and movements. The algorithm also allows for further analysis by allowing researchers to analyze the frequency of the variation and, in the case of a medical evaluation determine, for instance, a patient’s heart rate without using sensors. Results are comparable to those achieved through the use of hospital-grade monitors.
“Our goal was to develop a tool which will allow you to see changes that you cannot normally see. In the video, we tried to show that there is essentially a whole world of small changes and motion that we cannot see with our own eyes, and we gave examples of such phenomena that our algorithm can make visible,” said Rubinstein.
Code is available online for individuals interested in exploring the subtleties of motion. The team was interested in applying the work to the International Science & Technology Visualization Challenge as they felt it had broad appeal to a general audience, and would be a visually interesting way to share their work. 
One user of the team’s code has already posted magnified videos of his wife’s pregnancy, showing enhanced fetal movement, according to Rubinstein. Researchers hope to find additional applications for this work in fields such as medicine, civil engineering and architecture.
“Our team is still actively working on this direction, so people can expect more to come,” said Rubinstein. “ We hope that it will motivate people to look deeper into this type of processing and different applications it can support.”
For more information on this work, please visit: http://people.csail.mit.edu/mrub/vidmag/.

Abby Abazorius, CSAIL