Prototyping Mixed Reality Experiences
Host
Arvind Satyanarayan
Abstract
In this talk, I will illustrate my vision of mixed reality prototyping, describe the anatomy of mixed reality prototypes and what can be learned and how, with relatively little time and effort. I will start with a brief overview of the HCI research focused on mixed reality interfaces in my lab at Michigan over the last three years. I will then structure the talk around recent projects exploring how to enable rapid prototyping of mixed reality interfaces with limited technical skill and no need for programming. In particular, I will describe techniques for AR/VR content creation from paper mockups and Play-Doh models with support for Wizard of Oz via live video streaming, and techniques for collaborative, immersive authoring of 3D scenes using AR/VR devices as puppets to make virtual objects interactive without programming. Based on these projects, I hope to illustrate possible directions to enable broader participation in the design process by empowering non-technical designers to create complex mixed reality experiences.
Bio
Michael Nebeling (http://michael-nebeling.de) is an Assistant Professor at the University of Michigan where he leads the Information Interaction Lab (https://mi2lab.com). His current research is focused on creating new techniques, tools, and technologies to make AR/VR interface development easier and faster. Michael's vision is that anyone without 3D modeling, animation, or programming background can be an active participant in AR/VR design. His work has received nine Best Paper Awards and Honorable Mentions at the premier HCI conferences. He regularly serves on the program committees of the ACM CHI, UIST, and EICS conferences. He received a 2018 Disney Research Faculty Award and a Mozilla Research award. He joined Michigan in 2016 after completing a postdoc in the HCI Institute at Carnegie Mellon University and a PhD in the Department of Computer Science at ETH Zurich
In this talk, I will illustrate my vision of mixed reality prototyping, describe the anatomy of mixed reality prototypes and what can be learned and how, with relatively little time and effort. I will start with a brief overview of the HCI research focused on mixed reality interfaces in my lab at Michigan over the last three years. I will then structure the talk around recent projects exploring how to enable rapid prototyping of mixed reality interfaces with limited technical skill and no need for programming. In particular, I will describe techniques for AR/VR content creation from paper mockups and Play-Doh models with support for Wizard of Oz via live video streaming, and techniques for collaborative, immersive authoring of 3D scenes using AR/VR devices as puppets to make virtual objects interactive without programming. Based on these projects, I hope to illustrate possible directions to enable broader participation in the design process by empowering non-technical designers to create complex mixed reality experiences.
Bio
Michael Nebeling (http://michael-nebeling.de) is an Assistant Professor at the University of Michigan where he leads the Information Interaction Lab (https://mi2lab.com). His current research is focused on creating new techniques, tools, and technologies to make AR/VR interface development easier and faster. Michael's vision is that anyone without 3D modeling, animation, or programming background can be an active participant in AR/VR design. His work has received nine Best Paper Awards and Honorable Mentions at the premier HCI conferences. He regularly serves on the program committees of the ACM CHI, UIST, and EICS conferences. He received a 2018 Disney Research Faculty Award and a Mozilla Research award. He joined Michigan in 2016 after completing a postdoc in the HCI Institute at Carnegie Mellon University and a PhD in the Department of Computer Science at ETH Zurich