CSAIL Event Calendar: Previous Series
Understanding Naturally Conveyed Explanations of Device Behavior
Speaker: Michael Oltmans , Design Rationale Group - MIT AI Laboratory
Mechanical designers routinely explain their designs to one another using sketches and verbal explanations of behavior. We have created a prototype system, called ASSISTANCE, capable of interpreting multimodal explanations for simple 2-D kinematic devices. In contrast to current design tools, which force designers to specify the details of the design by navigating a forest of menus and dialog boxes, our system uses input in the form of hand drawn sketches, sketched annotations, and verbal descriptions to describe the devices behavior. From these explanations the program generates a model of the events and the causal relationships between the events.