Extracting Behavioral Information from Electronic Storyboards

In this paper we outline methods for extracting behavioral descriptions of interactive prototypes from electronic storyboards. This information is used to help interdisciplinary design teams evaluate potential ideas early in the design process. Using electronic story- boards provides a common descriptive medium where team members from diff erent disciplinary backgrounds can collectively express the intended behavior of their prototype. The behavioral information is extracted by a combination of visual tags applied to elements of the storyboard, analysis of storyboard layout, and natural language processing of text written in the frames. We describe this process, provide a proof of concept example, and discuss design choices in developing this tool.