MacVisSTA: A System for Multimodal Analysis of Human Communication and Interaction

Simple item page
dc.contributor.authorRose, Richard Travisen
dc.contributor.committeechairQuek, Francis K. H.en
dc.contributor.committeememberNorth, Christopher L.en
dc.contributor.committeememberFox, Edward A.en
dc.contributor.departmentComputer Scienceen
dc.date.accessioned2014-03-14T20:42:22Zen
dc.date.adate2007-08-23en
dc.date.available2014-03-14T20:42:22Zen
dc.date.issued2007-07-27en
dc.date.rdate2007-08-23en
dc.date.sdate2007-07-31en
dc.description.abstractThe study of embodied communication requires access to multiple data sources such as multistream video and audio, various derived and meta-data such as gesture, head, posture, facial expression and gaze information. This thesis presents the data collection, annotation, and analysis for multiple participants engaged in planning meetings. In support of the analysis tasks, this thesis presents the multimedia Visualization for Situated Temporal Analysis for Macintosh (MacVisSTA) system. It supports the analysis of multimodal human communication through the use of video, audio, speech transcriptions, and gesture and head orientation data. The system uses a multiple linked representation strategy in which different representations are linked by the current time focus. MacVisSTA supports analysis of the synchronized data at varying timescales for coarse-to-fine observational studies. The hybrid architecture may be extended through plugins. Finally, this effort has resulted in encoding of behavioral and language data, enabling collaborative research and embodying it with the aid of, and interface to, a database management system.en
dc.description.degreeMaster of Scienceen
dc.identifier.otheretd-07312007-170614en
dc.identifier.sourceurlhttp://scholar.lib.vt.edu/theses/available/etd-07312007-170614/en
dc.identifier.urihttp://hdl.handle.net/10919/34281en
dc.publisherVirginia Techen
dc.relation.haspart20080809-rtrose-thesis.pdfen
dc.rightsIn Copyrighten
dc.rights.urihttp://rightsstatements.org/vocab/InC/1.0/en
dc.subjectImagery and Video Analysisen
dc.subjectInformation Accessen
dc.subjectVisualizationen
dc.titleMacVisSTA: A System for Multimodal Analysis of Human Communication and Interactionen
dc.typeThesisen
thesis.degree.disciplineComputer Scienceen
thesis.degree.grantorVirginia Polytechnic Institute and State Universityen
thesis.degree.levelmastersen
thesis.degree.nameMaster of Scienceen

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
20080809-rtrose-thesis.pdf
Size:
3.21 MB
Format:
Adobe Portable Document Format
Download

Collections

Masters Theses