Surface Gesture & Object Tracking on Tabletop Devices
MetadataShow full item record
In this thesis, we are interested in the use of tabletop surfaces for interactive manipulations. We focus on the implementation of Image Processing algorithms and techniques in two projects exploiting a horizontal surface: â Tangram Projectâ and â MirrorTrackâ . The â Tangram Projectâ studies childrenâ s mathematical skills when manipulating geometrical shapes. This project is supported by NFS (NSF 0736151) based on the proposal â Social Organization, Learning Technologies & Discourse: System Features for Facilitating Mathematical Reasoning in PreK-3 Studentsâ by M. Evans, F. Quek, R. Ehrich and J. Wilkins. Our contribution is the design and realization of visio-based tracking software that could be used in a classroom. Our implementation offers three modes of interaction making it easier to study the childrenâ s behaviors in specific situations and constraints. The â MirrorTrack Projectâ is an idea described in previous research [P.-K. Chung et al,2008a] [P.-K. Chung et al,2008b] using a horizontal surface with two side-mounted cameras to track fingertips. Our contribution to the â MirrorTrack Projectâ is the design and realization of video-based interaction software. â MirrorTrack Projectâ provides an improvement to one of the Tangram modes (the Virtual mode) by providing real 3D fingertip location above the surface. Among other functionalities, it provides hovering and touch detection [Y. Verdie et al, 2009]. We conclude by describing the possibility of merging those two systems and by highlighting the benefits of such a fusion. Integrating â MirrorTrackâ with the â Tangram projectâ provides even more interaction opportunities for the children.
- Masters Theses