Show simple item record

dc.contributor.authorBharambe, Sachin Vasanten_US
dc.date.accessioned2019-01-11T07:00:45Z
dc.date.available2019-01-11T07:00:45Z
dc.date.issued2017-07-19en_US
dc.identifier.othervt_gsexam:11277en_US
dc.identifier.urihttp://hdl.handle.net/10919/86661
dc.description.abstractReal-time, virtual and mixed reality systems have diverse uses for real-world data visualization, representation, and remote collaboration in distant learning settings, especially in universities. Design of such systems involves challenges in mapping the real world data and physical world structure accurately to digital form of physical space, also called as virtual models. Researchers have created similar systems using multiple cameras, stereo cameras, accelerometers, and motion detectors. This report presents a platform to detect and track real-time locations of people present in buildings and map their location information into virtual models as avatars using omni-directional cameras installed in the physical space. These models were created as part of the Mirror Worlds project. The project infrastructure is funded by National Science Foundation. This infrastructure enables users to connect virtual and physical aspects of the environment through a coordinate-based data networking system to enable interaction with the rest of the system including environment objects and other users. This is an interdisciplinary project where students from various departments have worked on the development of virtual model of the Moss Art Center and Torgersen Hall in Unity / X3D. Some students from the Department of Computer Science have developed a coordinate-based data networking system. The prototype of a detection and tracking algorithm to extract the location information was developed using background subtraction in MATLAB. The proposed approach was developed using the combination of background subtraction and neural networks along with heuristics based on spatial information about the physical space. The system was scaled to work across multiple buildings, extract the location information of people present in the physical space, and map location information into shared virtual space as an avatar. The concept of remote presence was extended to create a collaborative object manipulation application using Leap Motion controller. Effects of fidelity were evaluated to perform the collaborative object manipulation task in shared virtual space based on user study conducted for this application. Since no annotated people video dataset is publicly available with overhead view from omni-directional cameras, three videos were annotated manually to test the performance of the approach. The current approach almost works at near real-time rates. All three video sequences were evaluated to compute frame based detection accuracy. Precision and recall obtained for the first video sequence of people detection is 93.85% and 95.06% respectively.en_US
dc.format.mediumETDen_US
dc.publisherVirginia Techen_US
dc.rightsThis item is protected by copyright and/or related rights. Some uses of this item may be deemed fair and permitted by law even without permission from the rights holder(s), or the rights holder(s) may have licensed the work for use under certain conditions. For other uses you need to obtain permission from the rights holder(s).en_US
dc.subjectHuman position detectionen_US
dc.subjectposition trackingen_US
dc.subjectnetwork communicationen_US
dc.subjectvirtual realityen_US
dc.subjectremote presence and collaborationen_US
dc.titleSmart Environment Based On Real-Time Human Position Tracking For Remote Presence And Collaborationen_US
dc.typeThesisen_US
dc.contributor.departmentElectrical and Computer Engineeringen_US
dc.description.degreeMaster of Scienceen_US
thesis.degree.nameMaster of Scienceen_US
thesis.degree.levelmastersen_US
thesis.degree.grantorVirginia Polytechnic Institute and State Universityen_US
thesis.degree.disciplineComputer Engineeringen_US
dc.contributor.committeechairKnapp, R. Benjaminen_US
dc.contributor.committeememberAbbott, Amos L.en_US
dc.contributor.committeememberPolys, Nicholas Fearingen_US


Files in this item

Thumbnail
Thumbnail

This item appears in the following Collection(s)

Show simple item record