Projected Augmented-Reality

Malhotra, Shorya; Long, Zachary; Prasad, Dilan; Akalwadi, Siddharth

Projected Augmented-Reality

dc.contributor.author	Malhotra, Shorya	en
dc.contributor.author	Long, Zachary	en
dc.contributor.author	Prasad, Dilan	en
dc.contributor.author	Akalwadi, Siddharth	en
dc.date.accessioned	2021-12-15T03:16:59Z	en
dc.date.available	2021-12-15T03:16:59Z	en
dc.date.issued	2021-12-14	en
dc.description.abstract	Augmented Reality is one of the core pillars of the upcoming Industry 4.0 (the next industrial revolution) and is expected to have an enormous impact in the future. This is supported by Meta’s (formerly Facebook) announced plans to unveil their own virtual reality world. Typically, extended reality experiences, like that of Meta and others we have seen, require users to make use of personal headsets. Our project, on the other hand, developed technology for a communal augmented reality experience without the need for personal devices. Our team developed a calibration system to bring this glasses-free augmented reality experience to life. The approach we took involved a projector, a powerful Windows Desktop, a Microsoft Azure Kinect Camera, and a Qualisys Motion Tracking system. Combining these hardware components, we were able to track objects entering the projector’s frustum and accurately display 3D images on moving physical objects. Our final product entailed a C++ script that utilized OpenCV’s ArUco Marker detection module to estimate positions and scales of markers, a Qualisys Motion Tracking system to track rigid bodies moving around the room, a Unity program to tie all the hardware components together, and necessary documentation for further development of our project. We found that the best way to approach this problem was to first project a scatter board of 25 ArUco markers on the physical calibration board. With the help of OpenCV and the Azure Kinect Camera, we then panned and scaled one projected ArUco marker to the center of the physical calibration board. Once OpenCV determined the ArUco marker was centered, the calibration was completed. Any graphic could then be accurately projected onto the moving board, giving the user an elegant glasses-free augmented reality experience.	en
dc.description.notes	The two versions of the final report are in ProjectedARReport.docx (Word) and .pdf (PDF). The two versions of the final presentation are in ProjectedARPresentation.pptx (PowerPoint) and .pdf (PDF). All project files (Unity project, Qualisys project and Visual Studio project) including the code files, for this project can be found in ProjectedARSystem.zip (.zip).	en
dc.identifier.uri	http://hdl.handle.net/10919/107003	en
dc.language.iso	en_US	en
dc.publisher	Virginia Tech.	en
dc.rights	Attribution-NonCommercial-ShareAlike 4.0 International	en
dc.rights.uri	http://creativecommons.org/licenses/by-nc-sa/4.0/	en
dc.subject	Augmented Reality	en
dc.subject	Calibration System	en
dc.subject	Projected Augmented Reality	en
dc.subject	Automated Calibration System	en
dc.subject	Unity	en
dc.subject	Qualisys Motion Tracking	en
dc.subject	ArUco Markers	en
dc.subject	Computer Vision	en
dc.subject	OpenCV	en
dc.subject	C++	en
dc.subject	C#	en
dc.subject	Visual Studio	en
dc.subject	Azure Kinect	en
dc.subject	Unity Plugin	en
dc.subject	Extended Reality	en
dc.subject	Glasses-Free Augmented Reality (AR)	en
dc.subject	3D Projection	en
dc.subject	Projection Mapping	en
dc.subject	Virtual Reality	en
dc.subject	Azure Camera	en
dc.title	Projected Augmented-Reality	en
dc.type	Presentation	en
dc.type	Report	en
dc.type	Other	en