A Cyber-Physical System (CPS) Approach to Support Worker Productivity based on Voice-Based Intelligent Virtual Agents

Simple item page
dc.contributor.authorLinares Garcia, Daniel Antonioen
dc.contributor.committeechairRoofigari-Esfahan, Nazilaen
dc.contributor.committeememberAnumba, Chimay J.en
dc.contributor.committeememberJazizadeh Karimi, Farrokhen
dc.contributor.committeememberLee, Sang Wonen
dc.contributor.departmentMyers-Lawson School of Constructionen
dc.date.accessioned2022-08-17T08:00:13Zen
dc.date.available2022-08-17T08:00:13Zen
dc.date.issued2022-08-16en
dc.description.abstractThe Architecture, Engineering, and Construction (AEC) industry is currently challenged by low productivity trends and labor shortages. Efforts in academia and industry alike invested in developing solutions to this pressing issue. The majority of such efforts moved towards modernization of the industry, making use of digitalization approaches such as cyber-physical systems (CPS). In this direction, various research works have developed methods to capture information from construction environments and elements and provide monitoring capabilities to measure construction productivity at multiple levels. At the root of construction productivity, the productivity at the worker level is deemed critical. As a result, previous works explored monitoring the productivity of construction workers and resources to address the industry's productivity problems. However, productivity trends are not promising and show a need to more rigorously address productivity issues. Labor shortages also exacerbated the need for increasing the productivity of the current labor workers. Active means to address productivity have been explored as a solution in recent years. As a result, previous research took advantage of CPS and developed systems that sense construction workers' actions and environment and enable interaction with workers to render productivity improvements. One viable solution to this problem is providing on-demand activity-related information to the workers while at work, to decrease the need for manually seeking information from different sources, including supervisors, thereby improving their productivity. Especially, construction workers whose activities involve visual and manual limitations need to receive more attention, as seeking information can jeopardize their safety. Multiple labor trades such as plumbing, steel work, or carpenters are considered within this worker classification. These workers rely on knowledge gathered from the construction project documentation and databases, but have difficulties accessing this information while doing their work. Research works have explored the use of knowledge retrieval systems to give access to construction project data sources to construction workers through multiple methods, including information booths, mobile devices, and augmented reality (AR). However, these solutions do not address the need of this category of workers in receiving on-demand activity related information during their work, without negatively impacting their safety. This research focuses on voice, as an effective modality most appropriate for construction workers whose activities impose visual and manual limit actions. to this end, first, a voice-based solution is developed that supports workers' productivity through providing access to project knowledge available in Building Information Modeling (BIM) data sources. The effect of the selected modality on these workers' productivity is then evaluated using multiple user studies. The work presented in this dissertation is structured as follows: First, in chapter 2, a literature review was conducted to identify means to support construction workers and how integration with BIM has been done in previous research. This chapter identified challenges in incorporating human factors in previous systems and opportunities for seamless integration of workers into BIM practices. In chapter 3, voice-based assistance was explored as the most appropriate means to provide knowledge to workers while performing their activities. As such, Chapter 3 presents the first prototype of a voice-based intelligent virtual agent, aka VIVA, and focuses on evaluating the human factors and testing performance of voice as a modality for worker support. VIVA was tested using a user study involving a simulated construction scenario and the results of the performance achieved through VIVA were compared with the baseline currently used in construction projects for receiving activity-related information, i.e., blueprints. Results from this assessment evidenced productivity performance improvements of users using VIVA over the baseline. Finally, chapter 4 presents an updated version of VIVA that provides automatic real-time link to BIM project data and provides knowledge to the workers through voice. This system was developed based on web platforms, allowing easier development and deployment and access to more devices for future deployment. This study contributes to the productivity improvements in the AEC industry by empowering construction workers through providing on-demand access to project information. This is done through voice as a method that does not jeopardize workers' safety or interrupt their activities. This research contributes to the body of knowledge by developing an in-depth study of the effect of voice-based support systems on worker productivity, enabling real-time BIM-worker integration, and developing a working worker-level productivity support solution for construction workers whose activities limit them in manually accessing project knowledge.en
dc.description.abstractgeneralThe Architecture, Engineering, and Construction (AEC) industry is currently challenged by low productivity trends and labor shortages. At the root of productivity, the improving productivity of construction workers is of critical essence. Therefore, academia and industry alike have shown great interest in research to develop solutions addressing construction worker productivity. For this purpose, monitoring systems for construction worker support have been developed, but productivity trends do not seem to improve, while labor shortages have increased productivity concerns. Other approaches to address productivity improvements have explored active means for productivity support. These include monitoring systems that also interact with the user. Construction workers performing activities that require allocating immense attention while using both hands, e.g. plumbers, steel workers, carpenters, have not been the focus of previous research because of the challenges of their conditions and needs. The activities performed by these workers require access to construction project data and documentation. Still, it is difficult for these workers to access information from the documents while doing their work. Therefore, previous researchers have explored methodologies to bring project data and documentation to the field but providing workers on-demand access to this data and documents have not been thoroughly studied. This research focuses on identifying the most appropriate method to provide workers access to information during activities that require more visual and manual attention. Worker support is provided by developing a solution that provides workers access to knowledge during their activities without being disruptive. The study then evaluated the effect of providing non-disruptive access to information sources enabled through the developed solution on the productivity for workers. First, in chapter 2, this study reviews the literature on approaches to connect construction project databases, a.k.a. Building Information Modeling (BIM), and workers. This review identified system types, integration approaches, and future research trends for linking BIM sources and with workers. In addition, this chapter's outcomes highlight system interoperability challenges and challenges in developing interactive systems involving humans. In chapter 3, a voice-based support system was developed as the most appropriate method for worker support during work activities that limit visual and manual worker capabilities. Then, the performance benefits of using a voice-based support system for construction workers was evaluated through a user study involving simulated construction activities. Finally, in chapter 4, this study provided a new integration method to connect BIM and workers in real-time. This system allows workers to interact with information from BIM through voice. The system was developed based on web platforms, allowing easier development and deployment and access to more devices for future deployment. This study contributes to the productivity improvements in the AEC industry by empowering construction workers through providing on-demand access to project information. This is done through voice as a method that does not jeopardize workers' attention or interrupt their activities.en
dc.description.degreeDoctor of Philosophyen
dc.format.mediumETDen
dc.identifier.othervt_gsexam:35398en
dc.identifier.urihttp://hdl.handle.net/10919/111537en
dc.language.isoenen
dc.publisherVirginia Techen
dc.rightsIn Copyrighten
dc.rights.urihttp://rightsstatements.org/vocab/InC/1.0/en
dc.subjectCyber-Physical Systemsen
dc.subjectCPSen
dc.subjectVoice-Baseden
dc.subjectProductivityen
dc.subjectWorker Supporten
dc.subjectInteroperabilityen
dc.subjectVIVAen
dc.subjectHuman-System Interactionen
dc.titleA Cyber-Physical System (CPS) Approach to Support Worker Productivity based on Voice-Based Intelligent Virtual Agentsen
dc.typeDissertationen
thesis.degree.disciplineEnvironmental Design and Planningen
thesis.degree.grantorVirginia Polytechnic Institute and State Universityen
thesis.degree.leveldoctoralen
thesis.degree.nameDoctor of Philosophyen

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Linares_Garcia_DA_D_2022.pdf
Size:
3.69 MB
Format:
Adobe Portable Document Format
Download

Collections

Doctoral Dissertations