Assessing Cognitive Workload using Electroencephalogram (EEG) in Technology-Mediated Work Environments
Files
TR Number
Date
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Human–machine interaction has expanded rapidly with the growing integration of automation, robotics, and intelligent systems into industrial and training environments. Emerging technologies such as Augmented Reality (AR) and Virtual Reality (VR) are designed to enhance these interactions by providing immersive training, real-time task guidance, and enriched visual feedback. While these technologies have the potential to improve efficiency, safety, and learning outcomes, they also impose additional cognitive demands on operators who must process complex visual and spatial information while maintaining attention and situational awareness. In complex collaborative and immersive work environments, operators are often required to interact simultaneously with humans, machines, and digital interfaces. As human information-processing capacity is inherently limited, assessing cognitive workload is critical for understanding how operators respond to technology-mediated systems and for designing systems that better align with human capabilities and limitations.
This research examines changes in operators' cognitive workload within three rapidly evolving technology-mediated environments: VR-based training, triadic human–robot-human collaboration, and AR-assisted teleoperation. Rather than relying solely on subjective self-reports, this research employs neurophysiological measures, specifically electroencephalography (EEG), to assess workload during task performance. To examine cognitive workload across these technology-mediated environments, three separate studies were conducted.
Study 1 investigated cognitive workload among novice forklift drivers in a VR-based training environment. In a within-subject experiment involving 20 novice drivers, workload variations were analyzed across different task difficulty levels and repeated training sessions. Results indicated that both subjective assessments (NASA-TLX) and objective measures (EEG) effectively distinguished workload across varying levels of task difficulty. However, an additional training session did not substantially reduce the workload experienced by novice operators.
Study 2 evaluated cognitive workload during triadic human-robot collaboration involving a teleoperator and an onsite worker performing a collaborative assembly task with and without robotic assistance. Thirty-two participants were recruited and assigned to either teleoperator or onsite roles. We also evaluated whether manipulating the task demands of onsite participants indirectly affected teleoperator workload. Findings demonstrated that EEG effectively detected workload differences across collaboration conditions and showed that robotic assistance reduced cognitive workload. However, no evidence of workload transfer from the onsite participant to the teleoperator was observed when the onsite task demands were manipulated.
Study 3 assessed the effects of AR-based visual augmentation and material visibility on teleoperator workload. We developed an AR interface that overlays the real-time posture and position of the onsite participant onto the teleoperator's view. In a within-subject study involving 17 participants, workload was evaluated using NASA-TLX, EEG, and eye tracking measures under AR guidance and traditional multi-camera conditions, as well as under varying levels of material occlusion. Results showed that AR guidance reduced workload, while Occlusion level influenced EEG patterns and gaze behavior, suggesting adaptive visual information-processing strategies under limited visibility conditions. Overall, these studies demonstrate the value of multimodal approaches for assessing cognitive workload in technology-mediated environments. In particular, the findings highlight the sensitivity of EEG in capturing subtle variations in operator workload, with different EEG measures responding to changes in task demands and system design across VR training, human–robot collaboration, and AR-assisted teleoperation. While increased task difficulty consistently elevated workload, supportive technologies such as robotic assistance and AR guidance effectively reduced cognitive demands. These findings underscore the importance of integrating cognitive factors into the design of technology-driven systems to enhance human–machine interaction, improve operator performance, and support safer and more effective work environments.