Quantifying the Reliability of Performance Time and User Perceptions Obtained from Passive Exoskeleton Evaluations

Work-related musculoskeletal disorders (WMSDs) cost US industries billions annually and reduce quality of life for those afflicted. Passive exoskeletons (EXOs) have emerged as a potential intervention to reduce worker exposures to WMSD risk factors. As EXO adoption is rising, EXO manufacturers are designing and producing new EXOs in accordance with growing demand. However, there are no standardized EXO evaluation protocols and EXO use recommendations, due in part to insufficient information on the reliability of EXO evaluation measures. The purpose of this thesis was to quantify the reliability of common EXO evaluation measures, using both traditional approaches a more advanced statistical approach (i.e., Generalizability Theory), while also identifying potential effects of EXO type, work task, and individual differences. This work used data from a recently completed EXO evaluation study, conducted in Virginia Tech's Occupational Ergonomics and Biomechanics Lab. Forty-two total participants completed simulated occupational tasks, in two separate experimental sessions on different days, while using an arm-support EXO (ASE) and a back-support EXO (BSE). Several outcome measures reached excellent within-session reliability within four trials for many tasks considered. Between-session reliability levels were lower than within-session levels, with outcome measures reaching moderate-to-good reliability for most tasks. Interindividual differences accounted for the largest proportion of variance for measurement reliability, followed by the experimental session. For all tasks, outcome measures reached excellent dependability levels, with many achieving excellent levels within five total trials. Inconsistencies observed in between-session reliability levels and dependability levels suggest that additional training and EXO familiarity may affect measurement reliability of outcome measures differently for some tasks, unique to each EXO type. These discrepancies emphasize the importance for additional research into this topic. Overall, the current findings indicate that many of the commonly used EXO evaluation measures are reliable and dependable within five trials and one experimental session, providing a potential foundation for standardized EXO assessment protocols.