A data-driven approach to classifying manual material handling tasks using markerless motion capture and recurrent neural networks

dc.contributor.authorOjelade, Aanuoluwapoen
dc.contributor.authorRajabi, Mohammad Sadraen
dc.contributor.authorKim, Sunwooken
dc.contributor.authorNussbaum, Maury A.en
dc.date.accessioned2025-05-27T17:31:31Zen
dc.date.available2025-05-27T17:31:31Zen
dc.date.issued2025-05en
dc.description.abstractWork-related musculoskeletal disorders (WMSDs) are prevalent problems that encompass a range of conditions affecting muscles, tendons, and nerves due to repetitive strain, non-neutral postures, and forceful exertions. These disorders lead to pain, reduced productivity and substantial healthcare costs. Effective physical exposure assessment tools are needed in the workplace to quantify WMSD risks and the association between exposure and risks. While several tools are available, they are often limited in scope and lack the ability to assess physical risks continuously. In this study, we evaluated a data-driven approach to continuously classify manual material handling tasks and specific task conditions using different feature sets and machine learning algorithms. Specifically, kinematic data from markerless motion capture (MMC) system was used as input for various recurrent neural networks to classify among eight distinct manual material handling tasks: box lifting, asymmetric box lifting, box carriage, box pushing, box pulling, cart pushing, overhead lifting, and box lowering. The models we tested include bidirectional long-short term memory, gated recurrent units, and bidirectional gated recurrent units. We also classified specific task conditions, such as hand configurations and initial lifting height. Overall, using the MMC's kinematic data led to satisfactory results (e.g., accuracy of 80–94 %) in classifying the tasks and the task conditions. Our results, though, also emphasize that classification performance varied across different feature sets, tasks, and between males and females. Nonetheless, use of MMC demonstrates clear potential for physical exposure assessment.en
dc.description.versionAccepted versionen
dc.format.extent13 page(s)en
dc.format.mimetypeapplication/pdfen
dc.identifierARTN 103755 (Article number)en
dc.identifier.doihttps://doi.org/10.1016/j.ergon.2025.103755en
dc.identifier.eissn1872-8219en
dc.identifier.issn0169-8141en
dc.identifier.orcidNussbaum, Maury [0000-0002-1887-8431]en
dc.identifier.urihttps://hdl.handle.net/10919/134229en
dc.identifier.volume107en
dc.language.isoenen
dc.publisherElsevieren
dc.rightsIn Copyrighten
dc.rights.urihttp://rightsstatements.org/vocab/InC/1.0/en
dc.subjectPhysical exposure assessmenten
dc.subjectMusculoskeletal disordersen
dc.subjectMachine learningen
dc.subjectSex differencesen
dc.subjectComputer visionen
dc.titleA data-driven approach to classifying manual material handling tasks using markerless motion capture and recurrent neural networksen
dc.title.serialInternational Journal of Industrial Ergonomicsen
dc.typeArticle - Refereeden
dc.type.dcmitypeTexten
dc.type.otherArticleen
dc.type.otherJournalen
pubs.organisational-groupVirginia Techen
pubs.organisational-groupVirginia Tech/Engineeringen
pubs.organisational-groupVirginia Tech/Engineering/Industrial and Systems Engineeringen
pubs.organisational-groupVirginia Tech/Faculty of Health Sciencesen
pubs.organisational-groupVirginia Tech/All T&R Facultyen
pubs.organisational-groupVirginia Tech/Engineering/COE T&R Facultyen

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Ojelade DEPOSIT.pdf
Size:
4.43 MB
Format:
Adobe Portable Document Format
Description:
Accepted version
License bundle
Now showing 1 - 1 of 1
Name:
license.txt
Size:
1.5 KB
Format:
Plain Text
Description: