Automated Movement Assessment in Stroke Rehabilitation

Simple item page
dc.contributor.authorAhmed, Tamimen
dc.contributor.authorThopalli, Kowshiken
dc.contributor.authorRikakis, Thanassisen
dc.contributor.authorTuraga, Pavanen
dc.contributor.authorKelliher, Aislingen
dc.contributor.authorHuang, Jia-Binen
dc.contributor.authorWolf, Steven L.en
dc.date.accessioned2022-04-05T14:02:08Zen
dc.date.available2022-04-05T14:02:08Zen
dc.date.issued2021-08-19en
dc.description.abstractWe are developing a system for long term Semi-Automated Rehabilitation At the Home (SARAH) that relies on low-cost and unobtrusive video-based sensing. We present a cyber-human methodology used by the SARAH system for automated assessment of upper extremity stroke rehabilitation at the home. We propose a hierarchical model for automatically segmenting stroke survivor's movements and generating training task performance assessment scores during rehabilitation. The hierarchical model fuses expert therapist knowledge-based approaches with data-driven techniques. The expert knowledge is more observable in the higher layers of the hierarchy (task and segment) and therefore more accessible to algorithms incorporating high level constraints relating to activity structure (i.e., type and order of segments per task). We utilize an HMM and a Decision Tree model to connect these high level priors to data driven analysis. The lower layers (RGB images and raw kinematics) need to be addressed primarily through data driven techniques. We use a transformer based architecture operating on low-level action features (tracking of individual body joints and objects) and a Multi-Stage Temporal Convolutional Network(MS-TCN) operating on raw RGB images. We develop a sequence combining these complimentary algorithms effectively, thus encoding the information from different layers of the movement hierarchy. Through this combination, we produce a robust segmentation and task assessment results on noisy, variable and limited data, which is characteristic of low cost video capture of rehabilitation at the home. Our proposed approach achieves 85% accuracy in per-frame labeling, 99% accuracy in segment classification and 93% accuracy in task completion assessment. Although the methodology proposed in this paper applies to upper extremity rehabilitation using the SARAH system, it can potentially be used, with minor alterations, to assist automation in many other movement rehabilitation contexts (i.e., lower extremity training for neurological accidents).en
dc.description.notesThis material was based upon work supported by the National Science Foundation under Grant No. (2014499) and the National Institute on Disability, Independent Living, and Rehabilitation Research under Award No. 90REGE0010.en
dc.description.sponsorshipNational Science FoundationNational Science Foundation (NSF) [2014499]; National Institute on Disability, Independent Living, and Rehabilitation ResearchUnited States Department of Health & Human Services [90REGE0010]en
dc.description.versionPublished versionen
dc.format.mimetypeapplication/pdfen
dc.identifier.doihttps://doi.org/10.3389/fneur.2021.720650en
dc.identifier.issn1664-2295en
dc.identifier.other720650en
dc.identifier.pmid34489855en
dc.identifier.urihttp://hdl.handle.net/10919/109540en
dc.identifier.volume12en
dc.language.isoenen
dc.rightsCreative Commons Attribution 4.0 Internationalen
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/en
dc.subjectstroke rehabilitationen
dc.subjectautomationen
dc.subjectcyber-human intelligenceen
dc.subjectHMMen
dc.subjectMSTCN plusen
dc.subjecttransformeren
dc.subjectsegmentationen
dc.subjectmovement assessmenten
dc.titleAutomated Movement Assessment in Stroke Rehabilitationen
dc.title.serialFrontiers in Neurologyen
dc.typeArticle - Refereeden
dc.type.dcmitypeTexten

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
fneur-12-720650.pdf
Size:
2.53 MB
Format:
Adobe Portable Document Format
Description:
Published version
Download

Collections

Scholarly Works, Biomedical Engineering and Mechanics
Scholarly Works, Computer Science
Scholarly Works, Electrical and Computer Engineering