Toward a Consequential Validity Perspective for Selecting Participant Groups in Testing and Evaluation Studies for Complex System

dc.contributor.authorLau, Nathanen
dc.contributor.authorBoring, Ronald L.en
dc.contributor.editorWright, Juliaen
dc.contributor.editorBarber, Danielen
dc.description.abstractTesting and evaluation of technology design for complex systems cannot readily attain conclusive results. This is because skilled professionals are often not available for testing while non-professionals may not be capable of operating the actual systems or high-fidelity simulators. Thus, practitioners and applied scientists can be challenged with decisions on selecting participant groups, which can severely constrain choices in the experimental tasks. This article presents the perspective of consequential validity, highlighting that general validity or rules to participant selection probably do not exist. Most importantly, the validity of a testing method or an empirical finding critically rests on the decisions of interest that must take into account nuances or idiosyncrasies of specific situations and desired outcomes. This perspective stands in contrast to how the literature predominantly portrays validity of testing methods or empirical findings as universal rather than focusing on outcomes within the confines of the study methods. The perspective of consequential validity calls for studies on how classical metrics of reliability and validity could manifest in consequence of specific decisions informed by empirical testing.en
dc.description.notesYes, full paper (Peer reviewed?)en
dc.description.versionPublished versionen
dc.identifier.orcidLau, Nathan [0000-0003-2235-9527]en
dc.rightsCreative Commons Attribution 4.0 Internationalen
dc.subjectTesting and evaluationen
dc.subjectConsequential validityen
dc.titleToward a Consequential Validity Perspective for Selecting Participant Groups in Testing and Evaluation Studies for Complex Systemen
dc.title.serialHuman Factors and Simulationen
dc.typeConference proceedingen
pubs.organisational-group/Virginia Techen
pubs.organisational-group/Virginia Tech/Engineeringen
pubs.organisational-group/Virginia Tech/Engineering/Industrial and Systems Engineeringen
pubs.organisational-group/Virginia Tech/Faculty of Health Sciencesen
pubs.organisational-group/Virginia Tech/All T&R Facultyen
pubs.organisational-group/Virginia Tech/Engineering/COE T&R Facultyen


Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Lau_2022 AHFE Consequential Validity.pdf
554.96 KB
Adobe Portable Document Format
Published version