Toward a Consequential Validity Perspective for Selecting Participant Groups in Testing and Evaluation Studies for Complex System
| dc.contributor.author | Lau, Nathan | en |
| dc.contributor.author | Boring, Ronald L. | en |
| dc.contributor.editor | Wright, Julia | en |
| dc.contributor.editor | Barber, Daniel | en |
| dc.date.accessioned | 2022-08-15T19:36:32Z | en |
| dc.date.available | 2022-08-15T19:36:32Z | en |
| dc.date.issued | 2022-07-26 | en |
| dc.date.updated | 2022-08-13T05:26:50Z | en |
| dc.description.abstract | Testing and evaluation of technology design for complex systems cannot readily attain conclusive results. This is because skilled professionals are often not available for testing while non-professionals may not be capable of operating the actual systems or high-fidelity simulators. Thus, practitioners and applied scientists can be challenged with decisions on selecting participant groups, which can severely constrain choices in the experimental tasks. This article presents the perspective of consequential validity, highlighting that general validity or rules to participant selection probably do not exist. Most importantly, the validity of a testing method or an empirical finding critically rests on the decisions of interest that must take into account nuances or idiosyncrasies of specific situations and desired outcomes. This perspective stands in contrast to how the literature predominantly portrays validity of testing methods or empirical findings as universal rather than focusing on outcomes within the confines of the study methods. The perspective of consequential validity calls for studies on how classical metrics of reliability and validity could manifest in consequence of specific decisions informed by empirical testing. | en |
| dc.description.notes | Yes, full paper (Peer reviewed?) | en |
| dc.description.version | Published version | en |
| dc.format.mimetype | application/pdf | en |
| dc.identifier.doi | https://doi.org/10.54941/ahfe1001487 | en |
| dc.identifier.orcid | Lau, Nathan [0000-0003-2235-9527] | en |
| dc.identifier.uri | http://hdl.handle.net/10919/111525 | en |
| dc.language.iso | en | en |
| dc.rights | Creative Commons Attribution 4.0 International | en |
| dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | en |
| dc.subject | Testing and evaluation | en |
| dc.subject | Consequential validity | en |
| dc.title | Toward a Consequential Validity Perspective for Selecting Participant Groups in Testing and Evaluation Studies for Complex System | en |
| dc.title.serial | Human Factors and Simulation | en |
| dc.type | Conference proceeding | en |
| dc.type.dcmitype | Text | en |
| pubs.finish-date | 2022-07-28 | en |
| pubs.organisational-group | /Virginia Tech | en |
| pubs.organisational-group | /Virginia Tech/Engineering | en |
| pubs.organisational-group | /Virginia Tech/Engineering/Industrial and Systems Engineering | en |
| pubs.organisational-group | /Virginia Tech/Faculty of Health Sciences | en |
| pubs.organisational-group | /Virginia Tech/All T&R Faculty | en |
| pubs.organisational-group | /Virginia Tech/Engineering/COE T&R Faculty | en |
| pubs.start-date | 2022-07-24 | en |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- Lau_2022 AHFE Consequential Validity.pdf
- Size:
- 554.96 KB
- Format:
- Adobe Portable Document Format
- Description:
- Published version