The Development of a Hybrid Scoring Key for a Situational Judgment Test Designed for Training Evaluation

Simple item page
dc.contributor.authorFindlay, Rolanda A.en
dc.contributor.committeechairHauenstein, Neil M. A.en
dc.contributor.committeememberCooper, Lee D.en
dc.contributor.committeememberFoti, Roseanne J.en
dc.contributor.departmentPsychologyen
dc.date.accessioned2014-03-14T21:36:21Zen
dc.date.adate2007-06-15en
dc.date.available2014-03-14T21:36:21Zen
dc.date.issued2007-04-20en
dc.date.rdate2007-06-15en
dc.date.sdate2007-05-18en
dc.description.abstractAs a low fidelity work simulation, Situational Judgment Tests (SJTs) are an affordable and practical way of empirically linking training and on-the-job performance, thereby providing a viable means of evaluating training effectiveness. An issue, when utilizing SJTs, is deciding the appropriate manner in which the SJT should be scored. Traditional SJT scoring methodologies, while successfully utilized for selection and prediction, pose specific challenges when applied to a SJT designed to evaluate the effectiveness of a training program. This study discusses the shortcomings of traditional SJT scoring methodologies when used in the evaluation context. To overcome these challenges, an innovative scoring methodology, the Hybrid methodology, is presented. This study provides the detailed description of the Hybrid scoring key creation, and compares the Hybrid scoring key with two traditional scoring keys (Subject Matter Expert (SME) and Respondent-based scoring keys). Responses from a military training program are utilized to illustrate the distinctive effects of using the three different scoring approaches. The superiority of the hybrid scoring key, due to increased confidence in the key's accuracy, and findings regarding training evaluation are discussed. Future research directions and practical applications of the research are also discussed.en
dc.description.degreeMaster of Scienceen
dc.identifier.otheretd-05182007-214843en
dc.identifier.sourceurlhttp://scholar.lib.vt.edu/theses/available/etd-05182007-214843/en
dc.identifier.urihttp://hdl.handle.net/10919/42712en
dc.publisherVirginia Techen
dc.relation.haspartRFindlay_thesis.pdfen
dc.rightsIn Copyrighten
dc.rights.urihttp://rightsstatements.org/vocab/InC/1.0/en
dc.subjectScoring Keyen
dc.subjectTraining Evaluationen
dc.subjectSituational Judgment Testen
dc.titleThe Development of a Hybrid Scoring Key for a Situational Judgment Test Designed for Training Evaluationen
dc.typeThesisen
thesis.degree.disciplinePsychologyen
thesis.degree.grantorVirginia Polytechnic Institute and State Universityen
thesis.degree.levelmastersen
thesis.degree.nameMaster of Scienceen

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
RFindlay_thesis.pdf
Size:
363.11 KB
Format:
Adobe Portable Document Format
Download

Collections

Masters Theses