Comparing 12 finite state models of examinee performance on multiple-choice tests

dc.contributor.authorZin, Than Thanen
dc.contributor.committeechairImpara, James C.en
dc.contributor.committeememberFrary, Robert B.en
dc.contributor.committeememberGarcia-Pérez, Miguel A.en
dc.contributor.committeememberSchulman, Robert S.en
dc.contributor.committeememberWeber, Larry J.en
dc.contributor.committeememberWolfle, Lee M.en
dc.contributor.departmentEducational Research and Evaluationen
dc.date.accessioned2014-03-14T21:10:39Zen
dc.date.adate2006-05-04en
dc.date.available2014-03-14T21:10:39Zen
dc.date.issued1992en
dc.date.rdate2006-05-04en
dc.date.sdate2006-05-04en
dc.description.abstractFinite state test theory models the response behavior of an examinee and establishes the relationship between the ability of the examinee and the observed responses on a multiple-choice test. In finite state modeling, various assumptions about item characteristics and the examinees’ response strategies are made to estimate an examinee ability, and willingness to guess. Twelve sets of plausible assumptions about identifiability of distractors and examinee guessing strategies were adopted and the corresponding finite state models were actualized. Three consequences of the adoption of the 12 sets of assumptions were investigated: 1) the extent to which the resulting ability estimates rank ordered the examinees similarly, 2) variation in the magnitude of ability estimates and the estimated willingness to guess across the 12 models, and 3) the extent to which conclusions about examinees subgroups would differ according to the model employed. Also, conventional number-right scores were compared with the finite state scores with respect to the three outcomes just listed. All scoring methods rank ordered the examinees essentially the same. The magnitude of the finite state scores varied considerably across models mainly due to differing assumptions about the identifiability of distractors. Differing assumptions about examinee guessing strategy had surprisingly little effect on the magnitude of the ability estimates, though estimates of willingness to guess varied consistently according to the assumed strategies. Conclusions about group differences also varied across the models as a result of differing assumptions about both item characteristics and examinee guessing strategies.en
dc.description.degreePh. D.en
dc.format.extentix, 108 leavesen
dc.format.mediumBTDen
dc.format.mimetypeapplication/pdfen
dc.identifier.otheretd-05042006-164507en
dc.identifier.sourceurlhttp://scholar.lib.vt.edu/theses/available/etd-05042006-164507/en
dc.identifier.urihttp://hdl.handle.net/10919/37684en
dc.language.isoenen
dc.publisherVirginia Techen
dc.relation.haspartLD5655.V856_1992.Z56.pdfen
dc.relation.isformatofOCLC# 26284010en
dc.rightsIn Copyrighten
dc.rights.urihttp://rightsstatements.org/vocab/InC/1.0/en
dc.subject.lccLD5655.V856 1992.Z56en
dc.subject.lcshExaminations -- Evaluationen
dc.subject.lcshMultiple-choice examinations -- Evaluationen
dc.titleComparing 12 finite state models of examinee performance on multiple-choice testsen
dc.typeDissertationen
dc.type.dcmitypeTexten
thesis.degree.disciplineEducational Research and Evaluationen
thesis.degree.grantorVirginia Polytechnic Institute and State Universityen
thesis.degree.leveldoctoralen
thesis.degree.namePh. D.en

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
LD5655.V856_1992.Z56.pdf
Size:
3.72 MB
Format:
Adobe Portable Document Format
Description: