Cognitive Diagnostic Model, a Simulated-Based Study: Understanding Compensatory Reparameterized Unified Model (CRUM)

Simple item page
dc.contributor.authorGaleshi, Roofiaen
dc.contributor.committeechairSkaggs, Gary E.en
dc.contributor.committeememberSun, Minen
dc.contributor.committeememberSingh, Kusumen
dc.contributor.committeememberBurge, Penny L.en
dc.contributor.departmentEducational Research and Evaluationen
dc.date.accessioned2017-04-06T15:43:56Zen
dc.date.adate2012-11-28en
dc.date.available2017-04-06T15:43:56Zen
dc.date.issued2012-09-24en
dc.date.rdate2016-09-30en
dc.date.sdate2012-09-26en
dc.description.abstractA recent trend in education has been toward formative assessments to enable teachers, parents, and administrators assist students succeed. Cognitive diagnostic modeling (CDM) has the potential to provide valuable information for stakeholders to assist students identify their skill deficiency in specific academic subjects. Cognitive diagnosis models are mainly viewed as a family of latent class confirmatory probabilistic models. These models allow the mapping of students' skill profiles/academic ability. Using a complex simulation studies, the methodological issues in one of the existing cognitive models, referred to as compensatory reparameterized unified model (CRUM) under the log-linear model family of CDM, was investigated. In order for practitioners to implement these models, their item parameter recovery and examinees' classifications need to be studied in detail. A series of complex simulated data were generated for investigation with the following designs: three attributes with seven items, three attributes with thirty five items, four attributes with fifteen items, and five attributes with thirty one items. Each dataset was generated with observations of: 50, 100, 500, 1,000, 5,000, and 10,000 examinees. The first manuscript is the report of the investigation of how accurately CRUM could recover item parameters and classify examinees under true QMattrix specification and various research designs. The results suggested that the test length with regards to number of attributes and sample size affects the item parameter recovery and examinees classification accuracy. The second manuscript is the report of the investigation of the sensitivity of relative fit indices in detecting misfit for over- and opposite-Q-Matrix misspecifications. The relative fit indices under investigation were Akaike information criterion (AIC), Bayesian information criterion (BIC), and sample size adjusted Bayesian information criterion (ssaBIC). The results suggested that the CRUM can be a robust model given the consideration to the observation number and item/attribute combinations. The findings of this dissertation fill some of the existing gaps in the methodological issues regarding cognitive models' applicability and generalizability. It helps practitioners design tests in CDM framework in order to attain reliable and valid results.en
dc.description.degreePh. D.en
dc.identifier.otheretd-09262012-111522en
dc.identifier.sourceurlhttp://scholar.lib.vt.edu/theses/available/etd-09262012-111522/en
dc.identifier.urihttp://hdl.handle.net/10919/77228en
dc.language.isoen_USen
dc.publisherVirginia Techen
dc.rightsIn Copyrighten
dc.rights.urihttp://rightsstatements.org/vocab/InC/1.0/en
dc.subjectrelative fit indicesen
dc.subjectmodel selectionen
dc.subjectCRUMen
dc.subjectcognitive diagnostic modelen
dc.titleCognitive Diagnostic Model, a Simulated-Based Study: Understanding Compensatory Reparameterized Unified Model (CRUM)en
dc.typeDissertationen
dc.type.dcmitypeTexten
thesis.degree.disciplineEducational Research and Evaluationen
thesis.degree.grantorVirginia Polytechnic Institute and State Universityen
thesis.degree.leveldoctoralen
thesis.degree.namePh. D.en

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
etd-09262012-111522_Galeshi_R_D_2012.pdf
Size:
1.31 MB
Format:
Adobe Portable Document Format
Download

Collections

Doctoral Dissertations