Sage Journals: Discover world-class research

Abstract

This article extends Sympson’s partially noncompensatory dichtomous response model to ordered response data, and introduces a set of fully noncompensatory models for dichotomous and polytomous response data. The theoretical properties of the partially and fully noncompensatory response models are contrasted, and a small set of Monte Carlo simulations are presented to evaluate their parameter recovery performance. Results indicate that the respective models fit the data similarly when correctly matched to their respective population generating model. The fully noncompensatory models, however, demonstrated lower sampling variability and smaller degrees of bias than the partially noncompensatory counterparts. Based on the theoretical properties and empirical performance, it is argued that the fully noncompensatory models should be considered in item response theory applications when investigating conjunctive response processes.

Keywords

noncompensatory models compensatory models multidimensional item response theory MIRT conjunctive disjunctive

Get full access to this article

View all access options for this article.

References

Ackerman

T. A.

(1989). Unidimensional IRT calibration of compensatory and noncompensatory multidimensional items. Applied Psychological Measurement, 13, 113–127. https://doi.org/10.1177/014662168901300201

Babcock

(2011). Estimating a noncompensatory IRT model using Metropolis within Gibbs sampling. Applied Psychological Measurement, 35(4), 317–329. https://doi.org/10.1177/0146621610392366

Baker

F. B.

Kim

S. H.

(2004). Item response theory: Parameter estimation techniques (2nd ed.). Dekker.

Bock

R. D.

Aitkin

(1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46(4), 443–459.

Bolt

D. M.

Lall

V. F.

(2003). Estimation of compensatory and noncompensatory multidimensional item response models using Markov Chain Monte Carlo. Applied Psychological Measurement, 27(6), 395–414. https://doi.org/10.1177/0146621603258350

Cai

(2015). flexMIRT: A numerical engine for multilevel item factor analysis and test scoring [Computer software manual] (Version 3.0). Chapel Hill, NC: Vector Psychometric Group.

Chalmers

R. P.

(2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06

Chalmers

R. P.

(2018). SimDesign: Structure for organizing Monte Carlo simulation designs [Computer software manual] (R package version 1.13). https://CRAN.R-project.org/package=SimDesign

Chalmers

R. P.

Flora

D. B.

(2014). Maximum-likelihood estimation of noncompensatory IRT models with the MH-RM algorithm. Applied Psychological Measurement, 38(5), 339–358. https://doi.org/10.1177/0146621614520958

10.

Junker

B. W.

Sijtsma

(2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25(3), 258–272.

11.

Lord

F. M.

Novick

M. R.

(1968). Statistical theory of mental test scores. Addison-Wesley.

12.

Maris

(1999). Estimating multiple classification latent class models. Psychometrika, 64, 187–212.

13.

Muraki

Carlson

E. B.

(1995). Full-information factor analysis for polytomous item responses. Applied Psychological Measurement, 19, 73–90.

14.

Reckase

M. D.

(1997). A linear logistic multidimensional model for dichotomous item response data. In van der Linden

W. J.

Hambleton

R. K.

(Eds.), Handbook of modern item response theory (pp. 271–286). Springer-Verlag.

15.

Reckase

M. D.

(2009). Multidimensional item response theory. Springer-Verlag.

16.

Samejima

(1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika, 34, 1–97.

17.

Schneider

Chalmers

R. P.

Debelak

Merkle

(2019). Model selection of non-nested and nested item response models using Vuong tests. Multivariate Behavioral Research. Advance online publication. https://doi.org/10.1080/00273171.2019.1664280

18.

Sigal

M. J.

Chalmers

R. P.

(2016). Play it again: Teaching statistics with Monte Carlo simulation. Journal of Statistics Education, 24(3), 136–156. https://doi.org/10.1080/10691898.2016.1246953

19.

Sympson

J. B.

(1977). A model for testing with multidimensional items. In Weiss

D. J.

(Ed.), Proceedings of the 1977 Computerized Adaptive Testing Conference (pp. 82–98). University of Minnesota.

20.

Vuong

Q. H.

(1989). Likelihood ratio tests for model selection and non-nested hypotheses. Econometrica, 57(2), 307–333.

21.

Whitely

S. E.

(1980). Multicomponent latent trait models for ability tests. Psychometrika, 60, 181–198.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.12 MB

Partially and Fully Noncompensatory Response Models for Dichotomous and Polytomous Items

Abstract

Keywords

Get full access to this article

References

Supplementary Material