A Bayesian formulation for a popular conjunctive cognitive diagnosis model, the reduced reparameterized unified model (rRUM), is developed. The new Bayesian formulation of the rRUM employs a latent response data augmentation strategy that yields tractable full conditional distributions. A Gibbs sampling algorithm is described to approximate the posterior distribution of the rRUM parameters. A Monte Carlo study supports accurate parameter recovery and provides evidence that the Gibbs sampler tended to converge in fewer iterations and had a larger effective sample size than a commonly employed Metropolis–Hastings algorithm. The developed method is disseminated for applied researchers as an R package titled “rRUM.”
BrooksS. P.GelmanA. (1998). General methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics, 7, 434-455.
2.
ChenY.LiuJ.XuG.YingZ. (2015). Statistical analysis of Q-matrix based diagnostic classification models. Journal of the American Statistical Association, 110(510), 850-866.
3.
ChiuC.-Y.DouglasJ. A.LiX. (2009). Cluster analysis for cognitive diagnosis: Theory and applications. Psychometrika, 74, 633-665.
4.
ChiuC.-Y.KöhnH.-F. (2016). The reduced RUM as a logit model: Parameterization and constraints. Psychometrika, 81, 350-370.
5.
ChiuC.-Y.KöhnH.-F.WuH.-M. (2016). Fitting the reduced RUM with Mplus: A tutorial. International Journal of Testing, 16, 331-351.
6.
ChungM. (2014). Estimating the Q-matrix for cognitive diagnosis models in a Bayesian framework (Unpublished doctoral dissertation). Columbia University, New York, NY.
7.
CulpepperS. A. (2015). Bayesian estimation of the DINA model with Gibbs sampling. Journal of Educational and Behavioral Statistics, 40, 454-476.
8.
de la TorreJ. (2009). DINA model and parameter estimation: A didactic. Journal of Educational and Behavioral Statistics, 34, 115-130.
9.
de la TorreJ. (2011). The generalized DINA model framework. Psychometrika, 76, 179-199.
10.
de la TorreJ.DouglasJ. A. (2004). Higher-order latent trait models for cognitive diagnosis. Psychometrika, 69, 333-353.
11.
DiBelloL. V.StoutW. F.RoussosL. A. (1995). Unified cognitive/psychometric diagnostic assessment likelihood-based classification techniques. In NicholsP. D.ChipmanS. F.BrennanR. L. (Eds.), Cognitively diagnostic assessment (pp. 361-389). Routledge.
12.
EmbretsonS. (1984). A general latent trait model for response processes. Psychometrika, 49, 175-186.
13.
FengY.HabingB. T.HuebnerA. (2013). Parameter estimation of the reduced RUM using the EM algorithm. Applied Psychological Measurement, 38, 137-150.
14.
HartzS. M. (2002). A Bayesian framework for the unified model for assessing cognitive abilities: Blending theory with practicality (Unpublished doctoral dissertation). University of Illinois at Urbana–Champaign, Champaign.
15.
HensonR. A.DouglasJ. (2005). Test construction for cognitive diagnosis. Applied Psychological Measurement, 29, 262-277.
HensonR. A.TemplinJ. L.WillseJ. T. (2009). Defining a family of cognitive diagnosis models using log-linear models with latent variables. Psychometrika, 74, 191-210.
18.
HoffP. D. (2015). Equivariant and scale-free Tucker decomposition models. Bayesian Analysis.
19.
JiangH. (1996). Applications of computational statistics in cognitive diagnosis and IRT modeling (Unpublished doctoral dissertation). University of Illinois at Urbana–Champaign, Champaign.
20.
JunkerB. W.SijtsmaK. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258-272.
21.
KassR. E.CarlinB. P.GelmanA.NealR. M. (1998). Markov chain Monte Carlo in practice: A roundtable discussion. The American Statistician, 52, 93-100.
22.
KimY.-H. (2011). Diagnosing EAP writing ability using the reduced reparameterized unified model. Language Testing, 28, 509-541.
23.
LiF.CohenA.BottgeB.TemplinJ. L. (2016). A latent transition analysis model for assessing change in cognitive skills. Educational and Psychological Measurement, 76, 181-204.
24.
LiuY.DouglasJ. A.HensonR. A. (2009). Testing person fit in cognitive diagnosis. Applied Psychological Measurement, 33, 579-598.
25.
MarisE. (1992). Psychometric models for psychological processes and structures (Unpublished doctoral dissertation). University of Leuven, Belgium.
PlummerM.BestN.CowlesK.VinesK. (2006). Coda: Convergence diagnosis and output analysis for MCMC (R package Version 0.16-1) [Computer software manual]. Retrieved from http://CRAN.R-project.org/package=coda
30.
RoussosL. A.DiBelloL. V.StoutW.HartzS. M.HensonR. A.TemplinJ. L. (2007). The fusion model skills diagnosis system. In LeightonJ. P.GierlM. J. (Eds.), Cognitive diagnostic assessment for education: Theory and applications (pp. 275-318). Cambridge University Press.
31.
RuppA.TemplinJ.HensonR. A. (2010). Diagnostic measurement: Theory, methods, and applications. New York, NY: Guilford Press.
32.
TannerM. A.WongW. H. (1987). The calculation of posterior distributions by data augmentation. Journal of the American statistical Association, 82(398), 528-540.
33.
TatsuokaC. (2002). Data analytic methods for latent partially ordered classification models. Journal of the Royal Statistical Society, Series C: Applied Statistics, 51, 337-350.
34.
TatsuokaK. K. (1984). Analysis of errors in fraction addition and subtraction problems. Computer-Based Education Research Laboratory, University of Illinois at Urbana–Champaign, Champaign.
35.
TemplinJ. L.HensonR. A. (2006). Measurement of psychological disorders using cognitive diagnosis models. Psychological Methods, 11, 287-305.
36.
TemplinJ. L.HensonR. A.TemplinS. E.RoussosL. (2008). Robustness of hierarchical modeling of skill association in cognitive diagnosis models. Applied Psychological Measurement, 32, 559-574.
37.
TemplinJ. L.HoffmanL. (2013). Obtaining diagnostic classification model estimates using Mplus. Educational Measurement: Issues and Practice, 32(2), 37-50.
38.
von DavierM. (2014). The DINA model as a constrained general diagnostic model: Two variants of a model equivalency. British Journal of Mathematical and Statistical Psychology, 67, 49-71.
39.
WhitelyS. E. (1980). Multicomponent latent trait models for ability tests. Psychometrika, 45, 479-494.
