The calibration of the one-parameter logistic ability-based guessing (1PL-AG) model in item response theory (IRT) with a modest sample size remains a challenge for its implausible estimates and difficulty in obtaining standard errors of estimates. This article proposes an alternative Bayesian modal estimation (BME) method, the Bayesian Expectation-Maximization-Maximization (BEMM) method, which is developed by combining an augmented variable formulation of the 1PL-AG model and a mixture model conceptualization of the three-parameter logistic model (3PLM). By comparing with marginal maximum likelihood estimation (MMLE) and Markov Chain Monte Carlo (MCMC) in JAGS, the simulation shows that BEMM can produce stable and accurate estimates in the modest sample size. A real data example and the MATLAB codes of BEMM are also provided.
BeghettoR. A. (2019). Large-Scale assessments, personalized learning, and creativity: Paradoxes and possibilities. ECNU Review of Education, 2(3), 311–327. https://doi.org/10.1177/2096531119878963
2.
BéguinA. A.GlasC. A. W. (2001). MCMC estimation and some model-fit analysis of multidimensional IRT models. Psychometrika, 66(4), 541–561. https://doi.org/10.1007/bf02296195
3.
BockR. D.AitkinM. (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46(4), 443–459. https://doi.org/10.1007/BF02293801
4.
CaiL.LeeT. (2009). Covariance structure model fit testing under missing data: An application of the supplemented EM algorithm. Multivariate Behavioral Research, 44(2), 281–304. https://doi.org/10.1080/00273170902794255
5.
CulpepperS. A. (2015). Revisiting the 4-parameter item response model: Bayesian estimation and application. Psychometrika, 81(4), 1142–1163. https://doi.org/10.1007/s11336-015-9477-6
6.
du ToitM. (2003). IRT from SSI: BILOG-MG, MULTILOG, PARSCALE, TESTFACT. Scientific Software International.
7.
FariñaP.JorgeG.San MartínE. (2019). The use of an identifiability-based strategy for the interpretation of parameters in the 1PL-G and Rasch models. Psychometrika, 84(2), 511–528. https://doi.org/10.1007/s11336-018-09659-w
8.
GelmanA.RubinD. B. (1992). Inference from iterative simulation using multiple sequences. Statistical Science, 7(4), 457–472. https://doi.org/10.1214/ss/1177011136
9.
GuoS.ZhengC. (2019). The Bayesian expectation-maximization-maximization for the 3PLM. Frontiers in Psychology, 10(1175), 1–11. https://doi.org/10.3389/fpsyg.2019.01175
HutchinsonT. P. (1991). Ability, partial information, guessing: Statistical modelling applied to multiple-choice tests. Rumsby Scientific Publishing.
12.
KendallM. G.StuartA. (1961). Interval estimation: Confidence intervals. In KendallM. G.StuartA. (Eds.), The advanced theory of statistics (Vol. 2: Inference and Relationship, pp. 98–133). Hafner Publishing.
13.
LordF. M. (1980). Applications of item response theory to practical testing problems. Routledge.
14.
LordF. M.NovickM. R. (1968). Statistical theories of mental test scores. Addison-Wesley.
15.
McLachlanG.KrishnanT. (2007). The EM algorithm and extensions (Vol. 382). John Wiley.
OehlertG. W. (1992). A note on the delta method. American Statistician, 46(1), 27–29.
18.
ParkR.PituchK. A.KimJ.DoddB. G.ChungH. (2015). Marginalized maximum likelihood estimation for the 1PL-AG IRT model. Applied Psychological Measurement, 39(6), 1–17. https://doi.org/10.1177/0146621615574694
19.
PlummerM. (2003, March). JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling [Paper presentation]. The Proceedings of the 3rd international workshop on distributed statistical computing (dsc 2003). https://www.r-project.org/conferences/DSC-2003/Proceedings/Plummer.pdf
20.
RaschG. (1960). Probabilistic models for some intelligence and achievement tests. Danish Institute for Educational Research.
21.
San MartínE.Del PinoG.De BoeckP. (2006). IRT models for ability-based guessing. Applied Psychological Measurement, 30(3), 183–203. https://doi.org/10.1177/0146621605282773
22.
San MartínE.GonzálezJ.TuerlinckxF. (2015). On the unidentifiability of the fixed-effects 3PL model. Psychometrika, 80(2), 450–467. https://doi.org/10.1007/s11336-014-9404-2
23.
San MartínE.RolinJ.-M.CastroL. M. (2013). Identification of the 1PL model with guessing parameter: Parametric and semi-parametric results. Psychometrika, 78(2), 341–379. https://doi.org/10.1007/s11336-013-9322-8
24.
TianW.CaiL.ThissenD.XinT. (2013). Numerical differentiation methods for computing error covariance matrices in item response theory modeling: An evaluation and a new proposal. Educational and Psychological Measurement, 73(3), 412–439. https://doi.org/10.1177/0013164412465875
25.
von DavierM.RostJ. (2006). Mixture distribution item response models. In Rao CR.SinharayS. (Eds.), Handbook of statistics (Vol. 26, pp. 643–661). Elsevier.
26.
WallerN. G.FeuerstahlerL. M. (2017). Bayesian modal estimation of the four-parameter item response model in real, realistic, and idealized data sets. Multivariate Behavioral Research, 52(3), 350–370. https://doi.org/10.1080/00273171.2017.1292893
27.
WangW. C.HuangS. Y. (2011). Computerized classification testing under the one-parameter logistic response model with ability-based guessing. Educational and Psychological Measurement, 71(6), 925–941. https://doi.org/10.1177/0013164410392372
ZhangC. (2018). From expectation-3-maximization to Bayesian expectation-3-maximization: A latent mixture modeling-based Bayesian algorithm for the 4-parameter logistic model (Master in Science). University of Illinois at Urbana–Champaign. http://hdl.handle.net/2142/101297
30.
ZhangC.GuoS.ZhengC. (2018, April). Bayesian Expectation-Maximization-Maximization Algorithm for the PLM4 [Paper presentation]. The 80th NCME Annual Meeting, New York, NY, United States.
31.
ZhengC.MengX.GuoS.LiuZ. (2018). Expectation-Maximization-Maximization: A feasible MLE algorithm for the three-parameter logistic model based on a mixture modeling reformulation. Frontiers in Psychology, 8(2302), 1–10. https://doi.org/10.3389/fpsyg.2017.02302
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
