Bayesian Modal Estimation for the One-Parameter Logistic Ability-Based Guessing (1PL-AG) Model

Abstract

The calibration of the one-parameter logistic ability-based guessing (1PL-AG) model in item response theory (IRT) with a modest sample size remains a challenge for its implausible estimates and difficulty in obtaining standard errors of estimates. This article proposes an alternative Bayesian modal estimation (BME) method, the Bayesian Expectation-Maximization-Maximization (BEMM) method, which is developed by combining an augmented variable formulation of the 1PL-AG model and a mixture model conceptualization of the three-parameter logistic model (3PLM). By comparing with marginal maximum likelihood estimation (MMLE) and Markov Chain Monte Carlo (MCMC) in JAGS, the simulation shows that BEMM can produce stable and accurate estimates in the modest sample size. A real data example and the MATLAB codes of BEMM are also provided.

Keywords

1PL-AG BEMM MMLE IRT algorithm

Get full access to this article

View all access options for this article.

References

Beghetto

R. A.

(2019). Large-Scale assessments, personalized learning, and creativity: Paradoxes and possibilities. ECNU Review of Education, 2(3), 311–327. https://doi.org/10.1177/2096531119878963

Béguin

A. A.

Glas

C. A. W.

(2001). MCMC estimation and some model-fit analysis of multidimensional IRT models. Psychometrika, 66(4), 541–561. https://doi.org/10.1007/bf02296195

Bock

R. D.

Aitkin

(1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46(4), 443–459. https://doi.org/10.1007/BF02293801

Cai

Lee

(2009). Covariance structure model fit testing under missing data: An application of the supplemented EM algorithm. Multivariate Behavioral Research, 44(2), 281–304. https://doi.org/10.1080/00273170902794255

Culpepper

S. A.

(2015). Revisiting the 4-parameter item response model: Bayesian estimation and application. Psychometrika, 81(4), 1142–1163. https://doi.org/10.1007/s11336-015-9477-6

du Toit

. (2003). IRT from SSI: BILOG-MG, MULTILOG, PARSCALE, TESTFACT. Scientific Software International.

Fariña

Jorge

San Martín

(2019). The use of an identifiability-based strategy for the interpretation of parameters in the 1PL-G and Rasch models. Psychometrika, 84(2), 511–528. https://doi.org/10.1007/s11336-018-09659-w

Gelman

Rubin

D. B.

(1992). Inference from iterative simulation using multiple sequences. Statistical Science, 7(4), 457–472. https://doi.org/10.1214/ss/1177011136

Guo

Zheng

(2019). The Bayesian expectation-maximization-maximization for the 3PLM. Frontiers in Psychology, 10(1175), 1–11. https://doi.org/10.3389/fpsyg.2019.01175

10.

Houts

C. R.

Cai

(2015). flexMIRT: Flexible multilevel multidimensional item analysis and test scoring user’s manual version 3.5 RC. https://www.vpgcentral.com/software/irt-software/

11.

Hutchinson

T. P.

(1991). Ability, partial information, guessing: Statistical modelling applied to multiple-choice tests. Rumsby Scientific Publishing.

12.

Kendall

M. G.

Stuart

(1961). Interval estimation: Confidence intervals. In Kendall

M. G.

Stuart

(Eds.), The advanced theory of statistics (Vol. 2: Inference and Relationship, pp. 98–133). Hafner Publishing.

13.

Lord

F. M.

(1980). Applications of item response theory to practical testing problems. Routledge.

14.

Lord

F. M.

Novick

M. R.

(1968). Statistical theories of mental test scores. Addison-Wesley.

15.

McLachlan

Krishnan

(2007). The EM algorithm and extensions (Vol. 382). John Wiley.

16.

Mislevy

R. J.

(1986). Bayes modal estimation in item response models. Psychometrika, 51(2), 177–195. https://doi.org/10.1007/BF02293979

17.

Oehlert

G. W.

(1992). A note on the delta method. American Statistician, 46(1), 27–29.

18.

Park

Pituch

K. A.

Kim

Dodd

B. G.

Chung

(2015). Marginalized maximum likelihood estimation for the 1PL-AG IRT model. Applied Psychological Measurement, 39(6), 1–17. https://doi.org/10.1177/0146621615574694

19.

Plummer

(2003, March). JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling [Paper presentation]. The Proceedings of the 3rd international workshop on distributed statistical computing (dsc 2003). https://www.r-project.org/conferences/DSC-2003/Proceedings/Plummer.pdf

20.

Rasch

(1960). Probabilistic models for some intelligence and achievement tests. Danish Institute for Educational Research.

21.

San Martín

Del Pino

De Boeck

. (2006). IRT models for ability-based guessing. Applied Psychological Measurement, 30(3), 183–203. https://doi.org/10.1177/0146621605282773

22.

San Martín

González

Tuerlinckx

. (2015). On the unidentifiability of the fixed-effects 3PL model. Psychometrika, 80(2), 450–467. https://doi.org/10.1007/s11336-014-9404-2

23.

San Martín

Rolin

J.-M.

Castro

L. M

. (2013). Identification of the 1PL model with guessing parameter: Parametric and semi-parametric results. Psychometrika, 78(2), 341–379. https://doi.org/10.1007/s11336-013-9322-8

24.

Tian

Cai

Thissen

Xin

(2013). Numerical differentiation methods for computing error covariance matrices in item response theory modeling: An evaluation and a new proposal. Educational and Psychological Measurement, 73(3), 412–439. https://doi.org/10.1177/0013164412465875

25.

von Davier

Rost

. (2006). Mixture distribution item response models. In Rao C

Sinharay

(Eds.), Handbook of statistics (Vol. 26, pp. 643–661). Elsevier.

26.

Waller

N. G.

Feuerstahler

L. M.

(2017). Bayesian modal estimation of the four-parameter item response model in real, realistic, and idealized data sets. Multivariate Behavioral Research, 52(3), 350–370. https://doi.org/10.1080/00273171.2017.1292893

27.

Wang

W. C.

Huang

S. Y.

(2011). Computerized classification testing under the one-parameter logistic response model with ability-based guessing. Educational and Psychological Measurement, 71(6), 925–941. https://doi.org/10.1177/0013164410392372

28.

Yamamoto

(1982). Hybrid model of IRT and latent class models. ETS Research Report Series, 1982(2), i-61. https://doi.org/10.1002/j.2333-8504.1982.tb01326.x

29.

Zhang

(2018). From expectation-3-maximization to Bayesian expectation-3-maximization: A latent mixture modeling-based Bayesian algorithm for the 4-parameter logistic model (Master in Science). University of Illinois at Urbana–Champaign. http://hdl.handle.net/2142/101297

30.

Zhang

Guo

Zheng

(2018, April). Bayesian Expectation-Maximization-Maximization Algorithm for the PLM4 [Paper presentation]. The 80th NCME Annual Meeting, New York, NY, United States.

31.

Zheng

Meng

Guo

Liu

(2018). Expectation-Maximization-Maximization: A feasible MLE algorithm for the three-parameter logistic model based on a mixture modeling reformulation. Frontiers in Psychology, 8(2302), 1–10. https://doi.org/10.3389/fpsyg.2017.02302

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.28 MB