Sage Journals: Discover world-class research

Abstract

A three-parameter logistic (3PL) model variant, named the two-parameter logistic extension (2PLE) model, was developed. This new model employs a function that integrates item features according to an examinee’s ability level instead of a fixed guessing parameter used in the 3PL model to quantify guessing behavior. Correct response probabilities from a solution behavior and guessing behavior increase as the level of ability increases. At extreme cases in which the level of ability is close to negative infinity, the 2PLE model degenerates into a 3PL model with a guessing probability at chance level (i.e., 1/m, where m is the number of options). The properties of the 2PLE model were described and compared with those of other guessing models. Then, a simulation study comparing the performance of the 2PLE model with that of the 3PL model under three scenarios was conducted. Results showed that the 2PLE model generally outperforms the 3PL model. Finally, the application of the new model in comparison with several existing models was demonstrated by using two real data sets.

Keywords

three-parameter logistic model guessing parameter two-parameter logistic extension model

Get full access to this article

View all access options for this article.

References

Baker

F. B.

Kim

S.-H.

(2004). Item response theory: Parameter estimation techniques (2nd ed., rev. and expanded). New York, NY: Marcel Dekker.

Birnbaum

(1968). Some latent trait models and their use in inferring an examinee’s ability. In Lord

F. M.

Novick

M. R.

(Eds.), Statistical theories of mental test scores (pp. 397-479). Reading, MA: Addison-Wesley.

du Toit

. (Ed.). (2003). IRT from SSI: BILOG-MG, MULTILOG, PARSCALE, TESTFACT. Lincolnwood, IL: Scientific Software International.

Frary

R. B.

(1988). Formula scoring of multiple-choice tests (correction for guessing). Educational Measurement: Issues and Practice, 7(2), 33-38.

Hambleton

R. K.

Swaminathan

Rogers

H. J.

(1991). Fundamentals of item response theory. Newbury Park, CA: Sage.

Han

K. T.

(2012). Fixing the c parameter in the three-parameter logistic model. Practical Assessment, Research & Evaluation, 17(1). Retrieved from http://pareonline.net/getvn.asp?v=17&n=1

Holland

P. W.

(1990). The Dutch identity: A new tool for the study of item response models. Psychometrika, 55, 5-18.

Kass

R. E.

Raftery

A. E.

(1995). Bayes factors. Journal of the American Statistical Association, 90, 773-795.

Lee

Bolt

D. M.

(2018). An alternative to the 3PL: Using asymmetric item characteristic curves to address guessing effects. Journal of Educational Measurement, 55, 90-111.

10.

Lord

F. M.

Novick

M. R.

(1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.

11.

Maris

(2002). Concerning the identification of the 3PL model (Measurement and Research Department Reports 2003-3). Arnhem, The Netherlands: CITO National Institute for Educational Measurement.

12.

Pelton

T. W.

(2002). The accuracy of unidimensional measurement models in the presence of deviations from the underlying assumptions (Unpublished doctoral dissertation), Department of Instructional Psychology and Technology, Brigham Young University, Provo, UT.

13.

Rasch

(1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Danish Institute for Educational Research.

14.

San Martín

del Pino

de Boeck

. (2006). IRT models for ability-based guessing. Applied Psychological Measurement, 30, 183-203.

15.

San Martín

Gonzáles

Tuerlinckx

. (2015). On the unidentifiability of the fixed-effects 3PL model. Psychometrika, 80, 450-467.

16.

Swaminathan

Gifford

J. A.

(1979). Estimation of parameters in the three-parameter latent trait model (Report No. 90). Amherst: Laboratory of Psychometric and Evaluation Research, School of Education, University of Massachusetts.

17.

Tuerlinckx

De Boeck

(2005). Two interpretations of the discrimination parameter. Psychometrika, 70, 629-650.

18.

van der Linden

W. J.

Hambleton

R. K

. (1997). Handbook of modern item response theory. New York, NY: Springer-Verlag.

19.

van der Maas

H. L. J.

Molenaar

Maris

Kievit

R. A.

Borsboom

. (2011). Cognitive psychology meets psychometric theory: On the relation between process models for decision making and latent variable models for individual differences. Psychological Review, 118, 339-356.

20.

von Davier

. (2009). Is there need for the 3PL model? Guess what?Measurement: Interdisciplinary Research and Perspectives, 7, 110-114.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.41 MB