Sage Journals: Discover world-class research

Abstract

An ability-based guessing model is formulated and applied to several data sets regarding educational tests in language and in mathematics. The formulation of the model is such that the probability of a correct guess does not only depend on the item but also on the ability of the individual, weighted with a general discrimination parameter. By so doing, the possibility that the individual uses his or her ability to some extent for differentiating among responses while guessing is also considered. Some important properties of the model are described and compared with analogous properties of related models. After simulation studies, the model is applied to different data sets of the Chilean Sistema de Medición de la Calidad ń (SIMCE) tests of mathematics and language. The conclusion of this analysis seems relevant—namely, that the examinees use their ability to guess in the language test but not in the mathematics test.

Keywords

guessing parameter partial knowledge propensity to guess Rasch model

Get full access to this article

View all access options for this article.

References

Bechger, T. M. , Maris, G. , & Verstralen, H. H. M. (2005). The Nedelsky model for multiple choice items. In A. van der Ark , M. Croon , & K. Sijtsma (Eds.), New developments in categorical data analysis for the social and behavioral sciences. Mahwah, NJ: Lawrence Erlbaum.

Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more latent categories. Psychometrika, 37, 29-51.

Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores. London: Addison Wesley.

Cressie, N. , & Holland, P. W. (1983). Characterizing the manifest probabilities of latent trait models. Psychometrika, 48, 129-141.

DeMars, C. (2001). Group differences based on IRT scores: Does the model matter? Educational and Psychological Measurement, 61, 60-70.

Divgi, D. R. (1986). Applications of unidimensional item response theory models to multidimensional data. Applied Psychological Measurement, 7, 189-199.

Embretson, S. E. , & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum.

Hambleton, R. K. , Swaminathan, H. , & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage.

Hutchinson, T. P. (1991). Ability, partial information and guessing: Statistical modelling applied to multiple-choice tests. Rundle Mall, South Australia: Rumsby Scientific Publishing.

10.

Lord, F. M. (1983). Maximum likelihood estimation of item response parameters when some responses are omitted. Psychometrika, 48, 477-482.

11.

Maris, E. (1995). Psychometric latent response models. Psychometrika, 60, 523-547.

12.

Maris, G. (2002). Concerning the identification of the 3PL model (Measurement and Research Department Reports 2003-3). Arnhem, The Netherlands: CITO National Institute for Educational Measurement.

13.

McDonald, R. P. (1989). Future directions for item response theory. International Journal of Educational Research, 13, 205-220.

14.

McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Lawrence Erlbaum.

15.

Nedelsky, L. (1954). Absolute grading standards for objective tests. Educational and Psychological Measurement, 16, 159-176.

16.

Pelton, T.W.(2002). The accuracy of unidimensional measurement models in the presence of deviations for the underlying assumptions. Unpublished doctoral dissertation, Brigham Young University, Department of Instructional Psychology and Technology.

17.

Samejima, F. (1973). A comment on Birbaum’s three parameter logistic model in the latent trait theory. Psychometrika, 38, 221-233.

18.

SAS Institute . (1999). SAS online doc (Version 8) [Software manual on CD-ROM]. Cary, NC: Author.

19.

Thissen, D. , & Steinberg, L. (1984). A response model for multiple choice items. Psychometrika, 49, 501-519.

20.

Thissen, D. ,& Wainer, H. (Eds.).(2001). Item response models for items scored in two categories. Mahwah, NJ: Lawrence Erlbaum.

21.

van der Linden, W. J. , & Hambleton, R. K. (1997). Handbook of modern item response theory. New York: Springer Verlag.

22.

Weitzman, R. A. (1996). The Rasch model plus guessing. Educational and Psychological Measurement, 56, 779-790.

23.

Yen, W. M. , Burket, G. R. , & Sykes, R. C. (1991). Nonunique solutions to the likelihood equation for the three parameter logistic model. Psychometrika, 56, 39-54.

IRT Models for Ability-Based Guessing

Abstract

Keywords

Get full access to this article

References