Sage Journals: Discover world-class research

Abstract

The maximum likelihood estimate (MLE) of the ability parameter of an item response theory model with known item parameters was proved to be asymptotically normally distributed under a set of regularity conditions for tests involving dichotomous items and a unidimensional ability parameter (Klauer, 1990; Lord, 1983). This article first considers the more general case of tests that include a mix of dichotomous and polytomous items. A proof is given of the asymptotic normality of the MLE of the ability parameter for such tests under a set of regularity conditions. Then, it is proved that a similar result holds for the weighted likelihood estimate and the posterior mode of the ability parameter. Multidimensional ability parameters are considered next. Numerical illustrations are provided to demonstrate the asymptotic results.

Keywords

generalized partial credit mode three-parameter logistic model independent and not identically distributed (inid) random variables

Get full access to this article

View all access options for this article.

References

Baker

F. B.

Kim

H. S.

(2004). Item response theory: Parameter estimation techniques (2nd ed.). New York, NY: Marcel Dekker.

Bradley

R. A.

Gart

J. J.

(1962). The asymptotic properties of ML estimators when sampling from associated populations. Biometrika, 49, 205–213.

Chang

H. H.

(1996). The asymptotic posterior normality of the latent trait for polytomous IRT models. Psychometrika, 61, 445–463.

Chang

H. H.

Stout

(1993). The asymptotic posterior normality of the latent trait in an IRT model. Psychometrika, 58, 37–52.

Cox

D. R.

Hinkley

D. V.

(1974). Theoretical statistics. London, England: Chapman and Hall.

Darling-Hammond

Adamson

(2010). Beyond basic skills: The role of performance assessment in achieving 21st century standards of learning (Tech. Rep.). Stanford, CA: Stanford University, Stanford Center for Opportunity Policy in Education.

de Ayala

R. J.

(2009). The theory and practice of item response theory. New York, NY: Guilford Press.

Finkelman

Weiss

D. J.

Kim-Kang

(2010). Item selection and hypothesis testing for the adaptive measurement of change. Applied Psychological Measurement, 34, 238–254.

Glas

C. A. W.

Dagohoy

A. V. T.

(2007). A person fit test for IRT models for polytomous items. Psychometrika, 72, 159–180.

10.

Haberman

S. J.

von Davier

Lee

(2008). Comparison of multidimensional item response models: Multivariate normal ability distributions versus multivariate polytomous distributions (ETS Research Report No. RR-08-45) . Princeton, NJ: ETS.

11.

Klauer

K. C.

(1990). Asymptotic properties of the ML estimator of the ability parameter when item parameters are known. Methodika, 4, 23–26.

12.

Kolen

M. J.

Lee

(2011). Psychometric properties of scores on mixed-format tests. Educational Measurement: Issues and Practice, 30, 15–24.

13.

Lehmann

E. L.

(1999). Elements of large-sample theory. New York, NY: Springer.

14.

Lehmann

E. L.

Casella

(1998). Theory of point estimation (2nd ed.). New York, NY: Springer-Verlag.

15.

Lissitz

R. W.

Hou

Slater

(2012). The contribution of constructed response items to large scale assessment: measuring and understanding their impact. Journal of Applied Testing Technology, 13, 1–50.

16.

Lord

F. M.

(1983). Unbiased estimators of ability parameters, of their variance, and of their parallel-forms reliability. Psychometrika, 48, 233–245.

17.

Magis

(2015). A note on weighted likelihood and Jeffreys modal estimation of proficiency levels in polytomous item response models. Psychometrika, 80, 200–204.

18.

Muraki

(1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16, 159–176.

19.

Nordberg

(1980). Asymptotic normality of maximum likelihood estimators based on independent, unequally distributed observations in exponential family models. Scandinavian Journal of Statistics, 7, 27–32.

20.

Ogasawara

(2012). Asymptotic expansions for the ability estimator in item response theory. Computational Statistics, 27, 661–683.

21.

Ogasawara

(2013). Asymptotic expansions for the Bayes and pseudo Bayes estimators of ability in item response theory. Journal of Multivariate Analysis, 114, 359–377.

22.

Philippou

Roussas

G. G.

(1975). Asymptotic normality of the maximum likelihood estimate in the independent not identically distributed case. Annals of the Institute of Statistical Mathematics, 27, 45–55.

23.

R Core Team. (2015). R: A language and environment for statistical computing. Vienna, Austria: The R Foundation for Statistical Computing.

24.

Reckase

M. D.

(2009). Multidimensional item response theory. New York, NY: Springer.

25.

Samejima

(1998, 4). Expansion of Warm’s weighted likelihood estimator of ability for the three-parameter logistic model to general discrete responses. Paper presented at the annual meeting of the National Council of Measurement in Education, San Diego, CA.

26.

Segall

D. O.

(1996). Multidimensional adaptive testing. Psychometrika, 61, 331–354.

27.

Sinharay

. (2015). Asymptotically correct standardization of person-fit statistics beyond dichotomous items. Psychometrika. (Published through Online First). doi:10.1007/s11336-015-9465-x

28.

Sinharay

Wan

Choi

S. W.

Kim

(2015). Assessing individual-level impact of interruptions during online testing. Journal of Educational Measurement, 52, 80–105.

29.

Tao

Shi

Chang

(2012). Item-weighted likelihood method for ability estimation in tests composed of both dichotomous and polytomous items. Journal of Educational and Behavioral Statistics, 37, 298–315.

30.

Wainer

Vevea

J. L.

Camacho

Reeve

B. B.

Rosa

Nelson

(2001). Augmented scores—“borrowing strength” to compute scores based on small numbers of items. In Thissen

Wainer

(Eds.), Test scoring (pp. 343–387). Hillsdale, NJ: Lawrence Erlbaum.

31.

Wang

(2015). On latent trait estimation in multidimensional compensatory item response models. Psychometrika, 80, 428–449.

32.

Warm

T. A.

(1989). Weighted likelihood estimation of ability in item response theory. Psychometrika, 54, 427–450.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.21 MB

The Asymptotic Distribution of Ability Estimates

Abstract

Keywords

Get full access to this article

References

Supplementary Material