For mixed-type tests composed of both dichotomous and polytomous items, polytomous items often yield more information than dichotomous ones. To reflect the difference between the two types of items, polytomous items are usually pre-assigned with larger weights. We propose an item-weighted likelihood method to better assess examinees' ability levels. Simulation results show that the estimated ability based on the new procedure is more consistent with examinee’s true ability than the usual maximum likelihood method.
BakerF. B. (1992). Item response theory: Parameter estimation techniques. New York, NY: Marcel Dekker.
2.
BakerF. B.KimS.-H. (2004). Item response theory: Parameter estimation techniques. Revised and expanded (2nd ed.). New York, NY: Marcel Dekker.
3.
BirnbaumA. (1968). Some latent trait models and their use in inferring an examinee’s ability. In M. LordF.NovickM. R. (Eds.), Statistical theories of mental test scores (pp. 397–472). Reading, MA: Addison-Wesley.
4.
DonoghueJ. R. (1994). An empirical examination of the IRT information of polytomously scored reading items under the generalized partial credit model. Journal of Educational Measurement, 41, 295–311.
5.
EmbretsonS. E.ReiseS. P. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.
6.
FirthD. (1993). Bias reduction of maximum likelihood estimates. Biometrika, 80, 27–38.
7.
JodoinM. G. (2003). Measurement efficiency of innovative item formats in computer-based testing. Journal of Educational Measurement, 40, 1–15.
8.
HuF. (1997). The asymptotic properties of the maximum-relevance weighted likelihood estimators. The Canadian Journal of Statistics, 30, 45–59.
9.
HuF.RosenbergerW. F. (2000). Analysis of time trends in adaptive designs with application to a neurophysiology experiment. Statistics in Medicine, 19, 2067–2075.
10.
HuF.ZidekJ. V. (1995). Incorporating relevant sample information using the likelihood(Technical Report No. 161). Vancouver, British Columbia, Canada: Department of Statistics, The University of British Columbia.
LordF. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.
13.
LordF. M. (1983). Unbiased estimators of ability parameters, of their variance, and of their parallel-forms reliability. Psychometrika, 48, 233–245.
14.
MurakiE. (1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16, 159–176.
15.
MurakiE. (1993). Information functions of the generalized partial credit model. Applied Psychological Measurement, 17, 351–363.
16.
MurakiE. (1997). A generalized partial credit model. In van der LindenW. J.HambletonR. K. (Eds.), Handbook of modern item response theory (pp. 153–164). New York, NY: Springer.
PenfieldR. D.BergeronJ. M. (2005). Applying a weighted maximum likelihood latent trait estimator to the generalized partial credit model. Applied Psychological Measurement, 29, 218–233.
19.
WangS.WangT. (2001). Precision of Warm’s weighted likelihood estimates for a polytomous model in computerized adaptive testing. Applied Psychological Measurement, 25, 317–331.
20.
WangT.HansonB. A.LauC. A. (1999). Reducing bias in CAT ability estimation: A comparison of approaches. Applied Psychological Measurement, 23, 263–278.
21.
WangX.van EedenC.ZidekJ. V. (2004). Asymptotic properties of maximum weighted likelihood estimators. Journal of Statistical Planning and Inference, 119, 37–54.
22.
WangX.ZidekJ. V. (2005). Choosing likelihood weights by cross-validation. The Annals of Statistics, 33, 463–500.
23.
WarmT. A. (1989). Weighted likelihood estimation of ability in item response theory. Psychometrika, 54, 427–450.
