This article describes a Windows program for checking the suitability of unidimensional logistic item response models for binary and ordered polytomous responses with respect to a given set of data. The procedure on which the program is based consists of predicting the observed test score distributions from the item characteristic curves. The fit between the observed and predicted distributions is mainly assessed by using graphical displays, but an additional χ2-type statistic is also reported. The program allows the relative fit of different models to be compared and can also be used in the context of cross-validation assessment.
Get full access to this article
View all access options for this article.
References
1.
Hambleton, R. K. (1989).Constructing tests with item response models: A discussion of methods and two problems. Bulletin of the International Test Commission, 28,96-106.
2.
Hambleton, R. K. , & Swaminathan, H. (1985). Item response theory principles and applications. Boston: Kluwer.
3.
Hambleton, R. K. , & Traub, R. E. (1973).Analysis of empirical data using two logistic latent trait models. British Journal of Mathematical and Statistical Psychology, 26,195-211.
4.
Hanson, B. A. (1994). An extension of the Lord-Wingersky algorithm to polytomous items.Unpublished research note.
5.
Jöreskog, K. G. (1993). Testing structural equation models. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 294-316). Newbury Park, CA: Sage.
6.
Kolen, M. J. , & Brennan, R. L. (1995). Test equating: Methods and practices. New York: Springer.
7.
Lord, F. M. (1953).The relation of test score to the trait underlying the test. Educational and Psychological Measurement, 13,517-548.
8.
Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum.
9.
Lord, F. M. , & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
10.
Lord, F. M. , & Wingersky, M. S. (1984).Comparison of IRT true-score and equipercentile observed-score equatings. Applied Psychological Measurement, 8,452-461.
11.
Mislevy, R. J. (1986).Recent developments in the factor analysis of categorical variables. Journal of Educational Statistics, 11,3-31.
12.
Mislevy, R. J. , & Bock, R. D. (1990). BILOG 3 item analysis and test scoring with binary logistic models. Mooresville, IN: Scientific Software.
13.
Raven, J. C. (1960). Guide to the Standard Progressive Matrices. London: H. K. Lewis.
14.
Ross, J. (1966).An empirical study of a logistic mental test model. Psychometrika, 31,325-340.
15.
Thissen, D. (1991). Multilog user’s guide: Multiple, categorical item analysis and test scoring using item response theory. Chicago: Scientific Software.
16.
Thissen, D. , Pommerich, M., Billeaud, K., & Williams, V.S.L. (1995).Item response theory for scores on tests including polytomous items with ordered responses. Applied Psychological Measurement, 19,39-49.
17.
Thissen, D. , & Steinberg, L. (1986).A taxonomy of item response models. Psychometrika, 51,567-577.
18.
Wang, T. , Kolen, M. W., & Harris, D. J. (2000).Psychometric properties of scale scores and performance levels for performance assessments using polytomous IRT. Journal of Educational Measurement, 37,141-162.
