A Comparison of the Power of Rasch Total and Between-Item Fit Statistics to Detect Measurement Disturbances

Abstract

This study investigates the properties of the total and between fit statistics commonly used in Rasch model calibration and analysis programs to assess the fit of items to various Rasch models. There are two aspects of the study: an examination of the distributional properties of the item between fit statistics when the data fit the dichotomous model and a comparison of the power of the item between and total fit statistics to detect various types of simulated measurement disturbances in dichotomous data. The results indicate that the distributional properties of the between fit statistic are approximate unit normals and stable over a wide variety of testing conditions. In the presence of measurement disturbances, the between fit statistic appears to be more sensitive to systematic measurement disturbances and the total fit statistic is more sensitive to random measurement disturbances.

Get full access to this article

View all access options for this article.

References

Smith, R. M. (1991a). The distributional properties of Rasch item fit statistics. Educational and Psychological Measurement, 51, 541-565.

Smith, R. M. (1991b). IPARM: Item and person analysis with the Rasch model. Chicago: MESA Press.

Wright, B. W. (1980). After word. In G. Rasch, Probabilistic models for some intelligence and attainment tests 1960/1980. Chicago: University of Chicago Press.

Wright, B. W. , & Mead, R. J. (1978). BICAL: Calibrating items with the Rasch model (Research Memorandum 23A). Chicago: University of Chicago, Statistical Laboratory, Department of Education.

Wright, B. D. , & Panchapakesan, N. (1969). A procedure for sample-free item analysis. Educational and Psychological Measurement, 29, 23-48.