Studies investigating the power of person-fit statis tics often assume that the item parameters that are used to calculate the statistics are estimated in a sample with out misfitting item score patterns. However, in practical test applications calibration samples likely will contain such patterns. In the present study, the influence of the type and the number of misfitting patterns in the calibra tion sample on the detection rate of the ZU3 statistic was investigated by means of simulated data. An increase in the number of misfitting simulees resulted in a decrease in the power of ZU3. Furthermore, the type of misfit and the test length influenced the power of ZU3. The use of an iterative procedure to remove the misfitting patterns from the dataset was investigated. Results suggested that this method can be used to improve the power of ZU3.
Cliff, N., & Donoghue, J.R. (1992). Ordinal test fidelity estimated by an item sampling model. Psychometrika, 57, 217-236.
3.
Drasgow, F., Levine, M.V., & Williams, E.A. (1985). Appropriateness measurement with polychotomous item response models and standardized indices. British Journal of Mathematical and Statistical Psychology, 38, 67- 86.
4.
Frary, R.B. (1993). Statistical detection of multiple-choice answer copying: Review and commentary. Applied Measurement in Education , 6, 153-165.
5.
Hambleton, R.K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Boston: Kluwer-Nijhoff .
6.
Harnisch, D.L., & Linn, R.L. (1981). Analysis of item response patterns: Questionable test data and dissimilar curriculum practices. Journal of Educational Measurement, 18, 133-146.
Kingma, J., & TenVergert, E.M. (1985). A nonparametric scale analysis of the development of conservation. Applied Psychological Measurement, 9, 1-23.
9.
Kogut, J. (1987). Detecting aberrant response patterns in the Rasch model (Report No. 87-3). Enschede: University of Twente, Department of Education.
10.
Levine, M.V., & Drasgow, F. (1983). Appropriateness measurement: Validating studies and variable ability models. In D. J. Weiss (Ed.), New horizons in testing: Latent trait test theory and computerized adaptive testing (pp. 109-131). New York: Academic Press.
11.
Levine, M.V., & Rubin, D.B. (1979). Measuring the appropriateness of multiple-choice test scores. Journal of Educational Statistics, 4, 269-290.
12.
Lord, F.M. (1980). Applications of item response theory to practical testing problems. Hillsdale NJ: Erlbaum.
13.
Meijer, R.R. (1994). The number of Guttman errors as a simple and powerful person-fit statistic. Applied Psychological Measurement, 18, 311-314.
14.
Meijer, R.R., Molenaar, I.W., & Sijtsma, K. (1994). Influence of test and person characteristics on nonparametric appropriateness measurement. Applied Psychological Measurement, 18, 111-120.
15.
Meijer, R.R., Muijtjens, A.M.M., & van der Vleuten, C.P.M. (1996). Nonparametric person-fit research: Some theoretical issues and an empirical example. Applied Measurement in Education, 9, 77-89.
16.
Meijer, R.R., & Sijtsma, K. (1995). Detection of aberrant item score patterns: A review of recent developments. Applied Measurement in Education, 8, 261-272.
17.
Meijer, R.R., Sijtsma, K., & Smid, N.G. (1990). Theoretical and empirical comparison of the Mokken and the Rasch approach to IRT. Applied Psychological Measurement , 14, 283-298.
18.
Miller, M.D. (1986). Time allocation and patterns of item response . Journal of Educational Measurement, 23, 147-156.
19.
Mokken, R.J. (1971). A theory and procedure of scale analysis. New York: De Gruyter.
20.
Mokken, R.J., & Lewis, C. (1982). A nonparametric approach to the analysis of dichotomous item responses. Applied Psychological Measurement, 6, 417-430.
21.
Molenaar, I.W., & Hoijtink, H. (1990). The many null distributions of person fit indices . Psychometrika, 55, 75-106.
22.
Re-examination after fraud teacher (Herexamen na fraude leraar). (1994, June, 13). NRC Handelsblad, p. 8.
23.
Reise, S.P., & Due, A.M. (1991). The influence of test characteristics on the detection of aberrant response pattems. Applied Psychological Measurement , 15, 217-226.
24.
Schmitt, N.S., Cortina, J.M., & Whitney, D.J. (1993). Appropriateness fit and criterion-related validity . Applied Psychological Measurement, 17, 143-150.
25.
Sijtsma, K., & Molenaar, I.W. (1987). Reliability of test scores in nonparametric item response theory. Psychometrika, 52, 79-97.
26.
Sijtsma, K., & Verweij, A.C. (1992). Mokken scale analysis: Theoretical considerations and an application to transitivity tasks. Applied Measurement in Education, 5, 355-373.
27.
Tatsuoka, K.K., & Tatsuoka, M.M. (1983). Spotting erroneous rules of operation by the individual consistency index. Journal of Educational Measurement, 7, 215-231.
28.
van den Brink, W.P. (1977). Het verken-effect [The scouting effect]. Tijdschrift voor Onderwijsresearch, 2, 253-261.
29.
van der Flier, H. (1980). Vergelijkbaarheid van individuele testprestaties [Comparability of individual test performance]. Lisse: Swets & Zeitlinger.
30.
van der Flier, H. (1982). Deviant response patterns and comparability of test scores. Journal of Cross-Cultural Psychology, 13, 267-298.
