To realize the benefits of item response theory (IRT), one must have model-data fit. One facet of a model-data fit investigation involves assessing the tenability of the conditional item independence (CII) assumption. In this Monte Carlo study, the comparative performance of 10 indices for identifying conditional item dependence is assessed. The relative performances of these indices are evaluated in terms of their Type I error rate, power, and false positive rate. Results show that the residual correlations approach and the Q3 statistic can be considered as offering a reasonable compromise between maximum power and minimized false positive rates.
AckermanT. (1987). The robustness of LOGIST and BILOG IRT estimation programs to violations of local independence(Research Report 87-14). Iowa City, IA: ACT.
2.
AckermanT.SprayJ. A. (1987). A general model for item dependency(Research Report 87-9). Iowa City, IA: ACT.
3.
AgrestiA. (1996). An introduction to categorical data analysis. New York, NY: Wiley.
4.
BecherT. M.VerstralenH. F. M.VerhelstN. D. (2002). Equivalent linear logistic test models. Psychometrika, 67, 123-136.
5.
BishopY. M. M.FienbergS. E.HollandP. W. (1975). Discrete multivariate analysis: Theory and practice. Cambridge, MA: MIT Press.
6.
BockR. D. (1997). A brief history of item response theory. Educational Measurement: Issues and Practice, 16, 21-32.
7.
ChenW.-H.ThissenD. (1997). Local dependence indexes for item pairs using item response theory. Journal of Educational and Behavioral Statistics, 22, 265-289.
8.
CressieN.ReadT. R. C. (1984). Multinomial goodness-of-fit tests. Journal of Royal Statistical Society. Series B, 46, 440-464.
9.
EvansM.HastingsN.PeacockB. (2000). Statistical distributions (3rd ed.). New York, NY: Wiley.
10.
FraserC.McDonaldR. P. (1993). NOHARM87: A DOS computer program for fitting both unidimensional and multidimensional normal ogive models of latent trait theory[Computer software and manual]. Retrieved September 6, 2006, from http://people.niagarac.on.ca/cfraser/download/nhman/nhman.html
11.
FraserC.McDonaldR. P. (2003). NOHARM: A Windows program for fitting both unidimensional and multidimensional normal ogive models of latent trait theory[Computer software and manual]. Retrieved September 6, 2006, from http://people.niagarac.on.ca/cfraser/download/nhmanw/nhman.html
12.
GlasC. A. W.Suárez FalcónJ. C. (2003). A comparison of item-fit statistics for the three-parameter logistic model. Applied Psychological Measurement, 27, 87-106.
13.
GrayR. M. (1990). Entropy and information theory. New York, NY: Springer-Verlag.
14.
HabingB.RoussosL. A. (2003). On the need for negative local item dependence. Psychometrika, 68, 435-451.
15.
HosmerD. W.LemeshowS. (2000). Applied logistic regression (2nd ed.). New York, NY: Wiley.
16.
JöreskogK. G.SörbomD. (1989). LISREL7: A guide to the program and applications (2nd ed.). Chicago, IL: SPSS, Inc.
17.
KellerL. A.SwaminathanH.SireciS. G. (2003). Evaluating scoring procedures for context-dependent item sets. Applied Measurement in Education, 16, 207-222.
18.
KlineR. B. (1998). Principles and practice of structural equation modeling. New York, NY: Guilford.
19.
LevyR.MislevyR. J.SinharayS. (2009). Posterior predictive model checking for multidimensionality in item response theory. Applied Psychological Measurement, 33, 519-537.
20.
LongJ. S. (1997). Regression models for categorical and limited dependent variables. Thousand Oaks, CA: Sage.
21.
LordF. M.NovickM. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
22.
McDonaldR. P. (1979). The structural analysis of multivariate data: A sketch of a general theory. Multivariate Behavioral Research, 14, 21-38.
23.
McDonaldR. P. (1981). The dimensionality of tests and items. British Journal of Mathematical and Statistical Psychology, 34, 100-117.
24.
McDonaldR. P. (1994). Testing for approximate dimensionality. In LaveaultD.ZumboB. D.GessaroliM. E.BossM. W. (Eds.), Modern theories of measurement: Problems and issues (pp. 63-86). Ottawa, Ontario, Canada: University of Ottawa.
25.
McDonaldR. P.MokM. M.-C. (1995). Goodness of fit in item response models. Multivariate Behavioral Research, 30, 23-40.
MuthénL. K.MuthénB. O. (1998). Mplus User’s Guide(Version 4.1) [Computer software]. Los Angeles, CA: Author.
29.
R Development Core Team. (2007). R: A language and environment for statistical computing(Version 2.4.0) [Computer software]. Vienna, Austria: R Foundation for Statistical Computing. Program available at http://www.r-project.org
30.
ReeseL. M. (1995). The impact of local dependencies on some LSAT outcomes (Statistical Report 95-02.). Newtown, PA: Law School Admission Council.
31.
RosenbaumP. R. (1988). Item bundles. Psychometrika, 53, 349-359.
32.
ShannonC. E. (1948). A mathematical theory of communication. Bell System Technical Journal, 27, 376-423, 623-656.
33.
SteinbergL.ThissenD. (1996). Uses of item response theory and the testlet concept in the measurement of psychopathology. Psychological Methods, 1, 81-97.
34.
StoutW. (2002). Psychometrics: From practice to theory and back. Psychometrika, 67, 485-518.
35.
SwygertK. A.McLeodL. D.ThissenD. (2001). Factor analysis for items or testlets scored in more than two categories. In ThissenD.WainerH. (Eds.), Test scoring (pp. 217-250). Mahwah, NJ: Erlbaum.
36.
ThissenD.SteinbergL.MooneyJ. A. (1989). Trace lines for testlets: A use of multiple-categorical-response models. Journal of Educational Measurement, 26, 247-260.
37.
TsaiT.-H.HsuY.-C. (2005). The use of information entropy as a local item dependence assessment. Paper presented at the meeting of the American Educational Research Association. Montréal, Quebec, Canada.
38.
TuerlinckxF.De BoeckP. (2001). The effect of ignoring item interactions on the estimated discrimination parameters in item response theory. Psychological Methods, 6, 181-195.
39.
WainerH.BradlowE.DuZ. (2000). Testlet response theory: An analog for the 3PL model useful in testlet-based adaptive testing. In LindenW. J. v. d.GlasC. A. W. (Eds.), Computerized adaptive testing: Theory and practice (pp. 245-269). Boston, MA: Kluwer Academic.
40.
WainerH.KielyG. (1987). Item clusters and computerized adaptive testing: A case for testlet. Journal of Educational Measurement, 24, 185-202.
41.
WainerH.ThissenD. (1996). How is reliability related to the quality of test scores? What is the effect of local dependence on reliability?Educational Measurement: Issues and Practice, 15, 22-29.
42.
WainerH.WangX. (2000). Using a new statistical model for testlets to score TOEFL. Journal of Educational Measurement, 37, 203-220.
YenW. M. (1984). Effects of local item dependence on the fit and equating performance of the three-parameter logistic model. Applied Psychological Measurement, 8, 125-145.
45.
YenW. M. (1993). Scaling performance assessments: Strategies for managing local item dependence. Journal of Educational Measurement, 30, 187-213.
