A parallel design, in which items across different scales within an instrument share common stimuli and subjects respond to the common stimulus for each scale, is sometimes used in questionnaires or inventories. Because the items across scales share the same stimuli, the assumption of local item independence may not hold, thereby violating the assumption of local item independence under standard psychometric models. In this study, the authors describe a multidimensional item response model to detect specific forms of local item dependence. Three real data sets were analyzed to illustrate implications and applications of the proposed method.
Adams, R. J., & Wilson, M. R. (1996). Formulating the Rasch model as a mixed coefficients multinomial logit. In G. Englhard & M. Wilson (Eds.), Objective measurement: Theory into practice (Vol. 3, pp. 143-166). Norwood, NJ: Ablex.
2.
Adams, R. J., & Wilson, M. R., & Wang, W.-C. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21, 1-23.
3.
Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561-573.
4.
Andrich, D. (1985). A latent-trait model for item with response dependences: Implications for test construction and analysis. In S. E. Embretson (Ed.), Test design: Developments in psychology and psychometrics (pp. 245-275). New York: Academic Press.
5.
Béguin, A. A., & Glas, C. A. W. (2001). MCMC estimation and model-fit analysis of multidimensional IRT models. Psychometrika, 66, 541-562.
6.
Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinees ability. In F. Lord & M. Novick, Statistical theories of mental test scores (pp. 397-479). Reading, MA: Addison-Wesley.
7.
Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of the EM algorithm. Psychometrika, 46, 443-459.
8.
Bock, R. D., Gibbons, R., & Muraki, E. J. (1988). Full information item factor analysis. Applied Psychological Measurement, 12, 261-280.
9.
Bradlow, E. T., Wainer, H., & Wang, X. (1999). A Bayesian random effects model for testlets. Psychometrika, 64, 153-168.
10.
Chen, W., & Thissen, D. (1997). Local dependence indexes for item pairs using item response theory. Journal of Educational and Behavior Statistics, 22, 265-289.
11.
Cheng, Y.-Y., & Wang, W.-C. (1999). Creative thinking and its related factors for teachers with science competition awards. Research report of the National Science Council, Taiwan.
12.
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from in complete data via the EM algorithm. Journal of the Royal Statistical Society, 39B, 1-38.
13.
Fischer, G. H. (1973). The linear logistic test model as an instrument in educational research. Acta Psychologica, 37, 359-374.
14.
Fischer, G. H., & Parzer, P. (1991). An extension of the rating scale model with an application to the measurement of treatment effects. Psychometrika, 56, 637-651.
15.
Fischer, G. H., & Pononcy, I. (1994). An extension of the partial credit model with an application to the measurement of change. Psychometrika, 59, 177-192.
16.
Fraser, C. (1988). NOHARM: A Fortran program for fitting unidimensional and multidimensional normal ogive models of latent trait theory [Computer software and manual]. Armidale, Australia: University of New England, Centre for Behavioral Studies.
17.
Hattie, J. (1981). Decision criteria for determining unidimensionality. Unpublished doctoral dissertation, University of Toronto, Toronto, Canada.
18.
Hoijtink, H., Rooks, G., & Wilmink, F. W. (1999). Confirmatory factor analysis of items with a dichotomous response format using the multidimensional Rasch model. Psychological Methods, 4, 300-314.
19.
Hoskens, M., & De Boeck, P. (1997). A parametric model for local dependence among test items. Psychological Methods, 2, 261-277.
20.
Hoskens, M., & De Boeck, P. (2001). Multidimensional componential item response theory models for polytomous items. Applied Psychological Measurement, 25, 19-37.
21.
Jannarone, R. J. (1986). Conjunctive item response theory kernels. Psychometrika, 51, 357-384.
22.
Jannarone, R. J. (1995). Local dependence: Objectively measures or objectionably abominable? In M. Wilson (Ed.), Objective measurement: Theory into practice (Vol. 2, pp. 209-234). Norwood, NJ: Ablex.
23.
Johnson, D. E. (1998). Applied multivariate methods for data analysts. Pacific Grove, CA: Brooks/Cole.
24.
Kelderman, H. (1996). Multidimensional Rasch models for partial-credit scoring. Applied Psychological Measurement, 20, 155-168.
25.
Kelderman, H. (1997). Loglinear multidimensional item response models for polytomously scored items. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 287-304). New York: Springer-Verlag.
26.
Kelderman, H., & Rijkes, C. P. M. (1994). Loglinear multidimensional IRT models for polytomously scored items. Psychometrika, 59, 149-176.
27.
Lazarsfeld, P. F., & Henry, N. W. (1968). Latent structure analysis. Boston: Houghton-Mifflin.
28.
Linacre, J. M. (1989). Many-faceted Rasch measurement. Chicago: MESA.
29.
Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum.
30.
Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
31.
Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.
32.
McDonald, R. P. (1982). Linear versus nonlinear models in latent trait theory. Applied Psychological Measurement, 6, 379-396.
33.
McKinley, R. L., & Reckase, M. D. (1983). MAXLOG: A computer program for the estimation of the parameters of a multidimensional logistic model. Behavior Research Methods and Instrumentation, 15, 389-390.
34.
Muraki, E. (1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16, 159-176.
35.
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Institute of Educational Research.
36.
Reckase, M. D. (1985). The difficulty of test items that measure more than one dimension. Applied Psychological Measurement, 9, 401-412.
37.
Rosenbaum, P. R. (1984). Testing the conditional independence and monotonicity assumptions of item response theory. Psychometrika, 49, 425-435.
38.
Rosenbaum, P. R. (1988). Item bundles. Psychometrika, 53, 349-359.
39.
Rost, J., & Carstensen, C. H. (2002). Multidimensional Rasch measurement via item component models and faceted designs. Applied Psychological Measurement, 26, 42-56.
40.
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 17, 1-100.
41.
SAS Institute, Inc.(1999). The NLMIXED procedure [Computer software].Cary, NC: Author.
42.
Sireci, S. G., Thissen, D., & Wainer, H. (1991). On the reliability of testlet-based tests. Journal of Educational Measurement, 28, 237-247.
43.
Steinberg, L., & Thissen, D. (1996). Uses of item response theory and the testlet concept in the measurement of psychopathology. Psychological Methods, 1, 81-97.
44.
Thissen, D., Steinberg, L., & Mooney, J. A. (1989). Trace lines for testlets: A use of multiple-categorical-response models. Journal of Educational Measurement, 26, 247-260.
45.
Wainer, H. (1995). Precision and differential item functioning on a testlet-based test: The 1991 Law School Admissions Test as an example. Applied Measurement in Education, 8, 157-186.
46.
Wainer, H., & Kiely, G. (1987). Item clusters and computerized adaptive testing: A case for testlets. Journal of Educational Measurement, 24, 185-202.
47.
Wainer, H., & Lukhele, R. (1997). How reliable are TOEFL scores?Educational and Psychological Measurement, 57, 749-766.
48.
Wainer, H., Sireci, S. G., & Thissen, D. (1991). Differential testlet functioning: Definitions and detection. Journal of Educational Measurement, 28, 197-219.
49.
Wainer, H., & Thissen, D. (1996). How is reliability related to the quality of test scores? What is the effect of local dependence on reliability?Educational Measurement: Issues and Practice, 15(1), 22-29.
50.
Wainer, H., & Wang, X. (2000). Using a new statistical model for testlets to score TOEFL. Journal of Educational Measurement, 37, 203-220.
51.
Wang, X., Bradlow, E. T., & Wainer, H. (2002). A general Bayesian model for testlets: Theory and applications. Applied Psychological Measurement, 26, 109-128.
52.
Wilson, D. T., Wood, R., & Gibbons, R. (1991). TESTFACT: Test scoring, item statistics, and item factor analysis [Computer software and manual]. Mooresville, IN: Scientific Software.
53.
Wilson, M. R. (1988). Detecting and interpreting local item dependence using a family of Rasch models. Applied Psychological Measurement, 12, 353-364.
54.
Wilson, M. R. (1992). The partial order model: An extension of the partial credit model. Applied Psychological Measurement, 16, 309-325.
55.
Wilson, M. R., & Adams, R. J. (1995). Rasch models for item bundles. Psychometrika, 60, 181-198.
56.
Wolfinger, R. D., & SAS Institute, Inc. (n.d.). Fitting nonlinear mixed models with the new NLMIXED procedure. Retrieved November 11, 2003, from http://support.sas.com/rnd/app/papers/nlmixedsugi.pdf
57.
Wu, M. L., Adams, R. J., & Wilson, M. R. (1998). ConQuest [Computer software and manual]. Camberwell: Australian Council for Educational Research.
58.
Yen, W. M. (1984). Effects of local item dependence on the fit and equating performance of the three parameter logistic model. Applied Psychological Measurement, 8, 125-145.
59.
Yen, W. M. (1993). Scaling performance assessments: Strategies for managing local item dependence. Journal of Educational Measurement, 30, 187-213.
