Sage Journals: Discover world-class research

Abstract

Raju, van der Linden, & Fleer (1995) proposed an item response theory based, parametric differential item functioning (DIF) and differential test functioning (DTF) procedure known as differential functioning of items and tests (DFIT). According to Raju et al., the DFIT framework can be used with unidimensional and multidimensional data that are scored dichotomously and/or polytomously. This study examined the polytomous-DFIT framework. Factors manipulated in the simulation were: (1) length of test (20 and 40 items), (2) focal group distribution, (3) number of DIF items, (4) direction of DIF, and (5) type of DIF. The findings provided promising results and indicated directions for future research. The polytomous DFIT framework was effective in identifying DTF and DIF for the simulated conditions. The DTF index did not perform as consistently as the DIF index. The findings are similar to those of unidimensional and multidimensional DFIT studies.

Get full access to this article

View all access options for this article.

References

Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561–573.

Baker, F. B. (1993). EQUATE2: Computer program for equating two metrics in item response theory[Computer program]. Madison: University of Wisconsin, Laboratory of Experimental Design.

Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29–51.

Candell, G. L. , & Drasgow, F. (1988). An iterative procedure for linking metrics and assessing item bias in item response theory. Applied Psychological Measurement, 12, 253–260.

Chang, H. , & Mazzeo, J. (1994). The unique correspondence of the item response function and item category response functions in polytomously scored item response models. Psychometrika, 59, 391–404.

Cohen, A. S. , & Kim, S. H. (1993). A comparison of Lord’s X 2 and Raju’s area measures on detection of DIF. Applied Psychological Measurement, 17, 39–52.

Drasgow, F. (1987). Study of the measurement of bias of two standardized psychological tests. Journal of Applied Psychology, 72, 19–29.

Dunbar, S. B. , Koretz, D. M. ,& Hoover, H. D. (1991). Quality control in the development and use of performance assessments. Applied Measurement in Education, 4, 289–303.

Fleer, P. F. (1993). Amonte carlo assessment of a new measure of item and test bias (Doctoral dissertation, Illinois Institute of Technology, 1993) Dissertation Abstracts International, 54-04B, 2266.

10.

Lautenschlager, G. J. , & Park, D. G. (1988). IRT item bias detection procedures: Issues of model misspecification, robustness, and parameter linking. Applied Psychological Measurement, 12, 365–376.

11.

Lord, F. M. (1980). Applications of item response theory to practical testing problems.Hillsdale NJ: Erlbaum.

12.

Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149–174.

13.

Miller, M. D. , & Oshima, T. C. (1992). Effect of sample size, number of biased items, and magnitude-of bias on a two-stage item bias estimation method. Applied Psychological Measurement, 16, 381–388.

14.

Muraki, E. (1992). Ageneralized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16, 159–176.

15.

Muraki, E. , & Bock, R.D. (1993). PARSCALE2: IRT based test scoring and item analysis for graded open-ended exercises and performance tasks[Computer program]. Chicago: Scientific Software International.

16.

Oshima, T. C. , Raju, N. , & Flowers, C. P. (1997). Development and demonstration of multidimensional IRT-based internal measures of differential functioning of items and tests. Journal of Educational Measurement, 34, 253–272.

17.

Raju, N. (1995). DFITPU: A FORTRAN program for calculating DIF/DTF[Computer program].Atlanta: Georgia Institute of Technology.

18.

Raju, N. S. , van der Linden, W. J. ,& Fleer, P. F. (1995). IRT-based internal measure of differential functioning of items and tests. Applied Psychological Measurement, 19, 353–368.

19.

Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph, No. 17.

20.

Samejima, F. (1972). A general model for freeresponse data. Psychometrika Monograph, No. 18.

21.

Zwick, R. , Donoghue, J. R. , & Grima, A. (1993). Assessment of differential item functioning for performance tasks. Journal of Educational Measurement, 30, 233–251.

A Description and Demonstration of the Polytomous-DFIT Framework

Abstract

Get full access to this article

References