Sage Journals: Discover world-class research

Abstract

A power formula for the SIBTEST procedure for differential item functioning (DIF) is derived. The power of SIBTEST is related to the item response function (IRF) for the studied item, the latent trait distributions and the sample sizes for the reference and focal groups, and the proportion of each group in the sample. Based on the power formula, a method for calculating the sample size for a desired power level is presented. Monte Carlo simulation studies show that the theoretical values calculated from the formulas derived in the article are close to what are observed in the simulated data.

Keywords

DIF SIBTEST item response theory power

Get full access to this article

View all access options for this article.

References

Bolt

D. M.

(2000). A SIBTEST approach to testing DIF hypotheses using experimentally designed test items. Journal of Educational Measurement, 37, 307-327.

Chang

H. H.

Mazzeo

Roussos

(2005). Detecting DIF for polytomously scored items: An adaptation of the SIBTEST procedure. Journal of Educational Measurement, 33, 333-353.

DeMars

C. E.

(2010). Type I error inflation for detecting DIF in the presence of impact. Educational and Psychological Measurement, 70, 961-972.

Dorans

N. J.

Kulick

(1986). Demonstrating the utility of the standardization approach to assessing unexpected differential item performance on the Scholastic Aptitude Test. Journal of Educational Measurement, 23, 355-368.

Gierl

M. J.

Gotzmann

Boughton

K. A.

(2004). Performance of SIBTEST when the percentage of DIF Items is large. Applied Measurement in Education, 17, 241-264.

Holland

P. W.

Thayer

D. T.

(1988). Differential item performance and the Mantel-Haenszel procedure. In Wainer

Braun

(Eds.), Test validity (pp. 129-145). Hillsdale, NJ: Erlbaum.

Holland

P. W.

Wainer

H. E.

(1993). Differential item functioning: Theory and practice. Hillsdale, NJ: Erlbaum.

Jiang

Stout

(1998). Improved Type I error control and reduced estimation bias for DIF detection using SIBTEST. Journal of Educational Statistics, 23, 291-322.

Lehmann

E. L.

(1999). Elements of large-sample theory. New York, NY: Springer.

10.

H.-H.

Stout

(1996). A new procedure for detection of crossing DIF. Psychometrika, 61, 647-677.

11.

Lord

F. M.

(1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.

12.

Nandakumar

Roussos

(2004). Evaluation of the CATSIB DIF procedure in a pretest setting. Journal of Educational and Behavioral Statistics, 29, 177-199.

13.

Paek

Wilson

(2011). Formulating the Rasch differential item functioning model under the marginal maximum likelihood estimation context and its comparison with Mantel-Haenszel procedure in short test and small sample conditions. Educational and Psychological Measurement, 71, 1023-1046.

14.

Raju

N. S.

(1988). The area between two item characteristic curves. Psychometrika, 53, 495-502.

15.

Rasch

(1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: The Danish Institute of Educational Research.

16.

Roussos

L. A.

Stout

W. F.

(1996). Simulation studies of the effects of small sample size and studied item parameters on SIBTEST and Mantel-Haenszel Type I error performance. Journal of Educational Measurement, 33, 215-230.

17.

Shealy

Stout

(1993). A model-based standardization approach that separates true bias/DIF from group ability differences and detects test bias/DTF as well as item bias/DIF. Psychometrika, 58, 159-194.

18.

Uttaro

Millsap

R. E.

(1994). Factors influencing the Mantel-Haenszel procedure in the detection of differential item functioning. Applied Psychological Measurement, 18(1), 15-25.

19.

Woods

C. M.

(2011). DIF testing for ordinal items with poly-SIBTEST, the Mantel and GMH tests, and IRT-LR-DIF when the latent distribution is nonnormal for both groups. Applied Psychological Measurement, 35, 145-164.

20.

Zwick

R. J.

(1990). When do item response function and Mantel-Haenszel definitions of differential item functioning coincide?Journal of Educational Statistics, 15, 185-197.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.63 MB

A Power Formula for the SIBTEST Procedure for Differential Item Functioning

Abstract

Keywords

Get full access to this article

References

Supplementary Material