The Wechsler Intelligence Scale for Children–Third Edition (WISC-III) is the most widely used test of intelligence in the world. However, the manual for the WISC-III provides insufficient detail regarding the detection of differential item functioning (DIF). The WISC-III national standardization sample (N = 2,200) was used to investigate DIF in six WISC-III subtests. After fitting two parameter logistic and graded response models to the data, items were tested for DIF using the item response theory likelihood ratio DIF detection method. Of the 151 items studied, 52 were found to function differently across groups. The magnitude of the DIF was also considered by examining (a) parameter differences between groups and (b) root mean squared probability differences. Because the scores of boys and girls may be composed of different items systematically scored as correct, their IQs cannot be assumed to have the same meaning. Further investigations of item content bias are recommended.
Get full access to this article
View all access options for this article.
References
1.
Angoff, W. H. (1993). Perspectives on differential item functioning methodology. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 3-24. Hillsdale, NJ: Lawrence Erlbaum.
2.
Bock, R. D. (1997). The nominal categories model. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 33-49). New York: Springer.
3.
Bock, R. D. , & Aitkin, M. (1981).Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46,443-445.
4.
Braden, J. P. (1999).Straight talk about assessment and diversity: What do we know?School Psychology Review, 14, 343-355.
5.
Bryk, A. (1980). Review of Bias in mental testing. Journal of Educational Measurement, 17,369-374.
6.
Cohen, A. S. , Kim, S., & Wollack, J. A. (1996).An investigation of the likelihood ratio test for detection of differential item functioning. Applied Psychological Measurement, 20,15-26.
7.
Cotter, D. E. , & Berk, R. A. (1981, April). Item bias in the WISC-R using Black, White, and Hispanic learning disabled children. Paper presented at the annual meeting of the American Educational Research Association, Los Angeles. (ERIC Document Reproduction Service No. ED 206 631)
8.
Diana v. the California State Board of Education. Case No. C-70-37 RFP. (N.D. Cal., 1970).
9.
Dorans, N. J. , & Kulick, E. (1983). Assessing unexpected differential item performance of female candidates on SAT and TWSE forms administered in December 1977: An application of the standardization approach (Research Rep. No. 83-9). Princeton, NJ: Educational Testing Service.
10.
Engelhard, G. , Hansche, L., & Rutledge, K. E. (1990).Accuracy of bias review judges in identifying differential item functioning on teacher certification tests. Applied Psychological Measurement, 3,347-360.
11.
Feingold, A. (1993).Cognitive gender differences: A developmental perspective. Sex Roles, 29,91-112.
12.
Frisby, C. L. (1998). Poverty and socioeconomic status. In J. L. Sandoval, C. L. Frisby, K. F. Geisinger, J. D. Scheuneman, & J. R. Grenier (Eds.), Test interpretation and diversity: Achieving equity in assessment (pp. 241-270). Washington, DC: American Psychological Association.
13.
Green, B. F. , Crone, C. R., & Folk, V. G. (1989).A method for studying differential distractor functioning. Journal of Educational Measurement, 26,147-160.
14.
Herrnstein, R. J. , & Murray, C. (1994). The bell curve. New York: Free Press.
15.
Holland, P. W. , & Thayer, D. T. (1988). Differential item functioning and the Mantel-Haenszel procedure. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 129-145). Hillsdale, NJ: Lawrence Erlbaum.
16.
Hutton, J. B. , Dubes, R., & Muir, S. (1992).Assessment practices of school psychologists; Ten years later. School Psychology Review, 21,271-284.
17.
Ilai, D. , & Willerman, L. (1989).Sex differences in WAIS-R item performance. Intelligence, 13,225-234.
18.
Jastak, J. E. , & Jastak, S. R. (1964).Short forms of the WAIS and WISC Vocabulary subtests. Journal of Clinical Psychology, 20,167-199.
19.
Jensen, A. R. (1969).How much can we boost IQ and scholastic achievement?Harvard Educational Review, 39, 1-123.
20.
Jensen, A. R. (1980). Bias in mental testing. New York: Free Press.
21.
Kamphaus, R. W. (1993). Clinical assessment of children’s intelligence. Needham Heights, MA: Allyn & Bacon.
22.
Koh, T. , Abbatiello, A., & McLoughlin, C. S. (1984).Cultural bias in WISC subtest items: A response to Judge Grady’s suggestions in relation to the PASE case. School Psychology Review, 13,89-94.
23.
Larry P. et al. v. Wilson Riles, Superintendent of Public Instruction for the State of California et al. Case No. C-71-2270 (N.D. Cal., 1979).
24.
Lawrence, I. M. , & Curley, W. E. (1989, March). Differential item functioning of SAT-Verbal reading subscore items for males and females: Follow-up study. Paper presented at the annual meeting of the American Educational Research Association, San Francisco.
25.
Lawrence, I. M. , Curley, W. E., & McHale, F. J. (1988, April). Differential item functioning of SAT-Verbal reading subscore items for male and female examinees. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA.
26.
Linn, R. L. , Levine, M. V., Hastings, C. N., & Waldrop, J. L. (1980). An investigation of item bias in a test of reading comprehension (Technical Rep. No. 163). Urbana: Center for the Study of Reading, University of Illinois at Urbana-Champaign.
27.
Loehlin, J. C. , Lindzey, G., & Spuhler, J. N. (1975). Race differences in intelligence. San Francisco: W. H. Freeman.
28.
Lynn, R. (1977).The intelligence of the Japanese. Bulletin of the British Psychological Society, 30,69-72.
29.
Maller, S. J. (1996).WISC-III Verbal item invariance across samples of deaf and hearing children of similar measured ability. Journal of Psychoeducational Assessment, 14,152-165.
30.
Maller, S. J. (1997).Deafness and WISC-III item difficulty: Invariance and fit. Journal of School Psychology, 35,299-314.
31.
Mantel, N. (1963).Chi-square tests with one degree of freedom, extensions of the Mantel-Haenszel procedure. American Statistical Association Journal, 58,690-700.
32.
Miele, F. (1979).Cultural bias in the WISC. Intelligence, 3,149-164.
33.
Mishra, S. P. (1983). Ethnic group bias in WISC-R Verbal items. Paper presented at the annual meeting of the American Psychological Association, Anaheim, CA.
34.
Munford, P. R. , & Munoz, A. (1980).A comparison of the WISC and WISC-R on Hispanic children. Journal of Clinical Psychology, 36,452-458.
35.
Nelson, K. M. , Arthur, P., Lautiger, J., & Smith, D. K. (1994, March). Does the use of color on the WISC-III affect student performance? Paper presented at the annual meeting of the National Association of School Psychologists, Seattle, WA.
36.
O’Neill, K. A. , & McPeek, W. M. (1993). Item and test characteristics that are associated with differential item functioning. In H. Wainer & H. I. Braun (Eds.), Differential item functioning (pp. 255-276). Hillsdale, NJ: Lawrence Erlbaum.
37.
Plake, B. S. (1980).A comparison of a statistical and subjective procedure to ascertain item validity: One step in the test validation process. Educational and Psychological Measurement, 30,397-404.
38.
Ross-Reynolds, J. , & Reschly, D. J. (1983).An investigation of item bias on the WISC-R with four sociocultural groups. Journal of Consulting and Clinical Psychology, 51,144-146.
39.
Ryan, K. E. , & Fan, M. (1994, April). Gender differences on a test of mathematics: Multidimensionality or differential test functioning. Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans, LA.
40.
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph, 4(2), Whole No. 17.
41.
Sandoval, J. (1979).The WISC-R and internal evidence of test bias with minority groups. Journal of Consulting and Clinical Psychology, 47, 919-919.
42.
ndoval, J. , & Miille, M.P.W. (1980).Accuracy of judgements of WISC-R item difficulty for minority groups. Journal of Consulting and Clinical Psychology, 48,249-249.
43.
ndoval, J. , Zimmerman, I. L., & Woo-Sam, J. M. (1977).Cultural differences on the WISC-R Verbal items. Journal of School Psychology, 21,49-55.
44.
Scheuneman, J. D. (1978, March). Ethnic group bias in intelligence test items. Paper presented at the American Educational Research Association, Toronto, Canada.
45.
Scheuneman, J. D. (1987).An experimental, exploratory study of causes of bias in test items. Journal of Educational Measurement, 24,97-118.
46.
Scheuneman, J. D. , & Gerritz, K. (1990).Using differential item functioning procedures to explore sources of item difficulty and group performance characteristics. Journal of Educational Measurement, 27,109-131.
47.
Smith, T. C. , Edmonds, J. E., & Smith, B. (1989).The role of sex differences in the referral process as measured by the Peabody Picture Vocabulary Test–Revised and the Wechsler Intelligence Scale for Children–Revised. Psychology in the Schools, 26,354-358.
48.
Stinnett, T. A. , Havey, J. M., & Oehler-Stinnett, J. (1994).Current test usage by practicing school psychologists: A national survey. Journal of Psychoeducational Assessment, 12,331-350.
Thissen, D. , & Steinberg, L. (1997). A response model for multiple-choice items. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 51-65). New York: Springer.
51.
Thissen, D. , Steinberg, L., & Gerrard, M. (1986).Beyond group mean differences: The concept of item bias. Psychological Bulletin, 99,118-128.
52.
Thissen, D. , Steinberg, L., & Wainer, H. (1988). Use of item response theory in the study of group differences in trace lines. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 149-169). Hillsdale, NJ: Lawrence Erlbaum.
53.
Thissen, D. , Steinberg, L., & Wainer, H. (1993). Detection of differential item functioning using the parameters of item response theory. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 67-114). Hillsdale, NJ: Lawrence Erlbaum.
54.
Turner, R. G. , & Willerman, L. (1977).Sex differences in WAIS item performance. Journal of Clinical Psychology, 33,795-798.
55.
Vance, B. , Hankins, N., & Brown, W. (1988).Ethnic and sex differences on the Test of Nonverbal Intelligence, Quick Test of Intelligence, and Wechsler Intelligence Scale for Children–Revised. Journal of Clinical Psychology, 44,261-265.
56.
Wechsler, D. (1944). Measurement of adult intelligence. Baltimore: Williams & Wilkins.
57.
Wechsler, D. (1974). The Wechsler Intelligence Scale for Children–Revised. New York: Psychological Corporation.
58.
Wechsler, D. (1991). Wechsler Intelligence Scale for Children–Third Edition. San Antonio, TX: Psychological Corporation.
59.
Weiss, L. G. , & Prifitera, A. (1995).An evaluation of differential prediction of WIAT achievement cores from WISC-III FSIQ across ethnic and gender groups. Journal of School Psychology, 33,279-304.
60.
Weiss, L. G. , Prifitera, A., & Roid, G. (1993). The WISC-III and the fairness of predicting achievement across ethnic and gender groups. Journal of Psychoeducational Assessment, Monograph Series: WISC-III, 35-42.
61.
Welch, C. , & Hoover, H. D. (1993).Procedures for extending item bias techniques to polytomously scored items. Applied Psychological Measurement, 6,1-19.
62.
Wessel, J. , & Potter, A. (1994, March). Analysis of WISC-III data from an urban population of referred children. Paper presented at the annual meeting of the National Association of School Psychologists, Seattle, WA.
63.
Wild, C. L. , & McPeek, W. M. (1986, August). Performance of the Mantel-Haenszel statistic in identifying differentially functioning items. Paper presented at the annual meeting of the American Psychological Association, Washington, DC.
64.
Wilkinson, S. C. (1993).WISC-R profiles of children with superior intellectual ability. Gifted Child Quarterly, 2,84-92.
65.
Willson, V. L. , Nolan, R. F., Reynolds, C. R., & Kamphaus, R. W. (1989).Race and gender effects on item functioning on the Kaufman Assessment Battery for Children. Journal of School Psychology, 27,289-296.
66.
Zwick, R. , Donoghue, J. R., & Grima, A. (1993).Assessing differential item functioning in performance tasks. Journal of Educational Measurement, 30,233-251.
