A biased test is generally understood to be a test that produces results that are systematically unfair to some group. For this to happen, the test must ordinarily measure variables for that group at least partly distinct from those it measures for other people in the population. There are two elements in this proposition: on the one hand, there is a matter of fairness, and, on the other hand, there is a matter of measuring different things for different groups. Although the two are logically related, they are not identical in all instances. That is, a test must usually measure different things for different groups to be unfair, but it is possible to have a test that measures different things for different groups and yet does not produce unfair results because of the way it is used.
Get full access to this article
View all access options for this article.
References
1.
American Psychological Association (1974) Standards for Educational and Psychological Tests. Washington, D.C.
2.
WindhamD. M. (1966) Standards for Educational and Psychological Tests and Manuals. Washington, D.C.
3.
WindhamD. M. (1954) Technical Recommendations for Psychological Tests and Diagnostic Techniques. Supplement to Psych. Bull.51, 2, Part 2.
4.
AngoffW. H.FordS. F. (1973) “Item-race interaction on a test of scholastic aptitude.” J. of Educ. Measurement10: 95–106.
5.
CardallC.CoffmanW. E. (1964) “A method for comparing the performance of different groups on the items in a test.” Research Bull. 64-61. Princeton, N.J.: Educational Testing Service.
6.
ClearyT. A.HiltonT. L. (1968) “An investigation of item bias.” Educ. and Psych. Measurement28: 61–75.
7.
ColeM.GayJ.GlickJ. A.SharpD. W. (1971) The Cultural Context of Learning and Thinking. New York: Basic Books.
8.
ColeN. S. (1973) “Bias in selection.” J. of Educ. Measurement10: 237–255.
9.
CronbachL. J. (1975) “Five decades of public controversy over mental testing.” Amer. Psychologist30: 1–14.
10.
CronbachL. J. (1971) “Test validation,” in ThorndikeR. L. (ed.) Educational Measurement. Washington, D.C.: Washington, D.C..
11.
CTB/McGraw-Hill (1974) Comprehensive Tests of Basic Skills, Form S: Technical Bulletin No. 1. Monterey, Calif.
12.
DarlingtonR. B. (1971) “Another look at ‘culture fairness.’” J. of Educ. Measurement 8: 71–82.
13.
DunfeeM. [ed.] (1974) Eliminating Ethnic Bias in Instructional Materials: Comment and Bibliography. Washington, D.C.: Association for Supervision and Curriculum Development.
14.
GreenD. R. (1973) “Racial and ethnic bias in achievement tests and what to do about it.” CTB/McGraw-Hill.
15.
GreenD. R. (1971) Racial and Ethnic Bias in Test Construction. Monterey, Calif.: CTB/McGraw-Hill.
16.
GreenD. R.DraperJ. F. (1972) “Exploratory studies of bias in achievement tests.” Presented at the meeting of the American Psychological Association, Honolulu.
17.
GreenD. R.RoudabushG. E. (1975) “An investigation of bias in a criterion-referenced reading test.” Presented at the meeting of the American Educational Research Association, Washington, D.C.
18.
LinnR. L. (1973) “Fair test use in selection.” Rev. of Educ. Research43: 139–161.
19.
McGRAW-HILL (1974a) Guidelines for Equal Treatment of the Sexes in McGraw-Hill Book Company Publications. New York.
20.
McGRAW-HILL (1974b) Multiethnic Publishing Guidelines. New York.
21.
MerzW. R. (1974) “A biased test may be fair, but then what does that really mean?” Presented at the meeting of the California Educational Research Association, San Francisco.
22.
MerzW. R. (1973) “Factor analysis as a technique in analyzing test item bias.” Presented at the meeting of the California Educational Research Association, Los Angeles.
23.
MessickS. (1974) “The standard problem: meaning and values in measurement and evaluation.” Research Bull. 74-44. Princeton, N.J.: Educational Testing Service.
24.
PetersenN. S.NovickM. R. (1975) “An evaluation of some models for test bias.” Presented at the meeting of the American Educational Research Association, Washington, D.C.
25.
PyrczakF. (1974) “Passage-dependence of multiple-choice items designed to measure the ability to identify the main idea of a paragraph: implications for validity.” Educ. and Psych. Measurement34: 343–348.
26.
ScheunemanJ. (1975) “A new method of assessing bias in test items.” Presented at the meeting of the American Educational Research Association, Washington, D.C.
27.
SommerJ. (1970) “Response to Robert Williams.” Counseling Psychologist2: 92
28.
TempG. (1971) “Validity of the SAT for blacks and whites in thirteen integrated institutions.” J. of Educ. Measurement8: 245–251.
29.
ThorndikeR. L. (1971) “Concepts of culture-fairness.” J. of Educ. Measurement8: 63–70.
30.
TuinmanJ. J. (1973-1974) “Determining the passage dependency of comprehension questions in five major tests.” Reading Research Q. 9: 206–223.
31.
VealeJ. R.ForemanD. I. (1975) “Cultural validity of test instruments: a new approach.” (unpublished)
