Although several different procedures are available for detecting item bias and selection bias, there does not appear to be a single procedure for detecting both types of bias. It is proposed that the Regression Model, which is popular in selection bias research, be adopted for item bias detection, thereby providing a common framework for studying both types of bias. In keeping with the commonality, the new method will be referred to as the Regression Bias method. An empirical test of the Regression Bias method as well as a comparison of the Regression Bias method with the other commonly used item bias detection methods are presented.
Get full access to this article
View all access options for this article.
References
1.
Angoff, W. H. (1972, September). A technique for the investigation of cultural differences. Paper presented at the meeting of the American Psychological Association, Honolulu.
2.
Angoff, W. H. and Ford, S. F. (1973). Item-race interaction on a test of scholastic aptitude. Journal of Educational Measurement, 10, 95-105.
3.
Berk, R. A. (1982). Handbook of methods for detecting test bias. Baltimore, MD: Hopkins University Press.
4.
Bereiter, A. (1975). Individualization and inequality. Contemporary Psychology, 20, 455-456.
5.
Camilli, G. (1979). A critique of the chi-square method for assessing item bias. Unpublished paper, Laboratory of Educational Research, University of Colorado, Boulder.
6.
Cardall, C. and Coffman, W. E. (1964). A method for comparing the performance of different groups on the items in a test. Princeton, NJ: Educational Testing Service.
7.
Cleary, T. A. (1968). Test bias: Prediction of grades of Negro and white Students in integrated colleges. Journal of Educational Measurement, 5, 115-124.
8.
Cole, N. A. (1973). Bias in selection. Journal of Educational Measurement, 10, 237-255.
9.
Cronbach, L. J. , Yalow, E., and Schaeffer, G. (1980). A mathematical structure for analyzing fairness in selection. Personnel Psychology, 33, 693-703.
10.
Darlington, R. B. (1971). Another look at cultural fairness. Journal of Education Measurement, 8, 71-82.
11.
Devine, P. J. and Raju, N. S. (1982). Extent of overlap among four item bias methods. Educational And Psychological Measurement, 42, 1049-1066.
12.
Dwyer, J. H. (1983). Statistical models for the social and behavioral sciences. New York, NY: Oxford University Press.
13.
Einhorn, H. J. and Bass, A. R. (1971). Methodological considerations relevant to discrimination in employment testing. Psychological Bulletin, 78, 261-269.
14.
Green, D. R. (1975). What does it mean to say a test is biased? Education and Urban Society, 8, 33-52.
15.
Green, D. R. and Draper, J. F. (1972). Exploratory studies of bias in achievement tests. Monterey: CTB/McGraw-Hill.
16.
Gross, A. L. and Su, W. (1975). Defining a fair or unbiased selection model: A question of utilities. Journal of Applied Psychology, 60, 345-351.
17.
Hunter, J. E. (1975). A critical analysis of the use of item means and item-test correlations to determine the presence or absence of content bias in achievement test items. Paper presented at the National Institute of Education conference on test bias, Maryland.
18.
Hunter, J. E. and Schmidt, F. L. (1976). Critical analysis of the statistical and ethical implications of various definitions of test bias. Psychological Bulletin, 83, 1053-1071.
19.
Ironson, G. H. and Subkoviak, M. (1979). A comparison of several methods of assessing item bias. Journal of Educational Measurement, 16, 209-225.
20.
Linn, R. L. (1973). Fair test use in selection. Review of Educational Research, 43, 139-161.
21.
Lord, F. M. (1980). Applications of item response theory to practical testing problems. New Jersey: Erlbaum.
22.
McNemar, Q. (1975). On so-called test bias. American Psychologist. 30, 848-851.
23.
Merz, W. R. (1973). Factor analysis as a technique in analyzing item bias. Paper presented at the Annual Meeting of the California Educational Research Association, Los Angeles.
24.
Peterson, N. S. (1976). An expected utility model for "optimal" selection. Journal of Educational Statistics, 1, 333-358.
25.
Rao, C. R. (1973). Linear statistical inference and its applications. New York: John Wiley & Sons, Inc.
26.
Reckase, M. D. (1979). Unifactor latent trait models applied to multifactor tests: Results and implications. Journal of Educational Statistics, 4, 207-230.
27.
Reynolds, C. R. (1981). The problem of bias in psychological assessment. In C. R. Reynolds and T. B. Gutkin (Eds.), The handbook of school psychology. New York: John Wiley & Sons.
28.
Rudner, L. M. (1977). An evaluation of select approaches for biased item identification. Unpublished doctoral dissertation, The Catholic University of America.
29.
Scheumeman, J. (1979). A method of assessing bias in test items. Journal of Educational Measurement, 16, 143-152.
30.
Science Research Associates. (1978). SRA Achievement Series, Form 1 (1978 ed.). Chicago: Author.
31.
Shepard, L. A. (1980). Definitions of bias. Paper presented at the third annual Johns Hopkins University Symposium on Educational Research, Washington, DC, November.
32.
Shepard, L. A. , Camilli, G., and Averill, M.Comparison of six procedures for detecting test item bias using both internal and external ability criteria. Journal of Educational Statistics, 6, 317-375.
33.
Thorndike, T. L. (1971). Concepts of culture-fairness. Journal of Education Measurement, 8, 63-70.
34.
Wood, R. L. , Wingersky, M. S., and Lord, F. M. (1976). LOGIST: A computer program for estimating examinee ability and item characteristic curve parameters. Research Memorandum, Princeton, NJ: Educational Testing Service.
35.
Wright, B. D. , Mead, R. J., and Bell, S. R. (1980). Bical: Calibrating items with the Rasch model. Research memorandum 230, Statistical Laboratory, Department of Education, University of Chicago.
36.
Wright, B. D. , Mead, R. J., and Draba, R. (1976). Detecting and correcting test item bias with a logistic response model. Research Memorandum 22, Statistical Laboratory, Department of Education, University of Chicago.
