The authors review the impact of research hypotheses and subject characteristics on the validity of observations. The research published over a 2-year span in 4 special education journals is then reviewed to ascertain the extent to which observer bias is a problem in special education research. It was found that about half of the research articles ran substantial risk of biased observation; in about three-fourths of these articles, no precautions were taken by the researchers to safeguard the validity of their observations.
Get full access to this article
View all access options for this article.
References
1.
Baer, D.M.Reviewer's comment: Just because it's reliable doesn't mean that you can use it. Journal of Applied Behavior Analysis, 1977, 10(1), 117-119.
2.
Barber, T.X., & Silver, M.J.Fact, fiction, and the experimenter bias effect. Psychological Bulletin Monograph Supplement, 1968, 70(6,pt.2), 1-29.
3.
Berscheid, E., & Walster, E.Beauty and the best. Psychology Today, 1972 , 5, 42-46; 74.
4.
Bloom, R., & Tesser, A.On reducing experimenter bias: The effects of forewarning. Canadian Journal of Behavioral Science, 1971, 3(2). 198-208.
5.
Campbell, D. T. Systematic error on the part of human links in communication systems . Information and Control, 1958, 1, 334-369.
6.
Campbell, D.T., & Stanley, J.C.Experimental and quasi-experimental designs for research. Chicago: Rand McNally, 1963.
7.
Cordaro, L., & Ison, J.R.Psychology of the scientist: X. observer bias in classical conditioning of the planaria. Psychological Reports, 1963 , 13, 787-789.
8.
Crowl, T.K., & MacGinitie, W.H.The influence of students' speech characteristics on teachers' evaluations of oral answers. Journal of Educational Psychology, 1974, 66(3), 304-308.
9.
Dana, J. M., & Dana, R.H.Experimenter-bias and the WAIS. Perceptual and Motor Skills, 1969, 28, 694.
10.
Follman, J., Wiley, R., Geiger, G., & Lavely, C.Effects of halo-effect instructions on level of ratings and inter-correlations . Psychological Reports, 1974, 35, 392.
11.
Foster, G.G., & Salvia, J.A.Teacher response to the label of learning disabled as a function of demand characteristics. Exceptional Children, 1977 , 43(8), 533-534.
12.
Foster, G., Ysseldyke, J., & Reese, J.I wouldn't have seen it if I hadn't believed it. Exceptional Children, 1975, 41, 469-473.
13.
Guilford, J.P.Psychometric methods. New York: McGraw-Hill, 1936.
14.
Harari, H., & McDavid, J.W.Name stereotypes and teachers' expectations. Journal of Educational Psychology, 1973, 65(2), 222-225.
15.
Hipskind, N.M., & Rintelmann, W.F.Effects of experimenter bias upon pure-tone and speech audiometry. Journal of Auditory Research, 1969, 9(4), 298-305.
16.
Johnson, R. W., & Adair, J.G.The effects of systematic recording error vs. experimenter bias on latency of word association. Journal of Experimental Research in Personality, 1970, 4, 270-275.
17.
Kazdin, A. E. Artifact, bias, and complexity of assessment: The ABC's of reliability . Journal of Applied Behavior Analysis, 1977 , 10, 141-150.
18.
Lenkowski, R.S., & Blackman, I.S.The effect of teachers' knowledge of race and social class on their judgments of children's academic competence and social acceptability. Mental Retardation, 1968, 6(6), 15-17.
19.
Madle, R.A., Neisworth, J.T., & Kurtz, P.D.Biasing of hyperkinetic behavior ratings by diagnostic reports: Effects of observer training and observation method. Journal of Learning Disabilities, 1980, 13(1), 30-33.
20.
Magee, J.W.An aptitude-by-treatment interaction analysis of teacher attitudes and the reduction of labeling bias. Unpublished doctoral dissertation, The Pennsylvania State University, 1978.
21.
Mason, E.J., & Larimore, D.L.Effects of biased psychological reports on two types of teachers' ratings. Journal of School Psychology , 1974, 12(1), 46-50.
22.
Miller, C. K., McLaughlin, J. A., Haddon, J., & Chansky, N. M. Socioeconomic class and teacher bias. Psychological Reports, 1968, 23, 806.
23.
Neer, W.L., Foster, D.A., Jones, J.G., & Reynolds, D.A.Socioeconomic bias in the diagnosis of mental retardation. Exceptional Children, 1973, 40, 38-39.
24.
Neisworth, J.T., Kurtz, P.D., Jones, R.T., & Madle, R.A.Biasing of hyperkinetic behavior ratings by diagnostic reports. Journal of Abnormal Child Psychology, 1974, 2(4), 323-329.
25.
Orne, M. T. On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. American Psychologist, 1962, 17, 776-783.
26.
Pickholtz, H.B.The effects of a child's racial ethnic label and achievement differences on school psychologists' decisions. Unpublished doctoral dissertation, The Pennsylvania State University, 1977.
27.
Podol, J., & Salvia, J.The effects of visibility of a prepalatal cleft on the evaluation of speech . Cleft Palate Journal, 1976, 13(4), 361-366.
28.
Rosenthal, R.Experimenter effects in behavioral research. New York: Appleton-Century-Crofts, 1966.
29.
Ross, M.B., & Salvia, J.A.Attractiveness as a biasing factor in teacher judgments. American Journal of Mental Deficiency, 1975, 80(1), 96-98.
30.
Salvia, J., Algozzine, R., & Sheare, J.Attractiveness and school achievement. Journal of School Psychology , 1977, 15(1), 60-67.
31.
Salvia, J., Clark, G.M., & Ysseldyke, J.E.Teacher retention of stereotypes of exceptionality . Exceptional Children, 1973, 39(8), 651-652.
32.
Saunders, B.T., & Vitro, F.T.Examiner expectancy and bias as a function of the referral process in cognitive assessment. Psychology in the Schools, 1971 , 8(2), 168-171.
33.
Smith, G.A.Observer drift under monitored and unmonitored conditions. Unpublished doctoral dissertation, The Pennsylvania State University , 1978.
34.
Sutherland, J.H.The learning disabilities label as a factor in the complex visual-motor integration performance of normal fourth grade children. Unpublished doctoral dissertation, The Pennsylvania State University, 1976.
35.
Webb, E.J., Campbell, D.T., Schwartz, E.D., & Sechrest, L.Unobstrusive measures: Nonreactive research in the social sciences . Chicago: Rand McNally, 1966.
36.
Wilson, P. R. Perceptual distortion of height as a function of ascribed academic status. Journal of Social Psychology, 1968 , 74, 97-102.
37.
Ysseldyke, J., & Foster, G.Bias in teachers' observations of emotionally disturbed and learning-disabled children. Exceptional Children, 1978, 44(8). 613-615.
