A Social Validation of College Examinations

Abstract

Social validation procedures were used to compare views held by professors and students concerning college examinations. In the first phase of this project, four groups of participants (21 professors and 126 students representing psychology and biology) listed characteristics of good and poor tests. The characteristics given by the groups were somewhat similar, although very few ideas were given about the results of examinations (e.g., range of scores). A socially valid questionnaire was constructed from the most commonly cited characteristics, and four additional groups of professors (n = 25) and students (n = 102) were asked to rate the importance of each. MANOVAs indicated that the professors and students gave significantly different ratings, but there were only slight differences between the two disciplines, and no differences between those who reported having taken measurement or testing classes and those who had not. The differences between professors and students were especially clear in ratings of Instructions and Question characteristics of tests. In contrast, items from the questionnaire concerning the Coverage and Content of an examination were given similar ratings by the four groups. The results suggest a number of ways that professors can construct examinations which students will respect.

Get full access to this article

View all access options for this article.

References

Anastasi, A. (1982). Psychological testing (5th ed.). New York: Macmillan.

Juvonen, J. (1987, April). Outcome and attributional disagreements between students and their teachers. Presented at the meeting of the Western Psychological Association, San Francisco, CA.

Kazdin, A. E. (1977). Assessing the clinical or applied importance of behavior change through social validation. Behavior Modification, 1, 427-451.

Nunnally, J. C. (1978). Psychometric theory (2nd ed.) New York: McGraw-Hill.

Runco, M. A. (1984). Teachers' judgments of creativity and social validation of divergent thinking tests. Perceptual and Motor Skills, 59, 711-719.

Runco, M. A. and Schreibman, L. (1983). Parental judgments of behavior therapy efficacy with autistic children: A social validation. Journal of Autism and Developmental Disorders, 13, 237-248.

Runco, M. A. and Schreibman, L. (1988). Children's judgments of autism and social validation of behavior therapy efficacy. Behavior Therapy, 19, 565-576.

Runco, M. A. and Thurston, B. J. (1987). Students' ratings of college teaching: A social validation. Teaching of Psychology, 14, 89-91.

Wolf, M. M. (1978). Social validity: The case for subjective measurement or how applied behavior analysis is finding its heart. Journal of Applied Behavior Analysis, 11, 203-214.