Item Placement and Wording Effects on Overall Ratings

Abstract

The purpose of the studies was to investigate the influence of the placement and wording (either positively or negatively) of rating scale items on students' overall course and instructor ratings. In both studies six evaluation forms were administered wherein 0, 10 or 20 of 30 scale items were negatively worded and presented either before or after overall ratings were assigned by students. In study one, the six forms were randomly administered to students enrolled in a single course taught by one instructor. In study two, the six forms were randomly administered in 14 course sections taught by 7 instructors. Results of both studies indicated that the overall ratings of the course and instructor were not significantly effected by the positive or negative wording of the scale items. The placement of the scale items after rather than before overall ratings were assigned, however, lowered the global assessments of the course in study one but not in study two.

Get full access to this article

View all access options for this article.

References

1. Illinois Course Evaluation System: Its rationale and description (ICES Newsletter No. 2). Urbana-Champaign: University of Illinois, Measurement and Research Division, Office of Instructional Resources, August (1977). (Mimeo).

Aleamoni, L. M. and Graham, M. H. The relationship between CEQ ratings and instructor's rank, class size, and course level. Journal of Educational Measurement, 1974, 11, 189-202.

Brandenburg, D. C. , Braskamp, L. A. , and Ory, J. C. Considerations for an evaluation program of instructional quality. CEDR Quarterly, 1979, 12, 8-13.

Brandenburg, D. C. , Slinde, J. A. , and Batista, E. E. Student ratings of instruction: Validity and normative interpretations. Journal of Research in Higher Education, 1977, 7, 67-78.

Braskamp, L. A. , Ory, J. C. , and Pieper, D. M. Written comments: Dimensions of instructional quality. Journal of Educational Psychology, 1981, 73, 65-70.

Couch, A. and Keniston, K. Yea sayers and nay sayers: Agreeing response set as a personality variable. Journal of Abnormal and Social Psychology, 1960, 60, 151-174.

Cronbach, L. J. Response sets and test validity . EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1946, 6, 475-494.

Cronbach, L. J. Further evidence on response sets and test design . EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1950, 10, 3-31.

Edwards, A. L. Techniques of attitude scale construction. New York: Appleton Century Crofts, 1957.

10.

Frey, P. W. , Leonard, D. W. , and Beatty, W. W. Student ratings of instruction: Validation research. American Educational Research Journal, 1975, 12, 435-447.

11.

Lemon, N. Attitudes and their measurement. John Wiley & Sons, New York, 1973.

12.

Likert, R. A technique for the measurement of attitudes . Archives of Psychology, 1932, 140, 44-53.

13.

Marsh, H. W. The influence of student, course, and instructor characteristics on evaluations of university teaching . American Educational Reseach Journal, 1980, 17, 219-237.

14.

McKeachie, W. J. and Lin, Y. Sex differences in student response to college teachers: Teacher warmth and teacher sex. American Educational Research Journal, 1971, 8, 22-226.

15.

Ory, J. C. , Braskamp, L. A. , Pieper, D. M. Congruency of student evaluative information collected by three methods. Journal of Educational Psychology, 1980, 72, 181-185.