148 students were asked to evaluate particular survey questions with scales that varied in number of scale points, type of labeling, and labeling of anchors only vs all scale points. No significant difference was found between variations on 4-and 5-point scales, so these data were collapsed. Analysis indicated that students generated scale-point exemplars significantly better for 4-point scales (96.7%) than for 5-point (87.8%) and 10-point (79.3%) scales. These results are discussed with respect to the administration of student evaluations and the care required in selecting a scale type and interpreting the subsequent outcomes.
Get full access to this article
View all access options for this article.
References
1.
AndrichD.MastersG. N. (1988) Rating scale analysis. In KeevesJ. P. (Eds), Educational research, methodology, and measurement: an international handbook. Oxford, Eng.: Pergamon.
2.
CliffN. (1959) Adverbs as multipliers. Psychological Review, 66, 27–44.
3.
ConklinE. S. (1923) The scale of values method for studies in genetic psychology. University of Oregon Publications, 2, No. 1.
4.
GuilfordJ. P. (1954) Psychometric methods. (2nd ed.) New York: McGraw-Hill. MeredithG. M. (1975) Structure of student-based evaluation ratings. Journal of Psychology91, 3–9.
5.
NeumannL.NeumannY. (1981) Comparison of six lengths of rating scales: students' attitudes toward instruction. Psychological Reports, 48, 399–404.
6.
SymondsP. M. (1924) On the loss of reliability in ratings due to coarseness of the scale. Journal of Experimental Psychology, 7, 456–461.
7.
TollefsonN.WigingtonH.McKnichtP. (1983) Course ratings as measures of instructional effectiveness. Instructional Science, 12, 389–395.
