Two classes of each of four hundred high school teachers were rated for teaching effectiveness by the teachers and by their students using the same instrument. Considerable interrater reliability was found across classes between student and teacher ratings on each item. Overall student-teacher agreement on relative ratings of items was good, as was within-class agreement. Modest interrater reliability was found item by item between teachers and students on which of the two classes deserved higher ratings. These findings generally support the validity of high school student ratings of instruction.
Get full access to this article
View all access options for this article.
References
1.
Aubrecht, J. D. and Hanna, G. S. (1982). Idea Form H technical manual. Manhattan, KS: Center for Faculty Evaluation and Development, Kansas State University.
2.
Center for Faculty Evaluation and Development . (1981). Student Reaction to Course and Teacher: IDEA Form H. Manhattan, KS: Author.
3.
Centra, J. A. (1975). Colleagues as raters of classroom instruction. Journal of Higher Education, 46, 327-337.
4.
Cohen, P. A. (1981). Student ratings of instruction and student achievement: A meta-analysis of multisection validity studies. Review of Educational Research, 51, 281-309.
5.
Hanna, G. S. , Aubrecht, J. D., and Hoyt, D. P. (1983). Discriminant and convergent validity of high school student ratings of instruction. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 43, 873-878.
6.
Hanna, G. S. , Hoyt, D. P., and Aubrecht, J. D. (1983). Identifying and adjusting for biases in student evaluations of instruction: Implications for validity. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 43, 1175-1185.
7.
Kulik, J. A. and McKeachie, W. J. (1975). The evaluation of teachers in higher education. In F. N. Kerlinger (Ed.), Review of Research in Education, Itasca, IL: F. E. Peacock.
8.
Marsh, H. W. (1982). Validity of students' evaluation of college teaching: A multitrait-multimethod analyses. Journal of Educational Psychology, 74, 264-279.
9.
Marsh, H. W. , Overall, J. V., and Kesler, S. P. (1979). Validity of student evaluation of instructional effectiveness: A comparison of faculty self-evaluation and evaluations by their students. Journal of Educational Psychology, 71, 149-160.
10.
Ory, J. C. , Braskamp, L. A., and Pieper, D. M. (1980). Congruency of student evaluative information collected by three methods. Journal of Educational Psychology, 72, 181-185.
