Students and instructors show moderate levels of agreement about the quality of day-to-day teaching. In the present study, we replicated and extended this finding by asking how correspondence between student and instructor ratings is moderated by time of semester and student demographic variables. Participants included 137 students and 5 instructors. On 10 separate days, students and instructors rated teaching effectiveness and challenge level of the material. Multilevel modeling indicated that student and instructor ratings of teaching effectiveness converged overall, but more advanced students and Caucasian students converged more closely with instructors. Student and instructor ratings of challenge converged early but diverged later in the semester. These results extend our knowledge about the connection between student and faculty judgments of teaching.
AikenL. S.WestS. G. (1991). Multiple regression: Testing and interpreting interactions. Thousand Oaks, CA: Sage.
2.
Al-IssaA.SuliemanH. (2007). Student evaluations of teaching: Perceptions and biasing factors. Quality Assurance in Education, 15, 302–317.
3.
BadriM. A.AbdullaM.KamaliM. A.DodeenH. (2006). Identifying potential biasing variables in student evaluation of teaching in a newly accredited business program in the UAE. International Journal of Educational Management, 20, 43–59.
4.
BarthM. M. (2008). Deciphering student evaluations of teaching: A factor analysis approach. Journal of Education for Business, 84, 40–46.
5.
BasowS. A.CodosS.MartinJ. L. (2013). The effects of professors’ race and gender on student evaluations and performance. College Student Journal, 47, 352–363.
6.
BasowS. A.MontgomeryS. (2005). Student ratings and professor self-ratings of college teaching: Effects of gender and divisional affiliation. Journal of Personnel Evaluation in Education, 18, 91–106.
7.
BasowS. A.PhelanJ. E.CapotostoL. (2006). Gender patterns in college students’ choices of their best and worst professors. Psychology of Women Quarterly, 30, 25–35.
8.
BeranT.ViolatoC. (2005). Ratings of university teacher instruction: How much do student and course characteristics really matter?Assessment & Evaluation in Higher Education, 30, 593–601. doi:10.1080/02602930500260688
9.
BosshardtW.WattsM. (2001). Comparing student and instructor evaluations of teaching. Journal of Economic Education, 32, 3–17.
10.
BrockxB.SpoorenP.MortelmansD. (2011). Taking the grading leniency story to the edge. The influence of student, teacher, and course characteristics on student evaluations of teaching in higher education. Educational Assessment, Evaluation and Accountability, 23, 289–306. doi:10.1007/s11092-011-9126-2
11.
CentraJ. A. (1993). Reflective faculty evaluation: Enhancing teaching and determining faculty effectiveness. San Francisco, CA: Jossey-Bass.
12.
DeeT. S. (2004). The race connection: Are teachers more effective with students who share their ethnicity?Education Next, 4, 52–59.
13.
DrewsD. R.BurroughsW. J.NokovichD. (1987). Teacher self-ratings as a validity criterion for student evaluations. Teaching of Psychology, 14, 23–25.
14.
EhrenbergR. G.GoldhaberD. D.BrewerD. J. (1995). Do teachers’ race, gender, and ethnicity matter? Evidence from the National Educational Longitudinal Study of 1988. Industrial and Labor Relations Review, 48, 547–561. doi:10.1207/s15328023top1401_5
15.
EndersC. K.TofighiD. (2007). Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods, 12, 121–138.
16.
GreenwaldA. G.GillmoreG. M. (1997). Grading leniency is a removable contaminant of student ratings. American Psychologist, 52, 1209–1217. doi:10.1037/0003-066X.52.11.1209
17.
GriffinT. J.HiltonJ. I.PlummerK.BarretD. (2014). Correlation between grade point averages and student evaluation of teaching scores: Taking a closer look. Assessment & Evaluation in Higher Education, 39, 339–348. doi:10.1080/02602938.2013.831809
18.
GurungR. R.VespiaK. M. (2007). Looking good, teaching well? Linking liking, looks, and learning. Teaching of Psychology, 34, 5–10. doi:10.1207/s15328023top3401_2
19.
HamermeshD.ParkerA. (2005). Beauty in the classroom: Instructors’ pulchritude and putative pedagogical productivity. Economics of Education Review, 24, 369–376.
20.
KohnJ.HatfieldL. (2006). The role of gender in teaching effectiveness ratings of faculty. Academy of Educational Leadership Journal, 10, 121–137.
21.
LiY. (1993). A comparative study of Asian and American students’ perceptions of faculty teaching effectiveness at Ohio University. Unpublished doctoral dissertation, Ohio University, Athens, OH.
22.
MarshH. W. (1980). The influence of student, course, and instructor characteristics in evaluations of university teaching. American Educational Research Journal, 17, 219–237.
23.
MarshH. W.RocheL. A. (2000). Effects of grading leniency and low workload on students’ evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?Journal of Educational Psychology, 92, 202–228.
24.
OlivaresO. J. (2001). Student interest, grading leniency, and teacher ratings: A conceptual analysis. Contemporary Educational Psychology, 26, 382–399.
25.
PanD.TanG. H.RagupathiK.BooluckK.RoopR.IpY. K. (2009). Profiling teacher/teaching using descriptors derived from qualitative feedback: Formative and summative applications. Research in Higher Education, 50, 73–100. doi:10.1007/s11162-008-9109-4
26.
PreacherK. J.CurranP. J.BauerD. J. (2006). Computational tools for probing interaction in multiple linear regression, multilevel modeling, and latent curve analysis. Journal of Educational and Behavioral Statistics, 31, 437–448.
27.
RaudenbushS. W.BrykA. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
28.
RemediosR.LiebermanD. A. (2008). I liked your course because you taught me well: The influence of grades, workload, expectations and goals on students’ evaluations of teaching. British Educational Research Journal, 34, 91–115. doi:10.1080/01411920701492043
29.
RenaudR. D.MurrayH. G. (2005). Factorial validity of student ratings of instruction. Research in Higher Education, 46, 929–953.
30.
RocheL. A.MarshH. W. (2000). Multiple dimensions of university teacher self-concept. Instructional Science, 28, 439–468.
31.
SanthanamE.HicksO. (2002). Disciplinary, gender and course year influences on student perceptions of teaching: Explorations and implications. Teaching in Higher Education, 7, 17–31.
32.
SmithB. P. (2007). Student ratings of teacher effectiveness: An analysis of end-of-course faculty evaluations. College Student Journal, 41, 788–800. doi:10.1080/13562510120100364
33.
SmithS. W.YooJ. H.FarrA. C.SalmonC. T.MillerV. D. (2007). The influence of student sex and instructor sex on student ratings of instructors: Results from a college of communication. Women’s Studies in Communication, 30, 64–77.
SpoorenP. (2010). On the credibility of the judge: A cross-classified multilevel analysis on students’ evaluation of teaching. Studies in Educational Evaluation, 36, 121–131. doi:10.1016/j.stueduc.2011.02.001
36.
SpoorenP.BrockxB.MortelmansD. (2013). On the validity of student evaluation of teaching: The state of the art. Review of Educational Research, 83, 598–642.
37.
TingK. (2000). A multilevel perspective on student ratings of instruction: Lessons from the Chinese experience. Research in Higher Education, 41, 637–661.
