Student evaluations of teaching (SETs) have become an important measure of the quality of teaching in higher education institutions in the United States. Some research indicates that SETs may be systematically biased; however, most studies of SETs do not include much measure of instructional choices teachers make.This study includes most variables the SET literature identifies as important and also adds measures of teacher choices, such as whether to use instructional technologies and what percent of time to spend lecturing.The results provide some useful information about how better to connect with students but also indicate that SETs are systematically biased against female teachers, older teachers, and perhaps minority teachers.These findings call into question de facto higher education policy making SETs our most important measure of teaching quality.
Get full access to this article
View all access options for this article.
References
1.
American Association of University Professors. Undated. Statement on Teaching Evaluation. Accessed August 2, 2004, at www.aaup.org/statements/Redbook/rbeval.htm.
2.
AbramiP. C.d’ApolloniaS.CohenP. A.. 1990. “Validity of Student Ratings of Instruction:What We Know and What We Do Not Know.” Journal of Educational Psychology, 82:285–296.
3.
d’ApolloniaS.AbramiP. C.. 1997. “Navigating Student Ratings of Instruction.” American Psychologist, 52(11):1198–1208.
4.
ArmstrongJ. S.2004. “How to Improve Service Quality and Satisfaction or My Boss Wants You to Like My Essays, So Please Give This a Good Rating.” Discussion for the Association for Consumer Research, Wed, 3 Mar. 2004, ACR-L Digest-28 Feb. 2004 to 2 Mar. 2004 (online listserve). Listserv@listserv.OKState.edu.
5.
ArmstrongJ. S.1998. “Are Student Ratings of Instruction Useful?” American Psychologist, 53:1223–1224.
6.
BaldwinT.BlattnerN.. 2003. “Guarding Against Potential Bias in Student Evaluations: What Every Faculty Member Needs to Know.” College Teaching, 51:27–32.
7.
BasowS. A.1995. “Student Evaluations of College Professors:When Gender Matters.” Journal of Educational Psychology, 87:656–665.
8.
BasowS. A.SilbergN. T.. 1987. “Student Evaluations and College Professors:Are Female and Male Professors Rated Differently?” Journal of Educational Psychology, 79:308–314.
9.
BernardM. E.et al.1981. “Sex-Role Behavior and Gender in the Teacher-Student Evaluations.” Journal of Educational Psychology, 73: 681–695.
10.
CashinW. E.1995. “Student Ratings of Teaching:The Research Revisited.” IDEA Paper No. 32. Manhattan, KA: Kansas State University, Center for Faculty Evaluation and Development.
11.
CentraJ. A.1993. “Reflective Faculty Evaluation:Enhancing Teaching and Determining Faculty Effectiveness.” San Francisco: Jossey-Bass.
12.
CohenP. A.1982. “Validity of Student Ratings in Psychology Courses:A Meta-Analysis of Multisection Validity Studies.” Teaching of Psychology, 9:78–82.
13.
CrantonP.SmithR. A.. 1990. “Reconsidering the Unit of Analysis:A Model of Student Ratings of Instruction.” Journal of Educational Psychology, 82:207–212.
14.
DenhardtR. B.2001. “The Big Questions of Public Administration Education.” Public Administration Review, 61(5):526–534.
15.
GreenwaldA. G.GilmoreG. M.. 1997. “Grading Leniency is a Removable Contaminant of Student Ratings.” American Psychologist, 52(11):1209–1217.
HamiltonL. C.1980. “Grades, Class Size, and Faculty Status Predict Teaching Evaluations.” Teaching Sociology, 8(1):47–62.
18.
HowardG. S.ConwayS. G.MaxwellS. E.. 1985. “Construct Validity of Measures of College Teaching Effectiveness.” Journal of Educational Psychology, 77:187–196.
19.
KiersteadD.D’AngostinoP.DillH., 1988. “Sex-Role Stereotyping of College Professors: Bias in Student Ratings of Instruction.” Journal of Educational Psychology, 80:342–344.
20.
LangbeinL. I.1994. “The Validity of Student Evaluations of Teaching.” PS: Political Science and Politics, 27(3):545–553.
21.
LueckT. L.EndresK. L.KaplanR. E.. 1993. “The Interaction Effects of Gender on Teaching Evaluations,” Journalism Education, 48(3):46–54.
22.
MarshH. W.1987. “Students’Evaluation of University Teaching:Research Findings, Methodological Issues, and Directions for Future Research.” International Journal of Educational Research, 11:253–283.
23.
MarshH. W.DunkinM. J.. 1992. “Students’Evaluations of University Teaching: A Multidimensional Perspective.” In SmartJ., Higher Education Handbook of Theory and Research, Vol. 8. New York: Agathon Press.
24.
MarshH. W.RocheL. A.. 1997. “Making Students’ Evaluations of Teaching Effectiveness Effective:The Critical Issues of Validity, Bias, and Utility.” American Psychologist, 51(11):1187–1197.
25.
MartinE.1984. “Power and Authority in the Classroom: Sexist Stereotypes in Teaching Evaluations.” Signs: Journal of Women in Culture and Society, 9:482–492.
26.
McKeachieW. J.1997. “Student Ratings.” American Psychologist, 52(11):1218–1225.
27.
McPhersonM. A.2003. “Revisiting the Determinants of Student Evaluation of Teachers Scores.” Unpublished research paper. University of North Texas.
28.
OfirC.SimonsonI.. 2001. “In Search of Negative Customer Feedback: The Effect of Expecting to Evaluate on Satisfaction Evaluations.” Journal of Marketing Research, 38:44–46.
29.
PetchersM. K.ChowJ. C.. 1988. “Sources of Variation in Students’ Evaluations of Instruction in a Graduate Social Work Program.” Journal of Social Work Education, 24:35–42.
30.
PindyckR. S.RubinfeldD. L.1981. Econometric Models and Economic Forecasts. 2nd ed. New York: McGraw-Hill.
31.
SeldinP.1989. “How Colleges Evaluate Professors.” American Association for Higher Education Bulletin, 41(7):282–302.
32.
SidaniusJ.CraneM.. 1989. “Job Evaluation and Gender: The Case of University Faculty.” Journal of Applied Social Psychology, 19:174–197.
33.
SteinerS.et al.2004. “Evaluating Teaching: Listening to Students While Acknowledging Bias.” Unpublished paper, Arizona State University School of Social Work.
34.
StudenmundA. H.2001. Using Econometrics, 4th ed. Boston:Addison Wesley Longman.
35.
WhittingtonL. A.2001. “Detecting Good Teaching.” Journal of Public Affairs Education, 7(5):5–8.
36.
WolferT. A.JohnsonM. M.. 2003. “Reevaluating Student Evaluation of Teaching: The Teaching Evaluation Form.” Journal of Social Work Education, 31:111–121.
