The Themes Present in the Qualitative Portion of the Student Evaluation of Teachers with Emphasis on the Differences in Themes among the Sex and Academic Rank of Faculty Members in a State University in the Philippines

Abstract

This paper identified the themes present in the comments of the students of a state university in the Philippines in the qualitative portion of the student evaluation of teachers (SET) for two semesters, one before the pandemic and the other during the pandemic. Thematic analysis revealed the following themes present: (a) general positive comments, (b) general negative comments, (c) expressions of gratitude, (d) wishes and greetings to the teacher, (e) positive comments on teaching method, (f) negative comments on teaching method, (g) positive comments on teachers’ demeanor, and (h) negative comments on teachers’ demeanor. There were no differences in the themes between male and female teachers and among instructors, assistant professors, associate professors, and professors. Similarly, there were no differences found in the themes identified before and during the pandemic. The thematic analysis showed that many students made only general comments that were not helpful at all in improving teaching effectiveness. Thus, it is recommended that in the SET instrument, instruction should be given to students to make their comments specific so that teachers will know what exact things they are doing well or not. Knowing these will help improve their teaching. It was noted that there were numerous negative comments on the teachers' teaching methods and demeanor. Hence, it is recommended that the university craft intervention measures that will acquaint teachers with the various methods of teaching, considering that at the tertiary level, many teachers are not education majors trained in pedagogy. In addition, seminars and workshops regarding teacher demeanor are suggested.

Keywords

student evaluation of teachers (SET)higher education sex academic rank COVID-19 pandemic

Get full access to this article

View all access options for this article.

References

Abrami

P. C.

d’Appollonia

(1999). Current concerns are past concerns. American Psychologist, 54(7), 519–520. https://doi.org/10.1037/0003-066X.54.7.519

Arbuckle

Williams

B. D.

(2003). Students’ perceptions of expressiveness: Age and gender effects on teacher evaluations. Sex Roles, 49(9/10), 507–516. https://doi.org/10.1023/A:1025832707002

Basow

S. A.

(1998). Student evaluations: The role of gender bias and teaching styles. In Collins

L. H.

Chrisler

J. C.

Quina

(Eds.), Arming athena: Career strategies for women in academe (pp. 135–156). Sage.

Basow

S. A.

Silberg

N. T.

(1987). Student evaluations of college professors: Are female and male professors rated differently? Journal of Educational Psychology, 79(3), 308–314. https://doi.org/10.1037/0022-0663.79.3.308

Becker

W. E.

Watts

(1999). The state of economic education: How departments of economics evaluate teaching. AEA Papers and Proceedings, 89(2), 344–349. https://doi.org/10.1257/aer.89.2.344

Bennett

S. K.

(1982). Student perceptions of and expectations for male and female instructors: Evidence relating to the question of gender bias in teaching evaluation. Journal of Educational Psychology, 74(2), 170–179. https://doi.org/10.1037/0022-0663.74.2.170

Bhana

McGrath

K. F.

Van Bergen

Moosa

(2019). Why having both male and female teachers is a good idea for schools. The Conversation. Retrieved from http://theconversation.com/why-having-both-male-and-female-teachers-is-a-good-idea-for-schools-123780.

Boring

(2015). Gender biases in student evaluations of teachers (Research Report No. 2015-13). Retrieved from the Research Papers in Economics website: https://ideas.repec.org/p/fce/doctra/1513.html.

Boring

Ottoboni

Stark

P. B.

(2016). Student evaluations of teaching (mostly) do not measure teaching effectiveness. ScienceOpen Research. https://doi.org/10.14293/S2199-1006.1.SOR-EDU.AETBZC.v1

10.

Braga

Paccagnella

Pellizzari

(2014). Evaluating students’ evaluations of professors. Economics of Education Review, 41, 71–88. https://doi.org/10.1016/j.econedurev.2014.04.002

11.

Brandenburg

D. C.

Slinde

J. A.

Batista

E. E.

(1977). Student ratings of instructor: Validity and normative interpretations. Research in Higher Education, 7(3), 67–78. https://doi.org/10.1007/BF00991945

12.

Caluza

L. J. B.

Function

D. G. C.

Verecio

R. L.

Cinco

J. C.

Quisumbing

L. A.

Laurente

M. L.

Gotardo

M. A.

(2017). Faculty performance evaluation in a Philippine university information technology program. IOSR Journal of Humanities and Social Science, 22(9), 28–36. https://doi.org/10.9790/0837-2209082836

13.

Carrell

S. E.

West

J. E.

(2010). Does professor quality matter? Evidence from random assignment of students to professors. Journal of Political Economy, 118(3), 409–432. https://doi.org/10.1086/653808

14.

Centra

J. A.

Creech

F. R.

(1976). The relationship between student, teacher, and course characteristics and student ratings of teacher effectiveness. Project report, 76-1. Educational Testing Service. https://www.ets.org/research/policy_research_reports/publications/report/1976/hylb.html

15.

Centra

J. A.

Gaubatz

N. B.

(2000). Is there gender bias in student evaluations of teaching? The Journal of Higher Education, 71(1), 17–33. https://doi.org/10.2307/2649280

16.

Coe

(1998). Can feedback improve teaching? A review of the social science literature with a view to identifying the conditions under which giving feedback to teachers will result in improved performance. Research Papers in Education, 13(1), 43–66. https://doi.org/10.1080/0267152980130104

17.

d’Appolonia

Abrami

P. C.

(1997). Navigating student ratings of instruction. American Psychologist, 52(11), 1198–1208. https://doi.org/10.1037/0003-066X.52.11.1198

18.

Dion

(2008). All-knowing or all-nurturing? Student expectations, gender roles, and practical suggestions for women in the classroom. PS: Political Science & Politics, 41(4), 853–856. https://doi.org/10.1017/S1049096508081110

19.

Elmore

P. B.

LaPointe

K. A.

(1974). Effects of teacher sex and student sex on the evaluation of college instructors. Journal of Educational Psychology, 66(3), 386–389. https://doi.org/10.1037/h0036493

20.

Feldman

K. A.

(1983). Seniority and experience of college teachers as related to evaluations they receive. Research in Higher Education, 18(1), 3–124. https://doi.org/10.1007/BF00992080

21.

Flores

M. A.

Barros

Simão

A. M. V.

Pereira

Flores

Fernandes

Costa

Ferreira

P. C.

(2022). Portuguese Higher education students’ adaptation to online teaching and learning in times of the COVID-19 pandemic: Personal and contextual factors. Higher Education, 83(6), 1389–1408. https://doi.org/10.1007/s10734-021-00748-x

22.

Galeon

G. A.

(2015). Correlates of the teaching performance of the college faculty members. International Journal of Applied Psychology, 5(3), 64–72. https://doi.org/10.5923/j.ijap.20150503.02

23.

Griffin

(2012). A first look at communication theory (8th ed.). McGraw-Hill.

24.

Hazari

Cass

Beattie

(2015). Obscuring power structures in the physics classroom: Linking teacher positioning, student engagement, and physics identity development. Journal of Research in Science Teaching, 52(6), 735–762. https://doi.org/10.1002/tea.21214

25.

Hofstede Insights. (2022). What about the Philippines? Retrieved from the Hofstede Insights website: https://www.hofstede-insights.com/country/the-philippines/.

26.

Hornstein

H. A.

(2017). Student evaluations of teaching are an inadequate assessment tool for evaluating faculty performance. Cogent Education, 4(1), Article 1304016. https://doi.org/10.1080/2331186X.2017.1304016

27.

Johnson

V. E.

(2003). Grade inflation: A crisis in college education. Springer-Verlag.

28.

Kaschak

(1978). Sex bias in student evaluations of college professors. Psychology of Women Quarterly, 2(3), 235–243. https://doi.org/10.1111/j.1471-6402.1978.tb00505.x

29.

Krautmann

A. C.

Sander

(1999). Grades and student evaluations of teachers. Economics of Education Review, 18(1), 59–63. https://doi.org/10.1016/S0272-7757(98)00004-1

30.

Lombardo

Tocci

(1979). Attribution of positive and negative characteristics of instructors as a function of attractiveness and sex of instructor and sex of subject. Perceptual and Motor Skills, 48(2), 491–494. https://doi.org/10.2466/pms.1979.48.2.491

31.

MacLeod

R. B.

Napoles

(2012). Preservice teachers’ perceptions of teaching effectiveness during teaching episodes with positive and negative feedback. Journal of Music Teacher Education, 22(1), 91–102. https://doi.org/10.1177/1057083711429851

32.

MacNell

Driscoll

Hunt

A. N.

(2015). What’s in a name: Exposing gender bias in student ratings of teaching. Innovative Higher Education, 40(4), 291–303. https://doi.org/10.1007/s10755-014-9313-4

33.

Marsh

H. W.

Dunkin

M. J.

(1992). Students’ evaluation of university teaching: A multidimensional perspective. In Smart

J. C.

(Ed.), Higher education: Handbook of theory and research (Vol. 8, pp. 143–234). Agathon.

34.

Martin

(1984). Power and authority in the classroom: Sexist stereotypes in teaching evaluations. Signs, 9(3), 482–492. https://doi.org/10.1086/494073

35.

Oliveira

Grenha Teixeira

Torres

Morais

(2021). An exploratory study on the emergency remote education experience of higher education students and teachers during the COVID-19 pandemic. British Journal of Educational Technology, 52(4), 1357–1376. https://doi.org/10.1111/bjet.13112

36.

Paludi

M. A.

Bauer

W. D.

(1983). Goldberg revisited: What’s in an author’s name. Sex Roles, 9(3), 387–390. https://doi.org/10.1007/BF00289673

37.

Pama

A. B.

Dulla

L. B.

De Leon

R. C.

(2013). Student evaluation of teaching effectiveness: Does faculty profile really matter? Catalyst, 8(1), 94–102. https://so01.tci-thaijo.org/index.php/hbds/article/view/173428/124267

38.

Planned Parenthood Federation of America Inc. (2020). What are gender roles and stereotypes? Retrieved from the Planned Parenthood website: https://www.plannedparenthood.org/learn/sexual-orientation-gender/gender-gender-identity/what-are-gender-roles-and-stereotypes.

39.

Reyes

J. V.

Ariraya

A. C.

Guerzon

R. A.

Solis

A. L.

(2018). The perceived impact of online student evaluation to the performance among faculty from PUP branches and campuses: Basis for policy review and implementation. KnE Social Sciences, 3(6), 623–640. https://doi.org/10.18502/kss.v3i6.2409

40.

Rodríguez-Rodríguez

Sánchez-Paniagua

Sanz-Landaluze

Moreno-Guzmán

(2020). Analytical chemistry teaching adaptation in the COVID-19 period: Experiences and students’ opinion. Journal of Chemical Education, 97(9), 2556–2564. https://doi.org/10.1021/acs.jchemed.0c00923

41.

Scheeler

M. C.

Ruhl

K. L.

McAfee

J. K.

(2004). Providing performance feedback to teachers: A review. Teacher Education and Special Education, 27(4), 396–407. https://doi.org/10.1177/088840640402700407

42.

Weinberg

B. A.

Fleisher

B. M.

Hashimoto

(2009). Evaluating teaching in higher education. Journal of Economic Education, 40(3), 227–261. https://doi.org/10.3200/JECE.40.3.227-261

43.

Wright

R. E.

(2006). Student evaluations of faculty: Concerns raised in the literature, and possible solutions. College Student Journal, 40(2), 417–422. https://go.gale.com/ps/i.do?p=AONE&u=googlescholar&id=GALE|A147389148&v=2.1&it=r&sid=AONE&asid=0d20a987