It's in the Syllabus: The Relationship Between Syllabi Word Use and Teaching Evaluations

Abstract

The authors analyzed 1,472 course syllabi written by 611 professors to determine whether communion-related and/or agency-related word use in professors’ syllabi predicted those same professors’ end-of-semester teaching evaluations. Linguistic inquiry and word count (LIWC) analyses revealed that professors who used more communal language—including third person plural pronouns (e.g., we), social words (e.g., discussion), and positive emotion words (e.g., please)—received significantly higher teaching evaluations, but agentic language did not significantly predict evaluation scores.

Keywords

word use person perception LIWC teaching evaluations syllabi

Get full access to this article

View all access options for this article.

References

Abe

J. A.

(2009). Words that predict outstanding performance. Journal of Research in Personality, 43(3), 528–531. https://doi.org/10.1016/j.jrp.2009.01.010

Abele

A. E.

Brack

(2013). Preference for other persons’ traits is dependent on the kind of social relationship. Social Psychology, 44(22), 84–94. https://doi.org/10.1027/1864-9335/a000138

Addison

W. E.

Stowell

J. R.

Reab

M. D.

(2015). Attributes of introductory psychology and statistics teachers: Findings from comments on RateMyProfessors.com. Scholarship of Teaching and Learning in Psychology, 1(3), 229–234. https://doi.org/10.1037/stl0000034

Ambady

Rosenthal

(1993). Half a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. Journal of Personality & Social Psychology, 64(3), 431–441. https://doi.org/10.1037/0022-3514.64.3.431

Barsade

S. G.

(2002). The ripple effect: Emotional contagion and its influence on group behavior. Administrative Science Quarterly, 47(4), 644–675. https://doi.org/10.2307/3094912

Bono

J. E.

Ilies

(2006). Charisma, positive emotions and mood contagion. Leadership Quarterly, 17(4), 317–334. https://doi.org/10.1016/j.leaqua.2006.04.008

Boyd

Pennebaker

J. W.

(2017). Language-based personality: A new approach to personality in a digital world. Current Opinion in Behavioral Sciences, 18, 63–68. https://doi.org/10.1016/j.cobeha.2017.07.017

Buchert

Laws

E. L.

Apperson

J. M.

Bregman

N. J.

(2008). First impressions and professor reputation: Influence on student evaluations of instruction. Social Psychology of Education, 11(4), 397–408. https://doi.org/10.1007/s11218-008-9055-1

Chung

Pennebaker

(2007). The psychological functions of function words. In Fiedler

(Ed.), Social communication (pp. 343–359). Psychology Press.

10.

Cuddy

A. J.

Fiske

S. T.

Glick

(2008). Warmth and competence as universal dimensions of social perception: The stereotype content model and the BIAS map. Advances in Experimental Social Psychology, 40, 61–149. https://doi.org/10.1016/S0065-2601(07)00002-0

11.

Decter-Frain

Frimer

J. A.

(2016). Impressive words: Linguistic predictors of public approval of the U.S. congress. Frontiers in Psychology, 7, 240. https://doi.org/10.3389/fpsyg.2016.00240

12.

Eisenkraft

Elfenbein

H. A.

(2010). The way you make me feel: Evidence for individual differences in affective presence. Psychological Science, 21(4), 505–510. https://doi.org/10.1177/0956797610364117

13.

Fiske

S. T.

Cuddy

A. J.

Glick

(2002). A model of (often mixed) stereotype content: Competence and warmth respectively follow from perceived status and competition. Journal of Personality and Social Psychology, 82(6), 878–902. https://doi.org/10.1037/0022-3514.82.6.878

14.

Fredrickson

B. L.

(2003). The value of positive emotions: The emerging science of positive psychology is coming to understand why it's good to feel good. American Scientist, 91(4), 330–335. https://doi.org/10.1511/2003.26.330

15.

Geng

Niu

Feng

Huang

(2020). Understanding the focal points and sentiment of learners in MOOC reviews: A machine learning and SC-LIWC-based approach. British Journal of Educational Technology, 51(5), 1785–1803. https://doi.org/10.1111/bjet.12999

16.

Giles

Edwards

A. L.

Walther

J. B.

(2023). Communication accommodation theory at 50: Recent developments. In Giles

(Ed.), Communication accommodation theory: Past accomplishments, current trends, and future prospects. Special issue: Language Sciences. Advance online: https://authors.elsevier.com/a/1hUV31OE9HWHOe

17.

Gross

Lakey

Edinger

Orehek

Heffron

(2009). Person perception in the college classroom: Accounting for taste in students’ evaluations of teaching effectiveness. Journal of Applied Social Psychology, 39(7), 1609–1638. https://doi.org/10.1111/j.1559-1816.2009.00497.x

18.

Hall

Verghis

Stockton

Goh

(2014). It takes just 120 seconds: Predicting satisfaction in technical support calls. Psychology & Marketing, 13(7), 500–508. https://doi.org/10.1002/mar.20711

19.

Harnish

Bridges

(2011). Effect of syllabus tone: Students’ perceptions of instructor and course. Social Psychology of Education, 14(3), 319–330. https://doi.org/10.1007/s11218-011-9152-4

20.

Hatfield

Cacioppo

J. T.

Rapson

R. L.

(1994). Emotional contagion. Cambridge University Press.

21.

Houser

M. L.

Waldbuesser

(2017). Emotional contagion in the classroom: The impact of teacher satisfaction and confirmation on perceptions of student nonverbal classroom behavior. College Teaching, 65(1), 1–8. https://doi.org/10.1080/87567555.2016.1189390

22.

Ishiyama

Hartlaub

(2002). Does the wording of syllabi affect student course assessment in introductory political science classes? PS: Political Science & Politics, 35(3), 567–570. https://doi.org/10.1017/S1049096502000860

23.

Jones

B. D.

Miyazaki

Biscotte

(2022). Motivational climate predicts student evaluations of teaching: Relationships between students’ course perceptions, ease of course, and evaluations of teaching. AERA Open, 8(1), 1–17. https://doi.org/10.1177/233285842110731

24.

Judd

C. M.

James-Hawkins

Yzerbyt

Kashima

(2005). Fundamental dimensions of social judgment: Understanding the relations between judgments of competence and warmth. Journal of Personality & Social Psychology, 89(6), 899–913. https://doi.org/10.1037/0022-3514.89.6.899

25.

Kern

M. L.

Eichstaedt

J. C.

Schwartz

H. A.

Dziurzynski

Ungar

L. H.

Stillwell

D. J.

Kosinski

Ramones

S. M.

Seligman

M. E. P.

(2014). The online social self: An open vocabulary approach to personality. Assessment, 21(2), 158–169. https://doi.org/10.1177/1073191113514104

26.

Kim

Damewood

Hodge

(2000). Professor attitude: Its effect on teaching evaluations. Journal of Management Education, 24(4), 458–473.

27.

Kulik

J. A.

(2001). Student ratings: Validity, utility, and controversy. New Directions for Institutional Research, 2001(109), 9–25. https://doi.org/10.1002/ir.1

28.

Tang

Sun

(2017). Text analysis with LIWC and Coh-metrix: Portraying MOOCs instructors. In Proceedings of the 10th international conference on educational data mining (pp. 400–401). https://files.eric.ed.gov/fulltext/ED596512.pdf

29.

Low

King

R. B.

Caleon

I. S.

(2016). Positive emotions predict students’ well-being and academic motivation: The broaden-and-build approach. In King

Bernardo

(Eds.), The psychology of Asian learners. Springer. https://doi.org/10.1007/978-981-287-576-1_30

30.

Mills

C. B.

Kwon

A. C.

Brown

K. A.

(2021). Examining the COMM in COMMunity policing: Communication accommodation, perception, and trust in law enforcement-suspect encounters. Journal of Police & Criminal Psychology, 36(2), 333–341. https://doi.org/10.1007/s11896-021-09445-y

31.

Osterman

K. F.

(2000). Students’ need for belonging in the school community. Review of Educational Research, 70(3), 323–367. https://doi.org/10.3102/00346543070003323

32.

Patrick

(2011). Student evaluations of teaching: Effects of the Big Five personality traits, grades, and the validity hypothesis. Assessment & Evaluation in Higher Education, 36(2), 239–249. https://doi.org/10.1080/02602930903308258

33.

Pennebaker

Booth

Boyd

Francis

(2015). Linguistic inquiry and word count: LIWC2015. Pennebaker Conglomerates (www.LIWC.net).

34.

Pressman

S. D.

Cohen

(2012). Positive emotion word use and longevity in famous deceased psychologists. Health Psychology, 31(3), 297–305. https://doi.org/10.1037/a0025339

35.

Rahimi

Bigdeli

R. A.

(2014). The broaden-and-build theory of positive emotions in second language learning. Procedia-Social and Behavioral Sciences, 159, 795–801. https://doi.org/10.1016/j.sbspro.2014.12.451

36.

Strayhorn

T. L.

(2018). College students’ sense of belonging: A key to educational success for all students. Routledge.

37.

Sun

Schwartz

H. A.

Son

Kern

M. L.

Vazire

(2020). The language of well-being: Tracking fluctuations in emotion experience through everyday speech. Journal of Personality & Social Psychology, 118(2), 364–387. https://doi.org/10.1037/pspp0000244

38.

Tausczik

Y. R.

Pennebaker

J. W.

(2010). The psychological meaning of words: LIWC and computerized text analysis methods. Journal of Language and Social Psychology, 29(1), 24–54. https://doi.org/10.1177/0261927X093516

39.

Watson

B. M.

Gallois

(1999). Communication accommodation between patients and health professionals: Themes and strategies in satisfying and unsatisfying encounters. International Journal of Applied Linguistics, 9(2), 167–180. https://doi.org/10.1111/j.1473-4192.1999.tb00170.x

40.

Wojciszke

Bazinska

Jaworski

(1998). On the dominance of moral categories in impression formation. Personality & Social Psychology Bulletin, 24(12), 1251–1263. https://doi.org/10.1177/01461672982412001