Sage Journals: Discover world-class research

Abstract

The current study examined the impact of teacher’s facial expressions in instructional videos on students’ learning process and outcomes for English vocabulary with positive and negative valence. Participants, Chinese learners studying English as a foreign language (EFL) in China, learned 32 words from an instructional video in which a teacher displayed either positive or negative facial expressions. Our findings suggest that learners dwelled longer and fixated more on slides presenting negative vocabulary than on those with positive one. Additionally, learners dwelled longer and fixated more on the teacher when they displayed positive facial expressions compared to negative ones. It was also observed that students’ motivation to learn increased when the teacher displayed positive emotions, irrespective of the emotional valence of words. More importantly, when the teacher exhibited negative emotions while introducing positive words, learners showed improved immediate learning outcomes. When the teacher displayed positive emotions while introducing negative words, learners showed improved delayed learning outcomes. Results suggest that the emotional incongruence between teacher’s facial expressions and the emotional valence of English vocabulary enhanced both immediate and delayed learning outcomes. Therefore, teachers are encouraged to display emotions that not align with the emotional valence of the learning content in their instructional videos, especially when teaching vocabulary in an EFL setting.

Keywords

emotion English vocabulary eye-tracking instructional videos

Get full access to this article

View all access options for this article.

References

Acheampong

F.A.

Nunoo-Mensah

Chen

(2021). Transformer models for text-based emotion detection: A review of BERT-based approaches. Artificial Intelligence Review, 54, 5789–5829. https://doi.org/10.1007/s10462-021-09958-2

Bates

Mächler

Bolker

Walker

(2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. https://doi.org/10.18637/jss.v067.i01

Baumeister

R.F.

Bratslavsky

Finkenauer

Vohs

K.D.

(2001). Bad is stronger than good. Review of General Psychology, 5(4), 323–370. https://psycnet.apa.org/doi/10.1037/1089-2680.5.4.323

Bebbington

MacLeod

Ellison

T.M.

Fay

(2017). The sky is falling: Evidence of a negativity bias in the social transmission of information. Evolution and Human Behavior, 38(1), 92–101. https://doi.org/10.1016/j.evolhumbehav.2016.07.004

Beege

Schneider

Nebel

Häßler

Rey

G.D.

(2018). Mood–affect congruency. Exploring the relation between learners’ mood and the affective charge of educational videos. Computers & Education, 123, 85–96. https://doi.org/10.1016/j.compedu.2018.05.001

Bradley

M. M.

Lang

P. J.

(1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25(1), 49–59. https://doi.org/10.1016/0005-7916(94)90063-9

Bradley

M.M.

Lang

P.J.

(1999). Affective Norms for English Words (ANEW): Stimuli, instruction manual and affective ratings (Technical Report No. C-1). University of Florida, NIMH Center for Research in Psychophysiology. https://pdodds.w3.uvm.edu/teaching/courses/2009-08UVM-300/docs/others/everything/bradley1999a.pdf

Brase

Mani

(2017). Effects of learning context on the acquisition and processing of emotional words in bilinguals. Emotion, 17(4), 628–639. https://doi.org/10.1037/emo0000263

Brod

Hasselhorn

Bunge

S.A.

(2018). When generating a prediction boosts learning: The element of surprise. Learning and Instruction, 55, 22–31. https://doi.org/10.1016/j.learninstruc.2018.01.013

10.

Calvo

M.G.

Beltrán

(2013). Recognition advantage of happy faces: Tracing the neurocognitive processes. Neuropsychologia, 51(11), 2051–2061. https://doi.org/10.1016/j.neuropsychologia.2013.07.010

11.

Dijksterhuis

A.J.

Aarts

(2003). On wildebeests and humans. Psychological Science, 14(1), 14–18. https://doi.org/10.1111/1467-9280.t01-1-01412

12.

Driver

(2022). Emotion-laden texts and words: The influence of emotion on vocabulary learning for heritage and foreign language learners. Studies in Second Language Acquisition, 44(4), 1071–1094. https://doi.org/10.1017/S0272263121000851

13.

Egidi

Ferrig

R.J.

(2009). How valence affects language processing: Negativity bias and mood congruence in narrative comprehension. Memory & Cognition, 37(5), 547–555. https://doi.org/10.3758/MC.37.5.547

14.

Frank

Kafkas

Montaldi

(2022). Experiencing surprise: The temporal dynamics of its impact on memory. Journal of Neuroscience, 42(33), 6435–6444. https://doi.org/10.1523/JNEUROSCI.1783-21.2022

15.

Horovitz

Mayer

R.E.

(2021). Learning with human and virtual instructors who display happy or bored emotions in video lectures. Computers in Human Behavior, 119, Article 106724. https://doi.org/10.1016/j.chb.2021.106724

16.

Hsieh

(2020). Effects of video captioning on EFL vocabulary learning and listening comprehension. Computer Assisted Language Learning, 33(5–6), 567–589. https://doi.org/10.1080/09588221.2019.1577898

17.

Hunt

Einstein

G.O.

(1981). Relational and item-specific information in memory. Journal of Verbal Learning and Verbal Behavior, 20(5), 497–514. https://doi.org/10.1016/S0022-5371(81)90138-9

18.

Kanazawa

(2016). Micro-level emotion as a factor of L2 vocabulary memory: The effect of lexical emotional valence on incidental recall performance. Language Education & Technology, 53, 23–52. https://doi.org/10.24539/let.53.0_23

19.

Kauschke

Bahn

Vesker

Schwarzer

(2019). The role of emotional valence for the processing of facial and verbal stimuli—Positivity or negativity bias? Frontiers in Psychology, 10, Article 1654. https://doi.org/10.3389/fpsyg.2019.01654

20.

Knight

B.G.

Maines

M.L.

Robinson

G.S.

(2002). The effects of sad mood on memory in older adults: A test of the mood congruence effect. Psychology and Aging, 17(4), 653–661. https://doi.org/10.1037//0882-7974.17.4.653

21.

Kuhl

Munzer

(2023). When pictures are not beneficial in multimedia learning: The case of threat-related pictures. Educational Psychology, 43(2–3), 155–172. https://doi.org/10.1080/01443410.2023.2185205

22.

Kuznetsova

Brockhoff

P.B.

Christensen

R.H.B.

(2017). LmerTest package: Tests in linear mixed effects models. Journal of Statistical Software, 82(13), 1–26. https://doi.org/10.18637/jss.v082.i13

23.

Lawson

A.P.

Mayer

R.E.

(2022). The power of voice to convey emotion in multimedia instructional messages. International Journal of Artificial Intelligence in Education, 32, 971–990. https://doi.org/10.1007/s40593-021-00282-y

24.

Lawson

A.P.

Mayer

R.E.

Adamo-Villani

Benes

Lei

Cheng

(2021a). Do learners recognize and relate to the emotions displayed by virtual instructors? International Journal of Artificial Intelligence in Education, 31(1), 134–153. https://doi.org/10.1007/s40593-021-00238-2

25.

Lawson

A.P.

Mayer

R.E.

Adamo-Villani

Benes

Lei

Cheng

(2021b). The positivity principle: Do positive instructors improve learning from video lectures? Educational Technology Research & Development, 69(6), 3101–3129. https://doi.org/10.1007/s11423-021-10057-w

26.

Lawson

A.P.

Mayer

R.E.

Adamo-Villani

Benes

Lei

Cheng

(2021c). Recognizing the emotional state of human and virtual instructors. Computers in Human Behavior, 114, Article 106554. https://doi.org/10.1016/j.chb.2020.106554

27.

Lee

Potter

R.F.

(2018). The impact of emotional words on listeners’ emotional and cognitive responses in the context of advertisements. Communication Research, 47(8), 1155–1180. https://doi.org/10.1177/0093650218765523

28.

Lenth

R.V.

(2021). emmeans: Estimated marginal means, aka least-squares means (R package Version 1.6.1) [Computer software]. Comprehensive R Archive Network (CRAN). https://doi.org/10.32614/CRAN.package.emmeans

29.

Leppänen

J.M.

Hietanen

J.K.

(2004). Positive facial expressions are recognized faster than negative facial expressions, but why? Psychological Research, 69, 22–29. https://doi.org/10.1007/s00426-003-0157-2

30.

Zhang

Xia

(2022). Investigating the visual behavior characteristics of architectural heritage using eye-tracking. Buildings, 12(7), Article 1058. https://doi.org/10.3390/buildings12071058

31.

Mayer

R.E.

(2011). Applying the science of learning. Pearson.

32.

McCrudden

M.T.

Rapp

D.N.

(2017). How visual displays affect cognitive processing. Educational Psychology Review, 29, 623–639. https://doi.org/10.1007/s10648-015-9342-2

33.

Montero Perez

Peters

Desmet

. (2017). Vocabulary learning through viewing video: The effect of two enhancement techniques. Computer Assisted Language Learning, 31(1–2), 1–26. https://doi.org/10.1080/09588221.2017.1375960

34.

Nasrallah

Carmel

(2009). Murder, she wrote: Enhanced sensitivity to negative word valence. Emotion, 9, 609–618. https://doi.org/10.1037/a0016305

35.

Chen

Zhu

Yang

(2022). Modulation of instructor’s eye gaze by facial expression in video lectures. Innovations in Education and Teaching International, 59(1), 15–23. https://doi.org/10.1080/14703297.2020.1788410

36.

Hong

(2016). Learning process and learning outcomes of video podcasts including the instructor and PPT slides: A Chinese case. Innovations in Education and Teaching International, 53(2), 135–144. https://doi.org/10.1080/14703297.2015.1060133

37.

Hong

Yang

(2017). Effects of the instructor’s pointing gestures on learning performance in video lectures. British Journal of Educational Technology, 48(4), 1020–1029. https://doi.org/10.1111/bjet.12471

38.

Huang

Zhao

Wen

Wang

(2025). Happy facial expressions and mouse pointing enhance EFL vocabulary learning from instructional videos. British Journal of Educational Technology, 56(1), 388–409. https://doi.org/10.1111/bjet.13515

39.

Ling

Wang

(2024). Instructors’ pointing gestures and positive facial expressions hinder learning in video lectures: Insights from teachers and students in China. Education and Information Technologies, 29, 21115–21131. https://doi.org/10.1007/s10639-024-12690-3

40.

Liu

Ling

Zhang

(2023). Does an instructor’s facial expressions override their body gestures in video lectures? Computers & Education, 193, Article 104679. https://doi.org/10.1016/j.compedu.2022.104679

41.

Liu

Wang

Yang

(2023). Cues facilitate foreign language vocabulary learning from instructional videos: Behavioral and neural evidence. Language Teaching Research. Advance online publication. https://doi.org/10.1177/136216882311647

42.

Liu

Zhang

Wang

(2024). The emotional design of an instructor: Body gestures do not boost the effects of facial expressions in video lectures. Interactive Learning Environments, 32(3), 952–971. https://doi.org/10.1080/10494820.2022.2105898

43.

Zhu

Zhang

Yang

(2024). An instructor’s beat gestures facilitate second language vocabulary learning from instructional videos: Behavioral and neural evidence. Language Teaching Research, 28(5), 1997–2025. https://doi.org/10.1177/13621688211039023

44.

R Core Team. (2025). R: A language and environment for statistical computing (Version 4.5.0) [Computer software]. R Foundation for Statistical Computing. https://www.R-project.org/

45.

Schmidt

S.R.

(2012). Memory for emotional words in sentences: The importance of emotional contrast. Cognition & Emotion, 26(6), 1015–1035. https://doi.org/10.1080/02699931.2011.631986

46.

Stull

A.T.

Fiorella

Gainer

M.J.

Mayer

R.E.

(2018). Using transparent whiteboards to boost learning from online stem lectures. Computers & Education, 120, 146–159. https://doi.org/10.1016/j.compedu.2018.02.005

47.

Unkelbach

Fiedler

Bayer

Stegmüller

Danner

(2008). Why positive information is processed faster: The density hypothesis. Journal of Personality and Social Psychology, 95(1), 36–49. https://doi.org/10.1037/0022-3514.95.1.36

48.

Vaish

Grossmann

Woodward

A.L.

(2008). Not all emotions are created equal: The negativity bias in social-emotional development. Psychological Bulletin, 134(3), 383–403. https://doi.org/10.1037/0033-2909.134.3.383

49.

Wang

Zhang

(2023). How do word valence and classes influence lexical processing? Evidence from virtual reality emotional contexts. Frontiers in Psychology, 13, Article 1032384. https://doi.org/10.3389/fpsyg.2022.1032384

50.

Warriner

A.B.

Kuperman

Brysbaert

(2013). Norms of valence, arousal, and dominance for 13,915 English lemmas. Behavior Research Methods, 45, 1191–1207. https://doi.org/10.3758/s13428-012-0314-x

51.

Wertheimer

(1959). Productive thinking. Harper.

52.

Wong

R.M.

Adesope

O.O.

(2021). Meta-analysis of emotional designs in multimedia learning: A replication and extension study. Educational Psychology Review, 33, 357–385. https://doi.org/10.1007/s10648-020-09545-x

53.

Yang

Liu

Zhang

(2021). The teacher’s eye gaze in university classrooms: Evidence from a field study. Innovations in Education and Teaching International, 60(1), 4–14. https://doi.org/10.1080/14703297.2021.1951808

54.

Zhang

Wang

Fang

Xiao

(2024). Guiding student learning in video lectures: Effects of instructors’ emotional expressions and visual cues. Computers & Education, 218, Article 105062. https://doi.org/10.1016/j.compedu.2024.105062

55.

Zhang

Huang

(2023). Perceived teachers’ enthusiasm and willingness to communicate in the online class: The mediating role of learning enjoyment and group interaction for Chinese as a second language. Language Teaching Research. Advance online publication. https://doi.org/10.1177/13621688231216

56.

Zhu

Yang

(2024). Unleashing the power of positivity: How positive instructors benefit learning from instructional videos – A meta-analytic review. Educational Psychology Review, 36, Article 47. https://doi.org/10.1007/s10648-024-09859-0

Emotional incongruence enhances English vocabulary acquisition from instructional videos

Abstract

Keywords

Get full access to this article

References