Two Emotional Design Features Are More Effective Than One in Multimedia Learning

Abstract

This study examined the impacts of adding emotional design features to a multimedia lesson (color alone, anthropomorphism alone, or color & anthropomorphism together) on college students’ affective processes (measured by ratings of experienced emotion during learning), cognitive processes (measured by eye-tracking metrics), and learning outcomes (measured by retention and transfer test scores). One-hundred students were randomly assigned to watch a short multimedia lesson in one of four conditions: no emotional design, colorful emotional design, anthropomorphism emotional design, and colorful and anthropomorphism emotional design. The study results showed that compared to the no emotional design group, the colorful and anthropomorphism emotional design group showed the higher positive emotion rating (d = .726), the shortest time to first fixation on an emotional design area (d = - .877), the longest fixation duration on emotional design areas (d = .640), and the best transfer test score (d = .679). In contrast, the anthropomorphism emotional design group outperformed the no emotional design group only on rating of positive emotion, and the colorful emotional design group outperformed the no emotional design group only on transfer test score. The results show that two emotional design features are more effective than one in multimedia lessons. A structural equation model indicated that positive emotion (tapping affective processing) and fixation duration (tapping cognitive processing) mediated the pathway from emotional design to learning performance. These results partially support the Cognitive-Affective Model of E-Learning.

Keywords

emotional design multimedia learning affective processes cognitive processes eye movements

Get full access to this article

View all access options for this article.

References

Brom

Stárková

D’Mello

S. K.

(2018). How effective is emotional design? A meta-analysis on facial anthropomorphisms and pleasant colors during multimedia learning. Educational Research Review, 25, 100−119. https://doi.org/10.1016/j.edurev.2018.09.004.

Chen

Lin

L.-S.

(2010). Structural equation-based latent growth curve modeling of watershed attribute-regulated stream sensitivity to reduced acidic deposition. Ecological Modelling, 221(17), 2086−2094. https://doi.org/10.1016/j.ecolmodel.2010.05.010.

Chen

C.-M.

Wang

H.-P.

(2011). Using emotion recognition technology to assess the effects of different multimedia materials on learning emotion and performance. Library & Information Science Research, 33(3), 244−255. https://doi.org/10.1016/j.lisr.2010.09.010.

Crawford

J. R.

Henry

J. D.

(2004). The positive and negative affect Schedule (PANAS): Construct validity, measurement properties and normative data in a large non‐clinical sample. British Journal of Clinical Psychology, 43(3), 245−265. https://doi.org/10.1348/0144665031752934.

Gillespie-Smith

Boardman

J. P.

Murray

I. C.

Norman

J. E.

O’Hare

Fletcher-Watson

(2016). Multiple measures of fixation on social content in infancy: evidence for a single social cognitive construct? Infancy, 21(2), 241−257. https://doi.org/10.1111/infa.12103.

Harp

S. F.

Mayer

R. E.

(1997). The role of interest in learning from scientific text and illustrations: On the distinction between emotional interest and cognitive interest. Journal of educational psychology, 89(1), 92−102. https://doi.org/10.1037/0022-0663.89.1.92.

Holmqvist

Nyström

Andersson

Dewhurst

Jarodzka

Van de Weijer

(2011). Eye tracking: A comprehensive guide to methods and measures. Oxford University Press.

Hooper

Coughlan

Mullen

M. R.

(2008). Structural equation modelling: guidelines for determining model fit. Electronic Journal of Business Research Methods, 6(1), 53−60.

Horovitz

Mayer

R. E.

(2021). Learning with human and virtual instructors who display happy or bored emotions in video lectures. Computers in Human Behavior, 119, 106724. https://doi.org/10.1016/j.chb.2021.106724.

10.

Jarodzka

(2022). Research methods in multimedia learning. In Mayer

R. E.

Fiorella

(Eds.) The Cambridge handbook of multimedia learning (3rd ed., pp. 41−55). Cambridge University Press.

11.

Kim

J.-E.

Nembhard

D. A.

(2019). Eye movement as a mediator of the relationships among time pressure, feedback, and learning performance. International Journal of Industrial Ergonomics, 70, 116−123. https://doi.org/10.1016/j.ergon.2018.12.006.

12.

Kumar

J. A.

Muniandy

Wan Yahaya

W. A. J.

(2019). Exploring the effects of emotional design and emotional intelligence in multimedia-based learning: an engineering educational perspective. New Review of Hypermedia and Multimedia, 25(1-2), 57−86. https://doi.org/10.1080/13614568.2019.1596169.

13.

Lai

Green

S. B.

(2016). The problem with having two watches: Assessment of fit when RMSEA and CFI disagree. Multivariate Behavioral Research, 51(2-3), 220−239. https://doi.org/10.1080/00273171.2015.1134306.

14.

Lai

M.-L.

Tsai

M.-J.

Yang

F.-Y.

Hsu

C.-Y.

Liu

T.-C.

Lee

S. W.-Y.

Lee

M.-H.

Chiou

G.-L.

Liang

J.-C.

Tsai

C.-C.

(2013). A review of using eye-tracking technology in exploring learning from 2000 to 2012. Educational Research Review, 10, 90−115. https://doi.org/10.1016/j.edurev.2013.10.001.

15.

Lawson

A. P.

Mayer

R. E.

(2021b). The power of voice to convey emotion in multimedia instructional messages. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-021-00282-y.

16.

Lawson

A. P.

Mayer

R. E.

Adamo-Villani

Benes

Lei

Cheng

(2021a). The positivity principle: Do positive instructors improve learning from instruction video lectures? Educational Technology Research and Development, 69(6), 3101−3129. https://doi.org/10.1007/s11423-021-10057-w.

17.

Lawson

A. P.

Mayer

R. E.

Adamo-Villani

Benes

Lei

Cheng

(2021a). Do learners recognize and relate to the emotions displayed by virtual instructors? International Journal of Artificial Intelligence in Education, 31(1), 134−153. https://doi.org/10.1007/s40593-021-00238-2.

18.

Lawson

A. P.

Mayer

R. E.

Adamo-Villani

Benes

Lei

Cheng

(2021b). Recognizing the emotional state of human and virtual instructors. Computers in Human Behavior, 114, 106554. https://doi.org/10.1016/j.chb.2020.106554.

19.

Liu

Deng

Dai

D. Y.

(2018). Heart rate variability reflects the effects of emotional design principle on mental effort in multimedia learning. Computers in Human Behavior, 89, 40−47. https://doi.org/10.1016/j.chb.2018.07.037.

20.

Lin

C. J.

Prasetyo

Y. T.

Widyaningrum

(2019). Eye movement measures for predicting eye gaze accuracy and symptoms in 2D and 3D displays. Displays, 60, 1−8. https://doi.org/10.1016/j.displa.2019.08.002.

21.

Mayer

R. E.

(2011). Applying the science of learning. Pearson.

22.

Mayer

R. E.

(2020). Searching for the role of emotions in e-learning. Learning and Instruction, 70, 101213. https://doi.org/10.1016/j.learninstruc.2019.05.010.

23.

Mayer

R. E.

(2021). Multimedia learning (3rd ed.). Cambridge University Press.

24.

Mayer

R. E.

Estrella

(2014). Benefits of emotional design in multimedia instruction. Learning and Instruction, 33, 12−18. https://doi.org/10.1016/j.learninstruc.2014.02.004.

25.

Mayer

R. E.

Moreno

(1998). A split-attention effect in multimedia learning. Journal of Educational Psychology, 90(2), 312−320. https://doi.org/10.1037/0022-0663.90.2.312.

26.

Moreno

(2007). Optimising learning from animations by minimising cognitive load: Cognitive and affective consequences of signalling and segmentation methods. Applied Cognitive Psychology: The Official Journal of the Society for Applied Research in Memory and Cognition, 21(6), 765−781. https://doi.org/10.1002/acp.1348.

27.

Moreno

Mayer

R. E.

(2002). Verbal redundancy in multimedia learning: When reading helps listening. Journal of Educational Psychology, 94(1), 156−163. https://doi.org/10.1037/0022-0663.94.1.156.

28.

Moreno

Mayer

(2007). Interactive multimodal learning environments. Educational Psychology Review, 19(3), 309−326. https://doi.org/10.1007/s10648-007-9047-2.

29.

Park

Knörzer

Plass

J. L.

Brünken

(2015). Emotional design and positive emotions in multimedia learning: An eye tracking study on the use of anthropomorphisms. Computers & Education, 86, 30−42. https://doi.org/10.1016/j.compedu.2015.02.016.

30.

Pekrun

(2017). Achievement emotions. In Elliot

A. J.

Dweck

C. S.

Yeager

D. S.

(Eds.) Handbook of competence and motivation: Theory and application (pp. 251−271). The Guilford Press.

31.

Pekrun

Linnenbrink-Garcia

(2012). Academic emotions and student engagement Handbook of research on student engagement (pp. 259−282). Springer. https://doi.org/10.1007/978-1-4614-2018-7_12.

32.

Pekrun

Perry

R. P.

(2014). Control-value theory of achievement emotions. In Pekrun

Linnenbrink-Garcia

(Eds.) International handbook of emotions in education (pp. 120−141). Taylor and Francis.

33.

Peng

Chen

Zhou

(2021). An eye tracking study: positive emotional interface design facilitates learning outcomes in multimedia learning? International Journal of Educational Technology in Higher Education, 18(1), 1−18. https://doi.org/10.1186/s41239-021-00274-x.

34.

Plass

J. L.

Heidig

Hayward

E. O.

Homer

B. D.

(2014). Emotional design in multimedia learning: Effects of shape and color on affect and learning. Learning and Instruction, 29, 128−140. https://doi.org/10.1016/j.learninstruc.2013.02.006.

35.

Plass

J. L.

Homer

B. D.

MacNamara

Ober

Rose

M. C.

Pawar

Hovey

C. M.

Olsen

(2020). Emotional design for digital games for learning: The effect of expression, color, shape, and dimensionality on the affective quality of game characters. Learning and Instruction, 70, 101194. https://doi.org/10.1016/j.learninstruc.2019.01.005.

36.

Plass

J. L.

Kalyuga

(2019). Four ways of considering emotion in cognitive load theory. Educational Psychology Review, 31(2), 339−359. https://doi.org/10.1007/s10648-019-09473-5.

37.

Plass

J. L.

Kaplan

(2016). Emotional design in digital media for learning. In Tettegah

Gartmeier

(Eds.) Emotions, technology, design, and learning (pp. 131−161). Elsevier. https://doi.org/10.1016/b978-0-12-801856-9.00007-4.

38.

Ponce

H. R.

Mayer

R. E.

(2014a). An eye movement analysis of highlighting and graphic organizer study aids for learning from expository text. Computers in Human Behavior, 41, 21−32. https://doi.org/10.1016/j.chb.2014.09.010.

39.

Ponce

H. R.

Mayer

R. E.

(2014b). Qualitatively different cognitive processing during online reading primed by different study activities. Computers in Human Behavior, 30, 121−130. https://doi.org/10.1016/j.chb.2013.07.054.

40.

Riva

Mantovani

Capideville

C. S.

Preziosa

Morganti

Villani

Gaggioli

Botella

Alcañiz

(2007). Affective interactions using virtual reality: The link between presence and emotions. CyberPsychology & Behavior, 10(1), 45−56. https://doi.org/10.1089/cpb.2006.9993.

41.

Russell

J. A.

(1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161−1178. https://doi.org/10.1037/h0077714.

42.

Russell

J. A.

(2003). Core affect and the psychological construction of emotion. Psychological Review, 110(1), 145−172. https://doi.org/10.1037/0033-295x.110.1.145.

43.

Schrader

Kalyuga

Plass

J. L.

(2022). Motivation and affect in multimedia learning. In Mayer

R. E.

Fiorella

(Eds.) The Cambridge handbook of multimedia learning (3rd ed., pp. 121−131). Cambridge University Press.

44.

Stark

Brünken

Park

(2018). Emotional text design in multimedia learning: a mixed-methods study using eye tracking. Computers & Education, 120, 185−196. https://doi.org/10.1016/j.compedu.2018.02.003.

45.

Stárková

Lukavský

Javora

Brom

(2019). Anthropomorphisms in multimedia learning: Attract attention but do not enhance learning? Journal of Computer Assisted Learning, 35(4), 555−568. https://doi.org/10.1111/jcal.12359.

46.

Tettegah

S. Y.

McCreery

M. P.

(Eds.) (2015). Emotions, Technology, and Learning. Academic Press.

47.

E. R.

Plass

J. L.

Hayward

E. O.

Homer

B. D.

(2012). Emotional design in multimedia learning. Journal of Educational Psychology, 104(2), 485−498. https://doi.org/10.1037/a0026609.

48.

Uzun

A. M.

Yıldırım

(2018). Exploring the effect of using different levels of emotional design features in multimedia science learning. Computers & Education, 119, 112−128. https://doi.org/10.1016/j.compedu.2018.01.002.

49.

Wang

Lin

Han

Spector

J. M.

(2020). Impacts of cues on learning: Using eye-tracking technologies to examine the functions and designs of added cues in short instructional videos. Computers in Human Behavior, 107, 106279. https://doi.org/10.1016/j.chb.2020.106279.

50.

Watson

Clark

L. A.

Tellegen

(1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063−1070. https://doi.org/10.1037//0022-3514.54.6.1063.

51.

Wong

R. M.

Adesope

O. O.

(2020). Meta-analysis of emotional designs in multimedia learning: A replication and extension study. Educational Psychology Review, 33(2), 357−385. https://doi.org/10.1007/s10648-020-09545-x.

52.

Zhai

Fang

Dong

Wei

Yuan

Cacciolatti

Yang

(2018). The effects of biofeedback‐based stimulated recall on self‐regulated online learning: A gender and cognitive taxonomy perspective. Journal of Computer Assisted Learning, 34(6), 775−786. https://doi.org/10.1111/jcal.12284.