The Effect of Digital Game-Based Learning Interventions on Cognitive,Metacognitive,and Affective-Motivational Learning Outcomes in School: A Meta-Analysis

Abstract

Digital game-based learning (DGBL) interventions can be superior to traditional instruction methods for learning, but previous meta-analyses covered a huge period and included a variety of different target groups, limiting the results’ transfer on specific target groups. Therefore, the aim of this meta-analysis is a theory-based examination of DGBL interventions’ effects on different learning outcomes (cognitive, metacognitive, affective-motivational) in the school context, using studies published between 2015 and 2020 and meta-analytic techniques (including moderator analyses) to examine the effectiveness of DGBL interventions compared to traditional instruction methods. Results from random-effects models revealed a significant medium effect for overall learning (g = .54) and cognitive learning outcomes (g = .67). Also found were a small effect for affective-motivational learning outcomes (g = .32) and no significant effect for metacognitive learning outcomes. Additionally, there was no evidence of publication bias. Further meta-regression models did not reveal evidence of moderating personal, environmental, or confounding factors. The findings partially support the positive impact of DGBL interventions in school, and the study addresses its practical implications.

Keywords

classroom research computers and learning game-based learning instructional technologies learning environments learning outcomes meta-analysis school context systematic review

Get full access to this article

View all access options for this article.

References

Abdul Jabbar

A. I.

Felicia

. (2015). Gameplay engagement and learning in game-based learning: a systematic review. Review of Educational Research, 85(4), 740–779. https://doi.org/10.3102/00346543155772

Ada

Akdeniz

M. F.

Gümgüm

Ö.

Keskin

Yazıcı

Yayan

. (2016, May). Interactive serious games with visual programming for mobile robot learning. In 2016 24th Signal Processing and Communication Application Conference (SIU) (pp. 485–488). IEEE. https://doi.org/10.1109/SIU.2016.7495783

Admiraal

Huizenga

Akkerman

Ten Dam

(2011). The concept of flow in collaborative game-based learning. Computers in Human Behavior, 27(3), 1185–1194. https://doi.org/10.1016/j.chb.2010.12.013

Kutlu

(2017). Effect of game environments on students’ learning. British Journal of Educational Technology, 48, 129–144. https://doi.org/10.1111/bjet.12346

Al-Azawi

Al-Faliti

Al-Blushi

(2016). Educational gamification vs. game based learning: comparative study. International Journal of Innovation, Management and Technology, 7(4), 131–136. https://doi.org/10.18178/ijimt.2016.7.4.659

All

Plovie

Castellar

E. P. N.

Van Looy

. (2017). Pre-test influences on the effectiveness of digital-game based learning: A case study of a fire safety game. Computers & Education, 114, 24–37. https://doi.org/10.1016/j.compedu.2017.05.018

Allen

K. N.

Friedman

B. D.

(2010). Affective learning: A taxonomy for teaching social work values. Journal of Social Work Values and Ethics, 7(2), 1–12.

Bandura

(1989). Human agency in social cognitive theory. American Psychologist, 44(9), 1175–1184. https://doi.org/10.1037/0003-066X.44.9.1175

Bandura

(1997). Self-efficacy: The exercise of control. Freeman.

10.

Bowers

C. A.

Serge

Blair

Cannon-Bowers

Joyce

Boshnack

(2013). The effectiveness of narrative pre-experiences for creating context in military training. Simulation & Gaming, 44(4), 514–522. https://doi.org/10.1177/1046878113475341

11.

Cagiltay

N. E.

Ozcelik

N. S.

(2015). The effect of competition on learning in games. Computers & Education, 87, 35–41. https://doi.org/10.1016/j.compedu.2015.04.001

12.

Cepeda

N. J.

Pashler

Vul

Wixted

J. T.

Rohrer

(2006). Distributed practice in verbal recall tasks: A review and quantitative synthesis. Psychological Bulletin, 132(3), 354–380. https://doi.org/10.1037/0033-2909.132.3.354

13.

Chang

C.-C.

Liang

Chou

P.-N.

Lin

G.-Y.

(2017). Is game-based learning better in flow experience and various types of cognitive load than non-game-based learning? Perspective from multimedia and media richness. Computers in Human Behavior, 71, 218–227. https://doi.org/10.1016/j.chb.2017.01.031

14.

Chen

C.-H.

(2019). The impacts of peer competition-based science gameplay on conceptual knowledge, intrinsic motivation, and learning behavioral patterns. Educational Technology Research and Development, 67(1), 179–198. https://doi.org/10.1007/s11423-018-9635-5

15.

Chen

C.-H.

Chiu

C.-H.

(2016). Employing intergroup competition in multitouch design-based learning to foster student engagement, learning achievement, and creativity. Computers & Education, 103, 99–113. https://doi.org/10.1016/j.compedu.2016.09.007

16.

Chen

C.-H.

Shih

C.-C.

Law

(2020). The effects of competition in digital game-based learning (DGBL): A meta-analysis. Educational Technology Research and Development, 68(4), 1855–1873. https://doi.org/10.1007/s11423-020-09794-1

17.

Chen

G.-D.

Lee

J.-H.

Wang

C.-Y.

Chao

P.-Y.

L.-Y.

Lee

(2012). An empathic avatar in a computer-aided learning program to encourage and persuade learners. Journal of Educational Technology & Society, 15(2), 62–72.

18.

Clark

D. B.

Tanner-Smith

E. E.

Killingsworth

S. S.

(2016). Digital games, design, and learning: A systematic review and meta-analysis. Review of Educational Research, 86(1), 79–122. https://doi.org/10.3102/0034654315582065

19.

Cochran

W. G.

(1954). The combination of estimates from different experiments. Biometrics, 10(1), 101–129. https://doi.org/10.2307/3001666

20.

Cohen

E. L.

(2016). Enjoyment of a counter-hedonic serious digital game: Determinants and effects on learning and self-efficacy. Psychology of Popular Media Culture, 5(2), 157–170. http://dx.doi.org/10.1037/ppm0000052

21.

Cohen

(1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46. https://doi.org/10.1177/001316446002000104

22.

Cohen

(1988). Statistical power analysis for the behavioural sciences (2nd ed.). Erlbaum Associates.

23.

Cohen

(2001). Defining identification: A theoretical look at the identification of audiences with media characters. Mass Communication & Society, 4(3), 245–264. https://doi.org/10.1207/S15327825MCS0403_01

24.

Cojocariu

V.-M.

Boghian

(2014). Teaching the relevance of game-based learning to preschool and primary teachers. Procedia – Social and Behavioral Sciences, 142, 640–646. https://doi.org/10.1016/j.sbspro.2014.07.679

25.

Connolly

T. M.

Stansfield

(2009). From e-learning to games-based e-learning. In Encyclopedia of information communication technology (pp. 268–275). IGI Global. https://doi.org/10.4018/978-1-59904-845-1.ch035

26.

Coombes

Chan

Allen

Foxcroft

D. R

. (2016). Mixed-methods evaluation of the good behaviour game in english primary schools. Journal of Community & Applied Social Psychology, 26(5), 369–387. https://doi.org/10.1002/casp.2268

27.

De Freitas

Mohan

Kinshuk . (2018). A game designers’ guide for creating learning games for mathematics. 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT) (pp. 146–148). IEEE. https://doi.org/10.1109/ICALT.2018.00144

28.

Dickey

M. D.

(2020). Narrative in game-based learning. In Plass

J. L.

Mayer

R. E.

Homer

B. D.

(Eds.), Handbook of game-based learning (pp. 283–306). MIT Press.

29.

Domagk

Schwartz

R. N.

Plass

J. L.

(2010). Interactivity in multimedia learning: An integrated model. Computers in Human Behavior, 26(5), 1024–1033. https://doi.org/10.1016/j.chb.2010.03.003

30.

Döring

Bortz

(2016). Forschungsmethoden und evaluation in den sozial- und humanwissenschaften. Springer. https://doi.org/10.1007/978-3-642-41089-5

31.

Egger

Smith

G. D.

Schneider

Minder

(1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315(7109), 629–634. https://doi.org/10.1136/bmj.315.7109.629

32.

Erhel

Jamet

(2013). Digital game-based learning: Impact of instructions and feedback on motivation and learning effectiveness. Computers & Education, 67, 156–167. https://doi.org/10.1016/j.compedu.2013.02.019

33.

Fien

Doabler

C. T.

Nelson

N. J.

Kosty

D. B.

Clarke

Baker

S. K.

(2016). An examination of the promise of the NumberShire level 1 gaming intervention for improving student mathematics outcomes. Journal of Research on Educational Effectiveness, 9(4), 635–661. https://doi.org/10.1080/19345747.2015.1119229

34.

Fragkos

K. C.

Tsagris

Frangos

C. C.

(2014). Publication bias in meta-analysis: Confidence intervals for Rosenthal’s fail-safe number. International Scholarly Research Notices, 2014, 825383. https://doi.org/10.1155/2014/825383

35.

Franciosi

S. J.

(2017). The effect of computer game-based learning on FL vocabulary transferability. Educational Technology & Society, 20(1), 123–133.

36.

Hedges

L. V.

Vevea

J. L.

(1996). Estimating effect size under publication bias: Small sample properties and robustness of a random effects selection model. Journal of Educational and Behavioral Statistics, 21(4), 299–332. https://doi.org/10.3102/10769986021004299

37.

Higgins

J. P. T.

Thompson

S. G.

(2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), 1539–1558. https://doi.org/10.1002/sim.1186

38.

Jackson

L. C.

O’Mara

Moss

Jackson

A. C.

(2018). A critical review of the effectiveness of narrative-driven digital educational games. International Journal of Game-Based Learning, 8(4), 32–49. https://doi.org/10.4018/IJGBL.2018100103

39.

Johnson

W. L.

Lester

J. C.

(2016). Face-to-face interaction with pedagogical agents, twenty years later. International Journal of Artificial Intelligence in Education, 26(1), 25–36. https://doi.org/10.1007/s40593-015-0065-9

40.

Jong

M. S. Y.

(2016). Teachers’ concerns about adopting constructivist GBL. British Journal of Educational Technology, 47, 601–617. https://doi.org/10.1111/bjet.12247

41.

Karakoç

Eryılmaz

Turan Özpolat

Yıldırım

. (2020). The effect of game-based learning on student achievement: A meta-analysis study. Technology, Knowledge and Learning, 27(1), 207–222. https://doi.org/10.1007/s10758-020-09471-5

42.

Kinzer

C. K.

Hoffman

D. L.

Turkay

Gunbas

Chantes

Dvorkin

Chaiwinij

(2012). The impact of choice and feedback on learning, motivation, and performance in an educational video game. Proceedings of the Games, Learning, and Society Conference, 2, 175–181.

43.

Klimmt

Hefner

Vorderer

Roth

Blake

(2010). Identification with video game characters as automatic shift of self-perceptions. Media Psychology, 13(4), 323–338. https://doi.org/10.1080/15213269.2010.524911

44.

Kuhn

Pease

(2006). Do children and adults learn differently? Journal of Cognition and Development, 7(3), 279–293. https://doi.org/10.1207/s15327647jcd0703_1

45.

Lai

A. F.

Chen

C. H.

Lee

G. Y.

(2019). An augmented reality-based learning approach to enhancing students’ science reading performances from the perspective of the cognitive load theory. British Journal of Educational Technology, 50(1), 232–247. https://doi.org/10.1111/bjet.12716

46.

Lamb

R. L.

Annetta

Firestone

Etopio

(2018). A meta-analysis with examination of moderators of student cognition, affect, and learning outcomes while using serious educational games, serious games, and simulations. Computers in Human Behavior, 80, 158–167. https://doi.org/10.1016/j.chb.2017.10.040

47.

Landis

J. R.

Koch

G. G.

(1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310

48.

Lee

J. J.

Hammer

(2011). Gamification in education: What, how, why bother? Academic Exchange Quarterly, 15(2), 146.

49.

Lester

J. C.

Spain

R. D.

Rowe

J. P.

Mott

B. W.

(2020). Instructional support, feedback, and coaching in game-based learning. In Plass

J. L.

Mayer

R. E.

Homer

B. D.

(Eds.), Handbook of game-based learning (pp. 209–238). MIT Press.

50.

Lester

J. C.

Spires

H. A.

Nietfeld

J. L.

Minogue

Mott

B. W.

Lobene

E. V.

(2014). Designing game-based learning environments for elementary science education: A narrative-centered learning perspective. Information Sciences, 264, 4–18. https://doi.org/10.1016/j.ins.2013.09.005

51.

Liew

T. W.

Tan

S.-M.

(2016). Virtual agents with personality: Adaptation of learner-agent personality in a virtual learning environment. Eleventh International Conference on Digital Information Management (ICDIM) (pp. 157–162). ICDIM. https://doi.org/10.1109/ICDIM.2016.7829758

52.

Loderer

Pekrun

Plass

J. L.

(2020). Emotional foundations of game-based learning. In Plass

J. L.

Mayer

R. E.

Homer

B. D.

(Eds.), Handbook of game-based learning (pp. 111–152). MIT Press.

53.

López-Fernández

Gordillo

Alarcón

P. P.

Tovar

(2021). Comparing traditional teaching and game-based learning using teacher-authored games on computer science education. IEEE Transactions on Education, 64(4), 367–373. https://doi.org/10.1109/TE.2021.3057849

54.

Malliarakis

Tomos

Shabalina

Mozelius

(2018). Andragogy and E.M.O.T.I.O.N: 7 key factors of successful serious games. In Ciussi

(Ed.), Proceedings of the 12th European Conference on Games Based Learning (pp. 371–378). ACI.

55.

Marklund

B. B.

Alklind Taylor

A. S.

(2016). Educational games in practice: The challenges involved in conducting a game-based curriculum. The Electronic Journal of E-Learning, 14(2), 122–135.

56.

Martha

A. S. D.

Santoso

H. B.

(2019). The design and impact of the pedagogical agent: A systematic literature review. Journal of Educators Online, 16(1). https://doi.org/10.9743/jeo.2019.16.1.8

57.

Mayer

R. E.

(2014). Computer games for learning: An evidence-based approach. Teachers College Record (pp. 1–3). MIT Press.

58.

Mayer

R. E.

(2020). Cognitive foundations of game-based learning. In Plass

J. L.

Mayer

R. E.

Homer

B. D.

(Eds.), Handbook of game-based learning (pp. 83–110). MIT Press.

59.

McLaren

B. M.

Adams

D. M.

Mayer

R. E.

Forlizzi

(2017). A computer-based game that promotes mathematics learning more than a conventional approach. International Journal of Game-Based Learning, 7(1), 36–56. https://doi.org/10.4018/IJGBL.2017010103

60.

Nelson

Kim

(2020). Multimedia design principles in game-based learning. In Plass

J. L.

Mayer

R. E.

Homer

B. D.

(Eds.), Handbook of game-based learning (pp. 307–328). MIT Press.

61.

Novak

(2015). A critical review of digital storyline-enhanced learning. Educational Technology Research and Development, 63(3), 431–453. https://doi.org/10.1007/s11423-015-9372-y

62.

Nussbaum

E. M.

Owens

M. C.

Sinatra

G. M.

Rehmat

A. P.

Cordova

J. R.

Ahmad

Dascalu

S. M.

(2015). Losing the lake: Simulations to promote gains in student knowledge and interest about climate change. International Journal of Environmental and Science Education, 10(6), 789–811.

63.

Partovi

Razavi

M. R.

(2019). The effect of game-based learning on academic achievement motivation of elementary school students. Learning and Motivation, 68, 101592. https://doi.org/10.1016/j.lmot.2019.101592

64.

Pawar

Tam

Plass

J. L.

(2020). Emerging design factors of game-based learning: Emotional design, musical score, and game mechanics design. In Plass

J. L.

Mayer

R. E.

Homer

B. D.

(Eds.), Handbook of game-based learning (pp. 347–367). MIT Press.

65.

Peeters

De Backer

Reina

V. R.

Kindekens

Buffel

Lombaerts

(2014). The role of teachers’ self-regulatory capacities in the implementation of self-regulated learning practices. Procedia – Social and Behavioral Sciences, 116, 1963–1970. https://doi.org/10.1016/j.sbspro.2014.01.504

66.

Pekrun

(2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18(4), 315–341. https://doi.org/10.1007/s10648-006-9029-9

67.

Pellas

Vosinakis

(2018). The effect of simulation games on learning computer programming: A comparative study on high school students’ learning performance by assessing computational problem-solving strategies. Education and Information Technologies, 23(6), 2423–2452. https://doi.org/10.1007/s10639-018-9724-4

68.

Plass

J. L.

Homer

B. D.

Kinzer

Frye

Perlin

(2011). Learning mechanics and assessment mechanics for games for learning. White Paper, 1, 1–19. https://doi.org/10.13140/2.1.3127.1201

69.

Plass

J. L.

Homer

B. D.

Kinzer

C. K.

(2015). Foundations of game-based learning. Educational Psychologist, 50(4), 258–283. https://doi.org/10.1080/00461520.2015.1122533

70.

Plass

J. L.

Homer

B. D.

Mayer

R. E.

Kinzer

C. K.

(2020). Theoretical foundations of game-based and playful learning. In Plass

J. L.

Mayer

R. E.

Homer

B. D.

(Eds.), Handbook of game-based learning (pp. 3–24). MIT Press.

71.

Plass

J. L.

Pawar

(2020). Adaptivity and personalization in game-based learning. In Plass

J. L.

Mayer

R. E.

Homer

B. D.

(Eds.), Handbook of game-based learning (pp. 263–282). MIT Press.

72.

Post

L. S.

Guo

Saab

Admiraal

(2019). Effects of remote labs on cognitive, behavioral, and affective learning outcomes in higher education. Computers & Education, 140, 1–9. https://doi.org/10.1016/j.compedu.2019.103596

73.

Prensky

(2007). Digital game-based learning. Paragon House.

74.

R Core Team. (2020). A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/

75.

Rigby

Ryan

R. M.

(2011). Glued to games: How video games draw us in and hold us spellbound (pp. 510–511). Praeger.

76.

Riley

R. D.

Higgins

J. P. T.

Deeks

J. J.

(2011). Interpretation of random effects meta-analyses. BMJ, 342, 964–967. https://doi.org/10.1136/bmj.d549

77.

Rosenthal

(1979). The “file drawer problem“ and tolerance for null results. Psychological Bulletin, 86(3), 638–641. https://doi.org/10.1037/0033-2909.86.3.638

78.

Rowe

J. P.

Shores

L. R.

Mott

B. W.

Lester

J. C.

(2011). Integrating learning, problem solving, and engagement in narrative-centered learning environments. International Journal of Artificial Intelligence in Education, 21(1–2), 115–133.

79.

Ryan

R. M.

Deci

E. L.

(2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78. https://doi.org/10.1037/0003-066X.55.1.68

80.

Ryan

R. M.

Rigby

C. S.

(2020). Motivational foundations of game-based learning. In Plass

J. L.

Mayer

R. E.

Homer

B. D.

(Eds.), Handbook of game-based learning (pp. 153–176). MIT Press.

81.

Sala

Gobet

(2017). Does chess instruction improve mathematical problem-solving ability? Two experimental studies with an active control group. Learning & Behavior, 45(4), 414–421. https://doi.org/10.3758/s13420-017-0280-3

82.

Sitzmann

(2011). A meta-analytic examination of the instructional effectiveness of computer-based simulation games. Personnel Psychology, 64(2), 489–528. https://doi.org/10.1111/j.1744-6570.2011.01190.x

83.

Skarbez

Smith

Whitton

M. C.

(2021). Revisiting Milgram and Kishino’s reality-virtuality continuum. Frontiers in Virtual Reality, 2, 1–8. https://doi.org/10.3389/frvir.2021.647997

84.

Steinkuehler

Tsaasan

A. M.

(2020). Sociocultural foundations of game-based learning. In Plass

J. L.

Mayer

R. E.

Homer

B. D.

(Eds.), Handbook of game-based learning (pp. 177–208). MIT Press.

85.

Sweller

(2011). Cognitive load theory. In Mestre

J. P.

Ross

B. H.

(Eds.), Psychology of learning and motivation (vol. 55, pp. 37–76). Academic Press. https://doi.org/10.1016/B978-0-12-387691-1.00002-8

86.

Tam

Pawar

(2020). Emerging design factors in game-based learning: Incentives, social presence, and identity design. In Plass

J. L.

Mayer

R. E.

Homer

B. D.

(Eds.), Handbook of game-based learning (pp. 367–386). MIT Press.

87.

Tangsripairoj

Sukkhet

Sumanotham

Yusuk

. (2019, July). Kiddy manner: A game-based mobile application for children learning thai social etiquette. In 2019 16th International Joint Conference on Computer Science and Software Engineering (JCSSE) (pp. 109–114). IEEE. https://doi.org/10.1109/JCSSE.2019.8864177

88.

Theng

Y.-L.

Aung

(2012). Investigating effects of Avatars on primary school children’s affective responses to learning. Journal on Multimodal User Interfaces, 5(1), 45–52. https://doi.org/10.1007/s12193-011-0078-0

89.

van der Meij

Harmsen

. (2015). Animated pedagogical agents effects on enhancing student motivation and learning in a science inquiry learning environment. Educational Technology Research and Development, 63(3), 381–403. https://doi.org/10.1007/s11423-015-9378-5

90.

van Reijmersdal

E. A.

Jansz

Peters

van Noort

. (2013). Why girls go pink: Game character identification and game-players’ motivations. Computers in Human Behavior, 29(6), 2640–2649. https://doi.org/10.1016/j.chb.2013.06.046

91.

Veenman

M. V. J.

Van Hout-Wolters

B. H. A. M.

Afflerbach

. (2006). Metacognition and learning: Conceptual and methodological considerations. Metacognition and Learning, 1(1), 3–14. https://doi.org/10.1007/s11409-006-6893-0

92.

Veltri

N. F.

Krasnova

Baumann

Kalayamthanam

(2014). Gender differences in online gaming: A literature review. 20th Americas Conference on Information Systems (pp. 1–11). Curran Associates.

93.

Viechtbauer

(2010). Conducting meta-analyses in R with the Metafor package. Journal of Statistical Software, 36(3), 1–48. https://doi.org/10.18637/jss.v036.i03

94.

Viechtbauer

Cheung

M. W.-L.

(2010). Outlier and influence diagnostics for meta-analysis. Research Synthesis Methods, 1(2), 112–125. https://doi.org/10.1002/jrsm.11

95.

Vogel

J. J.

Vogel

D. S.

Cannon-Bowers

Bowers

C. A.

Muse

Wright

(2006). Computer gaming and interactive simulations for learning: A meta-analysis. Journal of Educational Computing Research, 34(3), 229–243. https://doi.org/10.2190/FLHV-K4WA-WPVQ-H0YM

96.

Wigfield

Eccles

J. S.

(2000). Expectancy–value theory of achievement motivation. Contemporary Educational Psychology, 25(1), 68–81. https://doi.org/10.1006/ceps.1999.1015

97.

Wouters

van Nimwegen

van Oostendorp

van der Spek

E. D.

(2013). A meta-analysis of the cognitive and motivational effects of serious games. Journal of Educational Psychology, 105(2), 249–265. https://doi.org/10.1037/a0031311

98.

Wrzesien

Rodríguez

Rey

Alcañiz

Baños

R. M.

Vara

M. D.

(2015). How the physical similarity of Avatars can influence the learning of emotion regulation strategies in teenagers. Computers in Human Behavior, 43, 101–111. https://doi.org/10.1016/j.chb.2014.09.024

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.05 MB

0.11 MB

0.06 MB

0.05 MB

0.06 MB

0.05 MB