Restricted accessResearch articleFirst published online 2024-4
The Effect of Digital Game-Based Learning Interventions on Cognitive,Metacognitive,and Affective-Motivational Learning Outcomes in School: A Meta-Analysis
Digital game-based learning (DGBL) interventions can be superior to traditional instruction methods for learning, but previous meta-analyses covered a huge period and included a variety of different target groups, limiting the results’ transfer on specific target groups. Therefore, the aim of this meta-analysis is a theory-based examination of DGBL interventions’ effects on different learning outcomes (cognitive, metacognitive, affective-motivational) in the school context, using studies published between 2015 and 2020 and meta-analytic techniques (including moderator analyses) to examine the effectiveness of DGBL interventions compared to traditional instruction methods. Results from random-effects models revealed a significant medium effect for overall learning (g = .54) and cognitive learning outcomes (g = .67). Also found were a small effect for affective-motivational learning outcomes (g = .32) and no significant effect for metacognitive learning outcomes. Additionally, there was no evidence of publication bias. Further meta-regression models did not reveal evidence of moderating personal, environmental, or confounding factors. The findings partially support the positive impact of DGBL interventions in school, and the study addresses its practical implications.
Abdul JabbarA. I.FeliciaP. (2015). Gameplay engagement and learning in game-based learning: a systematic review. Review of Educational Research, 85(4), 740–779. https://doi.org/10.3102/00346543155772
2.
AdaM.AkdenizM. F.GümgümÖ.KeskinM.YazıcıA.YayanU. (2016, May). Interactive serious games with visual programming for mobile robot learning. In 2016 24th Signal Processing and Communication Application Conference (SIU) (pp. 485–488). IEEE. https://doi.org/10.1109/SIU.2016.7495783
3.
AdmiraalW.HuizengaJ.AkkermanS.Ten DamG. (2011). The concept of flow in collaborative game-based learning. Computers in Human Behavior, 27(3), 1185–1194. https://doi.org/10.1016/j.chb.2010.12.013
4.
AkO.KutluB. (2017). Effect of game environments on students’ learning. British Journal of Educational Technology, 48, 129–144. https://doi.org/10.1111/bjet.12346
5.
Al-AzawiR.Al-FalitiF.Al-BlushiM. (2016). Educational gamification vs. game based learning: comparative study. International Journal of Innovation, Management and Technology, 7(4), 131–136. https://doi.org/10.18178/ijimt.2016.7.4.659
6.
AllA.PlovieB.CastellarE. P. N.Van LooyJ. (2017). Pre-test influences on the effectiveness of digital-game based learning: A case study of a fire safety game. Computers & Education, 114, 24–37. https://doi.org/10.1016/j.compedu.2017.05.018
7.
AllenK. N.FriedmanB. D. (2010). Affective learning: A taxonomy for teaching social work values. Journal of Social Work Values and Ethics, 7(2), 1–12.
BanduraA. (1997). Self-efficacy: The exercise of control. Freeman.
10.
BowersC. A.SergeS.BlairL.Cannon-BowersJ.JoyceR.BoshnackJ. (2013). The effectiveness of narrative pre-experiences for creating context in military training. Simulation & Gaming, 44(4), 514–522. https://doi.org/10.1177/1046878113475341
CepedaN. J.PashlerH.VulE.WixtedJ. T.RohrerD. (2006). Distributed practice in verbal recall tasks: A review and quantitative synthesis. Psychological Bulletin, 132(3), 354–380. https://doi.org/10.1037/0033-2909.132.3.354
13.
ChangC.-C.LiangC.ChouP.-N.LinG.-Y. (2017). Is game-based learning better in flow experience and various types of cognitive load than non-game-based learning? Perspective from multimedia and media richness. Computers in Human Behavior, 71, 218–227. https://doi.org/10.1016/j.chb.2017.01.031
14.
ChenC.-H. (2019). The impacts of peer competition-based science gameplay on conceptual knowledge, intrinsic motivation, and learning behavioral patterns. Educational Technology Research and Development, 67(1), 179–198. https://doi.org/10.1007/s11423-018-9635-5
15.
ChenC.-H.ChiuC.-H. (2016). Employing intergroup competition in multitouch design-based learning to foster student engagement, learning achievement, and creativity. Computers & Education, 103, 99–113. https://doi.org/10.1016/j.compedu.2016.09.007
16.
ChenC.-H.ShihC.-C.LawV. (2020). The effects of competition in digital game-based learning (DGBL): A meta-analysis. Educational Technology Research and Development, 68(4), 1855–1873. https://doi.org/10.1007/s11423-020-09794-1
17.
ChenG.-D.LeeJ.-H.WangC.-Y.ChaoP.-Y.LiL.-Y.LeeY. (2012). An empathic avatar in a computer-aided learning program to encourage and persuade learners. Journal of Educational Technology & Society, 15(2), 62–72.
18.
ClarkD. B.Tanner-SmithE. E.KillingsworthS. S. (2016). Digital games, design, and learning: A systematic review and meta-analysis. Review of Educational Research, 86(1), 79–122. https://doi.org/10.3102/0034654315582065
19.
CochranW. G. (1954). The combination of estimates from different experiments. Biometrics, 10(1), 101–129. https://doi.org/10.2307/3001666
20.
CohenE. L. (2016). Enjoyment of a counter-hedonic serious digital game: Determinants and effects on learning and self-efficacy. Psychology of Popular Media Culture, 5(2), 157–170. http://dx.doi.org/10.1037/ppm0000052
CohenJ. (1988). Statistical power analysis for the behavioural sciences (2nd ed.). Erlbaum Associates.
23.
CohenJ. (2001). Defining identification: A theoretical look at the identification of audiences with media characters. Mass Communication & Society, 4(3), 245–264. https://doi.org/10.1207/S15327825MCS0403_01
24.
CojocariuV.-M.BoghianI. (2014). Teaching the relevance of game-based learning to preschool and primary teachers. Procedia – Social and Behavioral Sciences, 142, 640–646. https://doi.org/10.1016/j.sbspro.2014.07.679
25.
ConnollyT. M.StansfieldM. (2009). From e-learning to games-based e-learning. In Encyclopedia of information communication technology (pp. 268–275). IGI Global. https://doi.org/10.4018/978-1-59904-845-1.ch035
26.
CoombesL.ChanG.AllenD.FoxcroftD. R. (2016). Mixed-methods evaluation of the good behaviour game in english primary schools. Journal of Community & Applied Social Psychology, 26(5), 369–387. https://doi.org/10.1002/casp.2268
27.
De FreitasV.MohanP.Kinshuk. (2018). A game designers’ guide for creating learning games for mathematics. 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT) (pp. 146–148). IEEE. https://doi.org/10.1109/ICALT.2018.00144
28.
DickeyM. D. (2020). Narrative in game-based learning. In PlassJ. L.MayerR. E.HomerB. D. (Eds.), Handbook of game-based learning (pp. 283–306). MIT Press.
29.
DomagkS.SchwartzR. N.PlassJ. L. (2010). Interactivity in multimedia learning: An integrated model. Computers in Human Behavior, 26(5), 1024–1033. https://doi.org/10.1016/j.chb.2010.03.003
EggerM.SmithG. D.SchneiderM.MinderC. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315(7109), 629–634. https://doi.org/10.1136/bmj.315.7109.629
32.
ErhelS.JametE. (2013). Digital game-based learning: Impact of instructions and feedback on motivation and learning effectiveness. Computers & Education, 67, 156–167. https://doi.org/10.1016/j.compedu.2013.02.019
33.
FienH.DoablerC. T.NelsonN. J.KostyD. B.ClarkeB.BakerS. K. (2016). An examination of the promise of the NumberShire level 1 gaming intervention for improving student mathematics outcomes. Journal of Research on Educational Effectiveness, 9(4), 635–661. https://doi.org/10.1080/19345747.2015.1119229
34.
FragkosK. C.TsagrisM.FrangosC. C. (2014). Publication bias in meta-analysis: Confidence intervals for Rosenthal’s fail-safe number. International Scholarly Research Notices, 2014, 825383. https://doi.org/10.1155/2014/825383
35.
FranciosiS. J. (2017). The effect of computer game-based learning on FL vocabulary transferability. Educational Technology & Society, 20(1), 123–133.
36.
HedgesL. V.VeveaJ. L. (1996). Estimating effect size under publication bias: Small sample properties and robustness of a random effects selection model. Journal of Educational and Behavioral Statistics, 21(4), 299–332. https://doi.org/10.3102/10769986021004299
37.
HigginsJ. P. T.ThompsonS. G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), 1539–1558. https://doi.org/10.1002/sim.1186
38.
JacksonL. C.O’MaraJ.MossJ.JacksonA. C. (2018). A critical review of the effectiveness of narrative-driven digital educational games. International Journal of Game-Based Learning, 8(4), 32–49. https://doi.org/10.4018/IJGBL.2018100103
39.
JohnsonW. L.LesterJ. C. (2016). Face-to-face interaction with pedagogical agents, twenty years later. International Journal of Artificial Intelligence in Education, 26(1), 25–36. https://doi.org/10.1007/s40593-015-0065-9
40.
JongM. S. Y. (2016). Teachers’ concerns about adopting constructivist GBL. British Journal of Educational Technology, 47, 601–617. https://doi.org/10.1111/bjet.12247
41.
KarakoçB.EryılmazK.Turan ÖzpolatE.Yıldırımİ. (2020). The effect of game-based learning on student achievement: A meta-analysis study. Technology, Knowledge and Learning, 27(1), 207–222. https://doi.org/10.1007/s10758-020-09471-5
42.
KinzerC. K.HoffmanD. L.TurkayS.GunbasN.ChantesP.DvorkinT.ChaiwinijA. (2012). The impact of choice and feedback on learning, motivation, and performance in an educational video game. Proceedings of the Games, Learning, and Society Conference, 2, 175–181.
43.
KlimmtC.HefnerD.VordererP.RothC.BlakeC. (2010). Identification with video game characters as automatic shift of self-perceptions. Media Psychology, 13(4), 323–338. https://doi.org/10.1080/15213269.2010.524911
LaiA. F.ChenC. H.LeeG. Y. (2019). An augmented reality-based learning approach to enhancing students’ science reading performances from the perspective of the cognitive load theory. British Journal of Educational Technology, 50(1), 232–247. https://doi.org/10.1111/bjet.12716
46.
LambR. L.AnnettaL.FirestoneJ.EtopioE. (2018). A meta-analysis with examination of moderators of student cognition, affect, and learning outcomes while using serious educational games, serious games, and simulations. Computers in Human Behavior, 80, 158–167. https://doi.org/10.1016/j.chb.2017.10.040
47.
LandisJ. R.KochG. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310
LesterJ. C.SpainR. D.RoweJ. P.MottB. W. (2020). Instructional support, feedback, and coaching in game-based learning. In PlassJ. L.MayerR. E.HomerB. D. (Eds.), Handbook of game-based learning (pp. 209–238). MIT Press.
50.
LesterJ. C.SpiresH. A.NietfeldJ. L.MinogueJ.MottB. W.LobeneE. V. (2014). Designing game-based learning environments for elementary science education: A narrative-centered learning perspective. Information Sciences, 264, 4–18. https://doi.org/10.1016/j.ins.2013.09.005
51.
LiewT. W.TanS.-M. (2016). Virtual agents with personality: Adaptation of learner-agent personality in a virtual learning environment. Eleventh International Conference on Digital Information Management (ICDIM) (pp. 157–162). ICDIM. https://doi.org/10.1109/ICDIM.2016.7829758
52.
LodererK.PekrunR.PlassJ. L. (2020). Emotional foundations of game-based learning. In PlassJ. L.MayerR. E.HomerB. D. (Eds.), Handbook of game-based learning (pp. 111–152). MIT Press.
53.
López-FernándezD.GordilloA.AlarcónP. P.TovarE. (2021). Comparing traditional teaching and game-based learning using teacher-authored games on computer science education. IEEE Transactions on Education, 64(4), 367–373. https://doi.org/10.1109/TE.2021.3057849
54.
MalliarakisC.TomosF.ShabalinaO.MozeliusP. (2018). Andragogy and E.M.O.T.I.O.N: 7 key factors of successful serious games. In CiussiM. (Ed.), Proceedings of the 12th European Conference on Games Based Learning (pp. 371–378). ACI.
55.
MarklundB. B.Alklind TaylorA. S. (2016). Educational games in practice: The challenges involved in conducting a game-based curriculum. The Electronic Journal of E-Learning, 14(2), 122–135.
56.
MarthaA. S. D.SantosoH. B. (2019). The design and impact of the pedagogical agent: A systematic literature review. Journal of Educators Online, 16(1). https://doi.org/10.9743/jeo.2019.16.1.8
57.
MayerR. E. (2014). Computer games for learning: An evidence-based approach. Teachers College Record (pp. 1–3). MIT Press.
58.
MayerR. E. (2020). Cognitive foundations of game-based learning. In PlassJ. L.MayerR. E.HomerB. D. (Eds.), Handbook of game-based learning (pp. 83–110). MIT Press.
59.
McLarenB. M.AdamsD. M.MayerR. E.ForlizziJ. (2017). A computer-based game that promotes mathematics learning more than a conventional approach. International Journal of Game-Based Learning, 7(1), 36–56. https://doi.org/10.4018/IJGBL.2017010103
60.
NelsonB.KimY. (2020). Multimedia design principles in game-based learning. In PlassJ. L.MayerR. E.HomerB. D. (Eds.), Handbook of game-based learning (pp. 307–328). MIT Press.
61.
NovakE. (2015). A critical review of digital storyline-enhanced learning. Educational Technology Research and Development, 63(3), 431–453. https://doi.org/10.1007/s11423-015-9372-y
62.
NussbaumE. M.OwensM. C.SinatraG. M.RehmatA. P.CordovaJ. R.AhmadS.DascaluS. M. (2015). Losing the lake: Simulations to promote gains in student knowledge and interest about climate change. International Journal of Environmental and Science Education, 10(6), 789–811.
63.
PartoviT.RazaviM. R. (2019). The effect of game-based learning on academic achievement motivation of elementary school students. Learning and Motivation, 68, 101592. https://doi.org/10.1016/j.lmot.2019.101592
64.
PawarS.TamF.PlassJ. L. (2020). Emerging design factors of game-based learning: Emotional design, musical score, and game mechanics design. In PlassJ. L.MayerR. E.HomerB. D. (Eds.), Handbook of game-based learning (pp. 347–367). MIT Press.
65.
PeetersJ.De BackerF.ReinaV. R.KindekensA.BuffelT.LombaertsK. (2014). The role of teachers’ self-regulatory capacities in the implementation of self-regulated learning practices. Procedia – Social and Behavioral Sciences, 116, 1963–1970. https://doi.org/10.1016/j.sbspro.2014.01.504
66.
PekrunR. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18(4), 315–341. https://doi.org/10.1007/s10648-006-9029-9
67.
PellasN.VosinakisS. (2018). The effect of simulation games on learning computer programming: A comparative study on high school students’ learning performance by assessing computational problem-solving strategies. Education and Information Technologies, 23(6), 2423–2452. https://doi.org/10.1007/s10639-018-9724-4
68.
PlassJ. L.HomerB. D.KinzerC.FryeJ.PerlinK. (2011). Learning mechanics and assessment mechanics for games for learning. White Paper, 1, 1–19. https://doi.org/10.13140/2.1.3127.1201
PlassJ. L.HomerB. D.MayerR. E.KinzerC. K. (2020). Theoretical foundations of game-based and playful learning. In PlassJ. L.MayerR. E.HomerB. D. (Eds.), Handbook of game-based learning (pp. 3–24). MIT Press.
71.
PlassJ. L.PawarS. (2020). Adaptivity and personalization in game-based learning. In PlassJ. L.MayerR. E.HomerB. D. (Eds.), Handbook of game-based learning (pp. 263–282). MIT Press.
72.
PostL. S.GuoP.SaabN.AdmiraalW. (2019). Effects of remote labs on cognitive, behavioral, and affective learning outcomes in higher education. Computers & Education, 140, 1–9. https://doi.org/10.1016/j.compedu.2019.103596
73.
PrenskyM.(2007). Digital game-based learning. Paragon House.
74.
R Core Team. (2020). A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/
75.
RigbyS.RyanR. M. (2011). Glued to games: How video games draw us in and hold us spellbound (pp. 510–511). Praeger.
76.
RileyR. D.HigginsJ. P. T.DeeksJ. J. (2011). Interpretation of random effects meta-analyses. BMJ, 342, 964–967. https://doi.org/10.1136/bmj.d549
RoweJ. P.ShoresL. R.MottB. W.LesterJ. C. (2011). Integrating learning, problem solving, and engagement in narrative-centered learning environments. International Journal of Artificial Intelligence in Education, 21(1–2), 115–133.
79.
RyanR. M.DeciE. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78. https://doi.org/10.1037/0003-066X.55.1.68
80.
RyanR. M.RigbyC. S. (2020). Motivational foundations of game-based learning. In PlassJ. L.MayerR. E.HomerB. D. (Eds.), Handbook of game-based learning (pp. 153–176). MIT Press.
81.
SalaG.GobetF. (2017). Does chess instruction improve mathematical problem-solving ability? Two experimental studies with an active control group. Learning & Behavior, 45(4), 414–421. https://doi.org/10.3758/s13420-017-0280-3
82.
SitzmannT. (2011). A meta-analytic examination of the instructional effectiveness of computer-based simulation games. Personnel Psychology, 64(2), 489–528. https://doi.org/10.1111/j.1744-6570.2011.01190.x
83.
SkarbezR.SmithM.WhittonM. C. (2021). Revisiting Milgram and Kishino’s reality-virtuality continuum. Frontiers in Virtual Reality, 2, 1–8. https://doi.org/10.3389/frvir.2021.647997
84.
SteinkuehlerC.TsaasanA. M. (2020). Sociocultural foundations of game-based learning. In PlassJ. L.MayerR. E.HomerB. D. (Eds.), Handbook of game-based learning (pp. 177–208). MIT Press.
TamF.PawarS. (2020). Emerging design factors in game-based learning: Incentives, social presence, and identity design. In PlassJ. L.MayerR. E.HomerB. D. (Eds.), Handbook of game-based learning (pp. 367–386). MIT Press.
87.
TangsripairojS.SukkhetM.SumanothamJ.YusukB. (2019, July). Kiddy manner: A game-based mobile application for children learning thai social etiquette. In 2019 16th International Joint Conference on Computer Science and Software Engineering (JCSSE) (pp. 109–114). IEEE. https://doi.org/10.1109/JCSSE.2019.8864177
88.
ThengY.-L.AungP. (2012). Investigating effects of Avatars on primary school children’s affective responses to learning. Journal on Multimodal User Interfaces, 5(1), 45–52. https://doi.org/10.1007/s12193-011-0078-0
89.
van der MeijH.van der MeijJ.HarmsenR. (2015). Animated pedagogical agents effects on enhancing student motivation and learning in a science inquiry learning environment. Educational Technology Research and Development, 63(3), 381–403. https://doi.org/10.1007/s11423-015-9378-5
90.
van ReijmersdalE. A.JanszJ.PetersO.van NoortG. (2013). Why girls go pink: Game character identification and game-players’ motivations. Computers in Human Behavior, 29(6), 2640–2649. https://doi.org/10.1016/j.chb.2013.06.046
91.
VeenmanM. V. J.Van Hout-WoltersB. H. A. M.AfflerbachP. (2006). Metacognition and learning: Conceptual and methodological considerations. Metacognition and Learning, 1(1), 3–14. https://doi.org/10.1007/s11409-006-6893-0
92.
VeltriN. F.KrasnovaH.BaumannA.KalayamthanamN. (2014). Gender differences in online gaming: A literature review. 20th Americas Conference on Information Systems (pp. 1–11). Curran Associates.
93.
ViechtbauerW. (2010). Conducting meta-analyses in R with the Metafor package. Journal of Statistical Software, 36(3), 1–48. https://doi.org/10.18637/jss.v036.i03
94.
ViechtbauerW.CheungM. W.-L. (2010). Outlier and influence diagnostics for meta-analysis. Research Synthesis Methods, 1(2), 112–125. https://doi.org/10.1002/jrsm.11
95.
VogelJ. J.VogelD. S.Cannon-BowersJ.BowersC. A.MuseK.WrightM. (2006). Computer gaming and interactive simulations for learning: A meta-analysis. Journal of Educational Computing Research, 34(3), 229–243. https://doi.org/10.2190/FLHV-K4WA-WPVQ-H0YM
96.
WigfieldA.EcclesJ. S. (2000). Expectancy–value theory of achievement motivation. Contemporary Educational Psychology, 25(1), 68–81. https://doi.org/10.1006/ceps.1999.1015
97.
WoutersP.van NimwegenC.van OostendorpH.van der SpekE. D. (2013). A meta-analysis of the cognitive and motivational effects of serious games. Journal of Educational Psychology, 105(2), 249–265. https://doi.org/10.1037/a0031311
98.
WrzesienM.RodríguezA.ReyB.AlcañizM.BañosR. M.VaraM. D. (2015). How the physical similarity of Avatars can influence the learning of emotion regulation strategies in teenagers. Computers in Human Behavior, 43, 101–111. https://doi.org/10.1016/j.chb.2014.09.024
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
