Serious games are interactive games with a purpose for education, developed generally under software technology, serious games also include tabletop games (board games and card games), and many of them are used in medical settings like hospital training. Previous work indicates that serious games can enhance students' motivation, interaction, and engagement. This study aimed to evaluate the effectiveness of a serious game on medical students' learning outcomes and determine its effect on students' flow and motivation and examine the relationship between the flow and motivation.
Methods
This was a prospective study performed for two years (2018-2019 and 2019-2020 academic years). A total of 108 third-year medical students participated in this study. Students were asked to play a serious game on a computer for twenty minutes. A set of questionnaires containing evaluation grids to measure the flow and the motivation were given to students. The effectiveness of the game was assessed using pre-and post-tests.
Results
Complete datasets were available for 97 students. Flow and motivation dimensions experienced by the students were generally high (mean = 54,5). Significant and positive relationships between the sub-scale of flow experience and intrinsic motivation to know, intrinsic motivation to experience simulation, and the three types of extrinsic motivation were found. There was a negative correlation between the flow dimension and intrinsic motivation toward accomplishments and amotivation. There was a significant difference between the mean scores of pre-tests and post-tests (p < .01).
Conclusion
The serious game is regarded as a particularly active and problem-solving form of learning that promote medical students' motivation, flow and learning achievements.
AndermanE. M.DawsonH. (2013). Learning with motivation. In MayerR.AlexanderP. (Eds.), Handbook of Research on Learning and Instruction (pp. 219–241). New York: Routledge. https://doi.org/10.4324/9780203839089.ch11
3.
BeardC.WilsonJ. P. (2006). Experiential learning: A best practice handbook for educators and trainers. London: Kogan Page. https://doi:10.1080/13504620500526529
4.
BellottiF.BertaR.De GloriaA. (2010). Designing Effective Serious Games: Opportunities and Challenges for Research. International Journal of Emerging Technologies in Learning (iJET), 5(SI3), 22–35. https://doi.org/10.3991/ijet.v5iSI3.1500
5.
BoekerM.AndelP.VachW.FrankenschmidtA. (2013). Game-based e-learning is more effective than a conventional instructional method: A randomized controlled trial with third-year medical students. PloS one, 8(12), e82328. https://doi.org/10.1371/journal.pone.0082328
6.
BonkC.J.DennenV.P. (2005). Massive multiplayer online gaming: A research framework for military training and education.
7.
BootW. R.KramerA. F.SimonsD. J.FabianiM.GrattonG. (2008). The effects of video game playing on attention, memory, and executive control. Acta psychologica, 129(3), 387–398. https://doi.org/10.1016/j.actpsy.2008.09.005
8.
CarJ.Carlstedt-DukeJ.Tudor CarL.PosadzkiP.WhitingP.ZaryN.AtunR.MajeedA.CampbellJ.Digital Health Education Collaboration (2019). Digital Education in Health Professions: The Need for Overarching Evidence Synthesis. Journal of medical Internet research, 21(2), e12913. https://doi.org/10.2196/12913
9.
ConnollyT. M.BoyleE. A.MacArthurE.HaineyT.BoyleJ. M. (2012). A systematic literature review of empirical evidence on computer games and serious games. Computers & Education, 59(2), 661–686. https://doi:10.1016/j.compedu.2012.03.004
10.
CookD. A.HatalaR.BrydgesR.ZendejasB.SzostekJ. H.WangA. T.ErwinP. J.HamstraS. J. (2011). Technology-enhanced simulation for health professions education: A systematic review and meta-analysis. JAMA, 306(9), 978–988. https://doi.org/10.1001/jama.2011.1234
CulbertsonS. S.FullagarC. J.SimmonsM. J.ZhuM. (2015). Contagious flow: Antecedents and consequences of optimal experience in the classroom. Journal of Management Education, 39(3), 319–349. https://doi.org/10.1177/1052562914545336
14.
DalgarnoB.LeeM.J.W. (2010). What are the learning affordances of 3-D virtual environments?British Journal of Educational Technology, 41, 10–32. https://doi.org/10.1111/j.1467-8535.2009.01038.x
15.
DavidsM. R.ChikteU. M.HalperinM. L. (2011). Development and evaluation of a multimedia e-learning resource for electrolyte and acid-base disorders. Advances in physiology education, 35(3), 295–306. https://doi.org/10.1152/advan.00127.2010
16.
Del BlancoÁ.TorrenteJ.Fernández-ManjónB.RuizP.GinerM. (2017). Using a videogame to facilitate nursing and medical students' first visit to the operating theatre. A randomized controlled trial. Nurse education today, 55, 45–53. https://doi.org/10.1016/j.nedt.2017.04.026
17.
DiehlL. A.SouzaR. M.GordanP. A.EstevesR. Z.CoelhoI. C. (2017). InsuOnline, an electronic game for medical education on insulin therapy: A randomized controlled trial with primary care physicians. Journal of medical Internet research, 19(3), e72. https://doi.org/10.2196/jmir.6944
18.
DonkinL.ChristensenH.NaismithS. L.NealB.HickieI. B.GlozierN. (2011). A systematic review of the impact of adherence on the effectiveness of e-therapies. Journal of medical Internet research, 13(3), e52. https://doi.org/10.2196/jmir.1772
19.
DriscollM. (2000) Psychology of Learning for Instruction. Needham He.
20.
EliasH.MustafaS.RoslanS.NoahS. (2011). Examining potential relationships between flow and motivational forces in Malaysian secondary school students. Procedia - Social and Behavioral Sciences, 9. https://doi: 10.1016/j.sbspro.2010.12.443
21.
FournierJ.GaudreauDemontrond-BehrP.VisioliJ.ForestJ.JacksonS., 2007. French translation of the flow state scale-2: Factor structure, cross-cultural invariance, and associations with goal attainment. Psychology of Sport and Exercise, 8(6): 897–916. https://doi.org/10.1016/j.psychsport.2006.07.007
22.
GarrisR.AhlersR.DriskellJ. E. (2002). Games, motivation, and learning: A research and practice model. Simulation & Gaming, 33(4), 441–467. https://doi.org/10.1177/1046878102238607
23.
GentryS. V.GauthierA.L'Estrade EhrstromB.WortleyD.LilienthalA.Tudor CarL.Dauwels-OkutsuS.NikolaouC. K.ZaryN.CampbellJ.CarJ. (2019). Serious gaming and gamification education in health professions: Systematic review. Journal of medical Internet research, 21(3), e12994. https://doi.org/10.2196/12994
24.
GijbelsD.DochyF.Van den BosscheP.SegersM. (2005). Effects of problem-based learning: A meta-analysis from the angle of assessment. Review of Educational Research, 75(1), 27–61. https://doi.org/10.3102/00346543075001027
25.
GleasonA. W. (2015). RELM: Developing a serious game to teach evidence-based medicine in an academic health sciences setting. Medical reference services quarterly, 34(1), 17–28. https://doi.org/10.1080/02763869.2015.986709
26.
GorbanevI.Agudelo-LondoñoS.GonzálezR. A.CortesA.PomaresA.DelgadilloV.YepesF. J.MuñozÓ. (2018). A systematic review of serious games in medical education: Quality of evidence and pedagogical strategy. Medical education online, 23(1), 1438718. http://doi.org/10.1080/10872981.2018.1438718
27.
GraaflandM.SchraagenJ. M.SchijvenM. P. (2012). Systematic review of serious games for medical education and surgical skills training. The British journal of surgery, 99(10), 1322–1330. https://doi.org/10.1002/bjs.8819
HamariJ.ShernoffD. J.RoweE.CollerB.Asbell-ClarkeJ.EdwardsT. (2016). Challenging games help students learn: An empirical study on engagement, flow and immersion in game-based learning. Computers in Human Behavior, 54, 170–179. https://doi.org/10.1016/j.chb.2015.07.045
30.
HarteveldC.GuimarãesR.MayerI. S.BidarraR. (2010). Balancing play, meaning and reality: The design philosophy of LEVEE PATROLLER. Simulation & Gaming, 41(3), 316–340. https://doi.org/10.1177/1046878108331237
31.
HeutteJ.FenouilletF.Martin-KrummC.BoniwellI.CsikszentmihalyiM. (2016b). Proposal for a conceptual evolution of the flow in education (EduFlow) model. In 8th European Conference on Positive Psychology (ECPP 2016), Angers, June 2016. https://hal.laas.fr/UR2-HB/hal-01470857
32.
HillR.W.BelanichJ.LaneH.C.CoreM.G.DixonM.ForbellE.KimJ.M.HartJ. (2006). Pedagogically structured game-based training: Development of the elect BiLAT simulation. Proceedings of the 25th Army Science Conference.
33.
HussainT.FeurzeigW. (2008) ‘Methods and tools for the development of effective training games’. American Educational Research Association (AERA) Annual Meeting, pp. 1–13.
34.
JacksonL. A.WittE. A.GamesA. I.FitzgeraldH. E.von EyeA.ZhaoY. (2012). Information technology use and creativity: Findings from the children and technology project. Computers in Human Behavior, 28(2), 370–376. https://doi.org/10.1016/j.chb.2011.10.006
35.
JennettC.CoxA. L.CairnsP.DhopareeS.EppsA.TijsT.WaltonA. (2008). Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies, 66(9), 641–661. http://sci-hub.tw/10.1016/j.ijhcs.2008.04.004
36.
JuzelenieneS.MikelionieneJ.EscudeiroP.CarvalhoC. (2014). GABALL project: Serious games based language learning. Procedia - Social and Behavioral Sciences, 136. https://doi: 10.1016/j.sbspro.2014.05.340
37.
KiiliK. (2005) ‘Digital game-based learning: Towards an experiential gaming model’. Internet and Higher Education, 8(1), 13–24. https://doi: 10.1016/j.iheduc.2004.12.001
38.
KnightJ. F.CarleyS.TregunnaB.JarvisS.SmithiesR.de FreitasS.DunwellI.Mackway-JonesK. (2010). Serious gaming technology in major incident triage training: A pragmatic controlled trial. Resuscitation, 81(9), 1175–1179. https://doi.org/10.1016/j.resuscitation.2010.03.042
39.
KolbD. A. (1984) Experience as the Source of Learning and Development Second Edition, Pearson Education, Inc. Upper Saddle River. http://academic.regis.edu/ed205/Kolb.pdf
40.
KowalJ.P.FortierM.S. (1999). Motivational determinants of flow: Contributions from self-determination theory. Journal of Social Psychology, 139, 355–368. https://doi.org/10.1080/00224549909598391
41.
KowalJ.FortierM. S. (2000). Testing relationships from the hierarchical model of intrinsic and extrinsic motivation using flow as a motivational consequence. Research quarterly for exercise and sport, 71(2), 171–181. https://doi.org/10.1080/02701367.2000.10608895
42.
LamerasP.ArnabS.DunwellI.StewartC.ClarkeS.PetridisP. (2017). Essential features of serious games design in higher education: Linking learning attributes to game mechanics. Br J Educ Technol, 48, 972–994. https://doi.org/10.1111/bjet.12467
43.
Maheu-CadotteM.CossetteS.DubéV.FontaineG.MailhotT.LavoieP.CournoyerA.BalliF.Mathieu-DupuisG. (2018). Effectiveness of serious games and impact of design elements on engagement and educational outcomes in healthcare professionals and students: A systematic review and meta-analysis protocol. BMJ Open, 8(3), 1–7. https://doi: 10.1136/bmjopen-2017-019871
44.
MannellR.ZuzánekJ.LarsonR. (1988) ‘Leisure states and “flow” experiences: Testing perceived freedom and intrinsic motivation hypotheses’. Journal of Leisure Research, 20(4), 289–304. https://doi: 10.1080/00222216.1988.11969782
45.
MiddekeA.AndersS.SchuelperM.RaupachT.SchuelperN. (2018). Training of clinical reasoning with a Serious Game versus small-group problem-based learning: A prospective study. PloS one, 13(9), e0203851. https://doi.org/10.1371/journal.pone.0203851
46.
MillsM. J.FullagarC. J. (2008). Motivation and flow: Toward an understanding of the dynamics of the relation in architecture students. The Journal of psychology, 142(5), 533–553. https://doi.org/10.3200/JRLP.142.5.533-556
MurciaJ.A.M.GimenoE.C.CollD.G.-C., 2008. Relationships among goal orientations, motivational climate and flow in adolescent athletes: Differences by gender. The Spanish Journal of Psychology, 11(1), 181–191. https://doi.org/10.1017/s1138741600004224
49.
NevinC. R.WestfallA. O.RodriguezJ. M.DempseyD. M.CherringtonA.RoyB.PatelM.WilligJ. H. (2014). Gamification as a tool for enhancing graduate medical education. Postgraduate medical journal, 90(1070), 685–693. https://doi.org/10.1136/postgradmedj-2013-132486
50.
O'NeilH.F.WainessR.BakerE.L. (2005). Classification of learning outcomes: Evidence from the computer games literature. The Curriculum Journal, 16, 455–474. https://doi.org/10.1080/09585170500384529
51.
OeiA. C.PattersonM. D. (2014). ‘Playing a puzzle video game with changing requirements improves executive functions’. Computers in Human Behavior, 37(August 2014), 216–228. https://doi.org/10.1016/j.chb.2014.04.046
52.
OlszewskiA. E.WolbrinkT. A. (2017). ‘Serious gaming in medical education: A proposed structured framework for game development’. Simulation in Healthcare, 12(4), 240–253. https://doi: 10.1097/SIH.0000000000000212
53.
PerskiO.BlandfordA.WestR.MichieS. (2017). Conceptualising engagement with digital behaviour change interventions: A systematic review using principles from critical interpretive synthesis. Translational behavioral medicine, 7(2), 254–267. https://doi.org/10.1007/s13142-016-0453-1
54.
PrenskyM. (2002). ‘The motivation of gameplay: The real twenty first century learning revolution’. On the Horizon, 10(1), 5–11. https://doi: 10.1108/10748120210431349
55.
RooneyP. (2012). ‘A theoretical framework for serious game design: Exploring pedagogy, play and fidelity and their implications for the design process’. International Journal of Game-Based Learning, 2(4), 41–60. https://doi 10.4018/ijgbl.2012100103
56.
RyanR. M.DeciE. L. (2000). Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary Educational Psychology, 25(1), 54–67. https://doi.org/10.1006/ceps.1999.1020
57.
SailerM.HenseJ. U.MayrS. K.MandlH. (2017). How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction. Computers in Human Behavior, 69, 371–380. https://doi.org/10.1016/j.chb.2016.12.033
58.
SanchezA.Cannon-bowersJ.BowersC. (2010). Establishing a science of game based learning. In Cannon-BowersJ. A.BowersC. (Eds.), Serious game design and development: Technologies for training and learning (pp. 290–304). Hershey, PA: IGI Global. https://doi.org/10.4018/978-1-61520-739-8.ch016
59.
ShuteV. J.D'MelloS.BakerR.ChoK.BoschN.OcumpaughJ.VenturaM.AlmedaV. (2015a). Modeling how incoming knowledge, persistence, affective states, and in-game progress influence student learning from an educational game. Computers & Education, 86, 224–235. https://doi.org/10.1016/j.compedu.2015.08.001
60.
ShuteV. J.VenturaM.KeF. (2015b). The power of play: The effects of Portal 2 and Lumosity on cognitive and noncognitive skills. Computers & Education, 80, 58–67. https://doi.org/10.1016/j.compedu.2014.08.013
61.
SinghK.GranvilleM.DikaS. (2002). Mathematics and science achievement: Effects of motivation, interest, and academic engagement. The Journal of Educational Research, 95(6), 323–332. https://doi.org/10.1080/00220670209596607
62.
SmithR.D. (2006). Game impact theory: The five forces that are driving the adoption of game technologies within multiple established industries.
63.
SteinG.KimiecikJ.DanielsJ.JacksonS. (1995) ‘Psychological antecedents of flow in recreational sport’. Personality and Social Psychology Bulletin, 21, 125–135. https://doi: 10.1177/0146167295212003
64.
SusiT.JohannessonM.BacklundP. (2007). Serious games: An overview.
65.
UdenL.PageT. (2008) ‘Development of learning resources to promote knowledge sharing in problem based learning’. i-manager’s Journal of Educational Technology, 15–22. https://doi: 10.26634/jet.5.1.557
66.
VallerandR. J.BlaisM. R.BrièreN. M.PelletierL. G. (1989). ‘Construction et validation de l’échelle de motivation en éducation (EME) [construction and validation of the motivation toward education scale]’. Canadian Journal of Behavioural Science, 21(3), 323–349. https://doi: 10.1037/h0079855
67.
VogelJ. J.VogelD. S.Cannon-BowersJ.BowersC. A.MuseK.WrightM. (2006). Computer gaming and interactive simulations for learning: A meta-analysis. Journal of Educational Computing Research, 34(3), 229–243. https://doi.org/10.2190/FLHV-K4WA-WPVQ-H0YM
68.
WangR.DeMariaS.JrGoldbergA.KatzD. (2016). A systematic review of serious games in training health care professionals. Simulation in Healthcare: Journal of the Society for Simulation in Healthcare, 11(1), 41–51. https://doi.org/10.1097/SIH.0000000000000118
69.
WesteraW.NadolskiR. J.HummelH. G. K.WopereisI. G. J. H. (2008). Serious games for higher education: A framework for reducing design complexity. Journal of Computer Assisted Learning, 24(5), 420–432. https://doi.org/10.1111/j.1365-2729.2008.00279.x
70.
World Health Organization. (2013). Transforming and scaling up health professionals’ education and training: World Health Organization guidelines 2013. World Health Organization. https://apps.who.int/iris/handle/10665/93635
71.
WoutersP.van NimwegenC.van OostendorpH.van der SpekE. D. (2013). A meta-analysis of the cognitive and motivational effects of serious games. Journal of Educational Psychology, 105(2), 249–265. https://doi.org/10.1037/a0031311
