Computer games are increasingly being used by armed forces to supplement conventional training methods. However, despite considerable anecdotal claims about their training effectiveness, empirical evidence is lacking. This paper critically reviews major studies conducted in the past decade that have examined game-based training with dismounted soldiers. The findings indicate that these studies are characterized by methodological limitations and that the evidence regarding the effectiveness of game-based training for this military population is not compelling. Furthermore, due to methodological limitations with the studies, the possibility of negative training effects cannot be discounted. The paper concludes with implications for the scientific and military communities, as well as recommendations for the conduct of future studies in this area.
HaysRT.The effectiveness of instructional games: a literature review and discussion. Orlando, FL: Naval Air Warfare Center Training Systems Division, 2005.
2.
RomanPABrownD.Games – just how serious are they? In:Interservice/industry training, simulation, and education conference. Orlando, FL: NTSA, 2008.
MorrisonPBarlowM.Child’s play? Coercing a COTS game into a military experimentation tool. In: SimTecT 2004. Canberra, ACT: Simulation Industry Association of Australia.
5.
PrenskyM.Digital game-based learning. New York: McGraw Hill, 2001.
6.
BealSA.Using games for training dismounted light infantry leaders: Emergent questions and lessons learned. Research Report1841, US Army Research Institute for the Behavioral and Social Sciences, Arlington, VA, 2005.
7.
RicciKESalasECannon-BowersJA.Do computer-based games facilitate knowledge acquisition and retention?Mil Psychol1996; 8: 295–307.
8.
BelanichJMullinLNDresselJD.Symposium on PC-based simulations and gaming for military training. Research Product 2005–01, US Army Research Institute for the Behavioral and Social Sciences, Arlington, VA, 2004.
9.
KnerrBW.Current issues in the use of virtual simulations for dismounted soldier training. In NATO human factors and medicine panel workshop on “virtual media for military applications”, 2006, pp.21.1–12. West Point, NY: NATO.
10.
RatwaniKOrvisKKnerrB. An evaluation of game-based training effectiveness: context matters. In I/ITSEC 2010. Orlando, FL: NTSA.
11.
De FreitasS. Learning in immersive worlds: a review of game-based learning. Bristol, UK: Joint Information Systems Committee, 2006.
12.
SitzmannT.A meta-analytic examination of the instructional effectiveness of simulation based computer games. Personnel Psychol2011; 64: 489–528.
13.
NolanJMJonesJM.Games for training: leveraging commercial off the shelf multiplayer gaming software for infantry squad collective training. Monterey, CA: Naval Postgraduate School, 2005.
WiederholdMD.Physiological monitoring during simulation training and testing. Durham, NC: US Army Research Office, 2005.
16.
WoodmanMD.Cognitive training transfer using a personal computer-based game: a close quarters battle case study. Orlando, FL: University of Central Florida, 2006.
17.
KneuperGM.Substituting live training with virtual training by means of a Commercial Off The Shelf, First Person Shooter computer game and the effect on performance. Orlando, FL: University of Central Florida, 2006.
18.
ProctorMDWoodmanMD.Training “shoot house” tactics using a game. J Defense Model Simul2007; 4: 55–63.
19.
TopolskiRLeibrechtBCooleyS. Impact of game-based training on classroom learning outcomes. Arlington, VA: US Army Research Institute for the Behavioral and Social Sciences, 2010.
20.
MorrisonPParrSWardD.The evolution of 1st-person trainers: a case-study with VBS and HLA integration. In: SimTecT 2007. Canberra, ACT: Simulation Industry Association of Australia.
21.
BrownB.A training transfer study of simulation games. Monterey, CA: Naval Postgraduate School, 2010.
22.
BarlowMMorrisonPLuckM. Constructing the virtual section. In: SimTecT 2004. Canberra, ACT: Simulation Industry Association of Australia.
23.
BealSAChristRE.Training effectiveness evaluation of the Full Spectrum Command game. Technical Report 1140, US Army Research Institute for the Behavioral and Social Sciences, Alexandria, VA, 2004.
24.
SingerMJKnerrBW. Evaluation of a game-based simulation during distributed exercises. Research Report 1931, US Army Research Institute for the Behavioral and Social Sciences, Arlington, VA, 2010.
25.
van der HulstAMullerTBesselinkS. Bloody serious gaming – experiences with job oriented training. In: I/ITSEC, 2008. Orlando, FL: NTSA.
26.
ParchmanSWEllisJAChristinazD. An evaluation of three computer-based instructional strategies in basic electricity and electronics training. Mil Psychol2000; 12: 73–87.
27.
StoneRCaird-DaleyABessellK.SubSafe: A games-based training system for submarine safety and spatial awareness (Part 1). Virtual Reality2009; 13: 3–12.
28.
Caspian Learning. Serious games in defence education. Sunderland, UK: Caspian Learning, 2008.
29.
KnerrBWLamptonDR.An assessment of the virtual-integrated MOUT training system (V-IMTS). Arlington, VA: US Army Research Institute for the Behavioral and Social Sciences, 2005.
30.
BinSubiahAMaddockSRomanoD.A practical example of the development of a serious game for police training. In: FerdigRE (ed) Handbook of research on effective electronic gaming in education. Hershey, PA: Information Science Reference, 2008, pp.451–477.
31.
BoldoviciJABessemerDWBoltonA.The elements of training evaluation. Alexandria, VA: US Army Research Institute for the Behavioral and Social Sciences, 2002.
32.
SalasEMilhamLBowersC.Training evaluation in the military: misconceptions, opportunities, and challenges. Mil Psychol2003; 15: 3–16.
