Wargames and tabletop exercises (TTXs) have existed for centuries in military planning contexts but have seen relatively limited use as methods of inquiry within the human factors community of practice. We argue that that the use of these tools is not commensurate with their value, as they are effective and efficient means to conduct naturalistic inquiry. We demonstrate the value of wargames and TTXs by presenting two case studies of their use in different domains, highlighting how their outputs were used to achieve research objectives and to glean insights about human cognition in the context of work. We also discuss the similarity of wargames and TTXs to other methods of inquiry, and suggest future areas for research.
AngaforG.N.YevseyevaI.HeY. (2020). Game-based learning: A review of tabletop exercises for cybersecurity incident response training. Security and Privacy, 3(6), 1-19. https://doi.org/10.1002/spy2.126
2.
Caffrey (2000) Toward a history based doctrine for wargaming. Aerospace Power Journal, Fall 2000, 33-56.
3.
CiancioloA.T.SandersW.R. (2005). A task analysis of U.S. Army war-gaming: Implications for assessing the performance of combined arms task force battle staffs. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49(25), 2154-2158. https://doi.org/10.1177/154193120504902508
4.
CrandallB.KleinG.HoffmanR.R. (2006). Working minds: A practitioner’s guide to cognitive task analysis. MIT Press.
5.
de RosaF.StrodeC. (2022a). Exploring trust in unmanned systems with the maritime unmanned system trust game. Human Factors and Systems Interaction, 52, 9-16. https://doi.org/10.54941/ahfr1002133
6.
de RosaF.StrodeC. (2022b). Games to support disruptive technology adoption: the MUST Game use case. International Journal of Serious Games, 9(2), 93-114. https://dx.doi.org/ijsg.v9i2.492
7.
DortonS.L.MaryeskiL.R.OgrenL.DykensI.T.MainA. (2020). A wargame-augmented knowledge elicitation method for the agile development of novel systems. Systems, 8(27), 1-15. https://doi.org/10.3390/systems8030027
8.
DortonS.TupperS.MaryeskiL. (2017). Going digital: Consequences of increasing resolution of a wargaming tool for knowledge elicitation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 61(1), 2037-2041. https://doi.org/10.1177/1541931213601988
9.
EndsleyM.R. (1988). Situation awareness global assessment technique (SAGAT). IEEE National Aerospace and Electronics Conference, 789-795. https://doi.org/10.1109/NAECON.1988.195097
10.
ErwinM.DortonS.TupperS. (2017). Rolling the dice: Using low-cost tabletop simulation to develop and evaluate high-value CONOPS in uncertain tactical environments. Proceedings of MODSIM World 2017, 25-27 June, Virginia Beach, VA.
11.
FlanaganJ.C. (1954). The critical incident technique. Psychological Bulletin, 51(4), 327-358.
12.
HansenK.PoundsL. (2009). Beyond the hit-and-run tabletop exercise. Journal of Business Continuity & Emergency Planning, 3(2), 137-144.
13.
HoffmanR. R.WardP.FeltovichP. J.DiBelloL.FioreS. M.AndrewsD. (2014). Accelerated expertise: Training for high proficiency in a complex world. Taylor and Francis/CRC Press.
14.
KennedyQ.NesbittP.AltJ. (2014). Assessment of cognitive components of decision making with military versions of the IGT and WCST. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58(1), 300-304. https://doi.org/10.1177/154193120504902508
15.
KleinG. (2022). Snapshots of the Mind. MIT Press.
16.
KodalleT.OrmrodD.SampleC.ScottK. (2020). A general theory of influence in a DIME/PMESII/ASCOP/IRC2 Model. Journal of Information Warfare, 19(2), 12-26. https://www.jstor.org/stable/27033618
Mount-CampbellA.F.EvansK.D.WoodsD.D.ChippsE.M.Moffat-BruceS.D.PattersonE.S. (2019). Value and usage of a workaround artifact: A cognitive work analysis of “brains” used by hospital nurses. Journal of Cognitive Engineering and Decision Making, 13(2), 67-80. https://doi.org/10.1177/1555343418825429.
20.
NevilleK. J.PiresB.MadhavanP.BoothM.RosfjordK.PattersonE. S. (2022). The TRUSTS work system resilience framework: A foundation for resilience-aware development and transition. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 66(1), 2067–2071. https://doi.org/10.1177/1071181322661177
21.
OriesekD.F.SchwarzJ.O. (2008). Business wargaming: Securing corporate value. Gower Publishing.
22.
PerlaP.P. (1990). The art of wargaming. Naval Institute Press.
RossK. G.PhillipsJ. K.LinebergerR. E. (January, 2015). Marine Corps Instructor Mastery Model. Alexandria VA: Office of Naval Research.
25.
SchmittJ.KleinG.A.ThunholmP.BaxterH.C.RossK.G.BeanM. (2003). Recognitional planning model. Manual prepared for Battle Command Battle Laboratory, Fairborn, OH, Klein Associates, Inc..
26.
SmithS.C.RaioS.ErbacherR.F.WeismanM.J.ParkerT.W.EllisJ.E. (2022). Quantitative Measurement of Cyber Resilience: A Tabletop Exercise (Report No. ARL-TR-9380).
27.
TanzmanE.NievesL.A. (2008). Analysis of the Argonne Distance Tabletop Exercise Method (Report No. ANL/DIS-08-1).
28.
WardP.SchraagenJ. M.GoreJ.RothE. M.HoffmanR. R.KleinG. (2020). Reflections on the Study of Expertise and Its Implications for Tomorrow’s World. In WardP.SchraagenJ. M.GoreJ.RothE. (Eds.). The Oxford handbook of expertise (pp. 1193-1213). Oxford University Press.
29.
WoodsD. D. (1993). Process-tracing methods for the study of cognition outside the experimental psychological laboratory. In KleinG. A.OrasanuJ.CalderwoodR.ZsambokC. E. (Eds), Decision making in action: Models and methods (pp. 228–251). Ablex.
30.
WoodsD. D. (2003). Discovering how distributed cognitive systems work. In HollnagelE. (Ed.), Handbook of cognitive task design (pp. 37–53). Lawrence Erlbaum.
