Teamwork assessment requires research environments that replicate the task complexity and induce challenges and uncertainty. Gamified environments are gaining attention as suitable environments for teamwork assessment, where teaming behaviors can be quantified. However, further research is needed to establish the relationship between gaming mechanics and teaming competencies. This work aims to assess the consistency of video games in inducing teaming behaviors. Five video games were analyzed through coding behaviors and cooperative features from gameplay streams. Results show that the selected games induce similar behavioral profiles of percentages of teaming competencies. These games have similar design characteristics, including performance environments and game loops. Design suggestions reflect potential associations between the analyzed game mechanics and the resulting behavioral profiles. The resulting teamwork profiles can be targeted through the simulation cooperative genre, therefore providing a design tool for teamwork testbed designers to induce teamwork distributions of interest.
Asteroid Base. (2015). Lovers in a Dangerous Spacetime [Video Game].
2.
BishopJ.BurgessJ.RamosC.DriggsJ. B.WilliamsT.TossellC. C.… de VisserE. J. (2020, April). Chaopt: a testbed for evaluating human-autonomy team collaboration using the video game overcooked! 2. In 2020 Systems and Information Engineering Design Symposium (SIEDS) (pp. 1-6). IEEE.
3.
BurkeC. S.StaglK. C.SalasE.PierceL.KendallD.(2006). Understanding team adaptation: a conceptual analysis and model. Journal of Applied Psychology, 91(6), 1189.
4.
Cannon-BowersJ. A.SalasE.ConverseS. (1993). Shared mental models in expert team decision-making.
5.
ChaS. H. (2007). Comprehensive survey on distance/similarity measures between probability density functions. City, 1(2), 1.
6.
CookeN.DemirM.HuangL. (2020). A framework for human-autonomy team research. In Engineering Psychology and Cognitive Ergonomics. Cognition and Design: 17th International Conference, EPCE 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July19–24, 2020, Proceedings, Part II 22 (pp. 134-146). Springer International Publishing.
7.
DeppingA. E.MandrykR. L. (2017, October). Cooperation and interdependence: How multiplayer games increase social closeness. In Proceedings of the Annual Symposium on computer-human interaction in play (pp. 449-461).
8.
EspinosaJ. A.LerchF. J.KrautR. E. (2004). Explicit versus implicit coordination mechanisms and task dependencies: One size does not fit all.
9.
FarahY. A.DorneichM. C.GilbertS. B. (2022, September). Evaluating Team Metrics in Cooperative Video Games. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Vol. 66, No. 1, pp. 70-74). Sage CA: Los Angeles, CA: SAGE Publications.
10.
GisevN.BellJ. S.ChenT. F. (2013). Interrater agreement and interrater reliability: key concepts, approaches, and applications. Research in Social and Administrative Pharmacy, 9(3), 330-338.
11.
HarrisJ. J. (2019). Leveraging asymmetry and interdependence to enhance social connectedness in cooperative digital games.
12.
HanJ.PeiJ.TongH. (2022). Data mining: concepts and techniques. Morgan kaufmann.
13.
IlgenD. R.HollenbeckJ. R.JohnsonM.JundtD. (2005). Teams in organizations: From input-process-output models to IMOI models. Annu. Rev. Psychol., 56, 517-543.
Interia Game Studios.2018. Catastronauts [Video Game].
16.
KendallD. L.SalasE. (2004). Measuring team performance: Review of current methods and consideration of future needs. The science and simulation of human performance, 5, 307-326.
17.
MaloneT. W.CrowstonK. (1990, September). What is coordination theory, and how can it help design cooperative work systems? In Proceedings of the 1990 ACM conference on Computer-supported cooperative work (pp. 357-370).
18.
MarksM. A.MathieuJ. E.ZaccaroS. J. (2001). A temporally based framework and taxonomy of team processes. Academy of management review, 26(3), 356-376.
19.
MarlowS. L.SalasE.LandonL. B.PresnellB. (2016). Eliciting teamwork with game attributes: A systematic review and research agenda. Computers in Human Behavior, 55, 413-423.
20.
MayerI., (2018). Assessment of teams in a digital game environment. Simulation & Gaming, 49(6), 602-619.
21.
McDonaldN.SchoenebeckS.ForteA. (2019). Reliability and inter-rater reliability in qualitative research: Norms and guidelines for CSCW and HCI practice. Proceedings of the ACM on human-computer interaction, 3(CSCW), 1-23.
22.
MorschheuserB.RiarM.HamariJ.MaedcheA. (2017). How do games induce cooperation? A study on the relationship between game features and we-intentions in an augmented reality game. Computers in human behavior, 77, 169-183.
23.
RochaJ. B.MascarenhasS.PradaR. (2008). Game mechanics for cooperative games. ZON Digital Games2008, 72-80.
24.
RosenM. A.BedwellW. L.WildmanJ. L.FritzscheB. A.SalasE.BurkeC. S. (2011). Managing adaptive performance in teams: Guiding principles and behavioral markers for measurement. Human resource management review, 21(2), 107-122.
25.
SaavedraR.EarleyP. C.Van DyneL. (1993). Complex interdependence in task-performing groups. Journal of applied psychology, 78(1), 61.
26.
SalasE.DickinsonT. L.ConverseS. A.TannenbaumS. I. (1992). Toward an understanding of team performance and training.
27.
SalasE.SimsD. E.BurkeC. S. (2005). Is there a “big five” in teamwork?Small group research, 36(5), 555-599.
28.
Seif El-NasrM.AghabeigiB.MilamD.ErfaniM.LamemanB.MaygoliH.MahS. (2010, April). Understanding and evaluating cooperative games. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 253-262).
29.
SottilareR. A.Shawn BurkeC.SalasE.SinatraA. M.JohnstonJ. H.GilbertS. B. (2018). Designing adaptive instruction for teams: A meta-analysis. International Journal of Artificial Intelligence in Education, 28, 225-264.
Team 17, Ghost Town Games. 2018. Overcooked2! [Video Game].
32.
WieseC. W.ShufflerM. L.SalasE. (2015). Teamwork and team performance measurement.
33.
WuertzJ.AlharthiS. A.HamiltonW. A.BatemanS.GutwinC.TangA.… HammerJ. (2018, April). A design framework for awareness cues in distributed multiplayer games. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1-14)
