This study examines the relationship between action team communication characteristics and task demand levels, with the goal of informing communication-based measures of team workload. Forty teams of three participated in an experiment emulating key teaming aspects of action teams in a simulated task based on wildland firefighting command and control. Task demand levels and team interdependence were systematically manipulated. Team communication characteristics and subjective workload were measured. Results revealed several trends in team communication characteristics under high demand conditions, including more time spent communicating, longer utterance durations, reduced rates of speech, reductions in communication pattern complexity, and greater centralization in high-interdependence teams. Additionally, content-free communication measures improved statistical models of team performance in high demand missions beyond traditional workload questionnaires. Overall, this study provides evidence for the value of communication-based measures of team workload, highlights the important role of team interdependence in the team workload, and offers direction for further development and validation.
BarnesC. M.HollenbeckJ. R.WagnerD. T.DeRueD. S.NahrgangJ. D.SchwindK. M. (2008). Harmful help: The costs of backing-up behavior in teams. Journal of Applied Psychology, 93(3), 529–539. https://doi.org/10.1037/0021-9010.93.3.529
BedwellW. L.SalasE.FunkeG. J.KnottB. A. (2014). Team workload: A multilevel perspective. Organizational Psychology Review, 4(2), 99–123. https://doi.org/10.1177/2041386613502665
4.
BergerS.HenningR. (2019). Communication system cues to benefit distributed action teams. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 63(1), 904–908. https://doi.org/10.1177/1071181319631237
5.
BowersC. A.BraunC. C.Morgan JrB. B. (1997). Team workload: Its meaning and measurement. In BrannickM. T.SalasE.PrinceC. (Eds.), Team performance assessment and measurement (pp. 97–120). Psychology Press.
6.
BowersC. A.JentschF. (2005). Team workload. In StantonN. A.BrookhuisK.SalasE.HendrickH. (Eds.), Handbook of human factors and ergonomics methods (p. 768). CRC Press.
7.
ClarkH. H.BrennanS. E. (1991). Grounding in communication. In ResnickL. B.LevineJ. M.TeasleyS. D. (Eds.), Perspectives on socially shared cognition (pp. 127–149). American Psychological Association.
8.
CocoM. I.DaleR. (2014). Cross-recurrence quantification analysis of categorical and continuous time series: An R package. Frontiers in Psychology, 5, Article 510. https://doi.org/10.3389/fpsyg.2014.00510
9.
CookeN. J.GormanJ. C. (2009). Interaction-based measures of cognitive systems. Journal of Cognitive Engineering and Decision Making, 3(1), 27–46. https://doi.org/10.1518/155534309x433302
10.
CookeN. J.GormanJ. C.MyersC. W.DuranJ. L. (2013). Interactive team cognition. Cognitive Science, 37(2), 255–285. https://doi.org/10.1111/cogs.12009
11.
CookeN. J.ShopeS. M.SchiflettL. R. E.SalasE.CoovertM. D. (2004). Designing a synthetic task environment. In Scaled worlds: Development, validation, and application (pp. 263–278). Routledge.
12.
CuiX.ZhangY.ZhouY.HuangT.LiZ. (2021). Measurements of team workload: A time pressure and scenario complexity study for maritime operation tasks. International Journal of Industrial Ergonomics, 83, Article 103110. https://doi.org/10.1016/j.ergon.2021.103110
13.
DemirM.CohenM.JohnsonC. J.ChiouE. K.CookeN. J. (2023). Exploration of the impact of interpersonal communication and coordination dynamics on team effectiveness in human-machine teams. International Journal of Human-Computer Interaction, 39(9), 1841–1855. https://doi.org/10.1080/10447318.2022.2143004
14.
DiasR. D.ZenatiM. A.StevensR.GabanyJ. M.YuleS. J. (2019). Physiological synchronization and entropy as measures of team cognitive load. Journal of Biomedical Informatics, 96, Article 103250. https://doi.org/10.1016/j.jbi.2019.103250
15.
EntinE. E.MacMillanJ.SerfatyD. (1998). Analysis of organizational processes in adaptive command and control architectures. In SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No. 98CH36218) (Vol. 4, pp. 3664–3668). IEEE.
FincannonT.KeeblerJ. R.JentschF.PhillipsE.EvansA. W.III (2011). Team size, team role, communication modality, and team coordination in the distributed operation of multiple heterogeneous unmanned vehicles. Journal of Cognitive Engineering and Decision Making, 5(1), 106–131. https://doi.org/10.1177/1555343411399073
18.
FunkeG. J.KnottB. A.SalasE.PavlasD.StrangA. J. (2012). Conceptualization and measurement of team workload: A critical need. Human Factors, 54(1), 36–51. https://doi.org/10.1177/0018720811427901
19.
GervitsF.EberhardK.ScheutzM. (2016). Team communication as a collaborative process. Frontiers in Robotics and AI, 3, Article 62. https://doi.org/10.3389/frobt.2016.00062
GormanJ. C.CookeN. J.AmazeenP. G.FouseS. (2012). Measuring patterns in team interaction sequences using a discrete recurrence approach. Human Factors, 54(4), 503–517. https://doi.org/10.1177/0018720811426140
23.
GormanJ. C.GrimmD. A.StevensR. H.GallowayT.Willemsen-DunlapA. M.HalpinD. J. (2020). Measuring real-time team cognition during team training. Human Factors, 62(5), 825–860. https://doi.org/10.1177/0018720819852791
24.
GrimmD. A.GormanJ. C.CookeN. J.DemirM.McNeeseN. J. (2023). Dynamical measurement of team resilience. Journal of Cognitive Engineering and Decision Making, 17(4), 351–382. https://doi.org/10.1177/15553434231199729
25.
GroteG.KolbeM.Zala-MezöE.Bienefeld-SeallN.KünzleB. (2010). Adaptive coordination and heedfulness make better cockpit crews. Ergonomics, 53(2), 211–228. https://doi.org/10.1080/00140130903248819
26.
HalgasE.Van EijndhovenK.GeversJ. M. P.WiltshireT. J.WesterinkJ. H. D. M.RispensS. (2023). A review of using wearable technology to assess team functioning and performance. Small Group Research, 54(1), 41–76. https://doi.org/10.1177/10464964221125717
27.
HartS. G.StavelandL. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in Psychology, 52, 139–183. https://doi.org/10.1016/S0166-4115(08)62386-9
28.
HasanM.JeffersonN.HainT.DawsonJ. (2022). Automatic detection of behavioural codes in team interactions. Computer Speech & Language, 74, Article 101339. https://doi.org/10.1016/j.csl.2021.101339
29.
HeltonW. S.EplingS.de JouxN.FunkeG. J.KnottB. A. (2015). Judgments of team workload and stress: A simulated unmanned aerial vehicle case. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 59(1), 736–740. https://doi.org/10.1177/154193121559117
30.
JahangirR.TehY. W.HanifF.MujtabaG. (2021). Deep learning approaches for speech emotion recognition: State of the art and research challenges. Multimedia Tools and Applications, 80(16), 23745–23812. https://doi.org/10.1007/s11042-020-09874-7
31.
JohnsonC. J.LieberC. S.GutzwillerR. S.CookeN. J. (2023). Team workload in action teams: Exploring the impact of interdependence. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 67(1), 1127–1133. https://doi.org/10.1177/21695067231192281
32.
JohnsonM.BradshawJ. M.FeltovichP. J.JonkerC. M.Van RiemsdijkM. B.SierhuisM. (2014). Coactive design: Designing support for interdependence in joint activity. Journal of Human-Robot Interaction, 3(1), 43–69. https://doi.org/10.5898/jhri.3.1.johnson
33.
KaziS.KhaleghzadeganS.DinhJ. V.ShelhamerM. J.SapirsteinA.GoeddelL. A.ChimeN. O.SalasE.RosenM. A. (2021). Team physiological dynamics: A critical review. Human Factors, 63(1), 32–65. https://doi.org/10.1177/0018720819874160
34.
KhawajaM. A.ChenF.MarcusN. (2012). Analysis of collaborative communication for linguistic cues of cognitive load. Human Factors: The Journal of the Human Factors and Ergonomics Society, 54(4), 518–529. https://doi.org/10.1177/0018720811431258
35.
KozlowskiS. W.GullyS. M.McHughP. P.SalasE.Cannon-BowersJ. A. (1996). A dynamic theory of leadership and team effectiveness: Developmental and task contingent leader roles. Research in Personnel and Human Resources Management, 14, 253–306.
36.
LeiZ.WallerM. J.HagenJ.KaplanS. (2016). Team adaptiveness in dynamic contexts: Contextualizing the roles of interaction patterns and in-process planning. Group & Organization Management, 41(4), 491–525. https://doi.org/10.1177/1059601115615246
37.
LennéM. G.HogganB. L.FidockJ.StuartG.AidmanE. (2014). The impact of auditory task complexity on primary task performance in military land vehicle crew. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 58(1), 2185–2189. https://doi.org/10.1177/154193121458145
38.
LeonardiG. (2018). A method for the computation of entropy in the recurrence quantification analysis of categorical time series. Physica A: Statistical Mechanics and its Applications, 512, 824–836. https://doi.org/10.1016/j.physa.2018.08.058
39.
LongoL.WickensC. D.HancockG.HancockP. A. (2022). Human mental workload: A survey and a novel inclusive definition. Frontiers in Psychology, 13, Article 883321. https://doi.org/10.3389/fpsyg.2022.883321
40.
MacMillanJ.EntinE. E.SerfatyD. (2004). Communication overhead: The hidden cost of team cognition. In SalasE.FioreS. M. (Eds.), Team cognition: Understanding the factors that drive process and performance (pp. 61–82). American Psychological Association. https://doi.org/10.1037/10690-004
41.
MathieuJ. E.LucianoM. M. (2019). Multilevel emergence in work collectives. In HumphreyS. E.LeBretonJ. M. (Eds.), The handbook of multilevel theory, measurement, and analysis (pp. 163–186). American Psychological Association. https://doi.org/10.1037/0000115-008
OmodeiM.ElliottG.WalsheM.WearingA. (2005). Networked fire chief: A research and training tool that targets the human factors causes of unsafe decision making in wildfires. Eighth International Wildland Fire Safety Summit, 64–70.
44.
OmodeiM.TarantoP.ElliottG.WearingA.ClancyJ.ReynoldsC.WalsheM. (nd). Networked fire Chief NFC32 V1.40 user manual.
45.
ParkerJ.BestC.FunkeG.StrangA.MarionK. (2016). An investigation of coding schemes for sample entropy analysis of communications data. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 60(1), 111–115. https://doi.org/10.1177/1541931213601025
46.
R Core Team. (2013). R: A language and environment for statistical computing [computer software]. R Foundation for Statistical Computing. https://www.R-project.org/
RobertsA. P. J.StantonN. A.FayD. (2017). Land ahoy! Understanding submarine command and control during the completion of inshore operations. Human Factors, 59(8), 1263–1288. https://doi.org/10.1177/0018720817731678
49.
RobertsA. P. J.StantonN. A.FayD. T.PopeK. A. (2019). The effects of team co-location and reduced crewing on team communication characteristics. Applied Ergonomics, 81, Article 102875. https://doi.org/10.1016/j.apergo.2019.102875
50.
RussellS. M.FunkeG. J.KnottB. A.StrangA. J. (2012, September). Recurrence quantification analysis used to assess team communication in simulated air battle management. In Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, Sage CA: Los Angeles, CA (Vol. 56, No. 1, pp. 468–472). Sage Publications. https://doi.org/10.1177/1071181312561046
51.
SacksH.SchegloffE. A.JeffersonG. (1974). A simplest systematics for the organization of turn-taking for conversation. Language, 50(4), 696–735. https://doi.org/10.2307/412243
52.
Sanchez-ManzanaresM.RicoR.AntinoM.UitdewilligenS. (2020). The joint effects of leadership style and magnitude of the disruption on team adaptation: A longitudinal experiment. Group & Organization Management, 45(6), 836–864. https://doi.org/10.1177/1059601120958838
53.
SellersJ.HeltonW. S.NäswallK.FunkeG. J.KnottB. A. (2014). Development of the team workload questionnaire (TWLQ). Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 58(1), 989–993. https://doi.org/10.1177/1541931214581207
SilgeJ.RobinsonD. (2016). tidytext: Text mining and analysis using tidy data principles in R. Journal of Open Source Software, 1(3), Article 37. https://doi.org/10.21105/joss.00037
56.
SimpsonJ.NalepkaP.KallenR. W.DrasM.ReichleE. D.HoskingS. G.BestC.RichardsD.RichardsonM. J. (2022). Conversation dynamics in a multiplayer video game with knowledge asymmetry. Frontiers in Psychology, 13, 7031. https://doi.org/10.3389/fpsyg.2022.1039431
57.
StantonN. A.RobertsA. P. J. (2020). Better together? Investigating new control room configurations and reduced crew size in submarine command and control. Ergonomics, 63(3), 307–323. https://doi.org/10.1080/00140139.2019.1654137
58.
StantonN. A.RobertsA. P. J. (2020b). Block off: An examination of new control room configurations and reduced crew sizes examining engineered production blocking. Cognition, Technology & Work, 22(1), 29–55. https://doi.org/10.1007/s10111-019-00542-x
59.
StantonN. A.SalmonP. M.WalkerG. H.SalasE.HancockP. A. (2017). State-of-science: Situation awareness in individuals, teams and systems. Ergonomics, 60(4), 449–466. https://doi.org/10.1080/00140139.2017.1278796
60.
StrangA. J.HorwoodS.BestC.FunkeG. J.KnottB. A.RussellS. M. (2012). Examining temporal regularity in categorical team communication using sample entropy. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 56(1), 473–477. https://doi.org/10.1177/1071181312561047
61.
SundstromE. D. (1999). The challenges of supporting work team effectiveness. In ErikS. (Eds.), Supporting work team effectiveness: Best management practices for fostering high performance (pp. 3–23). Jossey-Bass Publishers.
62.
van den OeverF.SchraagenJ. M. (2021). Team communication patterns in critical situations. Journal of Cognitive Engineering and Decision Making, 15(1), 28–51. https://doi.org/10.1177/1555343420986657
63.
Van Den OeverF.SchraagenJ. M. (2021). Team communication patterns in critical situations. Journal of Cognitive Engineering and Decision Making, 15(1), 28–51. https://doi.org/10.1177/1555343420986657
64.
VerdièreK. J.DehaisF.RoyR. N. (2019). Spectral EEG-based classification for operator dyads’ workload and cooperation level estimation. In 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC) (pp. 3919–3924). IEEE. https://doi.org/10.1109/SMC.2019.8913848
65.
WallerM. J.OkhuysenG. A.SaghafianM. (2016). Conceptualizing emergent states: A strategy to advance the study of group dynamics. The Academy of Management Annals, 10(1), 561–598. https://doi.org/10.5465/19416520.2016.1120958
66.
WebberC. L.Jr.ZbilutJ. P. (2005). Recurrence quantification analysis of nonlinear dynamical systems. Tutorials in Contemporary Nonlinear Methods for the Behavioral Sciences, 94(2005), 26–94.
67.
WickensC.TsangP. S. (2015). Workload. In Boehm-DavisD. A.DursoF. T.LeeJ. D. (Eds.), APA handbook of human systems integration (pp. 277–292). American Psychological Association. https://doi.org/10.1037/14528-018
68.
WiltshireT. J.ButnerJ. E.FioreS. M. (2018). Problem-solving phase transitions during team collaboration. Cognitive Science, 42(1), 129–167. https://doi.org/10.1111/cogs.12482
69.
WoodsD. D.WreathallJ. (2016). Stress-strain plots as a basis for assessing system resilience. In ErikH. (Eds.),Resilience engineering perspectives (Vol. 1, pp. 157–172). CRC Press.
YoungM. S.StantonN. A.WalkerG. H.JenkinsD. P.SalmonP. M. (2007). Mental workload in command and control teams: Musings on the outputs of EAST and WESTT. In HarrisD. (Ed.), Engineering psychology and cognitive ergonomics (pp. 455–464). Springer.
72.
ZhangY.SheM.LiZ. (2023). Team workload: Review and conceptualization. International Journal of Industrial Ergonomics, 95, Article 103452. https://doi.org/10.1016/j.ergon.2023.103452
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
