Team Workload in Action Teams: A Review of Empirical Research

Abstract

Objective

This review examines how team workload has been studied in action team experiments, consolidates and synthesizes trends and findings, and identifies gaps and directions for future research.

Background

Team workload is often considered a team-level emergent construct distinct from individual workload, but the literature on action team research varies substantially in its conceptualization, manipulation, and measurement of the construct. Accurately characterizing team workload can inform strategies for improving how action teams operate under demanding conditions.

Method

A literature review was conducted, focusing on empirical studies that examined team workload in action team experiments.

Results

We identified diverse methods for measuring team workload, including subjective assessments, performance-based metrics, physiological indicators, and team interaction analyses. Team workload is predominantly analyzed as mean aggregates of individual workloads, though variance-based and configurational analyses were also observed. However, applications of various demand manipulations suggest nonlinear impacts on individuals and teams alike. These findings underscore the complex emergent properties of team workload, which individual workload measures may not capture fully.

Conclusions

There are numerous opportunities to improve and advance the study of team workload in action teams, including gaps in its conceptualization, dynamic measurement, and the application of demand manipulations.

Applications

This review’s findings can guide researchers and practitioners in measuring and manipulating team workload in action teams, highlighting potential methodological pitfalls and offering insights into the relationship between common teaming variables and empirical findings. These insights can be applied to enhance system design, training programs, and team evaluation practices in action team domains.

Keywords

workload teamwork team workload team performance team dynamics literature review

Get full access to this article

View all access options for this article.

References

Note. * = identifies a literature review article.

* Andersson

Rankin

Diptee

(2017). Approaches to team performance assessment: A comparison of self-assessment reports and behavioral observer scales. Cognition, Technology & Work, 19(2), 517–528. https://doi.org/10.1007/s10111-017-0428-0

Arrow

McGrath

J. E.

Berdahl

J. L.

(2000). Small groups as complex systems: Formation, coordination, development, and adaptation. Sage Publications.

* Barnes

C. M.

Hollenbeck

J. R.

Jundt

D. K.

DeRue

D. S.

Harmon

S. J.

(2011). Mixing individual incentives and group incentives: Best of both worlds or social dilemma? Journal of Management, 37(6), 1611–1635. https://doi.org/10.1177/0149206309360845

* Barnes

C. M.

Hollenbeck

J. R.

Wagner

D. T.

DeRue

D. S.

Nahrgang

J. D.

Schwind

K. M.

(2008). Harmful help: The costs of backing-up behavior in teams. Journal of Applied Psychology, 93(3), 529–539. https://doi.org/10.1037/0021-9010.93.3.529

Barth

Schraagen

J. M.

Schmettow

(2015). Network measures for characterising team adaptation processes. Ergonomics, 58(8), 1287–1302. https://doi.org/10.1080/00140139.2015.1009951

Bedwell

W. L.

Salas

Funke

G. J.

Knott

B. A.

(2014). Team workload: A multilevel perspective. Organizational Psychology Review, 4(2), 99–123. https://doi.org/10.1177/2041386613502665

* Berggren

Johansson

B. J.

Baroutsi

(2017). Assessing the quality of Shared Priorities in teams using content analysis in a microworld experiment. Theoretical Issues in Ergonomics Science, 18(2), 128–146. https://doi.org/10.1080/1463922x.2016.1159354

* Berggren

Johansson

B. J.

Svensson

Baroutsi

Dahlbäck

(2014). Statistical modelling of team training in a microworld study. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 58(1), 894–898. https://doi.org/10.1177/1541931214581188

10.

* Berggren

Prytz

Johansson

Nählinder

(2011). The relationship between workload, teamwork, situation awareness, and performance in teams: A microworld study. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 55(1), 851–855. https://doi.org/10.1177/1071181311551177

11.

* Bliss

J. P.

Fallon

C. K.

(2003). The effects of leadership style and primary task workload on team performance and follower satisfaction. International Journal of Applied Aviation Studies, 3(2), 259–276. https://psycnet.apa.org/record/2005-00246-005

12.

* Boehm-Davis

D. A.

Gee

S. K.

Baker

Medina-Mora

(2010). Effect of party line loss and delivery format on crew performance and workload. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 54(1), 126–130. https://doi.org/10.1177/154193121005400128

13.

Bowers

C. A.

Braun

C. C.

Morgan Jr

B. B.

(1997). Team workload: Its meaning and measurement. In Team performance assessment and measurement (pp. 97–120). Psychology Press.

14.

Bowers

C. A.

Jentsch

(2005). Team workload. In Stanton

N. A.

Brookhuis

Salas

Hendrick

(Eds.), Handbook of human factors and ergonomics methods. CRC Press.

15.

* Bowers

C. A.

Thornton

Braun

Morgan Jr

B. B.

Salas

(1998). Automation, task difficulty, and aircrew performance. Military Psychology, 10(4), 259–274. https://doi.org/10.1207/s15327876mp1004_3

16.

* Braarud

P. Ø.

(2001). Subjective task complexity and subjective workload: Criterion validity for complex team tasks. International Journal of Cognitive Ergonomics, 5(3), 261–273. https://doi.org/10.1207/s15327566ijce0503_7

17.

* Bretonnier

Michinov

Le Pabic

Hénaux

P.-L.

Jannin

Morandi

Riffaud

(2020). Impact of the complexity of surgical procedures and intraoperative interruptions on neurosurgical team workload. Neurochirurgie, 66(4), 203–211. https://doi.org/10.1016/j.neuchi.2020.02.003

18.

* Cannon-Bowers

J. A.

Salas

Blickensderfer

Bowers

C. A.

(1998). The impact of cross-training and workload on team functioning: A replication and extension of initial findings. Human Factors, 40(1), 92–101. https://doi.org/10.1518/001872098779480550

19.

* Cavuoto

L. A.

Hussein

A. A.

Vasan

Ahmed

Durrani

Khan

Cole

Wang

Kozlowski

Ahmad

Guru

K. A.

(2017). Improving teamwork: Evaluating workload of surgical team during robot-assisted surgery. Urology, 107(1), 120–125. https://doi.org/10.1016/j.urology.2017.05.012

20.

* Cooke

N. J.

(2005). Moderating effects of team role on workload demands of teams. In Human performance, situation awareness, and automation: Current research and trends HPSAA II, volumes I and II (p. 235). Psychology Press.

21.

Cooke

N. J.

Cohen

M. C.

Fazio

W. C.

Inderberg

L. H.

Johnson

C. J.

Lematta

G. J.

Peel

Teo

(2024). From teams to teamness: Future directions in the science of team cognition. Human Factors, 66(1), Article 00187208231162449. https://doi.org/10.1177/00187208231162449

22.

Cooke

N. J.

Gorman

J. C.

(2009). Interaction-based measures of cognitive systems. Journal of Cognitive Engineering and Decision Making, 3(1), 27–46. https://doi.org/10.1518/155534309x433302

23.

Cooke

N. J.

Gorman

J. C.

Myers

C. W.

Duran

J. L.

(2013). Interactive team cognition. Cognitive Science, 37(2), 255–285. https://doi.org/10.1111/cogs.12009

24.

Crawford

E. R.

LePine

J. A.

(2013). A configural theory of team processes: Accounting for the structure of taskwork and teamwork. Academy of Management Review, 38(1), 32–48. https://doi.org/10.5465/amr.2011.0206

25.

* Cui

Zhang

Zhou

Huang

(2021). Measurements of team workload: A time pressure and scenario complexity study for maritime operation tasks. International Journal of Industrial Ergonomics, 83(1), Article 103110. https://doi.org/10.1016/j.ergon.2021.103110

26.

* Davis

Welch

Walsh-Hart

Hanseman

Petro

Gerlach

Dorlac

Collins

Pritts

(2014). Effective teamwork and communication mitigate task saturation in simulated critical care air transport team missions. Military Medicine, 179(suppl_8), 19–23. https://doi.org/10.7205/MILMED-D-13-00240

27.

* Devlin

S. P.

Flynn

J. R.

Riggs

S. L.

(2018). Connecting the Big Five taxonomies: Understanding how individual traits contribute to team adaptability under workload transitions. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 62(1), 119–123. https://doi.org/10.1177/1541931218621027

28.

Dias

R. D.

Zenati

M. A.

Stevens

Gabany

J. M.

Yule

S. J.

(2019). Physiological synchronization and entropy as measures of team cognitive load. Journal of Biomedical Informatics, 96(1), Article 103250. https://doi.org/10.1016/j.jbi.2019.103250

29.

Endsley

M. R.

(1995). Toward a theory of situation awareness in dynamic systems. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37(1), 32–64. https://doi.org/10.1518/001872095779049543

30.

* Entin

E. B.

Entin

E. E.

(2000). Assessing team situation awareness in simulated military missions. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 44(1), 73–76. https://doi.org/10.1177/154193120004400120

31.

* Entin

E. E.

MacMillan

Serfaty

(1998). Analysis of organizational processes in adaptive command and control architectures. In SMC’98 conference proceedings. 1998 IEEE international conference on systems, man, and cybernetics (Cat. No. 98CH36218) (Vol. 4, pp. 3664–3668). IEEE.

32.

* Entin

E. E.

Serfaty

(1999). Adaptive team coordination. Human Factors: The Journal of the Human Factors and Ergonomics Society, 41(2), 312–325. https://doi.org/10.1518/001872099779591196

33.

* Feigh

K. M.

Pritchett

A. R.

(2014). Requirements for effective function allocation: A critical review. Journal of Cognitive Engineering and Decision Making, 8(1), 23–32. https://doi.org/10.1177/1555343413490945

34.

* Fincannon

T. D.

Evans

A. W.

Jentsch

Keebler

(2008). Interactive effects of backup behavior and spatial abilities in the prediction of teammate workload using multiple unmanned vehicles. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 52(14), 995–999. https://doi.org/10.1177/154193120805201409

35.

* Fincannon

T. D.

Evans

A. W.

Jentsch

Phillips

Keebler

(2009). Effects of sharing control of unmanned vehicles on backup behavior and workload in distributed operator teams. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 53(18), 1300–1303. https://doi.org/10.1518/107118109x12524443346518

36.

* Fincannon

T. D.

Keebler

J. R.

Jentsch

Phillips

Evans

A. W.

III (2011). Team size, team role, communication modality, and team coordination in the distributed operation of multiple heterogeneous unmanned vehicles. Journal of Cognitive Engineering and Decision Making, 5(1), 106–131. https://doi.org/10.1177/1555343411399073

37.

* Finomore

V. S.

Knott

B. A.

Nelson

W. T.

Galster

S. M.

Bolia

R. S.

(2007). The effects of multimodal collaboration technology on subjective workload profiles of tactical air battle management teams. In 2007 international symposium on aviation psychology (Vol. 190). Wright State University.

38.

* Fouse

Champion

Cooke

N. J.

(2012). The effects of vehicle number and function on performance and workload in human-robot teaming. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 56(1), 398–402. https://doi.org/10.1177/1071181312561090

39.

* Frank

Spirkovska

McCann

Wang

Pohlkamp

Morin

(2013). Autonomous mission operations. In 2013 IEEE aerospace conference (pp. 1–20). IEEE.

40.

Funke

G. J.

Knott

B. A.

Salas

Pavlas

Strang

A. J.

(2012). Conceptualization and measurement of team workload: A critical need. Human Factors, 54(1), 36–51. https://doi.org/10.1177/0018720811427901

41.

* Funke

G. J.

Galster

S. M.

(2007). The effects of spatial processing load and collaboration technology on team performance in a simulated C2 environment. In Proceedings of the 14th European conference on cognitive ergonomics: Invent! explore! (pp. 37–43). IEEE.

42.

* Funke

G. J.

Galster

S. M.

(2009). The effects of cognitive processing load and collaboration technology on team performance in a simulated command and control environment. International Journal of Industrial Ergonomics, 39(3), 541–547. https://doi.org/10.1016/j.ergon.2008.10.007

43.

* Funke

G. J.

Galster

S. M.

Nelson

W. T.

Dukes

(2006). Instant messaging and team performance in a simulated command and control environment. International Command and Control Research and Technology Symposium.

44.

* Funke

G. J.

Knott

B. A.

Galster

S. M.

Brown

R. D.

(2009). Team workload: A construct worth pursuing? In 2009 international symposium on aviation psychology (pp. 425-430). International Symposium on Aviation Psychology.

45.

* Gao

Cummings

M. L.

Bertuccelli

L. F.

(2012). Teamwork in controlling multiple robots. In Proceedings of the seventh annual ACM/IEEE international conference on human-robot interaction (pp. 81–88). IEEE.

46.

* Gao

Cummings

M. L.

Solovey

E. T.

(2014). Modeling teamwork in supervisory control of multiple robots. IEEE Transactions on Human-Machine Systems, 44(4), 441–453. https://doi.org/10.1109/thms.2014.2312391

47.

* Gao

Cummings

Solovey

(2016). Designing for robust and effective teamwork in human-agent teams. In Robust intelligence and trust in autonomous systems (pp. 167–190). Springer.

48.

* Gao

Jiang

Song

Pan

(2015). An integrated computer-based procedure for teamwork in digital nuclear power plants. Ergonomics, 58(8), 1303–1313. https://doi.org/10.1080/00140139.2015.1008055

49.

Garcia

Baldwin

Funke

Knott

Finomore

Warm

(2011). Team vigilance: The effects of co-action on workload in vigilance. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 55(1), 1185–1189. https://doi.org/10.1177/1071181311551247

50.

* Gervits

Eberhard

Scheutz

(2016). Team communication as a collaborative process. Frontiers in Robotics and AI, 3(1), 62. https://doi.org/10.3389/frobt.2016.00062

51.

Goldstein

(1999). Emergence as a construct: History and issues. Emergence: Complexity and Organization, 1(1), 49–72. https://doi.org/10.1207/s15327000em0101_4

52.

Goodwin

G. F.

Blacksmith

Coats

M. R.

(2018). The science of teams in the military: Contributions from over 60 years of research. American Psychologist, 73(4), 322–333. https://doi.org/10.1037/amp0000259

53.

Gopher

Donchin

(1986). Workload: An examination of the concept.

54.

Gorman

J. C.

Dunbar

T. A.

Grimm

Gipson

C. L.

(2017). Understanding and modeling teams as dynamical systems. Frontiers in Psychology, 8(1), 1053. https://doi.org/10.3389/fpsyg.2017.01053

55.

Gorman

Cooke

Winner

(2006). Measuring team situation awareness in decentralized command and control environments. Ergonomics, 49(12–13), 1312–1325. https://doi.org/10.1080/00140130600612788

56.

Gorman

J. C.

Cooke

N. J.

Winner

J. L.

(2017). Measuring team situation awareness in decentralized command and control environments. In Situational awareness (pp. 183–196). Routledge.

57.

Greenlee

E. T.

Funke

G. J.

Rice

(2019). Evaluation of the Team Workload Questionnaire (TWLQ) in a team-choice task. Human Factors, 61(2), 348–359. https://doi.org/10.1177/0018720818801657

58.

Grier

Wickens

C. D.

Kaber

Strayer

Boehm-Davis

Trafton

J. G.

St John

(2008). The red-line of workload: Theory, research, and design. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 52(18), 1204–1208. https://doi.org/10.1177/154193120805201811

59.

Grimm

D. A. P.

Gorman

J. C.

Cooke

N. J.

Demir

McNeese

N. J.

(2023). Dynamical measurement of team resilience. Journal of Cognitive Engineering and Decision Making, 17(4), 351–382. https://doi.org/10.1177/15553434231199729

60.

* Grote

Kolbe

Zala-Mezö

Bienefeld-Seall

Künzle

(2010). Adaptive coordination and heedfulness make better cockpit crews. Ergonomics, 53(2), 211–228. https://doi.org/10.1080/00140130903248819

61.

* Grugle

N. L.

Kleiner

B. M.

(2007). Effects of chemical protective equipment on team process performance in small unit rescue operations. Applied Ergonomics, 38(5), 591–600. https://doi.org/10.1016/j.apergo.2006.08.003

62.

* Guastello

S. J.

Correro II

A. N.

Marra

D. E.

(2018). Do emergent leaders experience greater workload? The swallowtail catastrophe model and changes in leadership in an emergency response simulation. Group Dynamics: Theory, Research, and Practice, 22(4), 200–222. https://doi.org/10.1037/gdn0000091

63.

* Guastello

S. J.

Correro II

A. N.

Marra

D. E.

(2019). Cusp catastrophe models for cognitive workload and fatigue in teams. Applied Ergonomics, 79(1), 152–168. https://doi.org/10.1016/j.apergo.2018.08.019

64.

* Guastello

S. J.

Marra

D. E.

(2018). External validity and factor structure of individual and group workload ratings. Theoretical Issues in Ergonomics Science, 19(2), 229–253. https://doi.org/10.1080/1463922x.2017.1356395

65.

* Guastello

S. J.

Marra

D. E.

Correro

A. N.

Michels

Schimmel

(2017). Elasticity and rigidity constructs and ratings of subjective workload for individuals and groups. In International symposium on human mental workload: models and applications (pp. 51–76). Springer.

66.

* Guastello

S. J.

Marra

D. E.

Perna

Castro

Gomez

Peressini

A. F.

(2016). Physiological synchronization in emergency response teams: Subjective workload, drivers and empaths. Nonlinear Dynamics, Psychology, and Life Sciences, 20(2), 223–270.

67.

* Hah

Willems

Phillips

(2006). The effect of air traffic increase on controller workload. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 50(1), 50–54. https://doi.org/10.1177/154193120605000111

68.

Halgas

E. A.

van Eijndhoven

K. H.

Gevers

J. M.

Wiltshire

T. J.

Westerink

J. H. M.

Rispens

(2023). A review of using wearable technology to assess team functioning and performance. Small Group Research, 54(1), 41–76. https://doi.org/10.1177/10464964221125717

69.

Hancock

P. A.

Meshkati

(1988). Human mental workload. Elsevier.

70.

Hart

S. G.

(2006). Nasa-Task Load Index (NASA-TLX); 20 years later. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 50(9), 904–908. https://doi.org/10.1177/154193120605000909

71.

Hart

S. G.

Staveland

L. E.

(1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology (Vol. 52, pp. 139–183). Elsevier.

72.

* Helton

W. S.

Epling

de Joux

Funke

G. J.

Knott

B. A.

(2015). Judgments of team workload and stress: A simulated unmanned aerial vehicle case. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 59(1), 736–740. https://doi.org/10.1177/1541931215591173

73.

* Helton

W. S.

Funke

G. J.

Knott

B. A.

(2014). Measuring workload in collaborative contexts: Trait versus state perspectives. Human Factors, 56(2), 322–332. https://doi.org/10.1177/0018720813490727

74.

Hildebrand

G. A.

Pharmer

J. A.

Weaver

M. D.

(2003). Performance and usability evaluation of an automated task management concept prototype design. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 47(17), 1913–1917. https://doi.org/10.1177/154193120304701703

75.

Hinds

P. J.

Bailey

D. E.

(2003). Out of sight, out of sync: Understanding conflict in distributed teams. Organization Science, 14(6), 615–632. https://doi.org/10.1287/orsc.14.6.615.24872

76.

* Huang

F. H.

Hwang

S.-L.

(2009). Experimental studies of computerized procedures and team size in nuclear power plant operations. Nuclear Engineering and Design, 239(2), 373–380. https://doi.org/10.1016/j.nucengdes.2008.10.009

77.

Huey

B. M.

Wickens

C. D.

(1993). Workload transition implications for individual and team performance. National Academy Press.

78.

Hutchins

(1995). Cognition in the wild. MIT press.

79.

INCOSE . (2023). INCOSE systems engineering handbook: A guide for system life cycle processes and activities (5th ed.). John Wiley & Sons.

80.

* Jobidon

M.-E.

Breton

Rousseau

Tremblay

(2006). Team response to workload transition: The role of team structure. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 50(17), 1769–1773. https://doi.org/10.1177/154193120605001710

81.

Johnson

C. J.

(2020). Communication networks and team workload in a command and control synthetic task environment Master's thesis. Arizona State University.

82.

Johnson

C. J.

(2023). Team workload in action teams. Doctoral dissertation. Arizona State University.

83.

Johnson

C. J.

Gutzwiller

R. S.

Holder

Amazeen

P. G.

Cooke

N. J.

(2025). Exploring the relationship between team workload and communication in action teams. Journal of Cognitive Engineering and Decision Making, 19(3), Article 15553434251328835. https://doi.org/10.1177/15553434251328835

84.

Johnson

C. J.

Lieber

C. S.

Gutzwiller

R. S.

Cooke

N. J.

(2023). Team workload in action teams: Exploring the impact of interdependence. In Proceedings of the human factors and ergonomics society - Annual Meeting (Vol. 67, pp. 1127–1133): Sage Publications. https://doi.org/10.1177/21695067231192281

85.

Johnson

Bradshaw

J. M.

Feltovich

P. J.

Jonker

C. M.

Van Riemsdijk

M. B.

Sierhuis

(2014). Coactive design: Designing support for interdependence in joint activity. Journal of Human-Robot Interaction, 3(1), 43–69. https://doi.org/10.5898/jhri.3.1.johnson

86.

Johnson

Bradshaw

J. M.

(2021). How interdependence explains the world of teamwork. In Engineering artificially intelligent systems: A systems engineering approach to realizing synergistic capabilities (pp. 122–146). Cham: Springer International Publishing.

87.

* Johnston

J. H.

Fiore

S. M.

Paris

Smith

(2013). Application of cognitive load theory to develop a measure of team cognitive efficiency. Military Psychology, 25(3), 252–265. https://doi.org/10.1037/h0094967

88.

Kazi

Khaleghzadegan

Dinh

J. V.

Shelhamer

M. J.

Sapirstein

Goeddel

L. A.

Chime

N. O.

Salas

Rosen

M. A.

(2021). Team physiological dynamics: A critical review. Human Factors, 63(1), 32–65. https://doi.org/10.1177/0018720819874160

89.

Keene

A. B.

Shiloh

A. L.

Eisen

Berger

Karwa

Fein

Orsi

Gong

(2021). Critical care surge during the COVID-19 pandemic: Implementation and feedback from frontline providers. Journal of Intensive Care Medicine, 36(2), 233–240. https://doi.org/10.1177/0885066620973175

90.

* Kennedy-Metz

L. R.

Wolfe

H. L.

Dias

R. D.

Yule

S. J.

Zenati

M. A.

(2020). Surgery task load index in cardiac surgery: Measuring cognitive load among teams. Surgical Innovation, 27(6), 602–607. https://doi.org/10.1177/1553350620934931

91.

* Kim

J. H.

Macht

G. A.

(2012). Comparison of individual and team-based dynamic decision-making task (anti-air warfare coordinator): Consideration of subjective mental workload metacognition. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 56(1), 2517–2521. https://doi.org/10.1177/1071181312561522

92.

Klein

K. J.

Kozlowski

S. W.

(2000). From micro to meso: Critical steps in conceptualizing and conducting multilevel research. Organizational Research Methods, 3(3), 211–236. https://doi.org/10.1177/109442810033001

93.

* Knott

B. A.

Bolia

R. S.

Nelson

W. T.

Galster

S. M.

(2006). The impact of instant messaging on team performance, subjective workload, and situation awareness in tactical command and control. In 11th international command and control research and technology symposium.

94.

* Knott

C. C.

Nelson

W. T.

McCroskey

M. K.

Miller

B. T.

(2007). Do you see what I see? Effects of communication on scanning strategies in change detection by individuals and teams of observers. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 51(18), 1186–1190. https://doi.org/10.1177/154193120705101828

95.

Kozlowski

S. W.

Gully

S. M.

McHugh

P. P.

Salas

Cannon-Bowers

J. A.

(1996). A dynamic theory of leadership and team effectiveness: Developmental and task contingent leader roles. Research in Personnel and Human Resources Management, 14(1), 253–306.

96.

* Krausman

A. S.

(2017). Understanding audio communication delay in distributed team interaction: Impact on trust, shared understanding, and workload. In 2017 IEEE conference on cognitive and computational aspects of situation management (CogSIMA) (pp. 1–3). IEEE.

97.

* Leggatt

A. P.

Noyes

J. M.

(2000). Navigation aids: Effects on crew workload and performance. Military Psychology, 12(2), 89–104. https://doi.org/10.1207/s15327876mp1202_1

98.

* Lei

Waller

M. J.

Hagen

Kaplan

(2016). Team adaptiveness in dynamic contexts: Contextualizing the roles of interaction patterns and in-process planning. Group & Organization Management, 41(4), 491–525. https://doi.org/10.1177/1059601115615246

99.

* Lenné

M. G.

Hoggan

B. L.

Fidock

Stuart

Aidman

(2014). The impact of auditory task complexity on primary task performance in military land vehicle crew. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 58(1), 2185–2189. https://doi.org/10.1177/1541931214581459

100.

* Lewis

Wang

Chien

S. Y.

Velagapudi

Scerri

Sycara

(2011). Process and performance in human-robot teams. Journal of Cognitive Engineering and Decision Making, 5(2), 186–208. https://doi.org/10.1177/1555343411409323

101.

* Ligda

S. V.

Fischer

Mosier

Matessa

Battiste

Johnson

W. W.

(2015). Effectiveness of advanced collaboration tools on crew communication in reduced crew operations. In International conference on engineering psychology and cognitive ergonomics (pp. 416–427). Springer.

102.

Lim

B. C.

Klein

K. J.

(2006). Team mental models and team performance: A field study of the effects of team mental model similarity and accuracy. Journal of Organizational Behavior: The International Journal of Industrial, Occupational and Organizational Psychology and Behavior, 27(4), 403–418. https://doi.org/10.1002/job.387

103.

* Lin

C. J.

Hsieh

T.-L.

Tsai

P.-J.

Yang

C.-W.

Yenn

T.-C.

(2011). Development of a team workload assessment technique for the main control room of advanced nuclear power plants. Human Factors and Ergonomics in Manufacturing & Service Industries, 21(4), 397–411. https://doi.org/10.1002/hfm.20247

104.

* Liu

Zhang

Zhu

(2016). Influence of time delay on team performance in space robotic teleoperation. In International conference on engineering psychology and cognitive ergonomics (pp. 189–197). Springer.

105.

* Lowndes

B. R.

Abdelrahman

A. M.

Thiels

C. A.

Mohamed

A. O.

McConico

A. L.

Bingener

Hallbeck

M. S.

(2019). Surgical team workload comparison for 4-port and single-port laparoscopic cholecystectomy procedures. Applied Ergonomics, 78(1), 277–285. https://doi.org/10.1016/j.apergo.2018.06.005

106.

MacMillan

Paley

M. J.

Entin

E. B.

Entin

E. E.

(2004). Questionnaires for distributed assessment of team mutual awareness. In Handbook of human factors and ergonomics methods (pp. 510–520). CRC Press.

107.

* MacMillan

Entin

E. E.

Serfaty

(2004). Communication overhead: The hidden cost of team cognition. In Team cognition: Process and performance at the inter and intra-individual level. American Psychological Association.

108.

* Marques

M. S.

Coelho

D. A.

Filipe

J. N.

Nunes

I. M. L.

(2015). The expanded cognitive task load index (NASA-TLX) applied to team decision-making in emergency preparedness simulation. In Proceedings of the human factors and ergonomics society Europe chapter 2014 annual conference (pp. 225–236). Human Factors and Ergonomics Society (HFES).

109.

Mathieu

J. E.

Luciano

M. M.

(2019). Multilevel emergence in work collectives.

110.

* McCann

Baranski

J. V.

Thompson

M. M.

Pigeau

R. A.

(2000). On the utility of experiential cross-training for team decision making under time stress. Ergonomics, 43(8), 1095–1110. https://doi.org/10.1080/00140130050084897

111.

* McKendrick

Shaw

de Visser

Saqer

Kidwell

Parasuraman

(2014). Team performance in networked supervisory control of unmanned air vehicles: Effects of automation, working memory, and communication content. Human Factors, 56(3), 463–475. https://doi.org/10.1177/0018720813496269

112.

* McKendrick

Shaw

Saqer

de Visser

Parasuraman

(2011). Team performance and communication within networked supervisory control human-machine systems. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 55(1), 262–266. https://doi.org/10.1177/1071181311551054

113.

Mitchell

D. K.

(2009). Workload analysis of the crew of the Abrams V2 SEP: Phase I baseline IMPRINT model (ARL-TR 5028). Army Research Laboratory. https://apps.dtic.mil/sti/tr/pdf/ADA508882.pdf

114.

Molleman

Slomp

(1999). Functional flexibility and team performance. International Journal of Production Research, 37(8), 1837–1858. https://doi.org/10.1080/002075499191021

115.

Morrison-Smith

Ruiz

(2020). Challenges and barriers in virtual teams: A literature review. SN Applied Sciences, 2(6), 1096. https://doi.org/10.1007/s42452-020-2801-5

116.

Naikar

(2016). Work domain analysis: Concepts, guidelines, and cases. CRC Press.

117.

Norman

D. A.

Bobrow

D. G.

(1975). On data-limited and resource-limited processes. Cognitive Psychology, 7(1), 44–64. https://doi.org/10.1016/0010-0285(75)90004-3

118.

O’Neill

McNeese

Barron

Schelble

(2020). Human–autonomy teaming: A review and analysis of the empirical literature. Human Factors, 64(5), Article 0018720820960865. https://doi.org/10.1177/0018720820960865

119.

Parasuraman

Sheridan

T. B.

Wickens

C. D.

(2008). Situation awareness, mental workload, and trust in automation: Viable, empirically supported cognitive engineering constructs. Journal of Cognitive Engineering and Decision Making, 2(2), 140–160. https://doi.org/10.1518/155534308X284417

120.

Park

Zhong

Dong

Barwise

Pickering

B. W.

(2022). Investigating the cognitive capacity constraints of an ICU care team using a systems engineering approach. BMC Anesthesiology, 22(1), 10. https://doi.org/10.1186/s12871-021-01548-7

121.

* Parker

Best

Funke

Strang

Marion

(2016). An investigation of coding schemes for sample entropy analysis of communications data. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 60(1), 111–115. https://doi.org/10.1177/1541931213601025

122.

Pharmer

Cropper

McKneely

Williams

(2004). Tactical tomahawk weapon control system v6 land attack combat system prototype human-computer interface. Naval Air Systems Command Orlando FL Training Systems Div.

123.

* Pierce

Rapada

Herder

P. A.

LaPorta

A. J.

Hoang

T. N.

Pena

Blankenship

Kiser

Catlin

S. A.

(2018). Surgery at sea: The effect of simulated high sea states on surgical performance. Journal of Special Operations Medicine: A Peer Reviewed Journal for SOF Medical Professionals, 18(2), 64–70. https://doi.org/10.55460/EMQ7-ROZP

124.

* Plant

K. L.

Stanton

N. A.

(2016). Distributed cognition in Search and Rescue: Loosely coupled tasks and tightly coupled roles. Ergonomics, 59(10), 1353–1376. https://doi.org/10.1080/00140139.2016.1143531

125.

* Porter

C. O.

Itir Gogus

R. C.-F.

(2010). When does teamwork translate into improved team performance? A resource allocation perspective. Small Group Research, 41(2), 221–248. https://doi.org/10.1177/1046496409356319

126.

* Porter

C. O.

Webb

J. W.

Gogus

C. I.

(2010). When goal orientations collide: Effects of learning and performance orientation on team adaptability in response to workload imbalance. Journal of Applied Psychology, 95(5), 935–943. https://doi.org/10.1037/a0019637

127.

* Priest

H. A.

Guthrie

Burke

C. S.

Bowers

C. A.

Salas

(2004). Are there differences in teamwork across team type? Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 48(22), 2582–2586. https://doi.org/10.1177/154193120404802215

128.

Puranik

Koopman

Vough

H. C.

(2020). Pardon the interruption: An integrative review and future research agenda for research on work interruptions. Journal of Management, 46(6), 806–842. https://doi.org/10.1177/0149206319887428

129.

Ramos-Villagrasa

P. J.

Marques-Quinteiro

Navarro

Rico

(2018). Teams as complex adaptive systems: Reviewing 17 years of research. Small Group Research, 49(2), 135–176. https://doi.org/10.1177/1046496417713849

130.

Roberts

A. P. J.

Webster

L. V.

Salmon

P. M.

Flin

Salas

Cooke

N. J.

Read

G. J.

Stanton

N. A.

(2021). State of science: Models and methods for understanding and enhancing teams and teamwork in complex sociotechnical systems. Ergonomics, 65(2), 1–27. https://doi.org/10.1080/00140139.2021.2000043

131.

* Roberts

A. P. J.

Stanton

N. A.

Fay

(2017). Land ahoy! Understanding submarine command and control during the completion of inshore operations. Human Factors, 59(8), 1263–1288. https://doi.org/10.1177/0018720817731678

132.

* Roberts

A. P. J.

Stanton

N. A.

Fay

D. T.

(2018). Go Deeper, Go Deeper: Understanding submarine command and control during the completion of dived tracking operations. Applied Ergonomics, 69(1), 162–175. https://doi.org/10.1016/j.apergo.2018.02.003

133.

* Roberts

A. P. J.

Stanton

N. A.

Fay

D. T.

Pope

K. A.

(2019). The effects of team co-location and reduced crewing on team communication characteristics. Applied Ergonomics, 81(1), Article 102875. https://doi.org/10.1016/j.apergo.2019.102875

134.

* Rothrock

Cohen

Yin

Thiruvengada

Nahum-Shani

(2009). Analyses of team performance in a dynamic task environment. Applied Ergonomics, 40(4), 699–706. https://doi.org/10.1016/j.apergo.2008.06.004

135.

Salas

Fiore

S. M.

(Eds.), (2004). Team cognition: Understanding the factors that drive process and performance. American Psychological Association.

136.

Salas

Sims

D. E.

Burke

C. S.

(2005). Is there a “big five” in teamwork? Small Group Research, 36(5), 555–599. https://doi.org/10.1177/1046496405277134

137.

* Saner

L. D.

Bolstad

C. A.

Gonzalez

Cuevas

H. M.

(2010). Predicting shared situation awareness in teams: A case of differential SA requirements. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 54(4), 314–318. https://doi.org/10.1177/154193121005400410

138.

* Sebok

(2000). Team performance in process control: Influences of interface design and staffing levels. Ergonomics, 43(8), 1210–1236. https://doi.org/10.1080/00140130050084950

139.

Sellers

Helton

W. S.

Näswall

Funke

G. J.

Knott

B. A.

(2014). Development of the team workload questionnaire (TWLQ). Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 58(1), 989–993. https://doi.org/10.1177/1541931214581207

140.

* Sellers

Helton

W. S.

Näswall

Funke

G. J.

Knott

B. A.

(2015). The Team Workload Questionnaire (TWLQ) A simulated unmanned vehicle task. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 59(1), 1382–1386. https://doi.org/10.1177/1541931215591231

141.

* She

(2019). User-defined information sharing for team situation awareness and teamwork. Ergonomics, 62(8), 1098–1112. https://doi.org/10.1080/00140139.2019.1607910

142.

Shneiderman

(2022). Intelligent agents and supertools. In Shneiderman

(Ed.), Human-Centered AI. Oxford University Press. https://doi.org/10.1093/oso/9780192845290.003.0013

143.

Siddaway

A. P.

Wood

A. M.

Hedges

L. V.

(2019). How to do a systematic review: A best practice guide for conducting and reporting narrative reviews, meta-analyses, and meta-syntheses. Annual Review of Psychology, 70(1), 747–770. https://doi.org/10.1146/annurev-psych-010418-102803

144.

* Sperling

B. K.

Pritchett

A. R.

(2011). Complementary information distribution to improve team performance in military helicopter operations: An experimental study. The International Journal of Aviation Psychology, 21(4), 375–396. https://doi.org/10.1080/10508414.2011.606756

145.

Stanton

N. A.

Stewart

Harris

Houghton

R. J.

Baber

McMaster

Salmon

Hoyle

Walker

Young

M. S.

Linsell

Dymott

Green

(2006). Distributed situation awareness in dynamic systems: Theoretical development and application of an ergonomics methodology. Ergonomics, 49(12–13), 1288–1311. https://doi.org/10.1080/00140130600612762

146.

* Stanton

N. A.

Roberts

A. P. J.

(2020a). Better together? Investigating new control room configurations and reduced crew size in submarine command and control. Ergonomics, 63(3), 307–323. https://doi.org/10.1080/00140139.2019.1654137

147.

* Stanton

N. A.

Roberts

A. P. J.

(2020b). Block off: An examination of new control room configurations and reduced crew sizes examining engineered production blocking. Cognition, Technology & Work, 22(1), 29–55. https://doi.org/10.1007/s10111-019-00542-x

148.

* Stanton

N. A.

Rothrock

Harvey

Sorensen

(2015). Investigating information-processing performance of different command team structures in the NATO Problem Space. Ergonomics, 58(12), 2078–2100. https://doi.org/10.1080/00140139.2015.1046499

149.

* Strang

A. J.

Funke

G. J.

Knott

B. A.

Galster

S. M.

Russell

S. M.

(2012). Effects of cross-training on team performance, communication, and workload in simulated air battle management. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 56(1), 1581–1585. https://doi.org/10.1177/1071181312561315

150.

* Strang

A. J.

Horwood

Best

Funke

G. J.

Knott

B. A.

Russell

S. M.

(2012). Examining temporal regularity in categorical team communication using sample entropy. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 56(1), 473–477. https://doi.org/10.1177/1071181312561047

151.

Strauch

(2017). Ironies of automation: Still unresolved after all these years. IEEE Transactions on Human-Machine Systems, 48(5), 419–433. https://doi.org/10.1109/thms.2017.2732506

152.

Sundstrom

E. D.

(1999). The challenges of supporting work team effectiveness. In Supporting work team effectiveness: Best management practices for fostering high performance (pp. 3–23). Jossey-Bass Publishers.

153.

* Svensson

Rencrantz

Lindoff

Berggren

Norlander

(2006). Dynamic measures for performance assessment in complex environments. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 50(24), 2585–2589. https://doi.org/10.1177/154193120605002415

154.

* Tollner-Burngasser

Riley

M. A.

Nelson

W. T.

(2010). Individual and team susceptibility to change blindness. Aviation Space & Environmental Medicine, 81(10), 935–943. https://doi.org/10.3357/asem.2809.2010

155.

* Tollner

A. M.

Riley

M. A.

Nelson

W. T.

Shockley

K. D.

Cummins-Sebree

(2006). Change blindness in teams: Are three pairs of eyes better than one? Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 50(17), 1789–1793. https://doi.org/10.1177/154193120605001714

156.

* Tremblay

Vachon

Lafond

Kramer

(2012). Dealing with task interruptions in complex dynamic environments: Are two heads better than one? Human Factors, 54(1), 70–83. https://doi.org/10.1177/0018720811424896

157.

Tsang

P. S.

Vidulich

M. A.

(2006). Mental workload and situation awareness. In Handbook of human factors and ergonomics (3rd ed., pp. 243–268). John Wiley & Sons Inc. https://doi.org/10.1002/0470048204.ch9

158.

Urban

J. M.

Bowers

C. A.

Monday

S. D.

Morgan

Jr, B. B.

(1995). Workload, team structure, and communication in team performance. Military Psychology, 7(2), 123–139. https://doi.org/10.1207/s15327876mp0702_6

159.

Van Den Oever

Schraagen

J. M.

(2021). Team communication patterns in critical situations. Journal of Cognitive Engineering and Decision Making, 15(1), 28–51. https://doi.org/10.1177/1555343420986657

160.

* Vashdi

D. R.

Bamberger

P. A.

Erez

(2013). Can surgical teams ever learn? The role of coordination, complexity, and transitivity in action team learning. Academy of Management Journal, 56(4), 945–971. https://doi.org/10.5465/amj.2010.0501

161.

* Verdière

K. J.

Dehais

Roy

R. N.

(2019). Spectral EEG-based classification for operator dyads’ workload and cooperation level estimation. In 2019 IEEE international conference on systems, man and cybernetics (SMC) (pp. 3919–3924). IEEE.

162.

Walker

G. H.

Gibson

Stanton

N. A.

Baber

Salmon

Green

(2006). Event analysis of systemic teamwork (EAST): A novel integration of ergonomics methods to analyse C4i activity. Ergonomics, 49(12–13), 1345–1369. https://doi.org/10.1080/00140130600612846

163.

* Walker

G. H.

Stanton

N. A.

Salmon

Jenkins

(2009). How can we support the commander’s involvement in the planning process? An exploratory study into remote and co-located command planning. International Journal of Industrial Ergonomics, 39(2), 456–464. https://doi.org/10.1016/j.ergon.2008.12.003

164.

Waller

M. J.

Okhuysen

G. A.

Saghafian

(2016). Conceptualizing emergent states: A strategy to advance the study of group dynamics. The Academy of Management Annals, 10(1), 561–598. https://doi.org/10.5465/19416520.2016.1120958

165.

Wasserman

Faust

(1994). Social network analysis: Methods and applications.

166.

Wickens

C. D.

(2008). Multiple resources and mental workload. Human Factors, 50(3), 449–455. https://doi.org/10.1518/001872008X288394

167.

Wickens

C. D.

McCarley

J. S.

Gutzwiller

R. S.

(2022). Applied attention theory. CRC Press.

168.

Wickens

C. D.

Tsang

P. S.

(2015). Workload. In APA handbook of human systems integration (pp. 277–292). American Psychological Association. https://doi.org/10.1037/14528-018

169.

Won

J. C.

Hannon

D. J.

(2013). Influence of resource allocation on teamwork and team performance within self-organizing teams. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 57(1), 270–274. https://doi.org/10.1177/1541931213571060

170.

* Wong

J. H.

Wright

Ogren

(2014). Cognitive dynamics of distributed teams performing dynamic, complex tasks. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 58(1), 2383–2387. https://doi.org/10.1177/1541931214581496

171.

Woods

D. D.

Hollnagel

(2006). Joint cognitive systems: Patterns in cognitive systems engineering. CRC Press.

172.

* Wright

M. C.

Kaber

D. B.

(2005). Effects of automation of information-processing functions on teamwork. Human Factors, 47(1), 50–66. https://doi.org/10.1518/0018720053653776

173.

* Yang

C.-W.

Yenn

T.-C.

Lin

C. J.

(2010). Assessing team workload under automation based on a subjective performance measure. Safety Science, 48(7), 914–920. https://doi.org/10.1016/j.ssci.2010.03.011

174.

* Yee

D. J.

Wiggins

M. W.

Searle

B. J.

(2020). Higher social cue utilisation improves communication, reduces perceived workload, and improves performance amongst ad hoc dyads in simulated rail control. Ergonomics, 63(1), 31–47. https://doi.org/10.1080/00140139.2019.1680872

175.

Young

M. S.

Brookhuis

K. A.

Wickens

C. D.

Hancock

P. A.

(2015). State of science: Mental workload in ergonomics. Ergonomics, 58(1), 1–17. https://doi.org/10.1080/00140139.2014.956151

176.

Young

M. S.

Stanton

N. A.

Walker

G. H.

Jenkins

D. P.

Salmon

P. M.

(2007). Mental workload in command and control teams: Musings on the outputs of EAST and WESTT. In Harris

(Ed.), Engineering psychology and cognitive ergonomics (pp. 455–464). Springer. https://doi.org/10.1007/978-3-540-73331-7_50

177.

* Zhang

(2016). Effect of speech display on team mutual awareness and diagnosis performance. In International Conference on Engineering Psychology and Cognitive Ergonomics (pp. 256–265). Springer.

178.

Zhang

She

(2023). Team workload: Review and conceptualization. International Journal of Industrial Ergonomics, 95(3), 103452. https://doi.org/10.1016/j.ergon.2023.103452