Assessing Team Situation Awareness in Simulated Military Missions

Abstract

We developed a measure of team situation awareness (SA) to capture team members' shared mental model of the team. The measure assesses the congruence among team members about what actions they were performing at salient events during a simulated mission. We used this measure in a research program investigating adaptive architectures for command and control (A2C2). As hypothesized, the measure of team SA was positively correlated with team performance and process measures in three A2C2 experiments in which it was used. The relationship between team SA and a teamwork measure that is comprised of such underlying team processes as coordination behavior and communication behavior supports the underlying premise of a link between team mental models and team SA. Team SA was negatively correlated with a measure of team workload, suggesting that increased levels of workload adversely affect team SA.

Get full access to this article

View all access options for this article.

References

Blickensderfer

Cannon-Bowers

J. A.

Salas

, (1998). Cross training and team performance. In Cannon-Bowers

J. A.

Salas

. Making decisions under stress. Washington, D. C: American Psychological Association.

Cannon-Bowers

J. A.

Salas

(1997). Framework for developing team performance measures in training. In Brannick

M. T.

Salas

Prince

Team performance assessment and measurement: theory, methods, and applications. Mahweh, NJ: Erlbaum.

Converse

S. A.

Kahler

S. E.

(1992). Knowledge acquisition and the measurement of shared mental models. Unpublished manuscript. Orlando, FL: Naval Training Systems Center.

Endsley

(199a). Measurement of situation awareness in dynamic systems. Journal of the Human Factors and Ergonomics Society, 37 (1), pp. 65–84.

Endsley

1995b). Toward a theory of situation awareness in dynamic systems. Human Factors, 37(1). p 32–64.

Entin

E. E.

(1999). Optimized command and control architectures for improved process and performance. Proc. of the 1999 Command & Control Research & Technology Symp., NWC, Newport, RI.

Entin

E. E.

Serfaty

(1999). Adaptive team coordination. Human Factors, 41(2), pp. 321–325.

Entin

E. E.

Serfaty

Kerrigan

C. K.

(1998). Choice and Performance Under Three Command and Control Architecture. Proc. of the 1998 Command & Control Research & Technology Symp., NPS, Monterey, CA.

Guzzo

R. A.

Salas

(1995). Team effectiveness and decision making in organizations. San Francisco, CA: Jossey-Bass.

10.

Hart

S. G.

Staveland

L. E.

(1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Hancock

P. A.

Meshkati

(Eds.), Human mental workload. Amsterdam: Elsevier.

11.

Salas

Prince

Baker

D. P.

Shrestha

(1995). Situation awareness in team performance: implications for measurement and training. Human Factors, 37(1). pp 123–136.

12.

Salas

Stout

R. J.

Cannon-Bowers

J. A.

(1994). The role of shared mental models in developing shared situational awareness. In Gilson

R. D.

Garland

D. J.

Koonce

J. M.

, (Ed.). Situational awareness in complex systems. Daytona Beach FL: Embry Riddle University Press.

13.

Stout

R. J.

Cannon-Bowers

J. A.

Salas

(1996). The role of shared mental models in developing team stiuational awareness; implications for training. Training Research Journal, 2, 85–116.

14.

Wollenbecker

J. M.

(1999). Using MTWS for human-in-the-loop C2 organizational experiments. Unpublished masters thesis, Naval Postgraduate School, Monterey, CA.