Evaluating Tactical Real-time Interaction in Multi-agent,Dynamic,Hazardous,High-stake Operations

Abstract

We pursued a broad research approach and adopted a combined theorist's and practitioner's perspective to discover novel and effective ways to model and analyze tactical response units and their missions. Experiences from our initial work on military and emergency response mission efficiency analysis made it possible to develop a set of methods and tools for modeling, analysis, and evaluation of tactical forces and their abilities at the lower organizational levels: Mission-critical skills of individual operators and teams, mission resource management, and overall unit performance. We performed case studies, field studies, and experiments using a combined control theory, Naturalistic Decision Making and Cognitive Systems Engineering framework. A composite approach was necessary to fulfill this endeavor. In this paper we outline our work on development of theories and models intended to sustain analysis, evaluation and assessment of military and emergency response units performing complex, high-stake tactical operations. We also tested these concepts in several simulated tactical operations, and finally, validated the concepts in a number of full-scale exercises.

Get full access to this article

View all access options for this article.

References

Bollen

K. A.

(1989). Structural Equations with Latent Variables. New York: Wiley.

Brehmer

Allard

(1991). Real time dynamic decision making: The effects of task complexity and feedback delays. In Rasmussen

Brehmer

Leplat

(Eds.), Distributed Decision Making: Cognitive Models for Cooperative Work. Chichester: Wiley.

Cannon-Bowers

J. A.

Salas

Pruitt

J. S.

(1996). Establishing the boundaries of a paradigm for decision making research. Human Factors, 38(2), pp. 193–205. Santa Monica, CA: The Human Factors Society.

Endsley

M. R.

(1995) Towards a theory for situation awareness in dynamic systems. Human Factors, 37, pp. 32–64. Santa Monica, CA: The Human Factors Society.

Hart

S. G.

Staveland

L. E.

(1988). Development of a multi-dimensional workload rating scale: Results of empirical and theoretical research. In Hancock

P. A.

Meshkati

(Eds.), Human Mental Workload. Amsterdam, The Netherlands: Elsevier Science B.V.

Hollnagel

(1997). Context, Cognition and Control. In Waern

(Ed.), Co-Operative Process Management. London: Taylor & Francis.

Hollnagel

(1998). Cognitive Reliability and Error Analysis Method (CREAM). Amsterdam, The Netherlands: Elsevier Science B.V.

Hollnagel

Woods

D. D.

, (1983). Cognitive Systems Engineering: New Wine in New Bottles. International Journal of Man-Machine Studies, 18, pp. 583–600.

Jöreskog

K. G.

Sörbom

(1993). LISREL® 8: Structural Equation Modeling with the SIMPLIS™ Command Language. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

10.

Orasanu

Connolly

(1993). The reinvention of decision making. In Klein

G. A.

Orasanu

Calderwood

Zsambok

C. E.

(Eds.), Decision making in action: Models and methods pp. 3–20. Norwood, NJ: Ablex Publishing Corporation.

11.

Rasmussen

Pejtersen

Goodstein . (1994). Cognitive Systems Engineering. New York: Wiley.

12.

Sjöberg

Svensson

Persson

L.-O.

(1979). The measurement of mood. Scandinavian Journal of Psychology, 20, pp. 1–18.

13.

Smith

Woods

D. D.

McCoy

Billings

Sarter

Denning

Dekker

S. W.

(1997). Human-Centered Technologies and Procedures for Future Air Traffic Management. Activities Report, Contract No. NAG2-995.

14.

Svensson

(1977). Response format and factor structure in mood adjective checklists. Scandinavian Journal of Psychology, 18, pp. 71–78.

15.

Woods

D. D.

Johannesen

L. J.

Cook

R. I.

Sarter

N. B.

(1994). Behind Human Error: Cognitive Systems, Computers, and Hindsight. CSERIAC State-of the Art Report. Wright-Patterson Air Force Base, OH, USA.

16.

Woods

D. D.

Sarter

N. B.

(1998). Learning from Automation Surprises and Going Sour Accidents: Progress on Human-Centered Automation. Report ERGO-CSEL-98-02. The Ohio State University, Columbus, OH, USA.

17.

Worm

(1997). Simulation-Supported Analysis and Development of Tactical and Lower Level Ground Battle Units. In Proceedings of the Human Factors and Ergonomics Society Europe Chapter 1997 Annual Conference. The Human Factors and Ergonomics Society Europe Chapter, Bochum, Germany.

18.

Worm

(1998a). Modeling Tactical Man-Machine Systems and Improving Tactical Mission Efficiency Using NDM and CSE. Poster presentation at The 4th Conference on Naturalistic Decision Making, The Airlie Center, Warrenton, VA, USA.

19.

Worm

(1998b). Tactical Joint Cognitive Systems Performance in Dynamic, Distributed, Time-Critical Operations. In Proceedings of The 4th International Symposium on Command and Control Research and Technology, Stockholm, Sweden.

20.

Worm

(1998c). Joint Tactical Cognitive Systems: Modeling, Analysis, and Performance Assessment. In Proceedings of The Human Factors and Ergonomics Society 42nd Annual Meeting, Santa Monica, CA: The Human Factors Society.

21.

Worm

(1998d). Command and Control Science: Theory and Tactical Applications. Linkoping Studies in Science and Technology, Thesis No. 714, Linkoping University, Linkoping, Sweden.

22.

Worm

(1999). Mission Efficiency Analysis of Tactical Joint Cognitive Systems. In Proceedings of The NATO International Symposium on Modeling and Analysis of Command and Control, Paris, France.

23.

Worm

Jenvald

Morin

(1998a). Mastering the Dynamics of Crisis: Improving Situation Awareness in High-Risk, Time-Critical Emergency Operations. In Proceedings of The International Emergency Management Society 1998 Annual Conference, Washington, DC, USA.

24.

Worm

Jenvald

Morin

(1998b). Mission Efficiency Analysis: Evaluating and Improving Tactical Mission Performance in High-Risk, Time-Critical Operations. Safety Science, 30, pp.79–98. Amsterdam, The Netherlands: Elsevier Science B.V.

25.

Zsambok

C. E.

(1997). Naturalistic decision making: Where are we now? In Zsambok

Klein

(Eds.), Naturalistic decision making pp.3–16. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.