Using a Reconstruction-Exploration Approach to Empower Cognitive Analysis Methods: Possibilities and Challenges

Abstract

One problem in analyzing large-scale, distributed tactical operations is to get an overview of the operation to guide the interpretation of data collected. Cognitive analysis methods, such as the critical decision method, do generally not focus on reconstructing detailed models of the work sessions, but rather on summarizing particular incidents based on retrospective interview data and self-reports. The existing reconstruction—exploration approach involves the construction and presentation of time-synchronized, event-driven multimedia models of the course of events from distributed operations. It does not, however, provide systematic analysis methods. This paper discusses the possibilities and challenges of integrating the critical decision method and the reconstruction—exploration approach to arrive at a complementary solution.

Get full access to this article

View all access options for this article.

References

Albinsson

P.-A.

Morin

Thorstensson

(2004). Managing metadata in collaborative command and control analysis. Proc. HFES, pp. 600–604.

Beyer

Holtzblatt

(1999). Contextual design. Interactions, 6(1), 32–42.

Flanagan

J. C.

(1954). The critical incident technique, Psychological Bulletin, 51(4), 327–359.

Klein

Calderwood

Macgregor

(1989). Critical decision method for eliciting knowledge. IEEE Transactions on Systems, Man and Cybernetics, 19(3), 462–472.

Klinger

(2003). Handbook of Team CTA. Fairborn, OH: Klein Associates Inc.

Mackay

W. E.

Beaudouin-Lafon

(1998). DIVA: Exploratory data analysis with multimedia streams, Proc. CHI, pp. 416–423.

Morin

(2002). Multimedia representations of distributed tactical operations. Dissertation No 771, Linköpings universitet, Sweden.

Morin

Albinsson

P.-A.

(2005). Exploration and context in communication analysis. In Bowers

Salas

Jentsch

(eds.), Creating High-Tech Teams: Practical Guidance on Work Performance and Technology. Washington DC: APA Press.

Morin

Jenvald

Nygren

Axelsson

Thorstensson

(2003). A study of first responders' use of digital cameras for documenting rescue operations for debriefing and analysis. Proc. of The Int. Emergency Management Society's Tenth Annual Conference, pp. 221–230.

10.

Patrick

James

(2004). Process tracing of complex cognitive work tasks. J. of Occupational and Organizational Psychology, 77(2), 259–280.

11.

Pigeau

McCann

(2000). Redefining command and control. In McCann

Pigeau

(eds.), The human in command: Exploring the modern military experience, pp. 163–184, New York: Kluwer/Plenum.

12.

Sanderson

Scott

Johnston

Mainzer

Watanabe

James

(1994). MacSHAPA and the enterprise of exploratory sequential data analysis (ESDA), Int. J. of Human-Computer Studies, 41, 633–681.

13.

Wong

W. B. L.

(2004). Data analysis for the critical decision method. In Daiper

Stanton

(eds.), The handbook of task analysis for human-computer interaction, pp. 327–345, Mahwah, NJ: Erlbaum.

14.

Wong

W. B. L.

Blandford

(2004). Situation awareness in emergency medical dispatch. Int. J. Human-Computer Studies 61, 421–452.

15.

Woods

D. D.

(1993). Process-tracing methods for the study of cognition outside of the experimental psychology laboratory. In Klein

G. A.

Orasanu

Calderwood

Zsambok

C. E.

(eds.), Decision making in action: Models and methods, pp. 228–251, Norwood, NJ: Ablex.