The primary goal of this effort was to understand the problems faced by military intelligence analysis personnel as well as how, and to what degree, the identification of these problems could guide the development of computational support systems. To develop this understanding, we performed a literature review, knowledge elicitation interviews and a cognitive task analysis (CTA) in the domain of Army Intelligence Analysis at the Brigade Combat Team. This effort consisted of identifying: (1) the major functions or cognitive tasks entailed in Army Intelligence Analysis; and (2) the complexities in the domain that pose challenges to performance of these cognitive tasks. Identifying the cognitive tasks and the challenges faced in performing those tasks provided a basis for determining opportunities for more effective support of human information processing and decision-making. In this paper, we document selected results of this analysis effort.
Get full access to this article
View all access options for this article.
References
1.
BodnarJ. (2005). Making Sense of Massive Data by Hypothesis Testing. In Proceedings of International Conference on Intelligence Analysis. McLean, VA.
2.
BoscheeE.WeischedelR.ZamanianA. (2005). Automatic Information Extraction. In Proceedings of International Conference on Intelligence Analysis. McLean, VA.
3.
De KeyserV.WoodsD. (1990). Fixation Errors: Failures to Revise Situation Assessment in Dynamic and Risky Systems. In ColomboA.de BustamanteSaiz A. (Eds.), System Reliability Assessment (pp. 231–251). Drodrecht, The Netherlands: Kluwer Academics.
4.
DoernerD. (1987). On the Difficulties People Have in Dealing With Complexities. In RasmussenJ.DuncanK.LeplatJ. (Eds.), New Technology and Human Errors. London: Wiley.
5.
ElmW.PotterS.TittleJ.WoodsD.GrossmanJ.PattersonE. (2005). Finding Decision Support Requirements for Effective Intelligence Analysis Tools. In Proceedings of International Conference on Intelligence Analysis. McLean, VA.
6.
GardnerS.UhlmannJ. (2005). A Decentralized Data Fusion Framework for Horizontal Integration of Intelligence Data. In Proceedings of International Conference on Intelligence Analysis. McLean, VA.
7.
HornR. (2005). Connecting the Smudges: How Analytics Info-Murals May Be of Help in Dealing With Social Messes. In Proceedings of International Conference on Intelligence Analysis. McLean, VA.
8.
KahnemanD.SlovicP.TverskyA. (1982). Judgment Under Uncertainty: Heuristics and Biases. Cambridge, UK: Cambridge University Press.
9.
KleinG.ArmstrongA.WoodsD.GokulachandraM.KleinH. (2000). Cognitive Wavelength: The Role of Common Ground in Distributed Reasoning. (Rep. No. AFRL-HE-WP-TR-2001-0029). Wright-Patternson Air Force Base: Air Force Research Laboratory.
10.
MorseE.StevesPotts M.ScholtzJ. (2005). Metrics and Methodologies for Evaluating Technologies for Intelligence Analysts. In Proceedings of International Conference on Intelligence Analysis. McLean, VA.
11.
PfautzJ.FouseA.RothE.KarabaichB. (2005a). Supporting Reasoning About Cultural and Organizational Influences in an Intelligence Analysis Decision Aid. In Proceedings of International Conference on Intelligence Analysis. McLean, VA.
12.
PfautzJ.RothE.BisantzA.FouseA.MaddenS.FichtlT. (2005b). The Impact of Meta-Information on Decision-Making in Intelligence Operations. In Proceedings of Human Factors and Ergonomics Society Annual Meeting. Orlando, FL.
13.
PirolliP.CardS. (2005). The Sensemaking Process and Leverage Points for Analyst Technology As Identified Through Cogntivie Task Analysis. In Proceedings of International Conference on Intelligence Analysis. McLean, VA.
14.
PopleH. (1982). Heuristic Methods for Imposing Structure on Ill-Structured Problems: The Structuring of Medical Diagnostics. In SzolovitzP. (Ed.), Artificial Intelligence in Medicine. AAAS, Westview Press.
15.
PotterS. S.RothE. M.WoodsD. D.ElmW. C. (2000). Bootstrapping Multiple Converging Cognitive Task Analysis Techniques for System Design. In ChipmanShalinSchraagen (Eds.), Cognitive Task Analysis (pp. 317–340). New Jersey: Lawrence Erlbaum.
16.
PowellG.BroomeB. (2002). Fusion-Based Knowledge for the Objective Force. In Proc. of The Military Sensing Series: National Symp. on Sensor and Data Fusion. San Diego, CA.
17.
PowellG. (2004a). Army Intelligence Analysis and Interpretation: Assessing the Utility and Limitations of Computational Diagnostic Reasoning. In Proceedings of DoD 2004 Command and Control Research and Technology Symposium. San Diego, CA.
18.
PowellG. (2004b). User-Centric System Design for Information Fusion. In Proceedings of Third International Workshop on Issues and Methods in Engineering Systems for Higher Level Fusion. Java, NY.
19.
PowellG.MatheusC. J.KokarM.LorenzG. G. (2006). Understanding the Role of Context in the Interpretation of Complex Battlespace Intelligence. In Proc. of Ninth International Conf. on Information Fusion. Florence, Italy.
20.
ReasonJ. T. (1990). Human Error. Cambridge University Press.
21.
RothE. M.WoodsD. D.PopleH. E. (1992). The Cognitive Simulation As a Tool for Cognitive Task Analysis. Ergonomics, 35(1163).
22.
SchraagenJ. M. C.ChipmanS. F.ShalinV. L. (2000). Introduction to Cognitive Task Analysis. In SchraagenJ. M. C.ChipmanS. F.ShalinV. L. (Eds.), Cognitive Task Analysis (pp. 3–24). Mahwah, NJ: Lawrence Erlbaum Associates.
23.
StichaP.BuedeD.ReesR. (2005). APOLLO: An Analytic Tool for Predicting a Subject's Decision-Making. In Proceedings of International Conference on Intelligence Analysis. McLean, VA.
24.
VicenteK.MumawR.RothE. (2004). Operator Monitoring in Complex Dynamic Work Environments: A Qualitative Cognitive Model Based on Field Observations. Theoretical Issues in Ergonomic Science, 5(5), 359–384.
25.
WaltzE. (1986). Data Fusion for C3I Systems. In The C3I Handbook. Palo Alto, CA: EW Communications.
26.
WasonP.Johnson-LairdP. (1972). Psychology of Reasoning: Structure and Content. London: Batsford.
27.
WoodsD.PattersonE. (2001). How Unexpected Events Produce an Escalation of Cognitive and Coordinative Demands. In HancockH.DesmondP. (Eds.), Stress, Workload, and Fatigue (pp. 290–304). Hillsdale, NJ: Lawrence Erlbaum.
28.
WoodsD. D.JohannesenL. J.CookR. I.SarterN. B. (1994). Behind Human Error: Cognitive Systems, Computers, and Hindsight. Wright-Patterson Air Force Base, Ohio: Crew Systems Ergonomics Information Analysis Center.
29.
WoodsD. D.PattersonE. S.RothE. M. (2002). Can We Ever Escapre From Data Overload? A Cognitive Systems Diagnosis. Cognition, Technology and Work, 4(1), 22–36.
30.
WoodsD. D.RothE. M. (1988). Cognitive Systems Engineering. In HelanderM. (Ed.), Handbook of Human-Computer Interaction. New York: North-Holland.
