Augmented Cognition Overview: Improving Information Intake under Stress

Abstract

Military operators are often put into complex human-machine interactive environments shown to fail when stressful situations are encountered. To enhance warfighter readiness and operational capability, DARPA's efforts in Augmented Cognition are developing a new generation of technologies to enable computational systems to adapt to the human's cognitive state in real-time. These augmented systems will be endowed with non-invasive sensors that provide objective measures of the warfighter's neurophysiological responses to ongoing events. Based on these measures, as well as cognitive and contextual models of the user's intentions and objectives, these systems will invoke validated mitigation strategies to enable maximal performance from the user, and to help return them to an optimally functional state. This panel provided an overview of the key components of an Augmented Cognition system, how its development and validation will be carried out, and where these technologies could be implemented both in military settings and beyond.

Get full access to this article

View all access options for this article.

References

Cannon

W. B.

(1929). Bodily Changes in Pain, Hunger, Fear and Rage: An Account of Recent Research into the Function of Emotional Excitement, 2nd Ed. New York: Appleton.

Cowan

(2001). The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences, 24, 87–185.

Ferreira

Pashler

(2002). Central bottleneck influences on the processing stages of word production. Journal of Experimental Psychology: Human Learning and Memory, 28, 1187–1199.

Hart

S. G.

Staveland

L. E.

(1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Hancock

P. A.

Meshkati

(Eds.) Human mental workload (pp. 139–183). Amsterdam: North-Holland.

Held

Durlach

N. I.

(1991). Telepresence, time delay, and adaptation. In Ellis

S. R.

(Ed.), Pictorial Communication in Virtual and Real Environments. New York: Taylor and Francis.

Just

Gonzalez

Schneider

(2004, January). Cognitive, Biological & Computational Analysis of Automaticity in Complex Cognition. Poster session presented at the Augmented Cognition Phase 2B Kickoff Meeting, Orlando, FL.

Lazarus

R. S.

Folkman

(1984). Stress, Appraisal, and Coping. New York: Springer.

Lee

J. D.

Moray

Trust, control strategies, and allocation of function in human-machine systems. Ergonomics 35 (1992), 1243–1270.

Miller

Chair (2002). Etiquette for Human-Computer Work: Papers from the AAAI Fall Symposium, North Falmouth, MA. Nellcor, http://www.oximax.com/n595.asp (reviewed on June 7th, 2004).

10.

Parasuraman

Riley

V. A.

Humans and automation: Use, misuse, disuse, abuse. Human Factors 39 (1997), 230–253.

11.

Parasuraman

Mouloua

Molloy

(1996). Effects of adaptive task allocation on monitoring of automated systems. Hum Factors 38, 665–679.

12.

Pringle

H. L.

Perry

C. M.

(2002). Eye movement measures of memory. Presented at the Defense Advanced Research Projects Agency (DARPA) Program Review, 10–12 July, Washington DC.

13.

Wickens

C. D.

Hollands

J. G.

(1999). Engineering Psychology and Human Performance (3rd Edition). Prentice Hall, Upper Saddle River, NJ.

14.

Wilson

G. W.

Russell

C. A.

Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks. Human Factors: The Journal of the Human Factors and Ergonomics Society. Vol. 45 Issue 4, Winter 2003.

15.

Young

P. M.

Clegg

B. A.

Smith

C. A. P.

(2004). Dynamic models of augmented cognition. Submitted to International Journal of Human-Computer Interaction.