Sage Journals: Discover world-class research

Abstract

This paper describes an adaptive system that “closes the loop” by utilizing a real-time, directly sensed measure of cognitive state of the human operator. The Honeywell Augmented Cognition team has developed a Closed Loop Integrated Prototype (CLIP) of a Communications Scheduler, for application to the U.S. Army's Future Force Warrior (FFW) program. It is expected that in a highly networked environment the sheer magnitude of communication traffic could overwhelm the individual soldier. The CLIP exploits real-time neurophysiological and physiological measurements of the human operator in order to create a cognitive state profile, which is used to augment the work environment to improve human-automation joint performance. An experiment showed that the Communications Scheduler enabled higher situation awareness and message comprehension in high workload conditions. Based solely on cognitive state, the system inferred a subject's message comprehension and repeated unattended messages in the majority of cases, without yielding an unacceptably high false alarm rate.

Get full access to this article

View all access options for this article.

References

Broadbent

D. E.

(1958). Perception and Communication. New York: Pergamon.

DuRousseau

D. R.

, (2004). Spatial-Frequency Patterns of Cognition, The AUGCOG Quarterly 1(3):10.

DuRousseau

D. R.

, (2004b) Multimodal Cognitive Assessment System. Final Technical Report, DARPA, DAAH01-03-C-R232.

Freeman

F. G.

Mikulka

P. J.

Prinzel

L. J.

Scerbo

M. W.

(1999). Evaluation of an adaptive automation system using three EEG indices with a visual tracking system. Biological Psychology, 50, 61–76.

Hilburn

Jorna

P. G.

Byrne

E. A.

Parasuraman

(1997). The effect of adaptive air traffic control (ATC) decision aiding on controller mental workload. In Mouloua

Koonce

(Eds.), Human-automation interaction: Research and practice (pp. 84–91). Mahwah, NJ: Erlbaum.

Hoover

Muth

(in press). A Real-Time Index of Vagal Activity. International Journal of Human-Computer Interaction.

Kahneman

(1973). Attention and Effort. Englewood Cliffs, NJ: Prentice-Hall.

Kass

S J

Doyle

Raj

Andrasik

Higgins

(2003, April). Intelligent adaptive automation for safer work environments. In Wallace

J. C.

Chen

, Occupational health and safety: Encompassing personality, emotion, teams, and automation. Symposium conducted at the Society for Industrial and Organizational Psychology 18th Annual Conference, Orlando, FL.

Kramer

A. F.

(1991). Physiological metrics of mental workload: A review of recent progress. In Damos

D. L.

(Ed.), Multiple-Task Performance (pp. 279–328). London: Taylor & Francis.

10.

Mikulka

P. J.

Scerbo

M. W.

Freeman

F. G.

(2002). Effects of a Biocybernetic System on Vigilance Performance. Human Factors, 44(4), 654–664.

11.

Parasuraman

Davies

D. R.

(1984). Varieties of Attention. New York: Academic Press.

12.

Parasuraman

Mouloua

Hilburn

(1999). Adaptive aiding and adaptive task allocation enhance human-machine interaction. In Scerbo

M. W.

Mouloua

(Eds.), Automation technology and human performance: Current research and trends (pp. 129–133). Mahwah, NJ: Erlbaum.

13.

Pashler

(1994) Dual-task interference in simple tasks: Data and theory. Psychological Bulletin, 116, 220–244.

14.

Pope

A. T.

Bogart

E. H.

Bartolome

D. S

(1995). Biocybernetic system validates index of operator engagement in automated task. Biological Psychology, 40, 187–195.

15.

Prinzel

L. J.

III Hadley

Freeman

F. G.

Mikulka

P. J.

(1999). Behavioral, subjective, and psychophysiological correlates of various schedules of short-cycle automation. In Scerbo

Krahl

(Eds.), Automation technology and human performance: Current research and trends. Mahwah, NJ: Lawrence Erlbaum Associates.

16.

Raj

A. K.

Perry

J. F.

Abraham

L. J.

Rupert

A. H.

(2003) Tactile interfaces for decision making support under high workload conditions, Aerospace Medical Association 74th Annual Scientific Meeting, San Antonio, TX.

17.

Raley

Stripling

Schmorrow

Patrey

Kruse

(in press). Augmented Cognition Overview: Improving Information Intake Under Stress. To appear in the Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting, New Orleans, LA.

18.

Sajda

Gerson

Parra

(2003). Spatial Signatures of Visual Object Recognition Events Learned from Single-trial Analysis of EEG, IEEE Engineering in Medicine and Biology Annual Meeting, Cancun, Mexico.

19.

Scott

W. B.

(1999). Automatic GCAS: You can't fly any lower. Aviation Week and Space Technology, February 1, 76–79.

20.

Treisman

A. M.

(1964). Verbal cues, language, and meaning in selective attention. American Journal of Psychology, 77, 206–219.

21.

Wickens

C. D.

Heffley

Kramer

Donchin

(1980) The event-related brain potential as an index of attention allocation in complex displays. Proceedings of the 24th Annual Meeting of the Human Factors Society. Santa Monica, CA, 1980.

22.

Wickens

C. D.

Hollands

J. G.

(2000). Engineering psychology and human performance (Third Edition). Upper Saddle River, NJ: Prentice-Hall Inc.

Closing the Loop of an Adaptive System with Cognitive State

Abstract

Get full access to this article

References