Using Automation to Support Decision Making: Challenges and Training Research Requirements

Abstract

Many of today's complex environments require operators to interact with sophisticated systems that are multi-modal and automated. Despite considerable advancements in systems design, performance is not always optimal. Research suggests that one reason for non-optimal performance may be due to inaccuracies in operators' understanding of how these complex systems work. These inaccuracies may lead to: (a) a bias towards use of automation, (b) over-trusting the automation, or (c) diffusing responsibility to the automation. Unfortunately, few theoretically-derived strategies exist to guide training design that builds an appropriate understanding of how the system works in addition to how to work the system. In this paper we take a training perspective to describe how and why automation may or may not be used to support decision making. Specifically, the paper will briefly: (1) discuss the training problems with human-computer teams, (2) describe a number of theoretical underpinnings for the problem, (3) provide an overview of challenges for addressing the problem, (4) forward two potential research areas that may mediate the challenges, and (5) describe expected payoffs for research in these areas.

Get full access to this article

View all access options for this article.

References

Air Transport Association (1998). Potential knowledge, policy, or training gaps regarding operation of FMS-Generation aircraft: Second Report..

Anca

J. M.

(1995). Steam gauge to glass cockpit: Training strategies for smooth transitioning from B747-200 to B747-400. In Johnston

Fuller

McDonald

(Eds.) Aviation psychology: Training and Selection, Proceedings of the 21^st Conference of the European Association for Aviation Psychology (EAAP)(pp. 291–297), Volume 2. Brookfield, VE: Ashgate.

Bayman

Mayer

R. E.

(1984). Instructional manipulation of users' mental models for electronic calculators. International Journal of Man-Machine Studies, 20, 189–199.

Billings

C. E.

(1997). Aviation automation: The search for a human-centered approach. Mahwah, NJ: Lawrence Erlbaum Associates.

Dwyer

D. J.

Oser

R. L.

Salas

Fowlkes

J. E.

(1999). Performance measurement in distributed environments: Initial results and implications for training. Military Psychology, 11(2), 189–215.

Glaser

(1990, January). The reemergence of learning theory within instructional research. American Psychologist, 45(1), 29–39.

Hopkins

V. D.

Woods

D. D.

(1996). Human factors in air traffic system automation. In Parasuraman

Mouloua

(Eds.). Automation and human performance: Theory and applications (pp. 319–336). Lawrence Erlbaum Associates.

Kieras

D. E.

Bovair

(1986). The acquisition of procedures from text: A production-system analysis of transfer of training. Journal of Memory and Language, 25, 507–524.

Kolodner

J. L.

(1997). Educational implication of analogy: A view from case-based reasoning. American Psychologist, 52(1), 57–66.

10.

Lee

J. D.

Sanquist

T. F.

(1996). Maritime automation. In Parasuraman

Mouloua

(Eds.). Automation and human performance (pp. 365–384). Mahwah, NJ: Erlbaum.

11.

Mayer

R. E.

(1989). Models for understanding. Review of Educational Research, 59(1), pp. 43–64.

12.

Moore

P. J.

Farquharson

Telfer

R. A.

(1996). Automation and human performance in airline pilot training. Mouloua

Koonce

J. M.

(Eds.), Human-automation interaction: Research and practice. Proceedings of the Second Automation Technology and Human Performance Conference, Daytona Beach, FL, LEA.

13.

Norman

D. A.

(1983). Some observations on mental models. In Gentner

Stevens

A. L.

(Eds.), Mental Models (pp. 7–14), Hillsdale, NJ: Erlbaum.

14.

Parasuraman

Riley

(1997). Humans and automation: Use, misuse, disuse, and abuse. Human Factors, 39(2), 230–253.

15.

Pelegrin

Maho

(1995). Pilot age and training performance In Johnston

Fuller

McDonald

(Eds.) Aviation psychology: Training and Selection, Proceedings of the 21st Conference of the European Association for Aviation Psychology (EAAP) (pp. 354–363), Volume 2. Brookfield, VE: Ashgate.

16.

Rouse

W. B.

Cannon-Bowers

J. A.

Salas

(1992). The role of mental models in team performance in complex systems. IEEE Transactions on Systems, Man, and Cybernetics, 22, 1296–1308.

17.

Salas

Cannon-Bower

J. A.

(1997). Methods, tools, and strategies for team training. In Quinones

M. A.

Ehrenstein

(Eds.), Training for a rapidly changing workplace: Applications of psychological research (pp. 249–279). Washington, DC: APA Press.

18.

Salas

Dickinson

T. L.

Converse

S. A.

Tannenbaum

S. I.

(1992). Toward an understanding of team performance and training. In Swezey

R. W.

Salas

(Ed.), Teams: Their training and performance (pp. 3–29). Norwood, NJ: Ablex.

19.

Sarter

N. B.

(1996). Cockpit automation: From quantity to quality, from individual pilot to multiple agents. In Parasuraman

Mouloua

(Eds.). Automation and human performance (pp. 267–280). Mahwah, NJ: Erlbaum.

20.

Sarter

N. B.

Woods

D. D.

(1994). Pilot interaction with cockpit automation II: An experimental study of pilot's model and awareness of the FMS. International Journal of Aviation Psychology, 4(1), 1–28.

21.

Schank

R. C.

(1994). Goal-based scenarios. In Schank

R. C.

Langer

(Eds.), Beliefs, reasoning, and decision making: PsychoLogic in honor of Bob Abelson (pp. 1–32). Hillsdale, NJ: Lawrence Erlbaum Associates.

22.

Sherry

Polson

P. G.

(1999). Shared models of flight management system vertical guidance. International Journal of Aviation Psychology, 9(2), 139–153.

23.

Walley

(1995). Conversion training for commercial pilots. In Johnston

Fuller

McDonald

(Eds.) Aviation psychology: Training and Selection, Proceedings of the 21^st Conference of the European Association for Aviation Psychology (EAAP) (pp. 324–329), Volume 2. Brookfield, VE: Ashgate.

24.

Wickens

C. D.

(1992). Process control and automation. In Wickens

(Ed.), Engineering psychology and human performance (2nd Ed.)(pp. 504–551). New York, NY: Harper Collins.