Trust as a Construct for Evaluation of Automated Aids: Past and Future Theory and Research

Abstract

As complex automated aids proliferate in transportation and manufacturing domains, examining human users' trust in such systems gains importance. We review some of the growing literature on trust in automated systems, and outline a program for future studies and theoretical developments. Trust is an intervening variable between automation reliability and use, among other factors. Consistent reliable machine performance can increase trust, and discrete errors can decrease trust. Trust tends to resist change over time. The association between trust and subsequent usage is positive but not clear-cut, and may be mediated by risk and self-confidence. The place of trust in the overall picture of human-automation system performance must be established. The suggested research program accomplishes this by investigating training issues and individual differences, employing new measures, and examining dynamics of trust and usage in automation possessing different reliability in different situations, automation with multiple modes, and adaptive automation.

Get full access to this article

View all access options for this article.

References

Bainbridge

Beishon

Hemming

J.H.

Splaine

(1974). A study of real-time human decision making using a plant simulator. In Edwards

Lees

(Eds.), The Human Operator in Process Control. London: Taylor and Francis.

Barber

(1983). The logic and limits of trust. New Brunswick, NJ: Rutgers University Press.

Billings

C. E.

(1991). Human-centered aircraft automation philosophy: A concept and guidelines (Technical Memo #103885). Moffett Field, CA: NASA Ames Research Center.

Cohen

M.S.

Parasuraman

Freeman

J.T.

(1998). Trust in decision aids: A model and its training implications. Proceedings of the 1998 Command and Control Research and Technology Symposium, Department of Defense C4ISSR Cooperative Research Program.

Hart

S.G.

Staveland

L.E.

(1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Hancock

P.A.

Meshkati

(Eds.), Human mental workload (pp. 139–183). Amsterdam: North-Holland.

Lee

Moray

(1992). Trust, control strategies and allocation of function in human-machine systems. Ergonomics, 35, 1243–1270.

Lee

J.D.

Moray

(1994). Trust, self-confidence, and operators' adaptation to automation. International Journal of Human-Computer Studies, 40, 153–184.

Masalonis

A.J.

Duley

J.A.

Galster

S.M.

Castano

D.J.

Metzger

Parasuraman

(1998). Air traffic controller trust in a conflict probe during Free Flight. Proceedings of the 42nd Annual Meeting of Human Factors and Ergonomics Society, 1607.

Moray

Inagaki

Itoh

(in press). Adaptive automation, trust, and self-confidence in fault management of time-critical tasks. Journal of Experimental Psychology: Applied..

10.

Muir

B.M.

(1994). Trust in automation: Part I. Theoretical issues in the study of trust and human intervention in automated systems. Ergonomics, 37, 1905–1922.

11.

Muir

B.M.

Moray

(1996). Trust in automation: Part II. Experimental studies of trust and human intervention in a process control simulation. Ergonomics, 39, 429–460.

12.

Parasuraman

Bahri

Deaton

J.E.

Morrison

J.G.

Barnes

(1992). Theory and design of adaptive automation in aviation systems. (Progress Report No. NAWCADWAR-92033-60). Washington, DC: Cognitive Science Lab.

13.

Parasuraman

Molloy

Singh

I.L.

(1993). Performance consequences of automation-induced “complacency”. International Journal of Aviation Psychology, 3, 1–23.

14.

Parasuraman

Riley

V.A.

(1997). Humans and auotmation: Use, misuse, disuse, abuse. Human Factors, 39, 230–253.

15.

Rempel

J.K.

Holmes

J.G.

Zanna

M.P.

(1985). Trust in close relationships. Journal of Personality and Social Psychology, 49, 95–112.

16.

Riley

(1994). Human use of automation. Unpublished doctoral dissertation, University of Minnesota, Minneapolis.

17.

Riley

(1996). Operator reliance on automation: Theory and data. In Parasuraman

Mouloua

(Eds.), Automation and human performance: Theory and applications (pp. 19–36). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

18.

Scerbo

M.W.

(1996). Perspectives on adaptive automation. In Parasuraman

Mouloua

(Eds.), Automation and human performance: Theory and applications (pp. 37–53). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

19.

Sheridan

T.B.

(1980). Computer control and human alienation. Technology Review, 10, 61–73.

20.

Sheridan

T.B.

(1992). Telerobotics, automation, and human supervisory control. Cambridge, MA: MIT Press.

21.

Singh

I. L.

Molloy

Parasuraman

(1993). Automation-induced “complacency”: Development of the complacency-potential rating scale. International Journal of Aviation Psychology, 3, 111–121.

22.

Toulmin

(1958). The uses of argument. Cambridge, England: Cambridge University Press.

23.

Tversky

Kahneman

(1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124–1131.

24.

Wickens

C.D.

(1994). Designing for situational awareness and trust in automation. In Proceedings of the IFAC Conference on Integrated Engineering, 171–175. Baden-Baden, Germany: IFAC.

25.

Wickens

C. D.

Mavor

Parasuraman

McGee

(1998). The future of air traffic control: Human operators and automation. Washington, DC: National Academy Press.

26.

Woods

D.D.

(1986). The design of decision aids in the age of “intelligence”. In Proceedings of the 1986 IEEE International Conference on Systems, Man, and Cybernetics, 398–401.