This paper addresses theoretical, empirical, and analytical studies pertaining to human use, misuse, disuse, and abuse of automation technology. Use refers to the voluntary activation or disengagement of automation by human operators. Trust, mental workload, and risk can influence automation use, but interactions between factors and large individual differences make prediction of automation use difficult. Misuse refers to over reliance on automation, which can result in failures of monitoring or decision biases. Factors affecting the monitoring of automation include workload, automation reliability and consistency, and the saliency of automation state indicators. Disuse, or the neglect or underutilization of automation, is commonly caused by alarms that activate falsely. This often occurs because the base rate of the condition to be detected is not considered in setting the trade-off between false alarms and omissions. Automation abuse, or the automation of functions by designers and implementation by managers without due regard for the consequences for human performance, tends to define the operator's roles as by-products of the automation. Automation abuse can also promote misuse and disuse of automation by human operators. Understanding the factors associated with each of these aspects of human use of automation can lead to improved system design, effective training methods, and judicious policies and procedures involving automation use.
Get full access to this article
View all access options for this article.
References
1.
Abbott, T. S. (1990). A simulation evaluation of the engine monitoring and control display (NASA Tech. Memorandum 1960). Hampton, VA: NASA Langley Research Center.
2.
Air Transport Association. (1989). National plan to enhance aviation safety through human factors improvements. Washington, DC: Author.
3.
Bainbridge, L. (1983). Ironies of automation. Automatica.19, 775–779.
4.
Bennett, K., & Flach, J. M. (1992). Graphical displays: Implications for divided attention, focused attention, and problem solving. Human Factors, 34, 513–533.
5.
Bessant, J., Levy, P., Ley, C., Smith, S., & Tranfield, D. (1992). Organization design for factory 2000. International Journal of Human Factors in Manufacturing, 2, 95–125.
6.
Billings, C. E. (1991). Human-centered aircraft automation: A concept and guidelines (NASA Tech. Memorandum 103885). Moffett Field, CA: NASA Ames Research Center.
7.
Billings, C. E., & Woods, D. D. (1994). Concerns about adaptive automation in aviation systems. In M. Mouloua & R. Parasuraman (Eds.), Human performance in automated systems: Current research and trends (pp. 264–269). Hillsdale, NJ: Erlbaum.
8.
Bowers, C. A., Oser, R. J., Salas, E., & Cannon-Bowers, J. A. (1996). Team performance in automated systems. In R. Parasuraman & M. Mouloua (Eds.), Automation and human performance: Theory and applications (pp. 243–263). Hillsdale, NJ: Erlbaum.
9.
Byrne, E. A., & Parasuraman, R. (1996). Psychophysiology and adaptive automation. Biological Psychology, 42, 249–268.
10.
Casey, S. (1993). Set phasers on stun. Santa Barbara, CA: Aegean.
11.
Casner, S. (1994). Understanding the determinants of problem solving behavior in a complex environment. Human Factors, 36, 580–596.
12.
Chambers, N., & Nagel, D. C. (1985). Pilots of the future: Human or computer?Communications of the Association for Computing Machinery, 28, 1187–1199.
13.
Corwin, W. H., Funk, H., Levitan, L., & Bloomfield, J. (1993). Flight crew information requirements (Contractor Rep. DTFA- 91-C-00040). Washington, DC: Federal Aviation Administration.
14.
Donald, M. (1991). Origins of the modem mind: Three stages in the evolution of culture and cognition. Cambridge, MA: Harvard University Press.
15.
Duley, J. A., Westerman, S., Molloy, R., & Parasuraman, R. (in press). Effects of display superimposition on monitoring of automated tasks. In Proceedings of the 9th International Symposium on Aviation Psychology. Columbus: Ohio State University.
16.
Edwards, E. (1977). Automation in civil transport aircraft. Applied Ergonomics, 4, 194–198.
17.
Endsley, M. (1996). Automation and situation awareness. In R. Parasuraman & M. Mouloua (Eds.), Automation and human performance: Theory and applications (pp. 163–181). Hillsdale, NJ: Erlbaum.
18.
Erzberger, H. (1992). CTAS: Computer intelligence for air traffic control in the terminal area (NASA Tech. Memorandum 103959). Moffett Field, CA: NASA Ames Research Center.
19.
Farber, E., & Paley, M. (1993, April). Using freeway traffic data to estimate the effectiveness of rear-end collision countermeasures. Paper presented at the Third Annual IVHS America Meeting, Washington, DC.
20.
Federal Aviation Administration. (1990). The national plan for aviation human factors. Washington, DC: Author.
21.
Fitts, P. M. (1951). Human engineering for an effective air navigation and traffic control system. Washington, DC: National Research Council.
22.
Funk, K., Lyall, B., & Riley, V. (1995). Perceived human factors problems of flightdeck automation (Phase I Final Rep.). Corvallis: Oregon State University.
23.
Gerwin, D., & Leung, T. K. (1986). The organizational impacts of flexible manufacturing systems. In T. Lupton (Ed.), Human factors: Man, machines and new technology (pp. 157–170). New York: Springer-Verlag.
24.
Getty, D. J., Swets, J. A., Pickett, R. M., & Gounthier, D. (1995). System operator response to warnings of danger: A laboratory investigation of the effects of the predictive value of a warning on human response time. Journal of Experimental Psychology: Applied, 1, 19–33.
25.
Gonzalez, R. C., & Howington, L. C. (1977). Machine recognition of abnormal behavior in nuclear reactors. IEEE Transactions on Systems, Man and Cybernetics, SMC-7, 717–728.
26.
Grabowski, M., & Wallace, W. A. (1993). An expert system for maritime pilots: Its design and assessment using gaming. Management Science, 39, 1506–1520.
27.
Hancock, P. A. (1996). Teleology for technology. In R. Parasuraman & M. Mouloua (Eds.), Automation and human performance: Theory and applications (pp. 461–497). Hillsdale, NJ: Erlbaum.
28.
Hancock, P. A., & Chignell, M. H. (1989). Intelligent interfaces. Amsterdam: Elsevier.
29.
Hancock, P. A., & Parasuraman, R. (1992). Human factors and safety in the design of intelligent vehicle-highway systems. Journal of Safety Research, 23, 181–198.
30.
Hancock, P. A., Parasuraman, R., & Byrne, E. A. (1996). Driver-centered issues in advanced automation for motor vehicles. In R. Parasuraman & M. Mouloua (Eds.), Automation and human performance: Theory and applications (pp. 337–364). Hillsdale, NJ: Erlbaum.
31.
Harris, W., Hancock, P. A., & Arthur, E. (1993). The effect of task load projection on automation use, performance, and workload. In Proceedings of the 7th International Symposium on Aviation psychology (pp. 890A–890F). Columbus: Ohio State University.
32.
Helmreich, R. L. (1984). Cockpit management attitudes. Human Factors, 26, 583–589.
33.
Hilburn, B., Jorna, P. G. A. M., & Parasuraman, R. (1995). The effect of advanced ATC automation on mental workload and monitoring performance: An empirical investigation in Dutch airspace. In Proceedings of the 8th International Symposium on Aviation Psychology (pp. 1382–1387). Columbus: Ohio State University.
34.
Hopkin, V. D. (1995). Human factors in air-traffic control. London: Taylor & Francis.
35.
IVHS America. (1992). Strategic plan for IVHS in the United States. Washington, DC: Author.
36.
Kirlik, A. (1993). Modeling strategic behavior in human-automation interaction: Why an “aid” can (and should) go unused. Human Factors, 35, 221–242.
37.
Kuchar, J. K., & Hansman, R. J. (1995). A probabilistic methodology for the evaluation of alerting system performance. In Proceedings of the IFAC/IFIP/IFORS/IEA Symposium. Cambridge, MA.
38.
Langer, E. (1989). Mindfulness. Reading, MA: Addison-Wesley.
39.
Lee, J. D., & Moray, N. (1992). Trust, control strategies, and allocation of function in human-machine systems. Ergonomics, 35, 1243–1270.
40.
Lee, J. D., & Moray, N. (1994). Trust, self-confidence, and operators' adaptation to automation. International Journal of Human-Computer Studies, 40, 153–184.
41.
Lewandowsky, S., & Nikolic, D. (1995, April). A connectionist approach to modeling the effects of automation. Paper presented at the 8th International Symposium on Aviation Psychology, Columbus, OH.
42.
Main Commission Aircraft Accident Investigation—WARSAW. (1994). Report on the accident to Airbus A320-211 aircraft in Warsaw on 14 September 1993. Warsaw: Author.
43.
May, P., Molloy, R., & Parasuraman, R. (1993, October). Effects of automation reliability and failure rate on monitoring performance in a multitask environment. Paper presented at the Annual Meeting of the Human Factors Society, Seattle, WA.
44.
McClellan, J. M. (1994, June). Can you trust your autopilot? Flying, 76–83.
45.
McClumpha, A., & James, M. (1994, June). Understanding automated aircraft. In M. Mouloua & R. Parasuraman (Eds.), Human performance in automated systems: Recent research and trends (pp. 314–319). Hillsdale, NJ: Erlbaum.
46.
McDaniel, J. W. (1988). Rules for fighter cockpit automation. In Proceedings of the IEEE National Aerospace and Electronics Conference (pp. 831–838). New York: IEEE.
47.
Ministere de l'Equipement, des Transports et du Tourisme. (1993). Rapport de la Commission d'Enquete sur l'Accident survenu le 20 Janvier 1992 pres du Mont Saite Odile a l/Airbus A. 320 Immatricule F-GGED Exploite par lay Compagnie Air Inter. Paris: Author.
48.
Molloy, R., Deaton, J. E., & Parasuraman, R. (1995). Monitoring performance with the EMACS display in an automated environment. In Proceedings of the 8th International Symposium on Aviation Psychology (pp. 68–73). Columbus, OH.
49.
Molloy, R., & Parasuraman, R. (1994). Automation-induced monitoring inefficiency: The role of display integration and redundant color coding. In M. Mouloua & R. Parasuraman (Eds.), Human performance in automated systems: Current research and trends (pp. 224–228). Hillsdale, NJ: Erlbaum.
50.
Molloy, R., & Parasuraman, R. (1996). Monitoring an automated system for a single failure: Vigilance and task complexity effects. Human Factors, 38, 311–322.
51.
Mosier, K., Heers, S., Skitka, L., & Burdick, M. (1996, March). Patterns in the use of cockpit automation. Paper presented at the 2nd Automation Technology and Human Performance Conference, Cocoa Beach, FL.
52.
Mosier, K., & Skitka, L. J. (1996). Human decision makers and automated decision aids: Made for each other? In R. Parasuraman & M. Mouloua (Eds.), Automation and human performance: Theory and applications (pp. 201–220). Hillsdale, NJ: Erlbaum.
53.
Mosier, K., Skitka, L., Burdick, M., & Heers, S. (1996). Automation bias, accountability, and verification behaviors. In Proceedings of the Human Factors and Ergonomics Society 40th Annual Meeting (pp. 204–208). Santa Monica, CA: Human Factors and Ergonomics Society.
54.
Mosier, K., Skitka, L. J., & Korte, K. J. (1994). Cognitive and social psychological issues in flight crew/automation interaction. In M. Mouloua & R. Parasuraman (Eds.), Human performance in automated systems: Current research and trends (pp. 191–197). Hillsdale, NJ: Erlbaum.
55.
Mouloua, M., & Parasuraman, R. (1994). Human performance in automated systems: Recent research and trends. Hillsdale, NJ: Erlbaum.
56.
Muir, B. M. (1988). Trust between humans and machines, and the design of decision aids. In E. Hollnagel, G. Mancini, & D. D. Woods (Eds.), Cognitive engineering in complex dynamic worlds (pp. 71–83). London: Academic.
57.
National Transportation Safety Board. (1973). Eastern Airlines L-1011, Miami, Florida, 20 December 1972 (Rep. NTSBAAR-73-14). Washington, DC: Author.
58.
National Transportation Safety Board. (1986). China Airlines B-747-SP, 300 NM northwest of San Francisco, 19 February 1985 (Rep. NTSB-AAR-86-03). Washington, DC: Author.
59.
National Transportation Safety Board. (1994). Aircraft accident report: Stall and loss of control on final approach (Rep. NTSB-AAR-94/07). Washington, DC: Author.
60.
National Transportation Safety Board. (1997a). Collision of Washington Metropolitan Transit Authority Train T111 with standing train at Shady Grove Station, near Gaithersburg, MD, January 6, 1996 (Rep. NTSB-ATL-96-MR008). Washington, DC: Author.
61.
National Transportation Safety Board. (1997b). Grounding of the Panamanian passenger ship Royal Majesty on Rose and Crown shoal near Nantucket, Massachusetts, June 10, 1995 (Rep. NTSB/MAR-97-01). Washington, DC: Author.
62.
Nickerson, R. S. (1995). Human interaction with computers and robots. International Journal of Human Factors in Manufacturing, 5, 5–27.
63.
Norman, D. (1990). The problem with automation: Inappropriate feedback and interaction, not over-automation. Proceedings of the Royal Society of London, B237, 585–593.
64.
Palmer, E., & Degani, A. (1991). Electronic checklists: Evaluation of two levels of automation. In Proceedings of the 6th International Symposium on Aviation Psychology (pp. 178–183). Columbus: Ohio State University.
65.
Parasuraman, R. (1993). Effects of adaptive function allocation on human performance. In D. J. Garland & J. A. Wise (Eds.), Human factors and advanced aviation technologies (pp. 147–157). Daytona Beach, FL: Embry-Riddle Aeronautical University Press.
66.
Parasuraman, R., Bahri, T., Deaton, J., Morrison, J., & Barnes, M. (1992). Theory and design of adaptive automation in aviation systems (Progress Rep. NAWCADWAR-92033-60). Warminster, PA: Naval Air Warfare Center, Aircraft Division.
67.
Parasuraman, R., Hancock, P. A., & Olofinboba, O. (1997). Alarm effectiveness in driver-centered collision-warning systems. Ergonomics, 40, 390–399.
68.
Parasuraman, R., Molloy, R., & Singh, I.L. (1993). Performance consequences of automation-induced “complacency.”International Journal of Aviation Psychology, 3, 1–23.
69.
Parasurarnan, R., & Mouloua, M. (Eds.). (1996). Automation and human performance: Theory and applications. Hillsdale, NJ: Erlbaum.
70.
Parasuraman, R., Mouloua, M., & Molloy, R. (1994). Monitoring automation failures in human-machine systems. In M. Mouloua & R. Parasuraman (Eds.), Human performance in automated systems: Current research and trends (pp. 45–49). Hillsdale, NJ: Erlbaum.
71.
Parasuraman, R., Mouloua, M., & Molloy, R. (1996). Effects of adaptive task allocation on monitoring of automated systems. Human Factors, 38, 665–679.
72.
Parasuraman, R., Mouloua, M., Molloy, R., & Hilburn, B. (1996). Monitoring automated systems. In R. Parasuraman & M. Mouloua (Eds.), Automation and human performance: Theory and applications (pp. 91–115). Hillsdale, NJ: Erlbaum.
73.
Phillips, D. (1995, August II). System failure cited in ship grounding. Washington Post, p. A7.
74.
Planzer, N., & Hoffman, M. A. (1995). Advancing free flight through human factors (Workshop Rep.). Washington DC: FAA.
75.
Poset, R. K. (1992). No brakes, no reversers!Air Line Pilot, 61 (4), 28–29.
76.
Radio and Technical Committee on Aeronautics. (1995). Free flight implementation (RTCA Task Force 3 Rep.). Washington, DC: Author.
77.
Rasmussen, J. (1986). Information processing and humanmachine interaction. Amsterdam: North-Holland.
78.
Reason, J. T. (1990). Human error. Cambridge, England: Cambridge University Press.
79.
Riley, V. (1989). A general model of mixed-initiative human-machine systems. In Proceedings of the Human Factors Society 33rd Annual Meeting (pp. 124–128). Santa Monica, CA: Human Factors and Ergonomics Society.
80.
Riley, V. (1994a). Human use of automation. Unpublished doctoral dissertation, University of Minnesota.
81.
Riley, V. (1994b). A theory of operator reliance on automation. In M. Mouloua & R. Parasuraman (Eds.), Human performance in automated systems: Recent research and trends (pp. 8–14). Hillsdale. NJ: Erlbaum.
82.
Riley, V. (1995). What avionics engineers should know about pilots and automation. In Proceedings of the 14th AIAN/IEEE Digital Avionics Systems Conference (pp. 252–257). Cambridge, MA: AIAA.
83.
Riley, V. (1996). Operator reliance on automation: Theory and data. In R. Parasuraman & M. Mouloua (Eds.), Automation and human performance: Theory and applications (pp. 19–35). Hillsdale, NJ: Erlbaum.
84.
Riley, V., Lyall, B., & Wiener, E. (1993). Analytic methods for flight-deck automation design and evaluation. phase two report: Pilot use of automation (Tech. Rep.). Minneapolis, MN: Honeywell Technology Center.
85.
Rouse, W. B. (1988). Adaptive aiding for human/computer controlHuman Factors, 30, 431–438.
86.
Sarter, N. (1996). Cockpit automation: From quantity to quality. from individual pilots to multiple agents. In R. Para suraman & M. Mouloua (Eds.), Automation and human performance: Theory and applications (pp. 267–280). Hillsdale, NJ; Erlbaum.
87.
Sarter, N., & Woods, D. D. (1991). Situation awareness: A critical but ill-defined phenomenon. International Journal of Aviation Psychology, 1, 45–57.
88.
Sarter, N., & Woods, D. D. (1994). Pilot interaction with cockpit automation II: An experimental study of pilots' model and awareness of the flight management system. International Journal of Aviation Psychology, 4, 1–28.
89.
Sarter, N., & Woods, D. D. (1995). “Strong, silent, and out-of the-loop”: Properties of advanced (cockpit) automation and their impact on human-automation interaction (Tech. Rep. CSEL 95-TR-01). Columbus: Ohio State University, Cognitive Systems Engineering Laboratory.
90.
Satchell, P. (1993). Cockpit monitoring and alerting systems. Aldershot, England: Ashgate.
91.
Scerbo, M. S. (1996). Theoretical perspectives on adaptive automation. In R. Parasuraman & M. Mouloua (Eds.), Automation and human performance: Theory and applications (pp. 37–63). Hillsdale, NJ: Erlbaum.
92.
Schank, R. (1984). The cognitive computer.Reading, MA: Addison-Wesley.
93.
Sheridan, T. (1980). Computer control and human alienation. Technology Review, 10, 61–73.
94.
Sheridan, T. (1992). Telerobotics, automation, and supervisory control. Cambridge: MIT Press.
95.
Singh, I. L., Deaton, J. E., & Parasuraman, R. (1993, October). Development of a scale to measure pilot attitudes to cockpit automation. Paper presented at the Annual Meeting of the Human Factors Society, Seattle, WA.
96.
Singh, I. L., Molloy, R., & Parasuraman, R. (1993a). Automation-induced “complacency”: Development of the complacency-potential rating scale. International Journal of Aviation Psychology, 3, 111–121.
97.
Singh, I. L., Molloy, R., & Parasuraman, R. (1993b). Individual differences in monitoring failures of automation. Journal of General Psychology, 120, 357–373.
98.
Singh, I. L., Molloy, R., & Parasuraman, R. (1997). Automation related monitoring inefficiency: The role of display location. International Journal of Human Computer Studies, 46, 17–30.
99.
Smith, M. J., & Carayon, P. (1995). New technology, automation, and work organization. International Journal of Human Factors in Manufacturing, 5, 95–116.
100.
Sorkin, R. D. (1988). Why are people turning off our alarms?Journal of the Acoustical Society of America, 84, 1107–1108.
101.
Sorkin, R. D., Kantowitz, B. H., & Kantowitz, S. C. (1988). Likelihood alarm displays. Human Factors, 30, 445–459.
102.
Spitzer, C. R. (1987). Digital avionics systems. Englewood Cliffs, NJ: Prentice-Hall.
103.
Sun, H., & Riis, J. O. (1994). Organizational, technical, strategic. and managerial issues along the implementation process of advanced manufacturing technologies-A general framework and implementation. International Journal of Human Factors in Manufacturing, 4, 23–36.
104.
Swets, J. A. (1992). The science of choosing the right decision threshold in high-stakes diagnostics. American Psychologist, 47, 522–532.
105.
Thompson, J. M. (1994). Medical decision making and automation. In M. Mouloua & R. Parasuraman (Eds.), Human performance in automated systems: Current research and trends (pp. 68–72). Hillsdale, NJ: Erlbaum.
106.
Tversky, A., & Kahneman, D. (1984). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124–1131.
107.
Vicente, K. J., & Rasmussen, J. (1990). The ecology of human-machine systems II: Mediating “direct perception” in complex work domains. Ecological Psychology, 2, 207–249.
108.
Weick, K. E. (1988). Enacted sense making in crisis situations. Journal of Management Studies, 25, 305–317.
109.
Whitfield, D., Ball, R. G., & Ord, G. (1980). Some human factors aspects of computer-aiding concepts for air traffic controllers. Human Factors, 22, 569–580.
110.
Wickens, C. D. (1992). Engineering psychology and human performance(2nd. ed.). New York: HarperCollins.
111.
Wickens, C. D. (1994). Designing for situation awareness and trust in automation. In Proceedings of the IFAC Conference on Integrated Systems Engineering (pp. 174–179). Baden-Baden, Germany: International Federation on Automatic Control.
112.
Wiener, E. L. (1985). Beyond the sterile cockpit. Human Factors, 27, 75–90.
113.
Wiener, E. L. (1988). Cockpit automation. In E. L. Wiener & D. C. Nagel (Eds.), Human factors in aviation (pp. 433–461). San Diego: Academic.
114.
Wiener, E. L. (1989). Human factors of advanced technology (“glass cockpit”) transport aircraft (Rep. 177528). Moffett Field, CA: NASA Ames Research Center.
115.
Wiener, E. L., & Curry, R. E. (1980). Flight-deck automation: Promises and problems. Ergonomics, 23, 995–1011.
116.
Will, R. P. (1991). True and false dependence on technology: Evaluation with an expert system. Computers in Human Behavior, 7, 171–183.
117.
Woods, D. D. (1996). Decomposing automation: Apparent simplicity, real complexity. In R. Parasuraman & M. Mouloua (Eds.), Automation and human performance: Theory and applications (pp. 3–17). Hillsdale, NJ: Erlbaum.
118.
Woods, D. D., Wise, J., & Hanes, L. (1981). An evaluation of nuclear power plant safety parameter display systems. In Proceedings of the Human Factors Society 25th Annual Meeting (pp. 110–114). Santa Monica, CA: Human Factors and Ergonomics Society.
119.
Yeh, Y.-Y., & Wickens, C. D. (1988). The dissociation of subjective measures of mental workload and performance. Human Factors, 30, 111–120.
120.
Zuboff, S. (1988). In the age of the smart machine: The future of work and power. New York: Basic Books.
