The Impact of Automation Conditions on Reliance Dynamics and Decision-Making

Abstract

The decision process of engaging or disengaging automation has been termed reliance on automation, and it has been widely analyzed as a summary measure of automation usage rather than a dynamic measure. We provide a framework for defining temporal reliance dynamics and apply it to a data-set from a previous study. Our findings show that (1) the higher the reliability of an automated system, the larger the reliance over time; and (2) more workload created by the automation type does not significantly affect the operators’ reliance dynamics in high-reliability systems, but it does produce greater reliance in low-reliability systems. Furthermore, on average, operators with low performance make fewer decision changes and prefer to stick to their decision of using automation even if it is not performing well. Operators with high performance, on average, have a higher frequency of decision change, and therefore, their automation usage periods are shorter.

Get full access to this article

View all access options for this article.

References

Chiou

E. K.

Lee

J. D.

(2021). Trusting Automation: Designing for Responsivity and Resilience. Human Factors, (April). https://doi.org/10.1177/00187208211009995

Drnec

Metcalfe

J. S.

(2016). Paradigm development for identifying and validating indicators of trust in automation in the operational environment of human automation integration. In Schmorrow

D. D.

Fidopiastis

C. M.

(Eds.), Foundations of augmented cognition: Neuroergonomics and operational neuroscience (pp. 157–167). Springer International Publishing.

Dzindolet

M. T.

Peterson

S. A.

Pomranky

R. A.

Pierce

L. G.

Beck

H. P.

(2003). The role of trust in automation reliance. International Journal of Human Computer Studies, 58(6), 697–718. https://doi.org/10.1016/S1071-5819(03)00038-7

Ezer

Fisk

A. D.

Rogers

W. A.

(2007). Reliance on automation as a function of expectation of reliability, cost of verification, and age. Proceedings of the Human Factors and Ergonomics Society, 1, 6–10. https://doi.org/10.1177/154193120705100102

Gao

Lee

J. D.

(2006). Extending the decision field theory to model operators’ reliance on automation in supervisory control situations. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans, 36, 943–959. https://doi.org/10.1109/TSMCA.2005.855783

Gremillion

G. M.

Metcalfe

J. S.

Marathe

A. R.

Paul

V. J.

Christensen

Drnec

Haynes

Atwater

(2016). Analysis of trust in autonomy for convoy operations. In George

Dutta

A. K.

Islam

M. S.

(Eds.), Micro-and nanotechnology sensors, systems, and applications viii (pp. 356–365). SPIE. https://doi.org/10.1117/12.2224009

Guznov

Lyons

Nelson

Woolley

(2016). The effects of automation error types on operators’ trust and reliance. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9740(1), 116–124. https://doi.org/10.1007/978-3-319-39907-2_11

Lee

Moray

(1992). Trust, control strategies and allocation of function in human-machine systems. Ergonomics, 35(10), 1243–1270. https://doi.org/10.1080/00140139208967392

Neubauer

Gremillion

Perelman

B. S.

La Fleur

Metcalfe

J. S.

Schaefer

K. E.

(2020). Analysis of facial expressions explain affective state and trust-based decisions during interaction with autonomy. In Ahram

Karwowski

Vergnano

Leali

Taiar

(Eds.), Intelligent human systems integration 2020 (pp. 999–1006). Springer International Publishing.

10.

Parasuraman

(1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39, 230–253.

11.

Rodriguez

Bustamante

Landfair

Magaldino

Demir

Amazeen

P. G.

Metcalfe

J. S.

Huang

Kang

(2021). Dynamics of trust in automation and interactive decision making during driving simulation tasks. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 65(1), 786–790. https://doi.org/10.1177/1071181321651288

12.

Ross

J. M.

Szalma

J. L.

Hancock

P. A.

Barnett

J. S.

Taylor

(2008). The effect of automation reliability on user automation trust and reliance in a search-and-rescue scenario. Proceedings of the Human Factors and Ergonomics Society, 2, 1340–1344. https://doi.org/10.1177/154193120805201908

13.

Shladover

S. E.

(2021). ‘self-driving’ cars begin to emerge from a cloud of hype. https://www.scientificamerican.com/article/self-driving-carsbegin-to-emerge-from-a-cloud-of-hype/

14.

Wang

Jamieson

G. A.

Hollands

J. G.

(2009). Trust and reliance on an automated combat identification system. Human Factors, 51(3), 281–291. https://doi.org/10.1177/0018720809338842