Modeling Driver Takeover Intention in Automated Vehicles With Attention-Based CNN Algorithm

Abstract

In highly and fully automated vehicles (AV), drivers could divert their attention to non-driving-related activities. Drivers may also take over AVs if they do not trust the way AVs drive in specific driving scenarios. Existing models have been developed to predict drivers’ takeover performance in responding to takeover requests initiated by AVs in semi-AVs. However, few models predicted driver-initiated takeover behavior in highly and fully AVs. The present study develops an attention-based multiple-input Convolutional Neural Network (CNN) to predict drivers’ takeover intention in fully AVs. The results indicated that the developed model successfully predicted takeover intentions of drivers with a precision of 0.982 and an F1-Score of.989, which were found to be substantially higher than other machine learning algorithms. The developed CNN model could be applied in improving the driving algorithms of the AV by considering drivers’ driving styles to reduce drivers’ unnecessary takeover behaviors.

Get full access to this article

View all access options for this article.

References

Braunagel

Rosenstiel

Kasneci

(2017). Ready for take-over? A new driver assistance system for an automated classification of driver takeover readiness. IEEE Intelligent Transportation Systems Magazine,9(4), 10–22.

Deo

Trivedi

M. M.

(2018). Looking at the driver/rider in autonomous vehicles to predict take-over readiness. Retrieved from http://arxiv.org/abs/1811.06047.

Zhou

Pulver

E. M.

Tilbury

D. M.

Robert

L. P.

Pradhan

A. K.

Yang

X. J.

(2020). Predicting driver takeover performance in conditionally automated driving. Accident; Analysis and Prevention, 148(105748), 105748

Grese

J. M.

Pasareanu

Pakdamanian

(2021). Formal analysis of a neural network predictor inShared-control autonomous driving. AIAA Scitech 2021 Forum. Reston, Virginia: American Institute of Aeronautics and Astronautics.

SAE, (2018) Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles -SAE international. (J3016B). Retrieved March 16, 2021, from Sae.org website: https://www.sae.org/standards/content/j3016_201806/

Jianhao

Jing

Longqiang

Hanzhang Wanzhong . (2019). Control oriented prediction of driver brake intention and intensity using a composite machine learning approach. Energies,12(13), 2483.

Khosla

Teterwak

Wang

Sarna

Tian

Isola

Krishnan

(2020). Supervised Contrastive Learning. Retrieved from http://arxiv.org/abs/2004.11362.

Krahé

Fenske

(2002), Predicting aggressive driving behavior: The role of macho personality, age, and power of car. Aggr. Behav., 28: 21-29.

Lee

J. D.

Liu

S.-Y.

Domeyer

DinparastDjadid

(2021). Assessing drivers’ trust of automated vehicle driving styles with a two-part mixed model of intervention tendency and magnitude. Human Factors,63(2), 197–209.

10.

Lotz

Weissenberger

(2019). Predicting take-over times of truck drivers in conditional autonomous driving. In Advances in Intelligent Systems and Computing (pp. 329–338). Cham: Springer International Publishing.

11.

Zhang

(2021). Drivers trust, acceptance, and takeover behaviors in fully automated vehicles: Effects of automated driving styles and driver’s driving styles. Accident Analysis & Prevention, 159, 106238.

12.

Pakdamanian

Sheng

Baee

Heo

Kraus

Feng

(2020). DeepTake: Prediction of driver takeover behavior using multimodal data. Retrieved from http://arxiv.org/abs/2012.15441

13.

Price

M. A.

Venkatraman

Gibson

Lee

Mutlu

(2016). Psychophysics of trust in vehicle control algorithms (No. 2016-010144). SAE Technical paper.

14.

Kato

et al., “Autoware on Board: Enabling Autonomous Vehicles with Embedded Systems,” 2018 ACM/IEEE 9th International Conference on Cyber-Physical Systems (ICCPS), 2018, pp. 287-296.