Evaluation of Driver Reaction to Disengagement of Advanced Driver Assistance System with Different Warning Systems While Driving Under Various Distractions

Abstract

Advanced driver assistance systems (ADAS) as a growing technology are expected to improve drivers’ performance by carrying out some of the drivers’ tasks and utilizing driver monitoring and warning systems to maintain their awareness. In this study, drivers’ reactions to the disengagement of ADAS and the effectiveness of steering wheel and face tracking warning systems were evaluated using driving simulation. The study was designed as a mixed design experiment to compare the effects of different types of driver monitoring and warning systems on driver response time, when drivers were driving under audio-, visual-, or no distraction. Data from 60 drivers were collected from the driving simulator experiments. In all experimental scenarios, the participant started driving on a long, straight highway segment and activated an ADAS, which was disengaged at the 11th min into the experiment without the driver’s knowledge. The driver’s response to the disengagement was collected and analyzed. A two-way mixed analysis of variance showed that the warning systems and distractions together affected drivers’ response times significantly. Moreover, post hoc test results showed that under the no distraction condition, the mean response time was lower when the face tracker alert was in use compared with no alert, and the response time was significantly lower when drivers were under audio distraction compared with visual or no distraction.

Keywords

human factors advanced driver assistance systems distraction driver attitudes driver behavior driver performance

Get full access to this article

View all access options for this article.

References

Cai

Saad

Abdel-Aty

Yuan

Lee

Safety Impact of Weaving Distance on Freeway Facilities with Managed Lanes Using Both Microscopic Traffic and Driving Simulations. Transportation Research Record: Journal of the Transportation Research Board, 2018. 2672: 130–141.

Motor Vehicle Crashes. Injury Facts. https://injuryfacts.nsc.org/motor-vehicle/overview/introduction/. Accessed June 5, 2022.

Kihara

Hasegawa

Takeda

Sato

Akamatsu

Kitazaki

Age-Related Differences in Effects of Non-Driving Related Tasks on Takeover Performance in ADAS. Journal of Safety Research, Vol. 72, 2020, pp. 231–238. https://doi.org/10.1016/j.jsr.2019.12.019.

DeGuzman

C. A.

Donmez

Knowledge of and Trust in Advanced Driver Assistance Systems. Accident Analysis & Prevention, Vol. 156, 2021, p. 106121. https://doi.org/10.1016/j.aap.2021.106121.

Noble

A. M.

Miles

Perez

M. A.

Guo

Klauer

S. G.

Evaluating Driver Eye Glance Behavior and Secondary Task Engagement While Using Driving Automation Systems. Accident Analysis & Prevention, Vol. 151, 2021, p. 105959. https://doi.org/10.1016/j.aap.2020.105959.

Dixit

V. V.

Chand

Nair

D. J.

Autonomous Vehicles: Disengagements, Accidents and Reaction Times. PLoS One, Vol. 11, No. 12, 2016, p. e0168054. https://doi.org/10.1371/journal.pone.0168054.

Inagaki

Itoh

Human’s Overtrust in and Overreliance on Advanced Driver Assistance Systems: A Theoretical Framework. International Journal of Vehicular Technology, Vol. 2013, 2013. https://doi.org/10.1155/2013/951762.

Khoda Bakhshi

A. K.

Ahmed

M. M.

Driving Simulator Trajectory-Level Analysis of Truck Drivers’ Behavioral Alteration in Connected Vehicles Environment Under Fog with Complex Roadway Geometry. Transportation Research Record: Journal of the Transportation Research Board, 2022, 2676: 435–451.

Sigari

M. H.

Fathy

Soryani

A Driver Face Monitoring System for Fatigue and Distraction Detection. International Journal of Vehicular Technology, Vol. 2013, 2013, pp. 1–11. https://doi.org/10.1155/2013/263983

10.

On-Road Automated Driving (ORAD) Committee. Taxonomy and Definitions for Terms Related to On-Road Motor Vehicle Automated Driving Systems. SAE International, 2014.

11.

Rudin-Brown

C. M.

Parker

H. A.

Behavioural Adaptation to Adaptive Cruise Control (ACC): Implications for Preventive Strategies. Transportation Research Part F: Traffic Psychology and Behaviour, Vol. 7, No. 2, 2004, pp. 59–76. https://doi.org/10.1016/j.trf.2004.02.001.

12.

Llaneras

R. E.

Salinger

Green

C. A.

Human Factors Issues Associated with Limited Ability Autonomous Driving Systems: Drivers’ Allocation of Visual Attention to the Forward Roadway. Presented at In Driving Assessment Conference, University of Iowa, 2013.

13.

Lin

Zhang

An Interview Study Exploring Tesla Drivers’ Behavioural Adaptation, Applied Ergonomics, Vol, 72, 2018, pp. 37–47. https://doi:10.1016/j.apergo.2018.04.006.

14.

Reagan

I. J.

Cicchino

J. B.

Kidd

D. G.

Driver Acceptance of Partial Automation After a Brief Exposure. Transportation Research Part F: Traffic Psychology and Behavior, Vol. 68, 2020, pp. 1–14. https://doi.org/10.1016/j.trf.2019.11.015.

15.

Louw

Markkula

Boer

Madigan

Carsten

Merat

Coming Back into the Loop: Drivers’ Perceptual-Motor Performance in Critical Events After Automated Driving. Accident Analysis & Prevention, Vol. 108, 2017, pp. 9–18. https://doi.org/10.1016/j.trc.2017.01.001.

16.

Gaspar

J. G.

Brown

T. L.

Matters of State: Examining the Effectiveness of Lane Departure Warnings as a Function of Driver Distraction. Transportation Research Part F: Traffic Psychology and Behavior, Vol. 71, 2020, pp. 1–7. https://doi.org/10.1016/j.trf.2020.03.009.

17.

Morales-Alvarez

Sipele

Léberon

Tadjine

H. H.

Olaverri-Monreal

Automated Driving: A Literature Review of the Take Over Request in Conditional Automation. Electronics, Vol. 9, No. 12, 2020, p. 2087.

18.

Olaverri-Monreal

Hasan

A. E.

Bulut

Körber

Bengler

Impact of In-Vehicle Displays Location Preferences on Drivers’ Performance and Gaze. IEEE Transactions on Intelligent Transportation Systems, Vol. 15, 2014, pp. 1770–1780.

19.

Lee

J. D.

Gore

B. F.

Campbell

J. L.

Display Alternatives for In-Vehicle Warning and Sign Information: Message Style, Location, and Modality. Transportation Human Factors, Vol. 1, No. 4, 1999, pp. 347–375.

20.

Olaverri-Monreal

Bengler

K. J.

Impact of Cultural Diversity on the Menu Structure Design of Driver Information Systems: A Cross-Cultural Study. Proc., 2011 IEEE Intelligent Vehicles Symposium (IV), Baden, Germany, June 5–9, 2011, pp. 107–112.

21.

Olaverri-Monreal

Lehsing

Trübswetter

Schepp

C. A.

Bengler

In-Vehicle Displays: Driving Information Prioritization and Visualization. Proc., 2013 IEEE Intelligent Vehicles Symposium (IV), Gold Coast, Australia, June 23–26, 2013, pp. 660–665.

22.

Wittmann

Kiss

Gugg

Steffen

Fink

Pöppel

Kamiya

Effects of Display Position of a Visual In-Vehicle Task on Simulated Driving. Applied Ergonomics, Vol. 37, 2006, pp. 187–199.

23.

Koesdwiady

Soua

Karray

Kamel

M. S.

Recent Trends in Driver Safety Monitoring Systems: State of the Art and Challenges. IEEE Transactions on Vehicular Technology, Vol. 66, No. 6, 2016, pp. 4550–4563.

24.

Yekhshatyan

Lee

J. D.

Changes in the Correlation Between Eye and Steering Movements Indicate Driver Distraction. IEEE Transactions on Intelligent Transportation Systems, Vol. 14, No. 1, 2012, pp. 136–145.

25.

Ahlstrom

Kircher

A Gaze-Based Driver Distraction Warning System and Its Effect on Visual Behavior. IEEE Transactions on Intelligent Transportation Systems, Vol. 14, No. 2, 2013, pp. 965–973.

26.

Gallahan

S. L.

Golzar

G. F.

Jain

A. P.

Samay

A. E.

Trerotola

T. J.

Weisskopf

J. G.

Lau

Detecting and Mitigating Driver Distraction with Motion Capture Technology: Distracted Driving Warning System. Proc., 2013 IEEE Systems and Information Engineering Design Symposium, Charlottesville, Virginia, IEEE, New York, April 2013, pp. 76–81.

27.

Fernández

Usamentiaga

Carús

J. L.

Casado

Driver Distraction Using Visual-Based Sensors and Algorithms. Sensors, Vol. 16, No. 11, 2016, p. 1805.

28.

Sandström

Lampsijärvi

Holmström

Maconi

Ahmadzai

Meriläinen

Hæggström

Forsman

Detecting Lane Departures from Steering Wheel Signal. Accident Analysis & Prevention, Vol. 99, 2017, pp. 272–278.

29.

McDonald

A. D.

Schwarz

Lee

J. D.

Brown

T. L.

Real-Time Detection of Drowsiness Related Lane Departures Using Steering Wheel Angle. Proc., Human Factors and Ergonomics Society Annual Meeting, Vol. 56, No. 1, Sage, Los Angeles, CA, September 2012, pp. 2201–2205.

30.

Kountouriotis

G. K.

Spyridakos

Carsten

O. M.

Merat

Identifying Cognitive Distraction Using Steering Wheel Reversal Rates. Accident Analysis & Prevention, Vol. 96, 2016, pp. 39–45.

31.

Horberry

Mulvihill

Fitzharris

Lawrence

Lenné

Kuo

Wood

Human-Centered Design for an In-Vehicle Truck Driver Fatigue and Distraction Warning System. IEEE Transactions on Intelligent Transportation Systems, Vol. 23, No. 6, 2021, pp. 5350–5359.

32.

Bassani

Catani

Hazoor

Hoxha

Lioi

Portera

Tefa

Do Driver Monitoring Technologies Improve the Driving Behaviour of Distracted Drivers? A Simulation Study to Assess the Impact of an Auditory Driver Distraction Warning Device on Driving Performance. Transportation Research Part F: Traffic Psychology and Behaviour, Vol. 95, 2023, pp. 239–250. https://doi.org/10.1016/j.trf.2023.04.013.

33.

Yang

Kim

J. H.

, The Effect of Visual Stimulus on Advanced Driver Assistance Systems in a Real Driving. Proc., IIE Annual Conference, Institute of Industrial and Systems Engineers (IISE), Pittsburgh, PA, 2017, pp. 1544–1549.

34.

Morando

Gershon

Mehler

Reimer

A Model for Naturalistic Glance Behavior Around Tesla Autopilot Disengagements. Accident Analysis & Prevention, Vol. 161, 2021, p. 106348. https://doi.org/10.1016/j.aap.2021.106348.

35.

Victor

T. W.

Tivesten

Gustavsson

Johansson

Sangberg

Ljung Aust

Automation Expectation Mismatch: Incorrect Prediction Despite Eyes on Threat and Hands on Wheel. Human Factors, Vol. 60, No. 8, 2018, pp. 1095–1116. https://doi:10.1177/0018720818788164.

36.

Kaber

D. B.

Liang

Zhang

Rogers

M. L.

Gangakhedkar

Driver Performance Effects of Simultaneous Visual and Cognitive Distraction and Adaptation Behavior. Transportation Research Part F: Traffic Psychology and Behaviour, Vol. 15, No. 5, 2012, pp. 491–501. https://doi.org/10.1016/j.trf.2012.05.004.

37.

Haque

M. M.

Washington

The Impact of Mobile Phone Distraction on the Braking Behaviour of Young Drivers: A Hazard-Based Duration Model. Transportation Research Part C: Emerging Technologies, Vol. 50, 2015, pp. 13–27. https://doi.org/10.1016/j.trc.2014.07.011.

38.

Realtime Driving Simulator. https://www.faac.com/realtime-technologies/products/rds-modular-driving-simulator/.

39.

Karthaus

Wascher

Getzmann

Distraction in the Driving Simulator: An Event-Related Potential (ERP) Study with Young, Middle-Aged, and Older Drivers. Safety, Vol. 7, No. 2, 2021, p. 36.

40.

Droździel

Tarkowski

Rybicka

Wrona

Drivers’ Reaction Time Research in the Conditions in the Real Traffic. Open Engineering, Vol. 10, No. 1, 2020, pp. 35–47. https://doi.org/10.1515/eng-2020-0004.

41.

American Association of State Highway and Transportation Officials (AASHTO). A Policy on Geometric Design of Highways and Streets, 7th ed. AASHTO, Washington, D.C., 2018.

42.

Lerner

N. D.

Huey

R. W.

McGee

H. W.

Sullivan

Older Driver Perception–Reaction Time for Intersection Sight Distance and Object Detection, Volume I: Final Report. FHWA-RD-93-168. FHWA, McLean, VA, 1995.

43.

R Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2021. https://www.R-project.org/. Accessed May 2022.

44.

Kassambara

rstatix: Pipe-Friendly Framework for Basic Statistical Tests. R Package Version 0.7.0. https://CRAN.R-project.org/package=rstatix. Accessed May 2022.

45.

Wickham

Averick

Bryan

Chang

McGowan

L. D. A.

François

Grolemund

, et al. Welcome to the Tidyverse. Journal of Open Source Software, Vol. 4, No. 43, 2019, p. 1686. https://doi.org/10.21105/joss.01686.

46.

Wang

Suga

Nacpil

E. J. C.

Yang

Nakano

Effect of Adaptive and Fixed Shared Steering Control on Distracted Driver Behavior. arXiv, 2021. https://doi.org/10.48550/arXiv.2106.03364.

47.

Welz

Voelter-Mahlknecht

Große-Siestrup

Preuß

The Influence of Different Auditory Stimuli on Attentiveness and Responsiveness in Road Traffic in Simulated Traffic Situations. International Journal of Environmental Research and Public Health, Vol. 17, No. 24, 2020, p. 9226. https://doi.org/10.3390/ijerph17249226.