Head-Up Display Graphic Warning to Support Collision Avoidance: Effect of Graphic Animation and Border on Driving Behavior and Eye Movement Pattern

Abstract

Several studies have determined the positive effect of head-up display (HUD) graphic warning to support collision avoidance. However, the visual complexity of the graphic warning may overburden the driver. Design principles and empirical evidence suggest that animation and border designs may increase visual saliency and reduce the visual complexity of graphic warnings. This study aimed to examine the effects of animation (within-subject factors: animated/non-animated) and border (within-subject factors: with/without border) on drivers’ attention and driving performance. Thirty drivers (19 females) experienced five warning conditions (the no-warning condition was the baseline condition) in simulated driving conditions. The results showed the positive effects of animation and border designs on the visual detection time (animation: 25.64% reduction; border: 6.73% reduction) and attention allocation strategies (animation: 9.53% less dwell time on the warning; border: 6.62% less dwell time on the warning) when compared with the original HUD warning. We only observed a positive effect of borders on brake reaction time (17.14% reduction). However, the positive effect of the border design on brake reaction time was only observed in the non-animated warning condition, and not in the animated warning condition. A limitation of the study is that the results were generated from young and inexperienced drivers, and they should be generalized to other driver groups only with caution. Overall, we recommend using non-animated warnings with borders in conditions that require fast reactions, and animated warnings with borders in conditions that require a superior attention strategy.

Keywords

pedestrians bicycles human factors human factors of vehicles advanced driver assistance systems driver behavior driver performance

Get full access to this article

View all access options for this article.

References

WHO. Road Traffic Injuries. 2022. https://www.who.int/news-room/fact-sheets/detail/road-traffic-injuries. Accessed July 20, 2022.

ITF. Road Safety Annual Report 2021: The Impact of Covid-19. OECD Publishing, Paris, 2021. https://www.itf-oecd.org/sites/default/files/docs/irtad-road-safety-annual-report-2021.pdf.

Smiley

Brookhuis

Alcohol, Drugs and Traffic Safety. Road Users and Traffic Safety. Van Gorcum & Comp BV, Assen, Netherlands, 1987.

Winkler

Kazazi

Vollrath

How to Warn Drivers in Various Safety-Critical Situations—Different Strategies, Different Reactions. Accident Analysis & Prevention, Vol. 117, 2018, pp. 410–426.

Naujoks

Neukum

Specificity and Timing of Advisory Warnings Based on Cooperative Perception. In Mensch & Computer Workshopband ( Butz

Schlichter

Koch

, eds.), De Gruyter, Munich, 2014, pp. 229–238.

Lundqvist

L. M.

Eriksson

Age, Cognitive Load, and Multimodal Effects on Driver Response to Directional Warning. Applied Ergonomics, Vol. 76, 2019, pp. 147–154.

Chang

S. H.

Lin

C. Y.

Hsu

C. C.

Fung

C. P.

Hwang

J. R.

The Effect of a Collision Warning System on the Driving Performance of Young Drivers at Intersections. Transportation Research Part F: Traffic Psychology and Behaviour, Vol. 12, No 5, 2009, pp. 371–380.

Abe

Richardson

Alarm Timing, Trust and Driver Expectation for Forward Collision Warning Systems. Applied Ergonomics, Vol. 37, No. 5, 2006, pp. 577–586.

Tan

H. S.

Huang

DGPS-Based Vehicle-to-Vehicle Cooperative Collision Warning: Engineering Feasibility Viewpoints. IEEE Transactions on Intelligent Transportation Systems, Vol. 7, No. 4, 2006, pp. 415–428.

10.

Noy

Y. I.

Lemoine

T. L.

Klachan

Burns

P. C.

Task Interruptability and Duration as Measures of Visual Distraction. Applied Ergonomics, Vol. 35, No. 3, 2004, pp. 207–213.

11.

Gabbard

J. L.

Fitch

G. M.

Kim

Behind the Glass: Driver Challenges and Opportunities for AR Automotive Applications. Proceedings of the IEEE, Vol. 102, No. 2, 2014, pp. 124–136.

12.

Charissis

Papanastasiou

Vlachos

Interface Development for Early Notification Warning System: Full Windshield Head-Up Display Case Study. In Human-Computer Interaction Interacting in Various Application Domains ( Jacko

J. A.

, ed.), Springer, Berlin, Heidelberg, 2009, pp. 683–692.

13.

Yang

Shi

Zhang

Wang

Zhang

Wan

Head-Up Display Graphic Warning System Facilitates Simulated Driving Performance. International Journal of Human–Computer Interaction, Vol. 35, No. 9, 2019, pp. 796–803.

14.

Hajiseyedjavadi

Zhang

Agrawal

Knodler

Fisher

Samuel

Effectiveness of Visual Warnings on Young Drivers Hazard Anticipation and Hazard Mitigation Abilities. Accident Analysis & Prevention, Vol. 116, 2018, pp. 41–52.

15.

Häuslschmid

Osterwald

Lang

Butz

Augmenting the Driver’s View with Peripheral Information on a Windshield Display. Proc., 20th International Conference on Intelligent User Interfaces (IUI ’15), Association for Computing Machinery, New York, 2015, pp. 311–321. https://doi.org/10.1145/2678025.2701393.

16.

Liu

Y. C.

Wen

M. H.

Comparison of Head-Up Display (HUD) vs. Head-Down Display (HDD): Driving Performance of Commercial Vehicle Operators in Taiwan. International Journal of Human-Computer Studies, Vol. 61, No. 5, 2004, pp. 679–697.

17.

Smith

Streeter

Burnett

Gabbard

J. L.

Visual Search Tasks: The Effects of Head-Up Displays on Driving and Task Performance. Proc., 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’15), Association for Computing Machinery, New York, 2015, pp. 80–87. https://doi.org/10.1145/2799250.2799291.

18.

Bolton

Burnett

Large

D. R.

An Investigation of Augmented Reality Presentations of Landmark-Based Navigation Using a Head-Up Display. Proc., 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI ’15), Association for Computing Machinery, New York, 2015, pp. 56–63. https://doi.org/10.1145/2799250.2799253.

19.

Horrey

W. J.

Wickens

C. D.

Driving and Side Task Performance: The Effects of Display Clutter, Separation, and Modality. Human Factors: The Journal of the Human Factors and Ergonomics Society, Vol. 46, No. 4, 2004, pp. 611–624.

20.

Guo

Zhao

Wang

Jiang

Analyzing Drivers’ Attitude towards HUD System Using a Stated Preference Survey. Advances in Mechanical Engineering, Vol. 6, 2014, p. 380647.

21.

Schwarz

Fastenmeier

Augmented Reality Warnings in Vehicles: Effects of Modality and Specificity on Effectiveness. Accident Analysis & Prevention, Vol. 101, 2017, pp. 55–66.

22.

Wogalter

M. S.

Communication-Human Information Processing (C-HIP) Model. In Forensic Human Factors and Ergonomics ( Wogalter

M. S.

, ed.), CRC Press, Boca Raton, FL, 2018, pp. 33–49.

23.

Endsley

M. R.

Toward a Theory of Situation Awareness in Dynamic Systems. Human Factors: The Journal of the Human Factors and Ergonomics Society, Vol. 37, No. 1, 1995, pp. 32–64.

24.

Fricke

Thüring

Complementary Audio-Visual Collision Warnings. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 53, No. 23, 2009, pp. 1815–1819.

25.

Yang

Shi

Kang

Zhang

Effect of Warning Graphics Location on Driving Performance: An Eye Movement Study. International Journal of Human–Computer Interaction, Vol. 36, No. 12, 2020, pp. 1–11.

26.

Kiefer

R. J.

LeBlanc

Palmer

M. D.

Salinger

Deering

R. K.

Shulman

Development and Validation of Functional Definitions and Evaluation Procedures for Collision Warning/Avoidance Systems. Report No.: DOT HS 808 964. August 1999. https://rosap.ntl.bts.gov/view/dot/2319. Accessed July 20, 2022.

27.

Lerner

N. D.

Dekker

Steinberg

G. V.

Huey

R. W.

Comsis Corporation. Inappropriate Alarm Rates and Driver Annoyance. Report No.: DOT HS 808 533. February 1996. https://rosap.ntl.bts.gov/view/dot/13303. Accessed July 20, 2022.

28.

Wang

Gan

Liu

Yang

Effect of Mapping Characteristic on Audiovisual Warning: Evidence from a Simulated Driving Study. Applied Ergonomics, Vol. 99, 2022, p. 103638.

29.

Faraday

Sutcliffe

Multimedia: Design for the “Moment.”

Proc., 5th ACM International Conference on Multimedia, Association for Computing Machinery, New York, 1997, pp. 183–192.

30.

Rashid

Wogalter

Effects of Warning Border Color, Width, and Design on Perceived Effectiveness. In Advances in Occupational Ergonomics and Safety II ( Das

Karwowski

, eds.), IOS Press and Ohmsha, Louisville, KY, 1997, pp. 455–456.

31.

Wogalter

M. S.

Conzola

V. C.

Smith-Jackson

T. L.

Research-Based Guidelines for Warning Design and Evaluation. Applied Ergonomics, Vol. 33, No. 3, 2002, pp. 219–230.

32.

Wogalter

M. S.

Conzola

V. C.

Using Technology to Facilitate the Design and Delivery of Warnings. International Journal of Systems Science, November 26, 2010. https://www.tandfonline.com/doi/abs/10.1080/00207720210133651. Accessed September 7, 2021.

33.

Young

S. L.

Increasing the Noticeability of Warnings: Effects of Pictorial, Color, Signal Icon and Border. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 1991, pp. 580–584. https://doi.org/10.1518/107118191786754662.

34.

Campbell

J. L.

Richard

C. M.

Brown

J. L.

McCallum

Crash Warning System Interfaces: Human Factors Insights and Lessons Learned. Report No.: HS 810 697. National Highway Traffic Safety Administration, Washington, January 2007.

35.

Young

S. L.

Increasing the Noticeability of Warnings: Effects of Pictorial, Color, Signal Icon and Border. Proceedings of the Human Factors Society Annual Meeting, Vol. 35, No. 9, 1991, pp. 580–584.

36.

Kraft

A. K.

Maag

Baumann

Comparing Dynamic and Static Illustration of an HMI for Cooperative Driving. Accident Analysis & Prevention, Vol. 144, 2020, p. 105682.

37.

Bederson

B. B.

Boltman

Does Animation Help Users Build Mental Maps of Spatial Information?

Proc. IEEE Symposium on Information Visualization (InfoVis’99), IEEE, New York, 1999, pp. 28–35.

38.

Boucheix

J. M.

Lowe

R. K.

Putri

D. K.

Groff

Cueing Animations: Dynamic Signaling Aids Information Extraction and Comprehension. Learning and Instruction, Vol. 25, 2013, pp. 71–84.

39.

Rieber

L. P.

Kini

A. S.

Theoretical Foundations of Instructional Applications of Computer-Generated Animated Visuals. Journal of Computer-Based Instruction, Vol. 18, No. 3, 1991, pp. 83–88.

40.

Pratt

Radulescu

P. V.

Guo

R. M.

Abrams

R. A.

It’s Alive! Animate Motion Captures Visual Attention. Psychological Science, Vol. 21, No. 11, 2010, pp. 1724–1730.

41.

Cian

Krishna

Elder

R. S.

A Sign of Things to Come: Behavioral Change through Dynamic Iconography. The Journal of Consumer Research, Vol. 41, No. 6, 2015, pp. 1426–1446.

42.

Chang

B. W.

Ungar

Animation: From Cartoons to the User Interface. Proc., 6th Annual ACM Symposium on User interface software and technology, Association for Computing Machinery, New York, 1993, pp. 45–55.

43.

Höffler

T. N.

Leutner

Instructional Animation versus Static Pictures: A Meta-Analysis. Learning and Instruction, Vol. 17, No. 6, 2007, pp. 722–738.

44.

Cheng

S. Y.

Doshi

Trivedi

M. M.

Active Heads-Up Display Based Speed Compliance Aid for Driver Assistance: A Novel Interface and Comparative Experimental Studies. Proc., IEEE Intelligent Vehicles Symposium, IEEE, New York, 2007, pp. 594–599.

45.

Jeihani

Banerjee

Ahangari

Brown

D. D.

The Potential Effects of Composition and Structure of Dynamic Message Sign Messages on Driver Behavior Using a Driving Simulator. August 2018. https://trid.trb.org/view/1563607. Accessed April 19, 2021.

46.

Wagemans

Elder

J. H.

Kubovy

Palmer

S. E.

Peterson

M. A.

Singh

von der Heydt

A Century of Gestalt Psychology in Visual Perception: I. Perceptual Grouping and Figure–Ground Organization. Psychological Bulletin, Vol. 138, No. 6, 2012, pp. 1172–1217.

47.

Zielinska

O. A.

Wogalter

M. S.

Mayhorn

C. B.

A Perceptual Analysis of Standard Safety, Fluorescent, and Neon Colors. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 58, No. 1, 2014, pp. 1879–1883.

48.

Adams

A. S.

Edworthy

Quantifying and Predicting the Effects of Basic Text Display Variables on the Perceived Urgency of Warning Labels: Tradeoffs Involving Font Size, Border Weight and Colour. Ergonomics, Vol. 38, No. 11, 1995, pp. 2221–2237.

49.

Skinner

N. P.

LaPlumm

T. T.

Bullough

J. D.

Warning Light Flash Frequency as a Method for Visual Communication to Drivers. Transportation Research Record: Journal of the Transportation Research Board, 2021. 2675: 88–93.

50.

Wang

M. J.

Y. C.

Chen

How Can We Design 3D Auditory Interfaces Which Enhance Traffic Safety for Chinese Drivers?

Proc., 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Association for Computing Machinery, New York, 2012, pp. 77–83.

51.

Graham

Use of Auditory Icons as Emergency Warnings: Evaluation within a Vehicle Collision Avoidance Application. Ergonomics, Vol. 42, No. 9, 1999, pp. 1233–1248.

52.

Nees

M. A.

Helbein

Porter

Speech Auditory Alerts Promote Memory for Alerted Events in a Video-Simulated Self-Driving Car Ride. Human Factors: The Journal of the Human Factors and Ergonomics Society, Vol. 58, No. 3, 2016, pp. 416–426.

53.

Lee

J. H.

Spence

Assessing the Benefits of Multimodal Feedback on Dual-Task Performance under Demanding Conditions. September 12008. https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2008.18. Accessed January 4, 2021.

54.

Wan

Zhang

The Effect of Lead Time of Collision Warning Messages on Driver Performance. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 58, No. 1, 2014, pp. 2088–2092.

55.

Yan

Zhang

The Influence of In-Vehicle Speech Warning Timing on Drivers’ Collision Avoidance Performance at Signalized Intersections. Transportation Research Part C: Emerging Technologies, Vol. 51, 2015, pp. 231–242.

56.

Inhoff

A. W.

Two Stages of Word Processing During Eye Fixations in the Reading of Prose. Journal of Verbal Learning and Verbal Behavior, Vol. 23, No. 5, 1984, pp. 612–624.

57.

Rayner

Castelhano

Eye Movements. Scholarpedia, Vol. 2, No. 10, 2007, p. 3649.

58.

Naujoks

Kiesel

Neukum

Cooperative Warning Systems: The Impact of False and Unnecessary Alarms on Drivers’ Compliance. Accident Analysis & Prevention, Vol. 97, 2016, pp. 162–175.

59.

Wang

Generalized Estimating Equations in Longitudinal Data Analysis: A Review and Recent Developments. Advances in Statistics, Vol. 2014, 2014, p. e303728.

60.

Reinolsmann

Alhajyaseen

Brijs

Pirdavani

Hussain

Brijs

Investigating the Impact of a Novel Active Gap Metering Signalization Strategy on Driver Behavior at Highway Merging Sections. Transportation Research Part F: Traffic Psychology and Behaviour, Vol. 78, 2021, pp. 42–57.

61.

Boucart

Lenoble

Quettelart

Szaffarczyk

Despretz

Thorpe

S. J.

Finding Faces, Animals, and Vehicles in Far Peripheral Vision. Journal of Vision, Vol. 16, No. 2, 2016, p. 10.

62.

Fademrecht

Bülthoff

de la Rosa

Action Recognition in the Visual Periphery. Journal of Vision, Vol. 16, No. 3, 2016, p. 33.

63.

Strasburger

Rentschler

Jüttner

Peripheral Vision and Pattern Recognition: A Review. Journal of Vision, Vol. 11, No. 5, 2011, p. 13.

64.

Moore

C. M.

Egeth

Perception without Attention: Evidence of Grouping under Conditions of Inattention. Journal of Experimental Psychology: Human Perception and Performance, Vol. 23, No. 2, 1997, pp. 339–352.

65.

Nygård

G. E.

Looy

T. V.

Wagemans

The Influence of Orientation Jitter and Motion on Contour Saliency and Object Identification. Vision Research, Vol. 49, No. 20, 2009, pp. 2475–2484.

66.

Castellotti

Montagnini

Del Viva

M. M.

Early Visual Saliency Based on Isolated Optimal Features. Frontiers in Neuroscience, Vol. 15, 2021, p. 483.

67.

Orquin

J. L.

Lagerkvist

C. J.

Effects of Salience Are Both Short- and Long-Lived. Acta Psychologica, Vol. 160, 2015, pp. 69–76.

68.

Galley

Betz

Biniossek

Fixation Durations: Why Are They So Highly Variable? In Advances in Visual Perception Research ( Heinen

, ed.), Nova Science, New York, NY, 2015, pp. 83–106.

69.

Lyu

Deng

Xie

Duan

A Field Operational Test in China: Exploring the Effect of an Advanced Driver Assistance System on Driving Performance and Braking Behavior. Transportation Research Part F: Traffic Psychology and Behaviour, Vol. 65, 2019, pp. 730–747.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

3.96 MB