Driving While Interacting With Google Glass: Investigating the Combined Effect of Head-Up Display and Hands-Free Input on Driving Safety and Multitask Performance

Abstract

Objective:

This study evaluated the individual and combined effects of voice (vs. manual) input and head-up (vs. head-down) display in a driving and device interaction task.

Background:

Advances in wearable technology offer new possibilities for in-vehicle interaction but also present new challenges for managing driver attention and regulating device usage in vehicles. This research investigated how driving performance is affected by interface characteristics of devices used for concurrent secondary tasks. A positive impact on driving performance was expected when devices included voice-to-text functionality (reducing demand for visual and manual resources) and a head-up display (HUD) (supporting greater visibility of the driving environment).

Method:

Driver behavior and performance was compared in a texting-while-driving task set during a driving simulation. The texting task was completed with and without voice-to-text using a smartphone and with voice-to-text using Google Glass’s HUD.

Results:

Driving task performance degraded with the addition of the secondary texting task. However, voice-to-text input supported relatively better performance in both driving and texting tasks compared to using manual entry. HUD functionality further improved driving performance compared to conditions using a smartphone and often was not significantly worse than performance without the texting task.

Conclusion:

This study suggests that despite the performance costs of texting-while-driving, voice input methods improve performance over manual entry, and head-up displays may further extend those performance benefits.

Application:

This study can inform designers and potential users of wearable technologies as well as policymakers tasked with regulating the use of these technologies while driving.

Keywords

driver behavior distraction multimodality displays wearable devices dual task time sharing task switching

Get full access to this article

View all access options for this article.

References

Angell

L. S.

Auflick

Austria

P. A.

Kochhar

D. S.

Tijerina

Biever

. . . Kiger

(2006). Driver workload metrics task 2 final report (No. HS-810 635). Washington, DC: National Highway Traffic Safety Administration.

Beckers

N. B.

Schreiner

Bertrand

Reimer

Mehler

Munger

Dobres

(2014). Comparing the demands of destination entry using Google Glass and the Samsung Galaxy S4. Proceedings of the Human Factors and Ergonomics Society 58th Annual Meeting (pp. 2156–2160). Santa Monica, CA: Human Factors and Ergonomics Society.

Boer

E. R.

Ward

N. J.

Manser

M. P.

Yamamura

Kuge

(2005, June). Driver performance assessment with a car following model. Paper presented at the Third International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design, Rockport, ME.

Cousineau

(2005). Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson’s method. Tutorial in Quantitative Methods for Psychology, 1(1), 4–45.

Drews

F. A.

Yazdani

Godfrey

C. N.

Cooper

J. M.

Strayer

D. L.

(2009). Text messaging during simulated driving. Proceedings of the Human Factors and Ergonomics Society 53rd Annual Meeting (pp. 762–770). Santa Monica, CA: Human Factors and Ergonomics Society.

Engström

(2011). Understanding attention selection in driving: From limited capacity to adaptive behaviour (Unpublished doctoral dissertation). Chalmers University, Sweden.

Filtness

A. J.

Lenné

M. G.

Mitsopoulos-Rubens

(2013, September). The impact of interface modality on police officers’ visual behaviour when using an in-vehicle system. Paper presented at the 3rd International Conference on Driver Distraction and Inattention, Gothenburg, Sweden.

Fitch

G. M.

Hanowski

R. J.

Guo

(2015). The risk of a safety-critical event associated with mobile device use in specific driving contexts. Traffic Injury Prevention, 16(2), 124–132.

Fitch

G. M.

Soccolich

S. A.

Guo

McClafferty

Fang

Olson

R. L.

. . . Dingus

T. A.

(2013). The impact of hand-held and hands-free cell phone use on driving performance and safety-critical event risk (No. DOT HS-811 757). Washington, DC: National Highway Traffic Safety Administration.

10.

Flannagan

M. J.

Harrison

A. K.

(1994). The effects of automobile head-up display location on younger and older drivers (UMTRI -94-22). Ann Arbor, MI: The University of Michigan Transportation Research Institute.

11.

Green

(2000). “How long does it take to stop?” Methodological analysis of driver perception-brake times. Transportation Human Factors, 2(3),195–216.

12.

Grier

Wickens

Kaber

Strayer

Boehm-Davis

Trafton

J. G.

John

M. S.

(2008). The red-line of workload: Theory, research, and design. Proceedings of the Human Factors and Ergonomics Society 52nd Annual Meeting (pp. 1204–1208). Santa Monica, CA: Human Factors and Ergonomics Society.

13.

Chaparro

Nguyen

Burge

R. J.

Crandall

Chaparro

Cao

(2014). Texting while driving: Is speech-based text entry less risky than handheld text entry? Accident Analysis & Prevention, 72, 287–295.

14.

Choi

McCarley

J. S.

Chaparro

B. S.

Wang

(2015). Texting while driving using Google Glass™: Promising but not distraction-free. Accident Analysis & Prevention, 81, 218–229.

15.

Ellis

Choi

Wang

(2015). Driving while reading using Google Glass versus using a smartphone: Which is more distracting to driving performance. Paper presented at the Eighth International Driving Symposium on Human Factors in Driving Assessment, Training and Vehicle Design, Salt Lake City, UT.

16.

McCarley

J. S.

Kramer

A. F.

(2014). Lane keeping under cognitive load performance changes and mechanisms. Human Factors, 56, 414–426.

17.

Horrey

W. J.

Wickens

C. D.

(2007). In-vehicle glance duration: Distributions, tails, and model of crash risk. Transportation Research Record: Journal of the Transportation Research Board, 2018(1), 22–28.

18.

Horrey

W. J.

Wickens

C. D.

Consalus

K. P.

(2006). Modeling drivers’ visual attention allocation while interacting with in-vehicle technologies. Journal of Experimental Psychology: Applied, 12, 67–78.

19.

Hosking

S. G.

Young

K. L.

Regan

M. A.

(2009). The effects of text messaging on young drivers. Human Factors, 51, 582–592.

20.

Hurts

Angell

L. S.

Perez

M. A.

(2011). The distracted driver mechanisms, models, and measurement. Reviews of Human Factors and Ergonomics, 7(1), 3–57.

21.

Kahneman

(1973). Attention and effort. Upper Saddle River, NJ: Prentice Hall.

22.

Kiefer

R. J.

(1991). Effect of a head-up versus head-down digital speedometer on visual sampling behavior and speed control performance during daytime automobile driving (SAE Paper No. 910111). Warrendale, PA: Society of Automotive Engineers.

23.

Kiefer

R. J.

Gellatly

A. W.

(1996). Quantifying the consequences of the “eyes-on-road” benefit attributed to head-up displays (SAE Paper No. 960946). Warrendale, PA: Society of Automotive Engineers.

24.

Lee

J. D.

See

K. A.

(2004). Trust in automation: Designing for appropriate reliance. Human Factors, 46, 50–80.

25.

Leveson

N. G.

(2011). Applying systems thinking to analyze and learn from events. Safety Science, 49(1), 55–64.

26.

Liu

Y. C.

Wen

M. H.

(2004). Comparison of head-up display (HUD) vs. head-down display (HDD): Driving performance of commercial vehicle operators in Taiwan. International Journal of Human-Computer Studies, 61(5), 679–697.

27.

Lyngsie

Pederson

M. S.

Stage

Vestergaard

K. F.

(2013). Don’t text while driving: The effect of smartphone text messaging on road safety during simulated driving. Human-Computer Interaction–INTERACT, 2013, 546–563.

28.

Menhour

Lechner

Charara

(2009). Steering control based on a two-level driver model: Experimental validation and robustness tests. Retrieved from http://ieeexplore.ieee.org/document/5280934/?reload=true

29.

National Highway Traffic Safety Administration. (2013). Visual-manual NHTSA driver distraction guidelines for in-vehicle electronic devices (Docket No. NHTSA-2010-0053, Document ID: NHTSA-2010-0053-0060). Washington, DC: National Highway Traffic Safety Administration.

30.

National Highway Traffic Safety Administration. (2014). distraction.gov. Retrieved from http://www.distraction.gov/

31.

Okabayashi

Sakata

Furukawa

Hatada

(1990). A heads-up display performance in automotive use. Society for Information Display, 3, 255–261.

32.

Olson

R. L.

Hanowski

R. J.

Hickman

J. S.

Bocanegra

J. L.

(2009). Driver distraction in commercial vehicle operations (No. FMCSA-RRR-09-042). Washington, DC: U.S. Department of Transportation.

33.

Regan

M. A.

Lee

J. D.

Young

K. L.

(Eds.). (2008). Driver distraction: Theory, effects, and mitigation. Boca Raton, FL: CRC Press.

34.

Riley

(1996). Operator reliance on automation: Theory and data. In Parasuraman

Mouloua

(Eds.), Automation theory and applications (pp. 19–35). Mahwah, NJ: Erlbaum.

35.

Rodriguez Paras

Yang

Tippey

Ferris

T. K.

(2015). Physiological indicators of the cognitive redline. Proceedings of the Human Factors and Ergonomics Society 59th Annual Meeting (pp. 637–641). Santa Monica, CA: Human Factors and Ergonomics Society.

36.

Rosenthal

T. J.

(1999). STISIM drive user’s manual. Hawthorne, CA: Systems Technology.

37.

SAS Institute. (2005). SAS/STAT 9.22 user’s guide: The MIXED procedure. Greenwood Village, CO: Author.

38.

Sawyer

B. D.

Finomore

V. S.

Calvo

A. A.

Hancock

P. A.

(2014). Google Glass: A driver distraction cause or cure? Human Factors, 56, 1307–1321.

39.

Sojourner

R. J.

Antin

J. F.

(1990). The effects of a simulated head-up display speedometer on perceptual task performance. Human Factors, 32, 329–340.

40.

Tsimhoni

Green

(2001). Visual demand of driving and the execution of display-intensive in-vehicle tasks. Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting (pp. 1586–1590). Santa Monica, CA: Human Factors and Ergonomic Society.

41.

Tufano

D. R.

(1997). Automotive HUDs: The overlooked safety issues. Human Factors, 39, 303–311.

42.

Wickens

C. D.

(1980). The structure of attentional resources. In Nickerson

(Ed.), Attention and Performance (pp. 239–257). Hillsdale, NJ: Lawrence Erlbaum.

43.

Wickens

C. D.

(2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomic Science, 3(2), 159–177.

44.

Wickens

C. D.

Horrey

W. J.

(2008). Models of attention, distraction, and highway hazard avoidance. In Regan

M. A.

Lee

J. D.

Young

K. l.

(Eds.), Driver distraction: Theory, effects and mitigation (pp. 249–279). Boca Raton, FL: CRC Press.

45.

Wittmann

Kiss

Gugg

Steffen

Finka

Poppela

Kamiya

(2006). Effects of display position of a visual in-vehicle task on simulated driving. Applied Ergonomics, 37, 187–199.

46.

Yager

C. E.

(2013). Driver safety impacts of voice-to-text mobile applications. Proceedings of the Human Factors and Ergonomics Society 57th Annual Meeting (pp. 1869–1873). Santa Monica, CA: Human Factors and Ergonomics Society.

47.

Yager

Dinakar

Sanagaram

Ferris

(2015). Emergency vehicle operator on-board device distractions (Technical report of the Intelligent Transportation Society of America). Retrieved from http://www.tsag-its.org/media/emergency-vehicle-operator-on-board-device-distractions-revised-report-2-19-15.pdf

48.

Yantis

Egeth

H. E.

(1999). On the distinction between visual salience and stimulus-driven attentional capture. Journal of Experimental Psychology: Human Perception and Performance, 25(3), 661.