Past studies using the distribution of eye fixations as an indicator of mental workload are limited to simulations and laboratory tasks. Hence, this assessment strategy has not yet been proven useful in real- world settings. In order to bridge this gap, in this study eye movements of a group of individuals were recorded while driving a car in a suburban road. Drivers’ scanpaths during driving and during driving while performing mundane secondary tasks were compared in this study. A more grouped pattern of fixations was expected in the dual-task condition than in the driving-only condition. As expected, results showed the effectiveness the spatiotemporal distribution of fixations in correctly discriminating between task load conditions, therefore indicating its usefulness for assessing mental workload also in complex real-world tasks.
Get full access to this article
View all access options for this article.
References
1.
Al GhalayiniM.AntounJ.MoacdiehN. M. (2018). Too much or too little? Investigating the usability of high and low data displays of the same electronic medical record. Health Informatics Journal, 1-16. doi: 10.1177/1460458218813725
2.
AmroucheS.GollanB.FerschaA.HeftbergerJ. (2018). Activity segmentation and identification based on eye gaze features. In Proceedings of the 11th Pervasive Technologies Related to Assistive Environments Conference (pp. 75-82). Corfù, Greece. doi: 10.1145/3197768.3197775
3.
CallanD. J. (1998). Eye movement relationships to excessive performance error in aviation. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 42(15), 1132-1136. doi: 10.1177/154193129804201516
4.
CamilliM.NacchiaR.TerenziM.Di NoceraF. (2008). ASTEF: A simple tool for examining fixations. Behavior research methods, 40(2), 373-382. doi:10.3758/BRM.40.2.373
5.
CamilliM.TerenziM.Di NoceraF. (2007). Concurrent validity of an ocular measure of mental workload. In de WaardD.HockeyG. R. J.NickelP.BrookhuisK. A. (Eds.), Human factors issues in complex system performance (pp. 117–129). Maastricht: Shaker.
6.
CamilliM.TerenziM.Di NoceraF. (2008). Effects of temporal and spatial demands on the distribution of eye fixations. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 52(18), 1248-1251. doi:10.1177/154193120805201820
7.
ClarkP. J.EvansF. C. (1954). Distance to nearest neighbor as a measure of spatial relationships in populations. Ecology, 35, 445-453. doi: 10.2307/1931034
8.
CoyneJ. T.SibleyC.SherwoodS.ForoughiC. K.OlsonT.VormE. (2017). Assessing Workload with Low Cost Eye Tracking During a Supervisory Control Task. In: SchmorrowD.C. FidopiastisC. (Eds.) Augmented Cognition. Neurocognition and Machine Learning. AC 2017. Lecture Notes in Computer Science, vol. 10284 (pp. 139–147). Springer, Cham. doi: 10.1007/978-3-319-58628-1_12
9.
DaviesA.VigoM.HarperS.JayC. (2016). The visualisation of eye-tracking scanpaths: what can they tell us about how clinicians view electrocardiograms?. In 2016 IEEE Second Workshop on Eye Tracking and Visualization (ETVIS) (pp. 79-83). IEEE.
10.
de GreefT.LafeberH.van OostendorpH.LindenbergJ. (2009). Eye movement as indicators of mental workload to trigger adaptive automation. In the 5th International Conference on Foundations of Augmented Cognition (pp. 219-228). Springer, Berlin, Heidelberg. doi:10.1007/978-3-642-02812-0_26
11.
Di NoceraF.CamilliM.TerenziM. (2006). Using the distribution of eye fixations to assess pilots' mental workload. In Proceedings of theHuman Factors and Ergonomics Society Annual Meeting, 50(1), 63-65. doi: 10.1177/154193120605000114.
12.
Di NoceraF.CamilliM.TerenziM. (2007). A random glance at the flight deck: Pilots' scanning strategies and the real-time assessment of mental workload. Journal of Cognitive Engineering and Decision Making1(3), 271-285, doi: 10.1518/155534307X255627
13.
Di NoceraF.MastrangeloS.ColonnaS. P.SteinhageA.BaldaufM.KatariaA. (2016). Mental workload assessment using eye-tracking glasses in a simulated maritime scenario. In de WaardD.BrookhuisK.A.ToffettiA.StuiverA.WeikertC.CoelhoD.ManzeyD.ÜnalA.B.RöttgerS.MeratN. (Eds.) (2016). Proceedings of the Human Factors and Ergonomics Society Europe Chapter 2015 Annual Conference. ISSN 2333-4959 (online). Available from http://hfeseurope.org.
14.
Di NoceraF.RanvaudR.PasqualiV. (2015). Spatial pattern of eye fixations and evidence of ultradian rhythms in aircraft pilots. Aerospace Medicine and Human Performance, 86(7), 647-651, doi:10.3357/AMHP.4275.2015
15.
Di NoceraF.TerenziM.CamilliM. (2006). Another look at scanpath: Distance to nearest neighbour as a measure of mental workload. In Waardde D.BrookhuisK. A.ToffettiA. (Eds.), Developments in human factors in transportation, design, and evaluation (pp. 295–303). Maastricht, Netherlands: Shaker Publishing.
16.
FindlayJ. M.KapoulaZ. (1992). Scrutinization, spatial attention, and the spatial programming of saccadic eye movements. The Quarterly Journal of Experimental Psychology, 45A, 633-647. doi: 10.1080/14640749208401336
17.
FittsP. M.JonesR. E.MiltonJ. L. (1950). Eye Movements of Aircraft Pilots during Instrument-landing Approaches. Aeronautical Engineering Review, 9(2), 24–29.
18.
GoldbergJ. H.KotvalX. P. (1999). Computer interface evaluation using eye movements: methods and constructs. International Journal of Industrial Ergonomics, 24(6), 631-645. doi:10.1016/S0169-8141(98)00068-7
19.
HarblukJ. L.NoyY. I.EizenmannM. (2002). Impact of cognitive distraction on driver visual behavior and vehicle control. Transport Canada TP# 13889E.
20.
HarrisR. L.GloverB. L.SpadyA. A. (1986). Analytic techniques of pilot scanning behavior and their application (Technical Paper No. 2525). Hampton, VA: NASA Langley Research Center.
21.
KatohZ. (1997). Saccade amplitude as a discriminator of flight types. Aviation, Space, and Environmental Medicine, 68(3), 205-208.
22.
KrebsM. J.WingertJ. W.CunninghamT. (1977). Exploration of an Oculometer-Based Model of Pilot Workload (Report CR-145153): National Aeronautics and Space Administration.
23.
KruizingaA.MulderB.de WaardD. (2006). Eye scan patterns in a simulated ambulance dispatcher's task. In de WaardD.BrookhuisK. A.ToffettiA. (Eds.), Developments in human factors in transportation, design, and evaluation (pp. 305–317). Maastricht, Netherlands: Shaker Publishing.
24.
LatorellaK.HardenJ. W. (2015). Flight Deck Interval Management Avionics: Eye-Tracking Analysis. 18th International Symposium on Aviation Psychology, 500-505.
25.
MaggiP.RicciardiO.Di NoceraF. (2019). Ocular Indicators of Mental Workload: A Comparison of Scanpath Entropy and Fixations Clustering. In: LongoL.LevaM. (Eds.) Human Mental Workload: Models and Applications. H-WORKLOAD 2019. Communications in Computer and Information Science, vol 1107 (pp. 205-212). Springer, Cham. doi:10.1007/978-3-030-32423-0_13
26.
MayJ. G.KennedyR. S.WilliamsM. C.DunlapW. P.BrannanJ. R. (1990). Eye movement indices of mental workload. Acta psychologica, 75(1), 75-89. doi: 10.1016/0001-6918(90)90067-P
27.
MoacdiehN.SarterN. (2015). Data density and poor organization: analyzing the performance and Attentional effects of two aspects of display clutter. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59(1), 1336-1340. doi:10.1177/1541931215591221
28.
MoacdiehN.SarterN. (2017). The effects of data density, display organization, and stress on search performance: An eye tracking study of clutter. IEEE Transactions on Human-Machine Systems, 47(6), 886-895.
29.
MoffittK. (1980). Evaluation of the fixation duration in visual search. Attention, Perception, & Psychophysics27(4), 370-372. doi: 10.3758/BF03206127
30.
RaynerK. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 134(3), 372–422. doi: 10.1037/0033-2909.124.3.372
31.
RecarteM. A.NunesL. (2002). Mental load and loss of control over speed in real driving.: Towards a theory of attentional speed control. Transportation Research Part F: Traffic Psychology and Behaviour, 5(2), 111-122. doi: 10.1016/S1369-8478(02)00010-4
32.
SalvucciD. D.GoldbergJ. H. (2000). Identifying fixations and saccades in eye-tracking protocols. In Proceedings of the 2000 symposium on Eye tracking research & applications, 71-78. New York: ACM Press. doi: 10.1145/355017.355028
33.
ToleJ. R.StephensA. T.HarrisR. L.EphrathA. R. (1982). Visual scanning behavior and mental workload in aircraft pilots. Aviation, Space, and Environmental Medicine, 53, 54-61.
34.
Van OrdenK. F.LimbertW.MakeigS.JungT. P. (2001). Eye activity correlates of workload during a visuospatial memory task. Human factors, 43(1), 111-121. doi: 10.1518/001872001775992570
35.
WolfE.MartinezM.RoitbergA.StiefelhagenR.DemlB. (2018). Estimating mental load in passive and active tasks from pupil and gaze changes using bayesian surprise. In Proceedings of the Workshop on Modeling Cognitive Processes from Multimodal Data, 1-6. doi:10.1145/3279810.3279852
36.
YarbusA. (1967). Eye movements and vision. New York, Plenum Press.
