StimulEye: An intelligent tool for feature extraction and event detection from raw eye gaze data

Abstract

Extraction of eye gaze events is highly dependent on automated powerful software that charges exorbitant prices. The proposed open-source intelligent tool StimulEye helps to detect and classify eye gaze events and analyse various metrics related to these events. The algorithms for eye event detection in use today heavily depend on hand-crafted signal features and thresholding, which are computed from the stream of raw gaze data. These algorithms leave most of their parametric decisions on the end user which might result in ambiguity and inaccuracy. StimulEye uses deep learning techniques to automate eye gaze event detection which neither requires manual decision making nor parametric definitions. StimulEye provides an end to end solution which takes raw streams of data from an eye tracker in text form, analyses these to classify the inputs into the events, namely saccades, fixations, and blinks. It provides the user with insights such as scanpath, fixation duration, radii, etc.

Keywords

Eye tracking fixations saccades scanpath deep learning

Get full access to this article

View all access options for this article.

References

Eye Tracking: The Complete Pocket Guide by Dennis Mahoney, pp. 3–33.

Poole

and e Ball

L.J.

, Eye Tracking in Human-Computer Interaction and Usability Research: Current Status and Future Prospects, Encyclopedia of Human-Computer Interaction, (2005), 211–219.

Harezlak

, & Kasprowski

, Application of eye tracking in medicine: A survey, research issues and challenge, Computerized Medical Imaging and Graphics65 (2017), 176–190. 10.1016/j. compmedimag.2017.04.006

, Xu

, Wang

, Jiang

, Liu

Attention Based Glaucoma Detection: A Large-scale Database and CNN Model, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2019), (pp. 10571–10580).

Goltz

, Grossberg

and Etemadpour

, Exploring simple neural network architectures for eyemovement classification, In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications, (2019), p. 4. ACM.

Punde

P.A.

, Jadhav

M.E.

and Manza

R.R.

, A study of eye tracking technology and its applications, 1st International Conference on Intelligent Systems and Information Management (ICISIM), Aurangabad, 2017, pp. 86–90, doi: 10.1109/ICISIM.2017.8122153.

Zemblys

, Niehorster

D.C.

and Holmqvist

, gazeNet: End-to-end eye-movement event detection with deep neural networks, Behavior Research Methods51(2) (2019), 840–864.

Anusree

and Amudha

, Eye movement Event Detection with Deep Neural Networks, International Conference On Computational Vision and Bio Inspired Computing, Springer, Cham, 2019.

Nyström

and Holmqvist

, An adaptive algorithm for fixation, saccade, and glissade detection in eye tracking data, Behavior Research Methods42(1) (2010).

10.

Zemblys

, Niehorster

D.C.

, Komogortsev

and Holmqvist

, Using machine learning to detect events in eye-tracking data, Behavior research methods50(1) (2018), 160–181

11.

Salvucci

D.D.

and Goldberg

J.H.

, Identifying fixations and saccades in eye-tracking protocols, In Proceedings of the 2000 Symposium on eye tracking research & applications, ETRA ’00 (2000), (pp. 71–78).

12.

Bylinskii

, Borkin

, Kim

, Pfister

and Oliva

, Eye Fixation Metrics for Large Scale Evaluation and Comparison of Information Visualizations, (2017), 235–255. 10.1007/978-3-319-47024-5_14

13.

Tamuly

, Jyotsna

and Amudha

, Deep Learning Model for Image Classification, International ConferenceOnComputational Vision and Bio Inspired Computing, Springer, Cham, 2019.

14.

Singh

and Dr. Singh

, Human Eye Tracking and Related Issues: A Review, International Journal of Scientific and Research Publications, 2012.

15.

Jyotsna

, Amudha

, Rao

and Nayar

, Intelligent Gaze Tracking Approach for Trail Making Test, Journal of Intelligent and Fuzzy systems, 2019.

16.

Wong

E.T.

, Yean

, Hu

, Lee

B.S.

, Liu

and Deepu

, Gaze Estimation Using Residual Neural Network, 2019 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), Kyoto, Japan, 2019.

17.

Samek

, Wiegand

and Müller

K.-R.

, Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models, 2019.

18.

Klambauer

, Unterthiner

, Mayr

and Hochreiter

, Self-normalizing neural networks, In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS’17), 2017.

19.

Mannor

, Peleg

and Rubinstein

, The cross entropy method for classification, In Proceedings of the 22nd international conference on Machine learning, 2005.

20.

Kingma

D.P.

and Ba

, Adam: A method for stochastic optimisation, 2014.

21.

Bhattarai

and Phothisonothai

, Eye-Tracking Based Visualizations and Metrics Analysis for Individual Eye Movement Patterns, 16th International Joint Conference on Computer Science and Software Engineering (JCSSE), Chonburi, Thailand, 2019.