Significant advancements of eye-tracking technology in extended reality (XR) head-mounted displays have increased the interest in gaze-based interactions. The benefits of gaze interaction proved that it could be a suitable alternative for hand-based interactions when users face situations where they must maintain their position due to mobility impairment. This study aims to assess the user experience of the gaze-based interaction, compared to hand-based interaction, in two movement conditions of static and dynamic. Twenty-four participants took part in this study, and their experience was evaluated in terms of perceived workload, usability, and performance. The results show that gaze-based interactions significantly outperform the hand-based interaction in terms of perceived workload and usability in case of limited mobility. Also, the user performance is significantly higher in gaze-based modes under situational impairment. The findings of this study can be used for designing XR interfaces considering the situation in which the task is performed.
Get full access to this article
View all access options for this article.
References
1.
ArdinyH.KhanmirzaE. (2018). The role of ar and vr technologies in education developments: opportunities and challenges. In 2018 6th rsi international conference on robotics and mechatronics (icrom) (pp. 482–487).
2.
BiswasP.LangdonP.UmadikarJ.KittusamiS.PrashantS. (2014). How interface adaptation for physical impairment can help able bodied users in situational impairment. In Inclusive designing (pp. 49–58). Springer.
3.
ChoiS. H.ParkK.-B.RohD. H.LeeJ. Y.MohammedM.GhasemiY.JeongH. (2022). An integrated mixed reality system for safety-aware human-robot collaboration using deep learning and digital twin generation. Robotics and Computer-Integrated Manufacturing, 73, 102258.
4.
DVJ.SalujaK. S.BiswasP. (2018). Gaze controlled interface for limited mobility environment. In Proceedings of the 2018 acm conference companion publication on designing interactive systems (pp. 319–322).
5.
GhasemiY.JeongH.ChoiS. H.ParkK.-B.LeeJ. Y. (2022). Deep learning-based object detection in augmented reality: A systematic review. Computers in Industry, 139, 103661.
6.
GhasemiY.SinghA.KimM.JohnsonA.JeongH. (2021). Effects of head-locked augmented reality on user’s performance and perceived workload. In Proceedings of the human factors and ergonomics society annual meeting (Vol. 65, pp. 1094–1098).
7.
HeH.SheY.XiahouJ.YaoJ.LiJ.HongQ.JiY. (2018). Real-time eye-gaze based interaction for human intention prediction and emotion analysis. In Proceedings of computer graphics international 2018 (pp. 185–194).
8.
HellerF.VanackenD.GeurtsE.LuytenK. (2020). Impact of situational impairment on interaction with wearable displays. In 22nd international conference on human-computer interaction with mobile devices and services (pp. 1–5).
9.
HosseiniM.HamidiH. R.KermanshahaniS. (2020). The impacts of situational impairment on touch gestures in public spaces: Walking in sunlight. Computers & Electrical Engineering, 84, 106617.
10.
KarlssonP.AllsopA.Dee-PriceB.-J.WallenM. (2018). Eye-gaze control technology for children, adolescents and adults with cerebral palsy with significant physical disability: Findings from a systematic review. Developmental neurorehabilitation, 21(8), 497–505.
11.
KimJ.HaJ. (2021). User experience in vr fashion product shopping: Focusing on tangible interactions. Applied Sciences, 11(13), 6170.
12.
KumarM.PaepckeA.WinogradT. (2007). Eyepoint: practical pointing and selection using gaze and keyboard. In Proceedings of the sigchi conference on human factors in computing systems (pp. 421–430).
13.
LeeK. (2012). Augmented reality in education and training. TechTrends, 56(2), 13–21.
14.
MajarantaP.BullingA. (2014). Eye tracking and eye-based human–computer interaction. In Advances in physiological computing (pp. 39–65). Springer.
15.
MiniotasD.ŠpakovO.TugoyI.MacKenzieI. S. (2005). Extending the limits for gaze pointing through the use of speech. Information Technology and Control, 34(3).
16.
MutasimA. K.BatmazA. U.StuerzlingerW. (2021). Pinch, click, or dwell: Comparing different selection techniques for eye-gaze-based pointing in virtual reality. In Acm symposium on eye tracking research and applications (pp. 1–7).
17.
NizamS. M.AbidinR. Z.HashimN. C.LamM. C.ArshadH.MajidN. (2018). A review of multimodal interaction technique in augmented reality environment. Int. J. Adv. Sci. Eng. Inf. Technol, 8(4-2), 1460.
18.
ParkK.-B.ChoiS. H.LeeJ. Y.GhasemiY.MohammedM.JeongH. (2021). Hands-free human–robot interaction using multimodal gestures and deep learning in wearable mixed reality. IEEE Access, 9, 55448–55464.
19.
SarsenbayevaZ.van BerkelN.LuoC.KostakosV.GoncalvesJ. (2017). Challenges of situational impairments during interaction with mobile devices. In Proceedings of the 29th australian conference on computer-human interaction (pp. 477–481).
20.
SinghA.GhasemiY.JeongH.KimM.JohnsonA. (2021). A comparative evaluation of the wearable augmented reality-based data presentation interface and traditional methods for data entry tasks. International Journal of Industrial Ergonomics, 86, 103190.
21.
WangZ.WangH.YuH.LuF. (2021). Interaction with gaze, gesture, and speech in a flexibly configurable augmented reality system. IEEE Transactions on Human-Machine Systems, 51(5), 524–534.
22.
ZhangG.HansenJ. P.MinakataK.AlapetiteA.WangZ. (2019). Eye-gaze-controlled telepresence robots for people with motor disabilities. In 2019 14th acm/ieee international conference on human-robot interaction (hri) (pp. 574–575).
