The mixed reality headset, Apple Vision Pro (AVP), features advanced eye- and hand-tracking capabilities and offers two text input methods on a virtual keyboard—Tap Typing (TT) and Gaze + Pinch (GP). Twenty participants completed a text entry task using standardized phrase sets with both methods, followed by a set of questionnaires evaluating perceived usability, subjective workload, eye fatigue, simulator sickness, user experience, and perceived exertion. Objective performance results revealed significantly faster typing speed with TT compared to GP and significantly fewer errors with TT compared to GP. Participants generally preferred TT (n = 15) over GP (n = 5), as well as significant differences in perceived usability, select subjective workload subscales, and user experience ratings. Participant feedback and suggestions are discussed, and implications for future design and research directions are explored.
AdhanomI. B.MacNeilageP.FolmerE. (2023). Eye tracking in virtual reality: A broad review of applications and challenges. Virtual Reality, 27(2), 1481–1505. https://doi.org/10.1007/s10055-022-00738-z
2.
BangorA.KortumP. T.MillerJ. T. (2008). An empirical evaluation of the system usability scale. International Journal of Human-Computer Interaction, 24(6), 574–594. https://doi.org/10.1080/10447310802205776
3.
BienerV.OfekE.PahudM.KristenssonP. O.GrubertJ. (2023). Extended reality for knowledge work in everyday environments. In SimeoneA.WeyersB.BialkovaS.LindemanR. W. (Eds.), Everyday virtual and augmented reality (pp. 21–56). Human–Computer Interaction Series. Springer.
4.
BorgG. (1998). Borg’s perceived exertion and pain scales. Human Kinetics.
5.
BuckinghamG. (2021). Hand tracking for immersive virtual reality: Opportunities and challenges. Frontiers in Virtual Reality, 2, 728461. https://doi.org/10.3389/frvir.2021.728461
6.
DubeT. J.ArifA. S. (2019, July26–31). Text entry in virtual reality: A comprehensive review of the literature [Conference session]. Human-Computer Interaction. Recognition and Interaction Technologies: Thematic Area, HCI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Orlando, FL, Proceedings, Part II 21 (pp. 419–437). Springer International Publishing. https://doi.org/10.1007/978-3-030-22643-5_33
7.
HartS. G. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in Psychology, 52, 139–183. https://doi.org/10.1016/S0166-4115(08)62386-9
8.
HuangZ.ZhuG.DuanX.WangR.LiY.ZhangS.WangZ. (2024). Measuring eye-tracking accuracy and its impact on usability in Apple Vision Pro. arXiv preprint, arXiv:2406.00255. https://doi.org/10.48550/arXiv.2406.00255v2
9.
KennedyR. S.LaneN. E.BerbaumK. S.LilienthalM. G. (1993). Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. International Journal of Aviation Psychology, 3(3), 203–220. https://doi.org/10.1207/s15327108ijap0303_3
10.
KernF.NieblingF.LatoschikM. E. (2023). Text input for non-stationary XR workspaces: Investigating tap and word-gesture keyboards in virtual and augmented reality. IEEE Transactions on Visualization and Computer Graphics, 29(5), 2658–2669. https://doi.org/10.1109/TVCG.2023.3247098
11.
MacKenzieI. S.SoukoreffR. W. (2003). Phrase sets for evaluating text entry techniques [Conference session]. CHI’03 Extended Abstracts on Human Factors in Computing Systems, (pp. 754–755). https://doi.org/10.1145/765891.765971
12.
MutasimA. K.BatmazA. U.StuerzlingerW. (2021). Pinch, click, or dwell: Comparing different selection techniques for eye-gaze-based pointing in virtual reality [Conference session]. ETRA ’21 Short Papers: ACM Symposium on Eye Tracking Research and Applications (pp. 1–7). https://doi.org/10.1145/3448018.3457998
13.
PfeufferK.MayerB.MardanbegiD.GellersenH. (2017). Gaze + pinch interaction in virtual reality [Symposium]. Proceedings of the 5th Symposium on Spatial User Interaction (pp. 99–108). https://doi.org/10.1145/3131277.3132180
14.
RickelE.HarrisK.MandileE.PagliariA.DerbyJ. L.ChaparroB. S. (2022). Typing in mid air: Assessing one-and two-handed text input methods of the microsoft hololens 2 [Conference session]. International Conference on Human-Computer Interaction (pp. 357–368). https://doi.org/10.1007/978-3-031-05939-1_24
15.
RosenbergL. B. (2022). Augmented reality: Reflections at thirty years [Conference session]. Proceedings of the Future Technologies Conference (FTC) 2021, 1 (pp. 1–11). https://doi.org/10.1007/978-3-030-89906-6_1
16.
SchreppM.HinderksA.ThomaschewskiJ. (2017). Design and evaluation of a short version of the User Experience Questionnaire (UEQ-S). International Journal of Interactive Multimedia and Artificial Intelligence, 4(6), 103–108. https://doi.org/10.9781/ijimai.2017.09.001
17.
Technavio. (2025). Augmented reality and virtual reality market to grow by USD 442.9 billion (2024-2028), rising demand for AR and VR tech drives growth, report highlights AI impact - Technavio. PR Newswire. https://tinyurl.com/technavioarvrmarke
