Past research has shown that text input methods must be quick, efficient, and involve little to no learning in order for them to be accepted in a consumer market. The Microsoft HoloLens is a mixed reality head-mounted display (HMD) that requires gestures or a physical clicker for interaction, including text entry. In this study, we investigated performance, perceived usability, and workload of these text input methods. Participants were able to type only 5.41WPM with the gesture method, gave it a poor usability score. The clicker method resulted in a WPM rate of 6.58, was given an “OK” usability score, and lower perceived exertion scores in the bicep and index finger. This study demonstrates the need for further research to develop more optimal text entry methods for MR environments.
Get full access to this article
View all access options for this article.
References
1.
AhnS.HeoS.LeeG. (2017, October). Typing on a Smartwatch for Smart Glasses. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces, Brighton, United Kingdom.
2.
BorgG. (1998). Borg’s Perceived Exertion And Pain Scales. Champaign, IL: Human Kinetics.
3.
BangorA.KortumP. T.MillerJ. T. (2009). Determining what individual SUS scores mean: adding an adjective rating scale. Journal of Usability Studies, 4(3), 114-123.
4.
BrookeJ. (1996). SUS-A quick and dirty usability scale. Usability evaluation in industry, 189(194), 4-7.
5.
GrubertJ.WitzaniL.OfekE.PahudM.KranzM.KristenssonP. O. (2018, March). Text Entry in Immersive Head-Mounted Display-based Virtual Reality using Standard Keyboards. Proceedings of the 2018 IEEE Conference on Virtual Reality and 3D User Interfaces, Reutlingen, Germany.
6.
HartS. G.StavelandL. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in Psychology, 52, 139–183.
7.
KnierimP.SchwindV.FeitA. M.NieuwenhuizenF.HenzeN. (2018, April). Physical Keyboards in Virtual Reality: Analysis of Typing Performance and Effects of Avatar Hands. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montréal, QC, Canada.
8.
LeeL. H.LamK. Y.YauY. P.BraudT.HuiP. (2019, March). HIBEY: Hide the keyboard in augmented reality. Paper presented at the 17th annual meeting of the IEEE International Conference on Pervasive Computing and Communications, Kyoto, Japan.
9.
MacKenzieI. S.SoukoreffR. W. (2003, April). Phrase Sets for Evaluating Text Entry Techniques. In CHI’03 extended abstracts on Human factors in computing systems, 754-755.
10.
PerrinetJ.PañedaX. G.CabreroS.MelendiD.GarcíaR.García. (2011). Evaluation of Virtual Keyboards for Interactive Digital Television Applications. International Journal of Human-Computer Interaction27(8), 703-728.
11.
RuanS.WobbrockJ. O.LiouK.NgA.LandayJ. (2016). Speech is 3x faster than typing for English and Mandarin text entry on mobile devices. arXiv preprint arXiv:1608.07323.
12.
SearsA. (1991). Improving Touchscreen Keyboards: Design issues and a comparison with other devices. Interacting with Computers, 3(3).
13.
SearsA.RevisD.SawtskiJ.CrittendenR.ShneidermanB. (1993). Investigation touchscreen typing: The effect of keyboard size on typing speed. Behaviour & Information Technology, 12, 17-22.
14.
ShelstadW. J.BenedictJ. D.SmithJ. K.MomoT.GuliuzoJ. D.ReussN. R.CoursonA.ChaparroB. S. (February, 2019). User Experience Evaluation of the Microsoft HoloLens for Student-Related Tasks. Poster presented at the Human Factors and Applied Psychology Student Conference, Orlando, FL.
15.
TurnerC. J.ChaparroB. S.HeJ. (2016). Text input on a smartwatch QWERTY keyboard: tap vs. trace. International Journal of Human-Computer Interaction, 33(2), 143-150.
16.
WilsonA. D.AgrawalaM. (April, 2006). Text Entry Using a Dual Joystick Game Controller. Proceedings of the 2006 CHI conference, Montréal, Québec, Canada.
