The Microsoft HoloLens, a mixed reality head-mounted display (HMD), has been demonstrated in domains such as medicine, engineering, and manufacturing. In order to interact with the device, voice input may be required. Given this range of environments, it is necessary to understand the impact of noise on voice dictation speed and accuracy. In this study, we evaluated the dictation feature of the HoloLens through speed (WPM), accuracy (WER), perceived workload, and perceived usability at three different noise levels: 40 dB, 55 dB, and 70 dB. No differences were found across noise levels in speed (67-75 WPM), or perceived workload. Accuracy and perceived usability worsened in the 70 dB noise condition. Only 37.5% of participants were able to successfully dictate in the 70 dB condition. This study shows that if the HoloLens is to be accepted in environments with high noise levels, improvements to dictation need to be made.
Get full access to this article
View all access options for this article.
References
1.
BangorA.KortumP. T.Miller.J., T. (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies, 4(3), 114-123.
2.
BrookeJ. (1996). SUS-A quick and dirty usability scale. Usability Evaluation in Industry, 189(194), 4-7.
DerbyJ. L.RarickC. T.ChaparroB. S. (2019). Text input performance with a mixed reality head-mounted display (HMD). Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Seattle, WA, USA, 63, 1476-1480. doi: 10.1177/1071181319631279
5.
EPRI (2019). Program on Technology Innovation: Assessment of Safety Aspects of Using Augmented Reality Technologies – Field Tests with Electric Utility Power Plant Operators and manhole Workers (Report No. 3002016558). EPRI, Palo Alto, CA.
6.
EvansG.MillerJ.PenaM. I.MacAllisterA.WinerE. H. (2017). Evaluating the Microsoft HoloLens through an augmented reality assembly application. Proceedings of Degraded Environments: Sensing, Processing, and Display 2017, Anaheim, CA, 10197. doi: 10.1117/12.2262626
GrubertJ.WitzaniL.OfekE.PahudM.KranzM.KristenssonP. O. (2018). Text entry in immersive head-mounted display-based virtual reality using standard keyboards. Proceedings of 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Reutlingen, Germany, 159-166. doi: 10.1109/VR.2018.8446059
9.
HannaM. G.AhmedI.NineJ.PrajapatiS.PantanowitzL. (2018). Augmented reality technology using Microsoft HoloLens in anatomic pathology. Archives of Pathology & Laboratory Medicine, 142(5), 638-644. doi: 10.5858/arpa.2017-0189-OA
10.
HartS. G. (2006). NASA-Task Load Index (NASA-TLX); 20 years later. Proceedings of the Human Factors and Ergonomics Society, 50, 904-908. doi: 10.1177/154193120605000909
11.
HartS. G.StavelandL. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in Psychology, 52, 139–183. doi: 10.1016/S0166-4115(08)62386-9
12.
HouW. (2019). Augmented reality museum visiting application based on the Microsoft HoloLens. Journal of Physics: Conference Series. doi: 10.1088/1742-6596/1237/5/052018
13.
KersteinR. (2018). Life through a HoloLens. The Bulletin of the Royal College of Surgeons of England, 100(8), 333-334. doi: 10.1308/rcsbull.2018.333
LiaH.PaulinG.YeoC. T.AndrewsJ.YiN.HaqH.… FichtingerG. (2018). HoloLens in suturing training. Proceedings of Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling, Houston, TX, USA, 10576. doi: 10.1117/12.2293934
17.
MakhijaniR.ShrawankarU.ThakareV. M. (2013). Opportunities and challenges in automatic speech recognition. arXiv preprint arXiv:1305.2846.
18.
Microsoft Store. (2020). Browse all HoloLens apps. Retrieved from https://www.microsoft.com/en- us/store/collections/hlgettingstarted/hololens
19.
MoorthyA. E.VuK. P. L. (2015). Privacy concerns for use of voice activated personal assistant in the public space. International Journal of Human-Computer Interaction, 31(4), 307-335. doi: 10.1080/10447318.2014.986642
20.
NewnhamJ. (2017). Enhancing reality. Microsoft HoloLens by example: Create immersive augmented reality experiences (pp. 7-19). Birmingham, UK: Packt Publishing.
21.
OngS. (2017). Interacting with holograms. Beginning Window mixed reality programming: For HoloLens and mixed reality headsets (pp. 95-114). Washington, USA: Springer.
PerlaR.HebbalaguppeR. (2017). Google Cardboard dates augmented reality: Issues, challenges and future opportunities. arXiv preprint arXiv:1706.03851.
24.
RaeE.LassoA.HoldenM. S.MorinE.LevyR.FichtingerG. (2018). Neurosurgical burr hole placement using the Microsoft HoloLens. Proceedings of Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling, Houston, TX, USA, 10576. doi: 10.1117/12.2293680
25.
RavandiG.NadriF.KahanjaniN.AhmadianM. (2012). Occupational noise exposure among the workers of Kerman Cement Plant, 2009. JOHE1(1), pp. 17-23.
26.
RuanS.WobbrockJ. O.LiouK.NgA.LandayJ. (2016). Speech is 3x faster than typing for English and Mandarin text entry on mobile devices. arXiv preprint arXiv:1608.07323.
27.
ShelstadW. J.BenedictJ. D.SmithJ. K.MomoT.GuliuzoJ. D.ReussN. R.… ChaparroB. S. (2019, January). User experience evaluation of the Microsoft HoloLens for student-related tasks. Poster presented at the Human Factors and Applied Psychology Student Conference, Orlando, FL.
28.
SmithA. L.ChaparroB. S. (2015). Smartphone text input method performance, usability, and preference with younger and older adults. Human Factors, 57(6), 1015-1028. doi: 10.1177/0018720815575644
29.
StrangeA. (2019). “Microsoft’s HoloLens 2 Team Answers More Questions About Biometric Security, Audio, and Hand Tracking.”Next Reality, N.P. Website.
