The U.S. Air Force (USAF) Warfighter Interactions and Readiness Division is actively integrating virtual reality (VR) technology in Distributed Mission Operations Live, Virtual, and Constructive (DMO LVC) training. A head-mounted display (HMD) comparison methodology was pilot tested to evaluate the usability of multiple VR headsets for application in Warfighter training. This report discusses key factors and considerations that may impact usability and user experience, thereby impacting the training of the user. Implications on how these findings may correlate with training efficiencies are discussed.
AhnS. J. G.NowakK. L.BailensonJ. N. (2022). Unintended consequences of spatial presence on learning in virtual reality. Computers & Education, 104532.
2.
AlbusP.VogtA.SeufertT. (2021). Signaling in virtual reality influences learning outcomes and cognitive load. Computers & Education, 166, 104154
3.
BaceviciuteS.MottelsonA.TerkildsenT.MakranskyG. (2020). Investigating representation of text and audio in educational VR using learning outcomes and EEG. In Proceedings of the 2020 CHI conference on human factors in computing systems (pp. 1–13). https://doi.org/10.1145/3313831.3376872
4.
ChanT. T.WangY.SoR. H. Y.JiaJ. (n.d.) Predicting subjective discomfort associated with lens distortion in VR headsets during vestibulo-ocular response to VR Scenes. In IEEE Transactions on Visualization and Computer Graphics, doi: 10.1109/TVCG.2022.3168190.
5.
CooperN.MilellaF.CantI.PintoC.WhiteM.MeyerG. (2016). Augmented cues facilitate learning transfer from virtual to real environments. IEEE International Symposium on Mixed and Augmented Reality (2016), 194-198, doi: 10.1109/ISMAR-Adjunct.2016.0075.
6.
FranzluebbersA.JohnsenK. (2018, October). Performance benefits of high-fidelity passive haptic feedback in virtual reality training. In Proceedings of the symposium on spatial user interaction, 16-24.
7.
HarperS. B.DortonS. L. (2021). A Pilot Study on Extending the SUS Survey: Early Results. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 65(1), 447–451. https://doi.org/10.1177/1071181321651162
8.
HightM.FussellS. G.KurkchubascheM. (2022). Effectiveness of VR simulations: Comparing virtual reality with 2d simulations for ab initio pilot training. International Journal of Aviation, Aeronautics, and Aerospace. https://doi.org/10.15394/jaaer.2022.1903
9.
HurterJ.MarajC.MurphyS. (2021). Commercial virtual reality displays: Issues of performance and simulator sickness from exocentric depth-perception tasks. Displays, 70, 102095.
10.
JensenL.KonradsenF. (2018). A review of the use of virtual reality head-mounted displays in education and training. Education and Information Technologies, 23(4), 1515-1529. doi:10.1007/s10639-017-9676-0
11.
KarreS. A.MathurN.ReddyY. R. (2019). Usability evaluation of VR products in industry: A systematic literature review. In Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing (SAC ‘19). Association for Computing Machinery, 1845–1851. https://doi.org/10.1145/3297280.3297462
12.
KimH. K.ParkJ.ChoiY.ChoeM. (2018). Virtual reality sickness questionnaire (VRSQ): Motion sickness measurement index in a virtual reality environment. Applied ergonomics, 69, 66-73.
13.
KennedyR. S.LaneN. E.BerbaumK. S.LilienthalM. G. (1993). Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. The International Journal of Aviation Psychology, 3(3), 203–220. https://doi.org/10.1207/s15327108ijap0303_3
14.
MaJ. (2014). Evaluation and comparison of head-mounted displays in immersive virtual environments (Order No. 1583639). Available from ProQuest Dissertations & Theses A&I; ProQuest Dissertations & Theses Global. (1656449918).
15.
MakranskyGBorre-GudeSMayerRE. (2019). Motivational and cognitive benefits of training in immersive virtual reality based on multiple assessments. J Comput Assist Learn, 35, 691– 707. https://doi.org/10.1111/jcal.12375
16.
MarraffinoM.D.JohnsonC.I.GaribaldiA.E. (2022). Virtual reality is better than desktop for training a spatial knowledge task, but not for everyone. In: ChenJ.Y.C.FragomeniG. (eds) Virtual, Augmented and Mixed Reality: Design and Development. HCII 2022. Lecture Notes in Computer Science, 13317. Springer. https://doi.org/10.1007/978-3-031-05939-1_14
17.
MorélotS.GarrigouA.DedieuJ.N’KaouaB. (2021). Virtual reality for fire safety training Influence of immersion and sense of presence on conceptual and procedural acquisition. Virc. Comput. Educ., 166, 104145.
18.
MurtzaR.MonroeS.YoumansR. J. (2017). Heuristic evaluation for virtual reality systems. Proceedings of the Human Factors and Ergonomics Society 2017 Annual Meeting, 2067-2071.
19.
ÖzgenD.S.AfacanY.SürerE. (2019). Usability of virtual reality for basic design education: a comparative study with paper-based design. International Journal of Technology and Design Education, 2019. https://doi.org/10.1007/s10798-019-09554-0
20.
PollardK. A.OiknineA. H.FilesB. T.SinatraA. M.PattonD.EricsonM.… KhooshabehP. (2020). Level of immersion affects spatial learning in virtual environments: Results of a three-condition withinsubjects study with long intersession intervals. Virtual Reality, 24(4), 783-796.
21.
Ramaseri ChandraA. N.El JamiyF.RezaH. (2022). A systematic survey on cybersickness in virtual environments. Computers, 11(4), 51.
22.
ReddyG.S.R., et al. (2022). Estimating cognitive load and cybersickness of Pilots in VR simulations via unobtrusive physiological sensors. in: ChenJ.Y.C.FragomeniG. (eds) Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry. HCII 2022. Lecture Notes in Computer Science, vol 13318. Springer. https://doi.org/10.1007/978-3-031-06015-1_18
SomrakA.HumarI.HossainM. S.AlhamidM. F.HossainM. A.GunaJ. (2019). Estimating VR sickness and user experience using different HMD technologies: An evaluation study. Future Generation Computer Systems, 94, 302-316.
25.
SmithP.L.LittleD.R. (2018). Small is beautiful: In defense of the smallN design. Psychonomic Bulletin & Review, 25, 2083–2101. https://doi.org/10.3758/s13423-018-1451-8
26.
UsohM.CatenaE.ArmanS.SlaterM. (2000). Using presence questionnaires in reality. Presence, 9(5), 497-503.
27.
YangP.LiuZ. (2022). The influence of immersive virtual reality (IVR) on skill transfer of learners: The moderating effects of learning engagement. International Journal of Emerging Technologies in Learning, 17(10), 62–73. https://doiorg.proxy.library.kent.edu/10.3991/ijet.v17i10.30923
