The successful operation of military aviation depends on effective pilot training. Current training capabilities of the United States Air Force might not be sufficient to meet the demand for new pilots. To help resolve this issue, this implementation study focused on developing an adaptive virtual reality (VR)-based training system for pilots. This prototype was built leveraging the three fundamental components for an adaptive training system including the trainee’s performance measures, adaptive logic, and adaptive variables. The prototype was based on the startup procedure for an F-16 cockpit and included adaptive feedback, display features, and various difficulty levels to help trainees maintain an optimal level of cognitive workload while completing their training. Implementation of adaptive VR training on a wide scale has the potential to reduce training time and cost. Future work is needed to validate the effectiveness of the approach. This prototype can assist in developing future adaptive VR-training systems.
Get full access to this article
View all access options for this article.
References
1.
BelaniM. (2020). Evaluating virtual reality as a medium for vocational skill training. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems
2.
BiddleC. J. (1968). Fighting Airman: The Way of the Eagle. Doubleday.
3.
BloomB. S. (1984). The 2 sigma problem: The search for methods of group instruction as effective as one-to-one tutoring. Educational researcher, 13(6), 4-16.
4.
BreimanL. (2001). Random forests. Machine learning, 45(1), 5-32.
5.
CharlesR. L.NixonJ. (2019). Measuring mental workload using physiological measures: A systematic review. Applied ergonomics, 74, 221-232.
6.
ChemuturiR.AmirabdollahianF.DautenhahnK. (2013). Adaptive training algorithm for robot-assisted upper-arm rehabilitation, applicable to individualised and therapeutic human-robot interaction. Journal of neuroengineering and rehabilitation, 10(1), 1-18.
7.
DahlstromN.NahlinderS. (2009). Mental workload in aircraft and simulator during basic civil aviation training. The International journal of aviation psychology, 19(4), 309-325.
8.
FeidakisM. (2016). A review of emotion-aware systems for e-learning in virtual environments. Formative assessment, learning data analytics and gamification, 217-242.
9.
FentonN.NeilM. (2018). Risk assessment and decision analysis with Bayesian networks. Crc Press.
10.
FricoteauxL.ThouveninI.MestreD. (2014). GULLIVER: a decision-making system based on user observation for an adaptive training in informed virtual environments. Engineering Applications of Artificial Intelligence, 33, 47-57.
11.
GavishN.GutiérrezT.WebelS.RodríguezJ.PeveriM.BockholtU.TecchiaF. (2015). Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks. Interactive Learning Environments, 23(6), 778-798.
12.
KelleyC. R. (1969). What is adaptive training?Human Factors, 11(6), 547-556.
13.
LahiriU.BekeleE.DohrmannE.WarrenZ.SarkarN. (2012). Design of a virtual reality based adaptive response technology for children with autism. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 21(1), 55-64.
14.
LangY.WeiL.XuF.ZhaoY.YuL.-F. (2018, 2018). Synthesizing personalized training programs for improving driving habits via virtual reality. 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)
15.
LoseyS. (2021, 23September 2021). The Air Force Is Still Short on Pilots and Hopes Tech Will Help Close the Gap.
16.
MaggioM. G.RussoM.CuzzolaM. F.DestroM.La RosaG.MoloniaF.BramantiP.LombardoG.De LucaR.CalabròR. S. (2019). Virtual reality in multiple sclerosis rehabilitation: A review on cognitive and motor outcomes. Journal of Clinical Neuroscience, 65, 106-111.
17.
MarianiA.PellegriniE.EnayatiN.KazanzidesP.VidottoM.De MomiE. (2018). Design and evaluation of a performance-based adaptive curriculum for robotic surgical training: A pilot study. 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (pp. 2162-2165)
18.
MilsteinN.GordonI. (2020). Validating measures of electrodermal activity and heart rate variability derived from the empatica E4 utilized in research settings that involve interactive dyadic states. Frontiers in Behavioral Neuroscience, 14.
19.
MonfortS. S.SibleyC. M.CoyneJ. T. (2016). Using machine learning and real-time workload assessment in a high-fidelity UAV simulation environment. Next-Generation Analyst IV (Vol. 9851, p. 98510B). International Society for Optics and Photonics.
20.
MorayN. (2013). Mental workload: Its theory and measurement (Vol. 8). Springer Science & Business Media.
21.
MühlbergerA.HerrmannM. J.WiedemannG.EllgringH.PauliP. (2001). Repeated exposure of flight phobics to flights in virtual reality. Behaviour research and therapy, 39(9), 1033-1050.
22.
OberhauserM.DreyerD. (2017). A virtual reality flight simulator for human factors engineering. Cognition, Technology & Work, 19(2), 263-277.
23.
OberhauserM.DreyerD.BraunstinglR.KoglbauerI. (2018). What’s real about virtual reality flight simulation?Aviation Psychology and Applied Human Factors.
24.
OrlanskyJ.DahlmanC. J.HammonC. P.MetzkoJ.TaylorH. L.YoungblutC. (1994). The value of simulation for training (IDA Paper P-2982). Institute for Defense Analyses, Alexandria, Va., USA.
25.
PovenmireH. K.RoscoeS. N. (1973). Incremental transfer effectiveness of a ground-based general aviation trainer. Human Factors, 15(6), 534-542.
26.
RadiantiJ.MajchrzakT. A.FrommJ.WohlgenanntI. (2020). A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Computers & Education, 147, 103778.
27.
RoscoeA. H. (1992). Assessing pilot workload. Why measure heart rate, HRV and respiration?Biological psychology, 34(2-3), 259-287.
28.
RoscoeS. N.BergmanC. A. (1980). Chapter 4: Flight performance control. In Aviation Psychology. Iowa State University Press.
29.
SauravK.DashA.SolankiD.LahiriU. (2018). Design of a VR-based upper limb gross motor and fine motor task platform for post-stroke survivors. 17th International Conference on Computer and Information Science (ICIS) (pp. 252-257)
30.
SchuurmansA. A. T.de LooffP.NijhofK. S.RosadaC.ScholteR. H. J.PopmaA.OttenR. (2020). Validity of the Empatica E4 wristband to measure heart rate variability (HRV) parameters: A comparison to electrocardiography (ECG). Journal of medical systems, 44(11), 1-11.
SummaS.BasterisA.BettiE.SanguinetiV. (2015). Adaptive training with full-body movements to reduce bradykinesia in persons with Parkinson’s disease: a pilot study. Journal of neuroengineering and rehabilitation, 12(1), 1-13.
33.
UddinS.KhanA.HossainM. E.MoniM. A. (2019). Comparing different supervised machine learning algorithms for disease prediction. BMC medical informatics and decision making, 19(1), 1-16.
WiseJ. A.HopkinV. D.GarlandD. J. (2010). Handbook of aviation human factors (WiseJ. A.HopkinV. D.GarlandD. J. Eds. 2nd Edition ed.). (2009)
36.
YerkesR. M.DodsonJ. D. (1908). The relation of strength of stimulus to rapidity of habit-formation. Punishment: Issues and experiments, 27-41.
37.
ZahabiM.Abdul RazakA. M. (2020). Adaptive virtual reality-based training: a systematic literature review and framework. Virtual Reality, 24(4).
38.
ZhouJ.AsterisP. G.ArmaghaniD. J.PhamB. T. (2020). Prediction of ground vibration induced by blasting operations through the use of the Bayesian Network and random forest models. Soil Dynamics and Earthquake Engineering, 139, 106390.
