Pseudo-pilots work in real-time simulations in air traffic control training and carry out an important task to ensure appropriate training for the trainee controllers. They are in constant communication with controllers during the training and are responsible for fulfilling the instructions given by the controllers. Unlike real operations, pseudo-pilots are required to monitor many aircraft simultaneously on the simulator’s radar screen and perform various interventions. This situation can be challenging, and the impact of such situations on their workload is usually neglected. In the literature, various studies have revealed the factors affecting controller workload; however, the factors affecting the workload of pseudo-pilots have not been emphasized. In this study, statistical analyses were carried out using the data obtained from real-time simulations and NASA-TLX surveys. As a result, the number of aircraft, controller performance, and the interruption duration were determined as the key factors that affect the overall workload of pseudo-pilots.
VagnerJPappováE.Comparison of Radar Simulator for Air Traffic Control. Nase MoreVol. 61, No. 1–2, 2014, pp. 31–35.
2.
JuričićBVarešakI.BožićD.The Role of the Simulation Devices in Air Traffic Controller Training. 19th International Symposium Electronics Traffic, 2011, pp. 1–9.
3.
CetekC.AybekF.CinarE.CavcarA.New Directions for Air Traffic Control Simulators: A Discussion to Guide the Selection and Renovation of Simulators. Aeronautical Journal, Vol. 117, No. 1190, 2013, pp. 415–426.
4.
MicroNav. BEST User Manual-Airborne Pilot Facilities. MicroNav, Bournemouth, 2010.
5.
PavlinovicM.JuricicB.Antulov-FantulinB.Air Traffic Controllers’ Practical Part of Basic Training on Computer Based Simulation Device. Proceedings of the 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia, IEEE, New York, NY, 2017, pp. 920–925.
6.
Aybek CetekF.Antulov-FantulinB.FrostP.DonmezK.KaplanZ.RogošićT.Project Atcosima: Preliminary Results and Analysis of Real-Time ATC and Flight Cockpit Simulations. In: Proceedings of the International Scientific Conference “Science and Traffic Development” (ZIRP 2019), Opatija, Croatia, 2019. p. 9–22.
7.
XiaotianE.JingyuZ.Holistic Thinking and Air Traffic Controllers’ Decision Making in Conflict Resolution. Transportation Research Part F: Traffic Psychology and Behaviour, Vol. 45, 2017, pp. 110–121.
8.
HartS. G.StavelandL. E.Development of NASA-TLX. Human Mental Workload Advance Psychology, Vol. 52, 1988, pp. 139–183.
9.
HartS. G.NASA-Task Load Index (NASA-TLX); 20 Years Later. Proceedings of the Human Factors and Ergonomics Society, Vol. 50, No. 9, 2006, pp. 904–908.
10.
ChhayaB.JaferS.RiceS.Human Factors Assessment of Scenario-driven Training in Web-based Simulation. In: Simultech: Proceedings of the 10th International Conference on Simulation and Modeling Methodologies, Technologies And Applications. Science and Technology Publications, Setúbal, Portugal, 2020, pp. 189–196.
11.
LiW. C.ChiuF. C.WuK. J.The Evaluation of Pilots Performance and Mental Workload by Eye Movement. In Proceedings of the 30th European Association for Aviation Psychology Conference, Sardinia, Italy, EAAP, 2012, p. 24–28.
12.
MetzgerU.ParasuramanR.Free Flight and the Air Traffic Controller: Active Control Versus Passive Monitoring. In: Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting, SAGE Publications, Vol. 43, 1999. p. 1–5.
DönmezK.DemirelS.ÖzdemirM.Handling the Pseudo Pilot Assignment Problem in Air Traffic Control Training by Using NASA TLX. Journal of Air Transport Management, Vol. 89, 2020, p. 101934.
15.
FinkeM.Stelkens-KobschT. H.Comparing Different Workload and Stress Assessment Methods in Air Traffic Control Simulations. DLRK, 2017, pp. 1–10.
16.
BuckleyE.DeBarysheB.HitchenerN.KohnP.Methods and Measurements in Real-Time Air Traffic Control System Simulation. U. S. Department of Transportation, Federal Aviation, Administration, Washington, D. C., 1983.
17.
CorkerK. M.GoreB. F.FlemingK.LaneJ.Free Flight and the Context of Control: Experiments and Modeling to Determine the Impact of Distributed Air-Ground Air Traffic Management on Safety and Procedures. In: 3rd USA/Europe Air Traffic Management R&D Seminar, FAA&EUROCONTROL, Naples, Italy, 2000, p. 13–16.
18.
MogfordR. H.MurphyE. D.GuttmanJ. A.Using Knowledge Exploration Tools to Study Airspace Complexity in Air Traffic Control. International Journal of Aviation Psychology, Vol. 4, 1993, pp. 29–45.
19.
PawlakW. W.BrintonC. R.CouchL.LancasterK. M.A Framework for the Evaluation of Air Traffic Complexity. American Institute of Aeronautics and Astronautics, Reston, VA, 1996.
20.
LeeP. U.Understanding Human-Human Collaboration to Guide Human-Computer Interaction Design in Air Traffic Control. Conference Proceedings - IEEE International Conference on Systems, Man, and Cybernetics, Vol. 2, 2005, pp. 1598–1603.
21.
BassE. J.BoltonM. L.FeighK.GriffithD.GunterE.ManskyW.RushbyJ.Toward a Multi-Method Approach to Formalizing Human-Automation Interaction and Human-Human Communications. Conference Proceedings - IEEE International Conference on Systems, Man, and Cybernetics, Anchorage, AK, IEEE, New York, 2011, pp. 1817–1824.
22.
BelloriniA.VanderhaegenF.Communication and Cooperation Analysis in Air Traffic Control. The 8th International Symposium on Aviation Psychology, Columbus, Ohio, ISAP, April 24–27, 1995, pp. 1–7.
23.
VermaS.SanN.StateJ.FieldM.KozonT.RaytheonN., et al. Changes in Roles / Responsibilities of Air Traffic Control Under Precision Taxiing. 2007 IEEE/AIAA 26th Digital Avionics Systems Conference, Dallas, TX, IEEE, New York, NY, 2007, pp. 1–12.
24.
BernhardtK. A.PoltavskiD.PetrosT.FerraroF. R.JorgensonT.CarlsonC., et al. The effects of dynamic workload and experience on commercially available EEG cognitive state metrics in a high-fidelity air traffic control environment. Applied Ergonomics, Vol. 77, 2019, pp. 83–91.
25.
MartinL.SwensonH.SadovskyA.ThipphavongJ.ChenL.SeoA.Effects of Scheduling and Spacing Tools on Controllers’ Performance & Perceptions of their Workload. 2011 IEEE/AIAA 30th Digital Avionics Systems Conference, Seattle, WA, IEEE, New York, NY, 2011, pp. 1–19.
26.
AbbassH. A.TangJ.AminR.EllejmiM.KirbyS.Augmented Cognition Using Real-Time EEG-Based Adaptive Strategies for Air Traffic Control. Proceedings of the Hum Factors and Ergonomics Society, Vol. 58, No. 1, 2014, pp. 230–234.
27.
WanyanX.ZhuangD.ZhangH.Improving Pilot Mental Workload Evaluation with Combined Measures. Biomedical Materials and Engineering, Vol. 24, No. 6, 2014, pp. 2283–2290.
28.
LeeP. U.PrevotT.HomolaJ.LeeH.KessellA.BrasilC.Impact of Airspace Reconfiguration on Controller Workload and Task Performance. 3rd International Conference on Applied Human Factors and Ergonomics, AHFE, 2010.
29.
HoangT.JungY. C.GuptaG.HolbrookJ.WangE. M.IngramC.WaqarM., et al. Development and Findings From the Spot and Runway Departure Advisor (SARDA) Human-in-the-Loop (HITL) Simulation Experiment. NASA Center for AeroSpace Information, Hanover, MD, 2014.
30.
De la TorreG. G.RamalloM. A.CervantesE.Workload Perception in Drone Flight Training Simulators. Computers in Human Behavior, Vol. 64, 2016, pp. 449–454.
31.
OhH.JeongS.ChoiK.LeeH. -T.Human-in-the-Loop Simulation Analysis of Conflict Resolution Maneuvers Using an Air Traffic Control Simulation. In: AIAA Modeling and Simulation Technologies Conference, American Institute of Aeronautics and Astronautics, Reston, Virginia, 2016.
32.
KoglbauerI.BraunstinglR.Ab Initio Pilot Training for Traffic Separation and Visual Airport Procedures in a Naturalistic Flight Simulation Environment. Transportation Research Part F: Traffic Psychology Behaviour, Vol. 58, 2018, pp. 1–10.
33.
LinC. J.LinP. H.ChenH. J.HsiehM. C.YuH. C.WangE. M. Y., et al. Effects of Controller-Pilot Communication Medium, Flight Phase and the Role in the Cockpit on Pilots’ Workload and Situation Awareness. Safety Science, Vol. 50, No. 9, 2012, pp. 1722–1731.
34.
LeeP. U.A Non-Linear Relationship between Controller Workload and Traffic Count. Proceedings of the Human Factors and Ergonomics Society, Vol. 49, No. 12, 2005, p. 1129–1133.
35.
HahS.Ben WillemsM. A.PhillipsR.The Effect of Air Traffic Increase on Controller Workload. In: Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting, Los Angeles, SAGE Publications, Vol. 50, 2006, p. 50–54.
36.
AyazH.WillemiB.BunceS.ShewokisP.IzzetogluK.HahS.DeshmukhA.OnaralB.Cognitive Workload Assessment of Air Traffic Controllers Using Optical Brain Imaging Sensors. In: Advances in Understanding Human Performance: Neuroergonomics, Human Factors Design, and Special Populations (MarekT.KarwowskiW.RiceV., eds.), CRC Press, Taylor & Francis Group, Boca Raton, Florida, 2010, pp. 21–31.
37.
QiaoH.ZhangJ.ZhangL.LiY.LoftS.Exploring the Peak-End Effects in Air Traffic Controllers’ Mental Workload Ratings. Human Factors, Vol. 64, No. 8, 2021, pp. 1292–1305.
38.
KaltenhäuserS.Tower and Airport Simulation: Flexibility as a Premise for Successful Research. Simulation Modelling Practice and Theory, Vol. 11, No. 3–4, 2003, pp. 187–196.
39.
LawsheC. H.A Quantitative Approach to Content Validity. Personnel Psychology, Vol. 28, 1975, pp. 563–575.
40.
NaidooP.SchaapP.VermeulenL. P.The Development of a Measure to Assess Perceptions of the Advanced Aircraft Training Climate. International Journal of Aviation Psychology, Vol. 24, No. 3, 2014, pp. 228–245. http://doi.org/10.1080/10508414.2014.918441
41.
Cheng-HuaY.Hsin-LiC.Exploring the Perceived Competence of Airport Ground Staff in Dealing with Unruly Passenger Behaviors. Tourism Management, Vol. 33, No. 3, 2012, pp. 611–621. http://doi.org/10.1016/j.tourman.2011.07.001
42.
AyreC.ScallyA. J.Critical Values for Lawshe’s Content Validity Ratio. Measurement of Evaluation in Counseling and Development, Vol. 47, No. 1, 2014, pp. 79–86.
43.
TaherdoostH.What Is the Best Response Scale for Survey and Questionnaire Design; Review of Different Lengths of Rating Scale / Attitude Scale / Likert Scale. International Journal of Academic Research in Management, Vol. 8, No. 1, 2019, pp. 1–10.
44.
KimT. K.Understanding One-Way ANOVA Using Conceptual Figures. Korean Journal of Anesthesiology, Vol. 70, No. 1, 2017, pp. 22–26.
45.
TukeyJ. W.Comparing Individual Means in the Analysis of Variance. Biometrics, Vol. 5, No. 2, 1949, pp. 99–114.
46.
ScheffeH.The Analysis of Variance. Wiley, New York, NY, 1959.
47.
BabbieE.The Basics of Social Research, 4th ed.Wadsworth, Belmont, CA, 2010.
48.
HairJ. F. J.AndersonR. E.TathamR. L.BlackW. C.Multivariate Data Analysis, 3rd ed.Macmillan, New York, NY, 1995.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
