We aimed to characterize the impact of startle and surprise, both independently and in combination, on subjective feelings, behavior (task performance and gaze behavior), and several physiological parameters.
Background
The effects of startle and surprise are known to affect pilots’ cognitive performance, with potential impact on safety. Startle and surprise can occur either together or independently, yet no studies have experimentally distinguished their specific effects.
Method
Participants (n = 45) were each assigned to one of the three conditions while performing the MATB-II task. In the startle condition, participants were subjected to an expected loud sound. In the surprise condition, an unexpected reverse video effect was applied to the experimental interface. In the combination condition, participants were exposed to both stimuli simultaneously.
Results
Surprise was associated with an increase in skin conductance without affecting performance. In contrast, startle was marked by a decline in performance on the communication sub-task, increased skin conductance and heart rate, and a narrowing of attention. When startle and surprise were combined, the results mirrored those of startle alone but included a stronger feeling of startle and surprise, and a more prolonged heart rate increase.
Conclusion
Startle and surprise combined yielded more numerous significant effects on subjective, behavioral, and physiological measures than startle and surprise independently.
Application
Identifying the specific impacts of startle and surprise could pave the way for their automatic detection using artificial intelligence. Safety could be enhanced through the design of specific countermeasures to help the crew cope with such states.
AdkinsB.BrennanE.HoffmannH.PatelK.SchmitC. (2019). Physiological startle response to frightening stimuli in light and dark environment. https://minds.wisconsin.edu/handle/1793/81996
3.
BEA. (2021). Investigation report, incident to the Airbus—A350-900 on 4th February 2020 at Paris-Orly.
CasnerS. M.GevenR. W.WilliamsK. T. (2013). The effectiveness of airline pilot training for abnormal events. Human Factors, 55(3), 477–485. https://doi.org/10.1177/0018720812466893
9.
CegarraJ.ValéryB.AvrilE.CalmettesC.NavarroJ. (2020). OpenMATB : A multi-attribute task Battery promoting task customization, software extensibility and experiment replicability. Behavior Research Methods, 52(5), 1980–1990. https://doi.org/10.3758/s13428-020-01364-w
10.
ChouC. Y.MarcaR. L.SteptoeA.BrewinC. R. (2014). Heart rate, startle response, and intrusive trauma memories. Psychophysiology, 51(3), 236–246. https://doi.org/10.1111/psyp.12176
11.
ChristopoulosG. I.UyM. A.YapW. J. (2019). The body and the brain : Measuring skin conductance responses to understand the emotional experience. Organizational Research Methods, 22(1), 394–420. https://doi.org/10.1177/1094428116681073
12.
ComstockJ. R.ArnegardR. J. (1992). The multi-attribute task battery for human operator workload and strategic behavior research. National Aeronautics and Space Administration. No. NAS 1.15: 104174.
13.
DehaisF.PeysakhovichV.ScannellaS.FongueJ.GateauT. (2015). Automation surprise » in aviation: Real-time solutions. In Proceedings of the 33rd annual ACM conference on human factors in computing systems (pp. 2525–2534). https://doi.org/10.1145/2702123.2702521
DiarraM.MarchittoM.BressolleM.-C.BaccinoT.Drai-ZerbibV. (2023). A narrative review of the interconnection between pilot acute stress, startle, and surprise effects in the aviation context: Contribution of physiological measurements. Frontiers in Neuroergonomics, 4(1), Article 1059476. https://doi.org/10.3389/fnrgo.2023.1059476
16.
DuchevetA.VoD.-B.PeyruqueouV.HogueT. D. L.GarciaJ.CausseM.ImbertJ.-P. (2024). FOCUS : An intelligent startle management assistant for maximizing pilot resilience. In In proceedings of the 2nd international conference on cognitive aircraft systems - ICCAS (pp. 5–12). https://doi.org/10.5220/0012915600004562
17.
EkmanP.FriesenW. V. (1971). Constants across cultures in the face and emotion. Journal of Personality and Social Psychology, 17(2), 124–129. https://doi.org/10.1037/h0030377
EkmanP.FriesenW. V.SimonsR. C. (1985). Is the startle reaction an emotion?Journal of Personality and Social Psychology, 49(5), 1416–1426. https://doi.org/10.1037/0022-3514.49.5.1416
FossJ. A.IsonJ. R.TorreJ. P.WansackS. (1989). The acoustic startle response and disruption of aiming: II. Modulation by forewarning and preliminary stimuli. Human Factors, 31(3), 319–333. https://doi.org/10.1177/001872088903100306
GrantP. R.MoszczynskiG. J.SchroederJ. A. (2018). Post-stall flight model fidelity effects on full stall recovery training. In 2018 modeling and simulation technologies conference. https://doi.org/10.2514/6.2018-2937
24.
HancockP. A.CruitJ.KochanJ. A.KaplanA. D.DiazY.PruchnickiS. (2022). Pilots’ responses to unexpected events: Conceptual, theoretical, methodological, and analytical issues. The International Journal of Aerospace Psychology, 32(4), 254–282. https://doi.org/10.1080/24721840.2022.2090944
25.
HartS. G.StavelandL. E. (1988). Development of NASA-TLX (task load index) : Results of empirical and theoretical research. In HancockP. A.MeshkatiN. (Éds.), Advances in psychology (Vol. 52, p. 139–183). North-Holland. https://doi.org/10.1016/S0166-4115(08)62386-9
26.
HiattS. W.CamposJ. J.EmdeR. N. (1979). Facial patterning and infant emotional expression : Happiness, surprise, and fear. Child Development, 50(4), 1020–1035. https://doi.org/10.2307/1129328
27.
HoffmanH. S.FleshlerM.AbplanalpP. L. (1964). Startle reaction to electrical shock in the rat. Journal of Comparative & Physiological Psychology, 58(1), 132–139. https://doi.org/10.1037/h0045324
28.
HogueT. D. L.MouratilleD.CausseM.ImbertJ.-P. (2024). ArGaze : An open and flexible software library for gaze analysis and interaction.
29.
HolandS.GirardA.LaudeD.Meyer-BischC.ElghoziJ.-L. (1999). Effects of an auditory startle stimulus on blood pressure and heart rate in humans. Journal of Hypertension, 17(12), 1893–1897. https://doi.org/10.1097/00004872-199917121-00018
KinneyL.O’HareD. (2020). Responding to an unexpected in-flight event : Physiological arousal, information processing, and performance. Human Factors, 62(5), 737–750. https://doi.org/10.1177/0018720819854830
32.
KleinG.PhillipsJ. K.RallE. L.PelusoD. (2007). A data-frame theory of sensemaking. In: Expertise out of context: Proceedings of the sixth international conference on naturalistic decision making (pp. 113–155). Lawrence Erlbaum Associates.
33.
KNKT. (2014). Aircraft accident investigation report, Indonesia air Asia Airbus A320-216; PK-AXC.
KrejtzK.DuchowskiA.KrejtzI.SzarkowskaA.KopaczA. (2016). Discerning ambient/focal attention with coefficient K. ACM Transactions on Applied Perception, 13(3), 11:1-11:20. https://doi.org/10.1145/2896452
36.
KrejtzK.SzmidtT.DuchowskiA. T.KrejtzI. (2014). Entropy-based statistical analysis of eye movement transitions. In Proceedings of the symposium on eye tracking research and applications (pp. 159–166). https://doi.org/10.1145/2578153.2578176
37.
LandmanA.GroenE. L.van PaassenM.BronkhorstA.MulderM. (2017a). The influence of surprise on upset recovery performance in airline pilots. The International Journal of Aerospace Psychology, 27(1-2), 2–14. https://doi.org/10.1080/10508414.2017.1365610
38.
LandmanA.GroenE. L.van PaassenM.BronkhorstA. W.MulderM. (2017b). Dealing with unexpected events on the flight deck: A conceptual model of startle and surprise. Human Factors, 59(8), 1161–1172. https://doi.org/10.1177/0018720817723428
LounisC.PeysakhovichV.CausseM. (2020). Lempel-Ziv complexity of dwell sequences: Visual scanning pattern differences between novice and expert aircraft pilots 8 p. https://doi.org/10.3929/ETHZ-B-000407653
42.
MaherT. F.FuredyJ. J. (1979). A comparison of the pupillary and lectrodermal components of the orienting reflex in sensitivity to initial stimulus presentation, repetition, and change. In The orienting reflex in humans. Routledge.
43.
MartinW. L.MurrayP. S.BatesP. R. (2012). The effects of startle on pilots during critical events: A case study analysis.
44.
MayD. N.RiceC. G. (1971). Effects of startle due to pistol shots on control precision performance. Journal of Sound and Vibration, 15(2), 197–202. https://doi.org/10.1016/0022-460X(71)90534-7
ÖhmanA.WiensS. (2003). On the automaticity of autonomic responses in emotion : An evolutionary perspective. In Handbook of affective sciences (pp. 256–275). Oxford University Press.
47.
PooladvandS.HasanzadehS. (2023). Impacts of stress on workers’ risk-taking behaviors: Cognitive tunneling and impaired selective attention. Journal of Construction Engineering and Management, 149(8), Article 04023060. https://doi.org/10.1061/JCEMD4.COENG-13339
RiveraJ.TaloneA. B.BoesserC. T.JentschF.YehM. (2014). Startle and surprise on the flight deck : Similarities, differences, and prevalence. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 58(1), 1047–1051. https://doi.org/10.1177/1541931214581219
50.
SchroederJ. A.Bürki-cohenJ.ShikanyD. A.GingrasD. R.DesrochersP. (2014). An evaluation of several stall models for commercial transport training.
51.
SchützwohlA.ReisenzeinR. (2012). Facial expressions in response to a highly surprising event exceeding the field of vision: A test of Darwin’s theory of surprise. Evolution and Human Behavior, 33(6), 657–664. https://doi.org/10.1016/j.evolhumbehav.2012.04.003
52.
ThackrayR. I. (1983). Rate of initial recovery and subsequent radar monitoring performance following a simulated emergency involving startle. Civil Aerospace Medical Institute.
53.
ThackrayR. I.TouchstoneR. M. (1970). Recovery of motor performance following startle. Perceptual & Motor Skills, 30(1), 279–292. https://doi.org/10.2466/pms.1970.30.1.279
WoodheadM. M. (1958). The effects of bursts of loud noise on a continuous visual task. British Journal of Industrial Medicine, 15(2), 120–125. https://doi.org/10.1136/oem.15.2.120
58.
WoodsD. D.SarterN. B. (2000). Learning from automation surprises and going sour accidents. In SarterN.AmalbertiR. (Eds.), Cognitive engineering in the aviation domain. Taylor & Francis.
59.
YeomansJ. S.FranklandP. W. (1995). The acoustic startle reflex : Neurons and connections. Brain Research. Brain Research Reviews, 21(3), 301–314. https://doi.org/10.1016/0165-0173(96)00004-5
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
