Attention Allocation to Projection Level Alleviates Overconfidence in Situation Awareness

Abstract

Overconfidence in situation awareness (SA) can lead to various detrimental consequences, including risky behaviors. This study investigates the influence of stress and attention allocation on SA in manufacturing. Specifically, this study aims to (1) examine the effects of stress on objective SA, (2) explore the relationship between SA levels and SA overconfidence, and (3) investigate the potential alleviation of SA overconfidence through attention allocation to more challenging SA levels. These findings demonstrate that stress impairs the comprehension aspect of SA. Moreover, SA overconfidence increases with the SA level. In exploring strategies to mitigate SA overconfidence, allocating attention specifically to the most challenging SA level—SA projection—proved effective in alleviating overconfidence. These findings contribute to future SA research by clarifying the relationship between stress and SA, uncovering the link between SA levels and SA overconfidence, and exploring methods to alleviate overconfidence and improve decision accuracy in manufacturing systems.

Keywords

situation awareness situation awareness overconfidence attention allocation situation awareness level stress

Get full access to this article

View all access options for this article.

References

Ashton

S. M.

Benoit

R. G.

Quaedflieg

C. W. E. M.

(2020). The impairing effect of acute stress on suppression-induced forgetting of future fears and its moderation by working memory capacity. Psychoneuroendocrinology, 120, 104790. https://doi.org/10.1016/j.psyneuen.2020.104790

Axure Software Solutions . (2021). Axure RP 10. Axure Software Solutions, Inc. https://www.axure.com/.

Bai

Dallasega

Orzes

Sarkis

(2020). Industry 4.0 technologies assessment: A sustainability perspective. International Journal of Production Economics, 229(5), 107776. https://doi.org/10.1016/j.ijpe.2020.107776

Dunning

(2011). Chapter five - the dunning–kruger effect: On being ignorant of one’s own ignorance. In Olson

J. M.

Zanna

M. P.

(Eds.), Advances in experimental social psychology (Vol. 44, pp. 247–296). Academic Press. https://doi.org/10.1016/B978-0-12-385522-0.00005-6

Ehrlinger

Mitchum

A. L.

Dweck

C. S.

(2016). Understanding overconfidence: Theories of intelligence, preferential attention, and distorted self-assessment. Journal of Experimental Social Psychology, 63(4), 94–100. https://doi.org/10.1016/j.jesp.2015.11.001

Endsley

M. R.

(1995a). Measurement of situation awareness in dynamic systems. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37(1), 65–84. https://doi.org/10.1518/001872095779049499

Endsley

M. R.

(1995b). Toward a theory of situation awareness in dynamic systems. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37(1), 32–64. https://doi.org/10.1518/001872095779049543

Endsley

M. R.

(2006). Expertise and situation awareness. In Ericsson

K. A.

Charness

Feltovich

P. J.

Hoffman

R. R.

(Eds.), The cambridge handbook of expertise and expert performance (pp. 633–652). Cambridge University Press. https://doi.org/10.1017/CBO9780511816796.036

Endsley

M. R.

(2012). Designing for situation awareness: An approach to user-centered design (2nd ed.). CRC Press. https://doi.org/10.1201/b11371

10.

Endsley

M. R.

(2015). Situation awareness misconceptions and misunderstandings. Journal of Cognitive Engineering and Decision Making, 9(1), 4–32. https://doi.org/10.1177/1555343415572631

11.

Endsley

M. R.

(2020). The divergence of objective and subjective situation awareness: A meta-analysis. Journal of Cognitive Engineering and Decision Making, 14(1), 34–53. https://doi.org/10.1177/1555343419874248

12.

Endsley

M. R.

(2021a). Situation awareness. In Salvendy

Karwowski

(Eds.), Handbook of human factors and ergonomics (5th ed., pp. 434–455). Wiley. https://doi.org/10.1002/9781119636113.ch17

13.

Endsley

M. R.

(2021b). A systematic review and meta-analysis of direct objective measures of situation awareness: A comparison of SAGAT and SPAM. Human Factors, 63(1), 124–150. https://doi.org/10.1177/0018720819875376

14.

Finkelstein

E. A.

Baid

Cheung

Y. B.

Schweitzer

M. E.

Malhotra

Volpp

Kanesvaran

Lee

L. H.

Dent

R. A.

Ng Chau Hsien

Bin Harunal Rashid

M. F.

Somasundaram

(2021). Hope, bias and survival expectations of advanced cancer patients: A cross-sectional study. Psycho-Oncology, 30(5), 780–788. https://doi.org/10.1002/pon.5675

15.

Gigerenzer

(2008). Why heuristics work. Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 3(1), 20–29. https://doi.org/10.1111/j.1745-6916.2008.00058.x

16.

Gonzalez

Wimisberg

(2007). Situation awareness in dynamic decision making: Effects of practice and working memory. Journal of Cognitive Engineering and Decision Making, 1(1), 56–74. https://doi.org/10.1177/155534340700100103

17.

Griffin

Tversky

(1992). The weighing of evidence and the determinants of confidence. Cognitive Psychology, 24(3), 411–435. https://doi.org/10.1016/0010-0285(92)90013-R

18.

Hamilton

Mancuso

Mohammed

Tesler

McNeese

(2017). Skilled and unaware: The interactive effects of team cognition, team metacognition, and task confidence on team performance. Journal of Cognitive Engineering and Decision Making, 11(4), 382–395. https://doi.org/10.1177/1555343417731429

19.

Harris

P. S.

Harris

P. R.

Miles

(2017). Self-affirmation improves performance on tasks related to executive functioning. Journal of Experimental Social Psychology, 70, 281–285. https://doi.org/10.1016/j.jesp.2016.11.011

20.

Hoch

S. J.

(1985). Counterfactual reasoning and accuracy in predicting personal events. Journal of Experimental Psychology: Learning, Memory, and Cognition, 11(4), 719–731. https://doi.org/10.1037/0278-7393.11.1-4.719

21.

International Organization for Standardization . (2019). Ergonomics of human-system interaction—Part 210: Human-centred design for interactive systems (ISO Standard No. 9241-210:2019) (2nd ed.). International Organization for Standardization. https://www.iso.org/standard/77520.html

22.

Jaeggi

S. M.

Buschkuehl

Perrig

W. J.

Meier

(2010). The concurrent validity of the N-back task as a working memory measure. Memory, 18(4), 394–412. https://doi.org/10.1080/09658211003702171

23.

Jiang

Rau

P. L. P.

(2017). Working memory performance impaired after exposure to acute social stress: The evidence comes from ERPs. Neuroscience Letters, 658, 137–141. https://doi.org/10.1016/j.neulet.2017.08.054

24.

Jiang

Karran

A. J.

Coursaris

C. K.

Léger

P.-M.

Beringer

(2023). A situation awareness perspective on human-AI interaction: Tensions and opportunities. International Journal of Human-Computer Interaction, 39(9), 1789–1806. https://doi.org/10.1080/10447318.2022.2093863

25.

Johnson

D. D. P.

Fowler

J. H.

(2011). The evolution of overconfidence. Nature, 477(7364), 317–320. https://doi.org/10.1038/nature10384

26.

Kadir

B. A.

Broberg

Conceição

C. S. d.

(2019). Current research and future perspectives on human factors and ergonomics in Industry 4.0. Computers & Industrial Engineering, 137(2), 106004. https://doi.org/10.1016/j.cie.2019.106004

27.

Kahneman

(2011). Thinking, fast and slow. Farrar, Straus and Giroux.

28.

Kiani

Borjali

Farahbakhsh

Farrokhi

(2015). Predictive power of work situation awareness by work overload and job stress among workers: Implication for occupational health. Journal of Health Sciences and Surveillance System, 3(2), 64–70.

29.

Klayman

Soll

J. B.

González-Vallejo

Barlas

(1999). Overconfidence: It depends on how, what, and whom you ask. Organizational Behavior and Human Decision Processes, 79(3), 216–247. https://doi.org/10.1006/obhd.1999.2847

30.

Kool

McGuire

J. T.

Rosen

Z. B.

Botvinick

M. M.

(2010). Decision making and the avoidance of cognitive demand. Journal of Experimental Psychology: General, 139(4), 665–682. https://doi.org/10.1037/a0020198

31.

Lall

Torvatn

Seim

E. A.

(2017). Towards industry 4.0: Increased need for situational awareness on the shop floor. In Advances in production management systems. The Path to Intelligent, Collaborative and Sustainable Manufacturing (pp. 322–329). Springer.

32.

Landmark

A. D.

Arica

Kløve

Kamsvåg

P. F.

Seim

E. A.

Oliveira

(2019). Situation awareness for effective production control. Advances in production management systems. Production management for the factory of the future (566, pp. 690–698). Springer.

33.

Lee

J. D.

(1999). Measuring driver adaptation to in-vehicle information systems: Disassociation of subjective and objective situation awareness measures. Proceedings of the Human Factors and Ergonomics Society - Annual Meeting, 43(18), 992–996. https://doi.org/10.1177/154193129904301810

34.

Lempert

K. M.

McGuire

J. T.

Hazeltine

D. B.

Phelps

E. A.

Kable

J. W.

(2018). The effects of acute stress on the calibration of persistence. Neurobiology of Stress, 8, 1–9. https://doi.org/10.1016/j.ynstr.2017.11.001

35.

Liang

Yang

Prakah-Asante

K. O.

Curry

Blommer

Swaminathan

Pitts

B. J.

(2021). Using eye-tracking to investigate the effects of pre-takeover visual engagement on situation awareness during automated driving. Accident Analysis & Prevention, 157(1), 106143. https://doi.org/10.1016/j.aap.2021.106143

36.

Liang

Zhou

Shen

(2022). Unveiling the mechanism of construction workers’ unsafe behaviors from an occupational stress perspective: A qualitative and quantitative examination of a stress–cognition–safety model. Safety Science, 145(2), 105486. https://doi.org/10.1016/j.ssci.2021.105486

37.

Lichacz

F. M. J.

(2009). Calibrating situation awareness and confidence within a multinational coalition operation. Military Psychology, 21(3), 412–426. https://doi.org/10.1080/08995600902914800

38.

Lin

Leung

A. W. S.

Zhang

(2020). Individual differences under acute stress: Higher cortisol responders performs better on N-back task in young men. International Journal of Psychophysiology: Official Journal of the International Organization of Psychophysiology, 150, 20–28. https://doi.org/10.1016/j.ijpsycho.2020.01.006

39.

Liu

Chen

Rau

P.-L. P.

(2023). The effects of motivation and noise on situation awareness: A study based on SAGAT and EEG. International Journal of Industrial Ergonomics, 97, 103491. https://doi.org/10.1016/j.ergon.2023.103491

40.

Coster

de Winter

(2017). How much time do drivers need to obtain situation awareness? A laboratory-based study of automated driving. Applied Ergonomics, 60, 293–304. https://doi.org/10.1016/j.apergo.2016.12.003

41.

Marottoli

R. A.

Richardson

E. D.

(1998). Confidence in, and self-rating of, driving ability among older drivers. Accident Analysis & Prevention, 30(3), 331–336. https://doi.org/10.1016/S0001-4575(97)00100-0

42.

Molins

Hassen

N. B.

Paz

Costa

Serrano

M.-Ã.

(2023). Logical decisions after a psychosocial stressor: The late phase of acute stress reduces loss aversion. Physiology & Behavior, 268, 114232. https://doi.org/10.1016/j.physbeh.2023.114232

43.

Moore

D. A.

Healy

P. J.

(2008). The trouble with overconfidence. Psychological Review, 115(2), 502–517. https://doi.org/10.1037/0033-295x.115.2.502

44.

Mulet Alberola

J. A.

Fassi

(2022). Analysis of interactive manufacturing systems: Towards a performance‐based assessment methodology. IET Collaborative Intelligent Manufacturing, 4(4), 286–298. https://doi.org/10.1049/cim2.12063

45.

Onnasch

Wickens

C. D.

Manzey

(2014). Human performance consequences of stages and levels of automation: An integrated meta-analysis. Human Factors, 56(3), 476–488. https://doi.org/10.1177/0018720813501549

46.

Pacaux-Lemoine

M.-P.

Trentesaux

Zambrano Rey

Millot

(2017). Designing intelligent manufacturing systems through human-machine cooperation principles: A human-centered approach. Computers & Industrial Engineering, 111, 581–595. https://doi.org/10.1016/j.cie.2017.05.014

47.

Price

Tenan

Head

Maslin

Lafiandra

(2016). Acute stress causes over confidence in Situation Awareness. In 2016 IEEE International multi-disciplinary conference on cognitive methods in situation awareness and decision support, CogSIMA 2016, San Diego, CA, USA, 21–25 March, 2016.

48.

Price

T. F.

LaFiandra

(2017). The perception of team engagement reduces stress induced situation awareness overconfidence and risk-taking. Cognitive Systems Research, 46, 52–60. https://doi.org/10.1016/j.cogsys.2017.02.004

49.

Sänger

Bechtold

Schoofs

Blaszkewicz

Wascher

(2014). The influence of acute stress on attention mechanisms and its electrophysiological correlates. Frontiers in Behavioral Neuroscience, 8, 353. https://doi.org/10.3389/fnbeh.2014.00353

50.

Selkowitz

A. R.

Lakhmani

S. G.

Chen

J. Y. C.

(2017). Using agent transparency to support situation awareness of the Autonomous Squad Member. Cognitive Systems Research, 46(194), 13–25. https://doi.org/10.1016/j.cogsys.2017.02.003

51.

Shah

A. K.

Oppenheimer

D. M.

(2008). Heuristics made easy: An effort-reduction framework. Psychological Bulletin, 134(2), 207–222. https://doi.org/10.1037/0033-2909.134.2.207

52.

Sharot

(2011). The optimism bias. Current Biology: CB, 21(23), R941–R945. https://doi.org/10.1016/j.cub.2011.10.030

53.

Shi

Rothrock

(2023). Using eye movements to evaluate the effectiveness of the situation awareness rating technique scale in measuring situation awareness for smart manufacturing. Ergonomics, 66(8), 1090–1098. https://doi.org/10.1080/00140139.2022.2132299

54.

Shields

G. S.

(2020). Stress and cognition: A user’s guide to designing and interpreting studies. Psychoneuroendocrinology, 112, 104475. https://doi.org/10.1016/j.psyneuen.2019.104475

55.

Shields

G. S.

Sazma

M. A.

McCullough

A. M.

Yonelinas

A. P.

(2017). The effects of acute stress on episodic memory: A meta-analysis and integrative review. Psychological Bulletin, 143(6), 636–675. https://doi.org/10.1037/bul0000100

56.

Sneddon

Mearns

Flin

(2013). Stress, fatigue, situation awareness and safety in offshore drilling crews. Safety Science, 56, 80–88. https://doi.org/10.1016/j.ssci.2012.05.027

57.

Sohn

Y. W.

Doane

S. M.

(2004). Memory processes of flight situation awareness: Interactive roles of working memory capacity, long-term working memory, and expertise. Human Factors, 46(3), 461–475. https://doi.org/10.1518/hfes.46.3.461.50392

58.

Sulistyawati

Wickens

C. D.

Chui

Y. P.

(2011). Prediction in situation awareness: Confidence bias and underlying cognitive abilities. The International Journal of Aviation Psychology, 21(2), 153–174. https://doi.org/10.1080/10508414.2011.556492

59.

Thompson

E. R.

(2007). Development and validation of an internationally reliable short-form of the positive and negative affect schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), 227–242. https://doi.org/10.1177/0022022106297301

60.

Visser

T. A. W.

Bender

A. D.

Bowden

V. K.

Black

S. C.

Greenwell-Barnden

Loft

Lipp

O. V.

(2019). Individual differences in higher-level cognitive abilities do not predict overconfidence in complex task performance. Consciousness and Cognition, 74, 102777. https://doi.org/10.1016/j.concog.2019.102777

61.

Wang

Rao

H. R.

(2016). Overconfidence in phishing email detection. Journal of the Association for Information Systems, 17(11), 759–783. https://doi.org/10.17705/1jais.00442

62.

Weinstein

(1980). Unrealistic optimism about future life events. Journal of Personality and Social Psychology, 39(5), 806–820. https://doi.org/10.1037/0022-3514.39.5.806

63.

Wickens

C. D.

(2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3(2), 159–177. https://doi.org/10.1080/14639220210123806

64.

Wickens

C. D.

(2008). Multiple resources and mental workload. Human factors, 50(3), 449–455. https://doi.org/10.1518/001872008x288394

65.

Wickens

C. D.

(2020). Processing resources and attention. In Multiple task performance (pp. 3–34). CRC Press.

66.

Wickens

C. D.

Gutzwiller

R. S.

Santamaria

(2015). Discrete task switching in overload: A meta-analyses and a model. International Journal of Human-Computer Studies, 79, 79–84. https://doi.org/10.1016/j.ijhcs.2015.01.002

67.

van Dijk

(2021). Acute stress amplifies experienced and anticipated regret in counterfactual decision-making. Stress: The International Journal on the Biology of Stress, 24(4), 359–369. https://doi.org/10.1080/10253890.2020.1813275

68.

Yeo

L. G.

Sun

Liu

Trapsilawati

Sourina

Chen

C.-H.

Mueller-Wittig

Ang

W. T.

(2017). Mobile EEG-based situation awareness recognition for air traffic controllers. In 2017 IEEE International Conference on systems, man, and Cybernetics (SMC), Banff, AB, Canada, 5–8 October, 2017.

69.

Chen

Yan

Kohn

(2023). Acute stress selectively blunts reward anticipation but not consumption: An ERP study. Neurobiology of Stress, 27(11), 100583. https://doi.org/10.1016/j.ynstr.2023.100583