The current study investigated how stress affects value-based decision-making during spatial navigation and different types of learning underlying decisions. Eighty-two adult participants (42 females) first learned to find object locations in a virtual environment from a fixed starting location (rigid learning) and then to find the same objects from unpredictable starting locations (flexible learning). Participants then decided whether to reach goal objects from the fixed or unpredictable starting location. We found that stress impairs rigid learning in females, and it does not impair, and even improves, flexible learning when performance with rigid learning is controlled for. Critically, examining how earlier learning influences subsequent decision-making using computational models, we found that stress reduces memory integration, making participants more likely to focus on recent memory and less likely to integrate information from other sources. Collectively, our results show how stress impacts different memory systems and the communication between memory and decision-making.
AllenM.PoggialiD.WhitakerK.MarshallT. R.KievitR. A. (2019). Raincloud plots: A multi-platform tool for robust data visualization. Wellcome Open Research, 4, Article 63. https://doi.org/10.12688/wellcomeopenres.15191.1
2.
AnggrainiD.GlasauerS.WunderlichK. (2018). Neural signatures of reinforcement learning correlate with strategy adoption during spatial navigation. Scientific Reports, 8(1), Article 10110. https://doi.org/10.1038/s41598-018-28241-z
3.
BehrensT. E. J.WoolrichM. W.WaltonM. E.RushworthM. F. S. (2007). Learning the value of information in an uncertain world. Nature Neuroscience, 10(9), Article 9. https://doi.org/10.1038/nn1954
4.
BellmundJ. L.DeukerL.Navarro SchröderT.DoellerC. F. (2016). Grid-cell representations in mental simulation. eLife, 5, Article e17089. https://doi.org/10.7554/eLife.17089
5.
BerghorstL.BogdanR.FrankM.PizzagalliD. (2013). Acute stress selectively reduces reward sensitivity. Frontiers in Human Neuroscience, 7, Article 133. https://doi.org/10.3389/fnhum.2013.00133
6.
BogdanR.PizzagalliD. A. (2006). Acute stress reduces reward responsiveness: Implications for depression. Biological Psychiatry, 60(10), 1147–1154. https://doi.org/10.1016/j.biopsych.2006.03.037
7.
BornsteinA. M.KhawM. W.ShohamyD.DawN. D. (2017). Reminders of past choices bias decisions for reward in humans. Nature Communications, 8, Article 15958. https://doi.org/10.1038/ncomms15958
8.
BrownT. I.CarrV. A.LaRocqueK. F.FavilaS. E.GordonA. M.BowlesB.BailensonJ. N.WagnerA. D. (2016). Prospective representation of navigational goals in the human hippocampus. Science, 352(6291), 1323–1326. https://doi.org/10.1126/science.aaf0784
9.
BrownT. I.GagnonS. A.WagnerA. D. (2020). Stress disrupts human hippocampal-prefrontal function during prospective spatial navigation and hinders flexible behavior. Current Biology, 30(10), 1821–1833. https://doi.org/10.1016/j.cub.2020.03.006
10.
BrunyéT. T.WoodM. D.HouckL. A.TaylorH. A. (2016). The path more travelled: Time pressure increases reliance on familiar route-based strategies during navigation. The Quarterly Journal of Experimental Psychology, 70(8), 1439–1452. https://doi.org/10.1080/17470218.2016.1187637
11.
BuchananT. W.TranelD.AdolphsR. (2006). Impaired memory retrieval correlates with individual differences in cortisol response but not autonomic response. Learning & Memory, 13(3), 382–387. https://doi.org/10.1101/lm.206306
12.
BusemeyerJ. R.GluthS.RieskampJ.TurnerB. M. (2019). Cognitive and neural bases of multi-attribute, multi-alternative, value-based decisions. Trends in Cognitive Sciences, 23(3), 251–263. https://doi.org/10.1016/j.tics.2018.12.003
13.
CollinsA. G. E. (2019). Reinforcement learning: Bringing together computation and cognition. Current Opinion in Behavioral Sciences, 29, 63–68. https://doi.org/10.1016/j.cobeha.2019.04.011
14.
CrumA. J.AkinolaM.MartinA.FathS. (2017). The role of stress mindset in shaping cognitive, emotional, and physiological responses to challenging and threatening stress. Anxiety, Stress, & Coping, 30(4), 379–395. https://doi.org/10.1080/10615806.2016.1275585
DraheimC.HarrisonT. L.EmbretsonS. E.EngleR. W. (2018). What item response theory can tell us about the complex span tasks. Psychological Assessment, 30(1), 116–129. https://doi.org/10.1037/pas0000444
17.
DuncanK. D.ShohamyD. (2016). Memory states influence value-based decisions. Journal of Experimental Psychology: General, 145(11), 1420–1426. https://doi.org/10.1037/xge0000231
18.
EcksteinM. K.WilbrechtL.CollinsA. G. (2021). What do reinforcement learning models measure? Interpreting model parameters in cognition and neuroscience. Current Opinion in Behavioral Sciences, 41, 128–137. https://doi.org/10.1016/j.cobeha.2021.06.004
19.
ElzingaB. M.BakkerA.BremnerJ. D. (2005). Stress-induced cortisol elevations are associated with impaired delayed, but not immediate recall. Psychiatry Research, 134(3), 211–223. https://doi.org/10.1016/j.psychres.2004.11.007
20.
GagnonS. A.WagnerA. D. (2016). Acute stress and episodic memory retrieval: Neurobiological mechanisms and behavioral consequences. Annals of the New York Academy of Sciences, 1369(1), 55–75. https://doi.org/10.1111/nyas.12996
21.
GagnonS. A.WaskomM. L.BrownT. I.WagnerA. D. (2019). Stress impairs episodic retrieval by disrupting hippocampal and cortical mechanisms of remembering. Cerebral Cortex, 29(7), 2947–2964. https://doi.org/10.1093/cercor/bhy162
22.
GoodroeS. C.StarnesJ.BrownT. I. (2018). The complex nature of hippocampal-striatal interactions in spatial navigation. Frontiers in Human Neuroscience, 12, Article 250. https://doi.org/10.3389/fnhum.2018.00250
GuenzelF. M.WolfO. T.SchwabeL. (2014). Sex differences in stress effects on response and spatial memory formation. Neurobiology of Learning and Memory, 109, 46–55. https://doi.org/10.1016/j.nlm.2013.11.020
25.
HeQ.HanA. T.ChuramanT. A.BrownT. I. (2021). The role of working memory capacity in spatial learning depends on spatial information integration difficulty in the environment. Journal of Experimental Psychology: General, 150(4), 666–685. https://doi.org/10.1037/xge0000972
26.
HeQ.LiuJ. L.BeveridgeE. H.EschapasseL.VargasV.BrownT. I. (2022). Episodic memory integration shapes value-based decision-making in spatial navigation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 48(8), 1098–1109. https://doi.org/10.1037/xlm0001133
27.
HeQ.LiuJ. L.EschapasseL.BeveridgeE. H.BrownT. I. (2022). A comparison of reinforcement learning models of human spatial navigation. Scientific Reports, 12, Article 13923. https://doi.org/10.1038/s41598-022-18245-1
28.
HeQ.McNamaraT. P.BodenheimerB.KlippelA. (2019). Acquisition and transfer of spatial knowledge during wayfinding. Journal of Experimental Psychology: Learning, Memory, and Cognition, 45(8), 1364–1386. https://doi.org/10.1037/xlm0000654
29.
HeQ.McNamaraT. P.BrownT. I. (2019). Manipulating the visibility of barriers to improve spatial navigation efficiency and cognitive mapping. Scientific Reports, 9, Article 11567. https://doi.org/10.1038/s41598-019-48098-0
30.
HegartyM.RichardsonA. E.MontelloD. R.LovelaceK.SubbiahI. (2002). Development of a self-report measure of environmental spatial ability. Intelligence, 30(5), 425–447. https://doi.org/10.1016/S0160-2896(02)00116-2
31.
HertwigR.BarronG.WeberE. U.ErevI. (2004). Decisions from experience and the effect of rare events in risky choice. Psychological Science, 15(8), 534–539. https://doi.org/10.1111/j.0956-7976.2004.00715.x
KuhlmannS.PielM.WolfO. T. (2005). Impaired memory retrieval after psychosocial stress in healthy young men. The Journal of Neuroscience, 25(11), 2977–2982. https://doi.org/10.1523/JNEUROSCI.5139-04.2005
38.
KumarP.BerghorstL. H.NickersonL. D.DutraS. J.GoerF. K.GreveD. N.PizzagalliD. A. (2014). Differential effects of acute stress on anticipatory and consummatory phases of reward processing. Neuroscience, 266, 1–12. https://doi.org/10.1016/j.neuroscience.2014.01.058
LighthallN. R.MatherM.GorlickM. A. (2009). Acute stress increases sex differences in risk seeking in the Balloon Analogue Risk Task. PLOS ONE, 4(7), Article e6002. https://doi.org/10.1371/journal.pone.0006002
41.
LighthallN. R.SakakiM.VasunilashornS.NgaL.SomayajulaS.ChenE. Y.SamiiN.MatherM. (2012). Gender differences in reward-related decision processing under stress. Social Cognitive and Affective Neuroscience, 7(4), 476–484. https://doi.org/10.1093/scan/nsr026
42.
LockwoodP. L.Klein-FlüggeM. C. (2021). Computational modelling of social cognition and behaviour—A reinforcement learning primer. Social Cognitive and Affective Neuroscience, 16(8), 761–771. https://doi.org/10.1093/scan/nsaa040
43.
MaximP.BrownT. I. (2023). Toward an understanding of cognitive mapping ability through manipulations and measurement of schemas and stress. Topics in Cognitive Science, 15(1), 75–101. https://doi.org/10.1111/tops.12576
44.
MurtyV. P.FeldmanHallO.HunterL. E.PhelpsE. A.DavachiL. (2016). Episodic memories predict adaptive value-based decision-making. Journal of Experimental Psychology: General, 145(5), 548–558. https://doi.org/10.1037/xge0000158
45.
NewmanE. L.CaplanJ. B.KirschenM. P.KorolevI. O.SekulerR.KahanaM. J. (2007). Learning your way around town: How virtual taxicab drivers learn to use both layout and landmark information. Cognition, 104(2), 231–253. https://doi.org/10.1016/j.cognition.2006.05.013
46.
ParkH.LeeD.CheyJ. (2017). Stress enhances model-free reinforcement learning only after negative outcome. PLOS ONE, 12(7), Article e0180588. https://doi.org/10.1371/journal.pone.0180588
47.
PazzagliaF.De BeniR. (2001). Strategies of processing spatial information in survey and landmark-centred individuals. European Journal of Cognitive Psychology, 13(4), 493–508. https://doi.org/10.1080/09541440125778
48.
PorcelliA. J.DelgadoM. R. (2017). Stress and decision making: Effects on valuation, learning, and risk-taking. Current Opinion in Behavioral Sciences, 14, 33–39. https://doi.org/10.1016/j.cobeha.2016.11.015
49.
PrestonS. D.BuchananT. W.StansfieldR. B.BecharaA. (2007). Effects of anticipatory stress on decision making in a gambling task. Behavioral Neuroscience, 121(2), 257–263. https://doi.org/10.1037/0735-7044.121.2.257
50.
QuesadaA. A.WiemersU. S.SchoofsD.WolfO. T. (2012). Psychosocial stress exposure impairs memory retrieval in children. Psychoneuroendocrinology, 37(1), 125–136. https://doi.org/10.1016/j.psyneuen.2011.05.013
51.
RaioC. M.KonovaA. B.OttoA. R. (2020). Trait impulsivity and acute stress interact to influence choice and decision speed during multi-stage decision-making. Scientific Reports, 10, Article 7754. https://doi.org/10.1038/s41598-020-64540-0
52.
SchönfeldP.AckermannK.SchwabeL. (2014). Remembering under stress: Different roles of autonomic arousal and glucocorticoids in memory retrieval. Psychoneuroendocrinology, 39, 249–256. https://doi.org/10.1016/j.psyneuen.2013.09.020
53.
SchwabeL.BohringerA.ChatterjeeM.SchachingerH. (2008). Effects of pre-learning stress on memory for neutral, positive and negative words: Different roles of cortisol and autonomic arousal. Neurobiology of Learning and Memory, 90(1), 44–53. https://doi.org/10.1016/j.nlm.2008.02.002
SchwabeL.OitzlM. S.PhilippsenC.RichterS.BohringerA.WippichW.SchachingerH. (2007). Stress modulates the use of spatial versus stimulus-response learning strategies in humans. Learning & Memory, 14(1–2), 109–116. https://doi.org/10.1101/lm.435807
SchwabeL.WolfO. T. (2014). Timing matters: Temporal dynamics of stress effects on memory retrieval. Cognitive, Affective & Behavioral Neuroscience, 14(3), 1041–1048. https://doi.org/10.3758/s13415-014-0256-0
58.
SchwabeL.WolfO. T.OitzlM. S. (2010). Memory formation under stress: Quantity and quality. Neuroscience & Biobehavioral Reviews, 34(4), 584–591. https://doi.org/10.1016/j.neubiorev.2009.11.015
59.
ShohamyD.WagnerA. D. (2008). Integrating memories in the human brain: Hippocampal-midbrain encoding of overlapping events. Neuron, 60(2), 378–389. https://doi.org/10.1016/j.neuron.2008.09.023
60.
SmeetsT.GiesbrechtT.JelicicM.MerckelbachH. (2007). Context-dependent enhancement of declarative memory performance following acute psychosocial stress. Biological Psychology, 76(1–2), 116–123. https://doi.org/10.1016/j.biopsycho.2007.07.001
61.
SpielbergerC. D.GorsuchR. L.LusheneR.VaggP.R.JacobsG. A. (1983). Manual for the state-trait anxiety inventory. Consulting Psychologists Press.
62.
Tóth-FáberE.JanacsekK.SzőllősiÁ.KériS.NemethD. (2021). Regularity detection under stress: Faster extraction of probability-based regularities. PLOS ONE, 16(6), Article e0253123. https://doi.org/10.1371/journal.pone.0253123
63.
van den BosR.HarteveldM.StoopH. (2009). Stress and decision-making in humans: Performance is related to cortisol reactivity, albeit differently in men and women. Psychoneuroendocrinology, 34(10), 1449–1458. https://doi.org/10.1016/j.psyneuen.2009.04.016
64.
van GervenD. J. H.FergusonT.SkeltonR. W. (2016). Acute stress switches spatial navigation strategy from egocentric to allocentric in a virtual Morris water maze. Neurobiology of Learning and Memory, 132, 29–39. https://doi.org/10.1016/j.nlm.2016.05.003
65.
VogelS.SchwabeL. (2016). Learning and memory under stress: Implications for the classroom. NPJ Science of Learning, 1, Article 16011. https://doi.org/10.1038/npjscilearn.2016.11
66.
ZoladzP. R.ClarkB.WarneckeA.SmithL.TabarJ.TalbotJ. N. (2011). Pre-learning stress differentially affects long-term memory for emotional words, depending on temporal proximity to the learning experience. Physiology & Behavior, 103(5), 467–476. https://doi.org/10.1016/j.physbeh.2011.01.016
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
