People learn differently from good and bad outcomes. We argue that valence-dependent learning asymmetries are partly driven by beliefs about the causal structure of the environment. If hidden causes can intervene to generate bad (or good) outcomes, then a rational observer will assign blame (or credit) to these hidden causes, rather than to the stable outcome distribution. Thus, a rational observer should learn less from bad outcomes when they are likely to have been generated by a hidden cause, and this pattern should reverse when hidden causes are likely to generate good outcomes. To test this hypothesis, we conducted two experiments (N = 80, N = 255) in which we explicitly manipulated the behavior of hidden agents. This gave rise to both kinds of learning asymmetries in the same paradigm, as predicted by a novel Bayesian model. These results provide a mechanistic framework for understanding how causal attributions contribute to biased learning.
AbramsonL. Y.SeligmanM. E. P.TeasdaleJ. D. (1978). Learned helplessness in humans: Critique and reformulation. Journal of Abnormal Psychology, 87, 49–74. doi:10.1037/0021-843x.87.1.49
2.
AlloyL. B.AbramsonL. Y. (1979). Judgment of contingency in depressed and nondepressed students: Sadder but wiser?Journal of Experimental Psychology: General, 108, 441–485. doi:10.1037/0096-3445.108.4.441
3.
BaumeisterR. F.BratslavskyE.FinkenauerC.VohsK. D. (2001). Bad is stronger than good. Review of General Psychology, 5, 323–370. doi:10.1037/1089-2680.5.4.323
4.
BradleyG. W. (1978). Self-serving biases in the attribution process: A reexamination of the fact or fiction question. Journal of Personality and Social Psychology, 36, 56–71. doi:10.1037/0022-3514.36.1.56
5.
CampbellW. K.SedikidesC. (1999). Self-threat magnifies the self-serving bias: A meta-analytic integration. Review of General Psychology, 3, 23–43. doi:10.1037/1089-2680.3.1.23
6.
ChaseH. W.FrankM. J.MichaelA.BullmoreE. T.SahakianB. J.RobbinsT. W. (2010). Approach and avoidance learning in patients with major depression and healthy controls: Relation to anhedonia. Psychological Medicine, 40, 433–440. doi:10.1017/S0033291709990468
7.
ChristakouA.GershmanS. J.NivY.SimmonsA.BrammerM.RubiaK. (2013). Neural and psychological maturation of decision-making in adolescence and young adulthood. Journal of Cognitive Neuroscience, 25, 1807–1823. doi:10.1162/jocn_a_00447
8.
EilD.RaoJ. M. (2011). The good news-bad news effect: Asymmetric processing of objective information about yourself. American Economic Journal: Microeconomics, 3, 114–138. doi:10.1257/mic.3.2.114
9.
FrankM. J.DollB. B.Oas-TerpstraJ.MorenoF. (2009). Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nature Neuroscience, 12, 1062–1068. doi:10.1038/nn.2342
10.
GershmanS. J. (2015a). Do learning rates adapt to the distribution of rewards?Psychonomic Bulletin & Review, 22, 1320–1327. doi:10.3758/s13423-014-0790-3
11.
GershmanS. J. (2015b). A unifying probabilistic view of associative learning. PLOS Computational Biology, 11(11), Article e1004567. doi:10.1371/journal.pcbi.1004567
12.
GershmanS. J. (2016). Empirical priors for reinforcement learning models. Journal of Mathematical Psychology, 71, 1–6. doi:10.1016/j.jmp.2016.01.006
13.
GershmanS. J. (2018). How to never be wrong. Psychonomic Bulletin & Review. Advance online publication. doi:10.3758/s13423-018-1488-8
14.
GershmanS. J.NivY. (2015). Novelty and inductive generalization in human reinforcement learning. Topics in Cognitive Science, 7, 391–415. doi:10.1111/tops.12138
15.
GershmanS. J.PesaranB.DawN. D. (2009). Human reinforcement learning subdivides structured action spaces by learning effector-specific values. The Journal of Neuroscience, 29, 13524–13531. doi:10.1523/JNEUROSCI.2469-09.2009
16.
HughesB. L.ZakiJ. (2015). The neuroscience of motivated cognition. Trends in Cognitive Sciences, 19(2), 62–64. doi:10.1016/j.tics.2014.12.006
17.
KleinC. T. F.Helweg-LarsenM. (2002). Perceived control and the optimistic bias: A meta-analytic review. Psychology & Health, 17, 437–446. doi:10.1080/0887044022000004920
18.
KuzmanovicB.JeffersonA.VogeleyK. (2016). The role of the neural reward circuitry in self-referential optimistic belief updates. NeuroImage, 133, 151–162.
19.
LefebvreG.LebretonM.MeynielF.Bourgeois-GirondeS.PalminteriS. (2017). Behavioural and neural characterization of optimistic reinforcement learning. Nature Human Behaviour, 1, Article 0067. doi:10.1038/s41562-017-0067
20.
MaierS. F.SeligmanM. E. (1976). Learned helplessness: Theory and evidence. Journal of Experimental Psychology: General, 105, 3–46. doi:10.1037/0096-3445.105.1.3
21.
MillerD. T.RossM. (1975). Self-serving biases in the attribution of causality: Fact or fiction?Psychological Bulletin, 82, 213–225. doi:10.1037/h0076486
22.
MorewedgeC. K. (2009). Negativity bias in attribution of external agency. Journal of Experimental Psychology: General, 138, 535–545. doi:10.1037/a0016796
23.
MoutsianaC.CharpentierC. J.GarrettN.CohenM. X.SharotT. (2015). Human frontal-subcortical circuit and asymmetric belief updating. The Journal of Neuroscience, 35, 14077–14085. doi:10.1523/JNEUROSCI.1120-15.2015
24.
MsetfiR. M.MurphyR. A.SimpsonJ.KornbrotD. E. (2005). Depressive realism and outcome density bias in contingency judgments: The effect of the context and intertrial interval. Journal of Experimental Psychology: General, 134, 10–22. doi:10.1037/0096-3445.134.1.10
25.
NelsonR. E.CraigheadW. E. (1977). Selective recall of positive and negative feedback, self-control behaviors, and depression. Journal of Abnormal Psychology, 86, 379–388.
26.
NivY.EdlundJ. A.DayanP.O’DohertyJ. P. (2012). Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain. The Journal of Neuroscience, 32, 551–562. doi:10.1523/JNEUROSCI.5498-10.2012
27.
RigouxL.StephanK. E.FristonK. J.DaunizeauJ. (2014). Bayesian model selection for group studies — revisited. NeuroImage, 84, 971–985. doi:10.1016/j.neuroimage.2013.08.065
28.
SharotT.KornC. W.DolanR. J. (2011). How unrealistic optimism is maintained in the face of reality. Nature Neuroscience, 14, 1475–1479. doi:10.1038/nn.2949
29.
SmoskiM. J.LynchT. R.RosenthalM. Z.CheavensJ. S.ChapmanA. L.KrishnanR. R. (2008). Decision-making and risk aversion among depressive adults. Journal of Behavior Therapy and Experimental Psychiatry, 39, 567–576. doi:10.1016/j.jbtep.2008.01.004
30.
StankeviciusA.HuysQ. J. M.KalraA.SerièsP. (2014). Optimism as a prior belief about the probability of future reward. PLOS Computational Biology, 10(5), Article e1003605. doi:10.1371/journal.pcbi.1003605
31.
StephanK. E.PennyW. D.DaunizeauJ.MoranR. J.FristonK. J. (2009). Bayesian model selection for group studies. NeuroImage, 46, 1004–1017. doi:10.1016/j.neuroimage.2009.03.025
32.
TakahataK.TakahashiH.MaedaT.UmedaS.SuharaT.MimuraM.KatoM. (2012). It’s not my fault: Postdictive modulation of intentional binding by monetary gains and losses. PLOS ONE, 7(12), Article e53421. doi:10.1371/journal.pone.0053421
33.
TaylorS. E. (1991). Asymmetrical effects of positive and negative events: The mobilization-minimization hypothesis. Psychological Bulletin, 110, 67–85.
34.
WachterT.LunguO. V.LiuT.WillinghamD. T.AsheJ. (2009). Differential effect of reward and punishment on procedural learning. The Journal of Neuroscience, 29, 436–443. doi:10.1523/JNEUROSCI.4132-08.2009
35.
WeinsteinN. D. (1980). Unrealistic optimism about future life events. Journal of Personality and Social Psychology, 39, 806–820. doi:10.1037/0022-3514.39.5.806
36.
YoshieM.HaggardP. (2013). Negative emotional outcomes attenuate sense of agency over voluntary actions. Current Biology, 23, 2028–2032. doi:10.1016/j.cub.2013.08.034
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
