Across development, people tend to demonstrate a preference for contexts in which they have the opportunity to make choices. However, it is not clear how children, adolescents, and adults learn to calibrate this preference based on the costs and benefits of agentic choice. Here, in both a primary, in-person, reinforcement-learning experiment (N = 92; age range = 10–25 years) and a preregistered online replication study (N = 150; age range = 8–25 years), we found that participants overvalued agentic choice but also calibrated their agency decisions to the reward structure of the environment, increasingly selecting agentic choice when choice had greater instrumental value. Regression analyses and computational modeling of participant choices revealed that participants’ bias toward agentic choice—reflecting its intrinsic value—remained consistent across age, whereas sensitivity to the instrumental value of agentic choice increased from childhood to early adulthood.
Ackerlund BrandtJ. A.DozierC. L.JuanicoJ. F.LaudontC. L.MickB. R. (2015). The value of choice as a reinforcer for typically developing children. Journal of Applied Behavior Analysis, 48(2), 344–362.
2.
AlbertD.SteinbergL. (2011). Age differences in strategic planning as indexed by the Tower of London. Child Development, 82(5), 1501–1517.
3.
AmsoD.SalhiC.BadreD. (2019). The relationship between cognitive enrichment and cognitive control: A systematic investigation of environmental influences on development through socioeconomic status. Developmental Psychobiology, 61(2), 159–178.
4.
BanduraA.CapraraG. V.BarbaranelliC.GerbinoM.PastorelliC. (2003). Role of affective self-regulatory efficacy in diverse spheres of psychosocial functioning. Child Development, 74(3), 769–782.
5.
BlainB.SharotT. (2021). Intrinsic reward: Potential cognitive and neural mechanisms. Current Opinion in Behavioral Sciences, 39, 113–118.
6.
Bobadilla-SuarezS.SunsteinC. R.SharotT. (2017). The intrinsic value of choice: The propensity to under-delegate in the face of potential gains and losses. Journal of Risk and Uncertainty, 54(3), 187–202.
7.
BottiS.OrfaliK.IyengarS. S. (2009). Tragic choices: Autonomy and emotional responses to medical decisions. The Journal of Consumer Research, 36(3), 337–352.
8.
BoureauY.-L.Sokol-HessnerP.DawN. D. (2015). Deciding how to decide: Self-control and meta-decision making. Trends in Cognitive Sciences, 19(11), 700–710.
9.
BownN. J.ReadD.SummersB. (2003). The lure of choice. Journal of Behavioral Decision Making, 16(4), 297–308.
10.
CauffmanE.ShulmanE. P.SteinbergL.ClausE.BanichM. T.GrahamS.WoolardJ. (2010). Age differences in affective decision making as indexed by performance on the Iowa Gambling Task. Developmental Psychology, 46(1), 193–207.
11.
CockburnJ.CollinsA. G. E.FrankM. J. (2014). A reinforcement learning mechanism responsible for the valuation of free choice. Neuron, 83(3), 551–557.
12.
CordovaD. I.LepperM. R. (1996). Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. Journal of Educational Psychology, 88(4), 715–730.
13.
DeckerJ. H.OttoA. R.DawN. D.HartleyC. A. (2016). From creatures of habit to goal-directed learners: Tracking the developmental emergence of model-based reinforcement learning. Psychological Science, 27(6), 848–858.
14.
DonatiM. A.PannoA.ChiesiF.PrimiC. (2014). A mediation model to explain decision making under conditions of risk among adolescents: The role of fluid intelligence and probabilistic reasoning. Journal of Clinical and Experimental Neuropsychology, 36(6), 588–595.
15.
DoremusT. L.BrunellS. C.RajendranP.SpearL. P. (2005). Factors influencing elevated ethanol consumption in adolescent relative to adult rats. Alcoholism, Clinical and Experimental Research, 29(10), 1796–1808.
16.
DouglasL. A.VarlinskayaE. I.SpearL. P. (2003). Novel-object place conditioning in adolescent and adult male and female rats: Effects of social isolation. Physiology & Behavior, 80(2–3), 317–325.
17.
DouglasL. A.VarlinskayaE. I.SpearL. P. (2004). Rewarding properties of social interactions in adolescent and adult male and female rats: Impact of social versus isolate housing of subjects and partners. Developmental Psychobiology, 45(3), 153–162.
18.
DunlapG.dePerczelM.ClarkeS.WilsonD.WrightS.WhiteR.GomezA. (1994). Choice making to promote adaptive behavior for students with emotional and behavioral challenges. Journal of Applied Behavior Analysis, 27(3), 505–518.
19.
FisherW. W.ThompsonR. H.PiazzaC. C.CroslandK.GotjenD. (1997). On the relative reinforcing effects of choice and differential consequences. Journal of Applied Behavior Analysis, 30(3), 423–438.
20.
GalvanA.HareT. A.ParraC. E.PennJ.VossH.GloverG.CaseyB. J. (2006). Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in adolescents. The Journal of Neuroscience, 26(25), 6885–6892.
21.
GalvánA.McGlennenK. M. (2013). Enhanced striatal sensitivity to aversive reinforcement in adolescents versus adults. Journal of Cognitive Neuroscience, 25(2), 284–296.
22.
GearyD. C. (2006). Development of mathematical understanding. In KuhnD.SieglerR. S.DamonW.LernerR. M. (Eds.), Handbook of child psychology: Cognition, perception, and language (6th ed., pp. 777–810). John Wiley. https://doi.org/10.1002/9780470147658.chpsy0218
23.
GironA. P.CirankaS.SchulzE.van den BosW.RuggeriA.MederB.WuC. M. (2023). Developmental changes in exploration resemble stochastic optimization. Nature Human Behaviour, 7(11), 1955–1967.
24.
GopnikA. (2020). Childhood as a solution to explore–exploit tensions. Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences, 375(1803), Article 20190502.
25.
HabichtJ.BowlerA.Moses-PayneM. E.HauserT. U. (2022). Children are full of optimism, but those rose-tinted glasses are fading—Reduced learning from negative outcomes drives hyperoptimism in children. Journal of Experimental Psychology: General, 151(8), 1843–1853.
26.
HansonJ. L.van den BosW.RoeberB. J.RudolphK. D.DavidsonR. J.PollakS. D. (2017). Early adversity and learning: Implications for typical and atypical behavioral development. Journal of Child Psychology and Psychiatry and Allied Disciplines, 58(7), 770–778.
27.
HarmsM. B.Shannon BowenK. E.HansonJ. L.PollakS. D. (2018). Instrumental learning and cognitive flexibility processes are impaired in children exposed to early life stress. Developmental Science, 21(4), Article e12596.
28.
HeckhausenJ.WroschC.SchulzR. (2010). A motivational theory of life-span development. Psychological Review, 117(1), 32–60.
29.
IyengarS. S.LepperM. R. (2000). When choice is demotivating: Can one desire too much of a good thing?Journal of Personality and Social Psychology, 79(6), 995–1006.
30.
KatzmanP. L.HartleyC. A. (2020). The value of choice facilitates subsequent memory across development. Cognition, 199, Article 104239.
31.
LeottiL. A.DelgadoM. R. (2011). The inherent reward of choice. Psychological Science, 22(10), 1310–1318.
32.
LeottiL. A.DelgadoM. R. (2014). The value of exercising control over monetary gains and losses. Psychological Science, 25(2), 596–604.
33.
LeottiL. A.IyengarS. S.OchsnerK. N. (2010). Born to choose: The origins and value of the need for control. Trends in Cognitive Sciences, 14(10), 457–463.
34.
LiquinE. G.GopnikA. (2022). Children are more exploratory and learn more than adults in an approach-avoid task. Cognition, 218, Article 104940.
35.
LunaB.MarekS.LarsenB.Tervo-ClemmensB.ChahalR. (2015). An integrative model of the maturation of cognitive control. Annual Review of Neuroscience, 38, 151–170.
36.
LyV.WangK. S.BhanjiJ.DelgadoM. R. (2019). A reward-based framework of perceived control. Frontiers in Neuroscience, 13, Article 65. https://doi.org/10.3389/fnins.2019.00065
37.
MaI.PhaneufC.van OpheusdenB.MaW. J.HartleyC. (2022). The component processes of complex planning follow distinct developmental trajectories. https://psyarxiv.com/d62rw/download?format=pdf
38.
MaierS. F.SeligmanM. E. P. (2016). Learned helplessness at fifty: Insights from neuroscience. Psychological Review, 123(4), 349–367.
39.
McCormackT.BramleyN.FroschC.PatrickF.LagnadoD. (2016). Children’s use of interventions to learn causal structure. Journal of Experimental Child Psychology, 141, 1–22.
40.
MederB.WuC. M.SchulzE.RuggeriA. (2021). Development of directed and random exploration in children. Developmental Science, 24(4), Article e13095.
41.
MengY.BramleyN.XuF. (2018). Children’s causal interventions combine discrimination and confirmation. In RogersT. T.RauM.ZhuX.KalishC. W. (Eds.), Proceedings of the 40th Annual Conference of the Cognitive Science Society (pp. 762–767). Cognitive Science Society. https://par.nsf.gov/servlets/purl/10062661
MoscarelloJ. M.HartleyC. A. (2017). Agency and the calibration of motivated behavior. Trends in Cognitive Sciences, 21(10), 725–735.
44.
MunueraJ.AgostM. R.BendetowiczD.KerebelA.ChambonV.LauB. (2022). Choice seeking is motivated by the intrinsic need for personal control. bioRxiv. https://doi.org/10.1101/2022.09.20.508669
45.
NussenbaumK.CohenA. O.DavisZ. J.HalpernD. J.GureckisT. M.HartleyC. A. (2020). Causal information-seeking strategies change across childhood and adolescence. Cognitive Science, 44(9), Article e12888. https://doi.org/10.1111/cogs.12888
46.
NussenbaumK.HartleyC. A. (2019). Reinforcement learning across development: What insights can we draw from a decade of research?Developmental Cognitive Neuroscience, 40, Article 100733.
47.
NussenbaumK.MartinR. E.MaulhardtS.YangY.Bizzell-HatcherG.BhattN. S.KoenigM.RosenbaumG. M.O’DohertyJ. P.CockburnJ.HartleyC. A. (2023). Novelty and uncertainty differentially drive exploration across development. eLife, 12, Article e84260. https://doi.org/10.7554/elife.84260
48.
NussenbaumK.PrentisE.HartleyC. A. (2020). Memory’s reflection of learned information value increases across development. Journal of Experimental Psychology: General, 149(10), 1919–1934.
49.
NussenbaumK.ScheupleinM.PhaneufC. V.EvansM. D.HartleyC. A. (2020). Moving developmental research online: Comparing in-lab and web-based studies of model-based reinforcement learning. Collabra: Psychology, 6(1), Article 17213. https://doi.org/10.1525/collabra.17213
50.
NussenbaumK.VelezJ. A.WashingtonB. T.HamlingH. E.HartleyC. A. (2022). Flexibility in valenced reinforcement learning computations across development. Child Development, 93(5), 1601–1615. https://doi.org/10.31234/osf.io/5f9uc
51.
OettingenG. (1995). Cross-cultural perspectives on self-efficacy. In BanduraA. (Ed.), Self-efficacy in changing societies (pp. 149–176). Cambridge University Press. https://doi.org/10.1017/CBO9780511527692.007
52.
PalminteriS.LebretonM. (2022). The computational roots of positivity and confirmation biases in reinforcement learning. Trends in Cognitive Sciences, 26(7), 607–621.
53.
PatallE. A. (2012). The motivational complexity of choosing: A review of theory and research. In RyanR. M. (Ed.), The Oxford handbook of human motivation (pp. 248–279). Oxford University Press. https://doi.org/10.1093/oxfordhb/9780195399820.013.0015
54.
PotterT. C. S.BryceN. V.HartleyC. A. (2017). Cognitive components underpinning the development of model-based learning. Developmental Cognitive Neuroscience, 25, 272–280.
55.
RaabH.HartleyC. A. (2020). Adolescents exhibit reducedPavlovian biases on instrumental learning. Scientific Reports, 10, 15770. https://doi.org/10.1038/s41598-020-72628-w
56.
RosenbaumG. M.GrassieH. L.HartleyC. A. (2022). Valence biases in reinforcement learning shift across adolescence and modulate subsequent memory. eLife, 11, e64620. https://doi.org/10.7554/eLife.64620
57.
RosenbaumG. M.HartleyC. A. (2019). Developmental perspectives on risky and impulsive choice. Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences, 374(1766), Article 20180133.
58.
RuggeriA.MarkantD. B.GureckisT. M.BretzkeM.XuF. (2019). Memory enhancements from active control of learning emerge across development. Cognition, 186, 82–94.
59.
SchlottmannA.AndersonN. H. (1994). Children’s judgments of expected value. Developmental Psychology, 30(1), 56–66.
60.
ShenhavA.BucknerR. L. (2014). Neural correlates of dueling affective reactions to win-win choices. Proceedings of the National Academy of Sciences, USA, 111(30), 10978–10983.
61.
ShenhavA.Dean WolfC. K.KarmarkarU. R. (2018). The evil of banality: When choosing between the mundane feels like choosing between the worst. Journal of Experimental Psychology. General, 147(12), 1892–1904.
62.
ShenhavA.FaheyM. P.GrahekI. (2021). Decomposing the motivation to exert mental effort. Current Directions in Psychological Science, 30(4), 307–314.
63.
ShenhavA.MusslickS.LiederF.KoolW.GriffithsT. L.CohenJ. D.BotvinickM. M. (2017). Toward a rational and mechanistic account of mental effort. Annual Review of Neuroscience, 40, 99–124.
64.
SheridanM. A.PeverillM.FinnA. S.McLaughlinK. A. (2017). Dimensions of childhood adversity have distinct associations with neural systems underlying executive functioning. Development and Psychopathology, 29(5), 1777–1794.
65.
SidarusN.PalminteriS.ChambonV. (2019). Cost-benefit trade-offs in decision-making and learning. PLOS Computational Biology, 15(9), Article e1007326.
66.
SmithD. G.XiaoL.BecharaA. (2012). Decision making in children and adolescents: Impaired Iowa Gambling Task performance in early adolescence. Developmental Psychology, 48(4), 1180–1187.
67.
SomervilleL. H.SasseS. F.GarradM. C.DrysdaleA. T.Abi AkarN.InselC.WilsonR. C. (2017). Charting the expansion of strategic exploratory behavior during adolescence. Journal of Experimental Psychology: General, 146(2), 155–164.
68.
SranS. K.BorreroJ. C. (2010). Assessing the value of choice in a token system. Journal of Applied Behavior Analysis, 43(3), 553–557.
69.
SuzukiS. (1997). Effects of number of alternatives on choice in humans. Behavioural Processes, 39(2), 205–214.
70.
TigerJ. H.HanleyG. P.HernandezE. (2006). An evaluation of the value of choice with preschool children. Journal of Applied Behavior Analysis, 39(1), 1–16.
71.
VéronneauM.KoestnerR. F.AbelaJ. R. Z. (2005). Intrinsic need satisfaction and well–being in children and adolescents: An application of the self-determination theory. Journal of Social and Clinical Psychology, 24(2), 280–292.
72.
WangK. S.DelgadoM. R. (2019). Corticostriatal circuits encode the subjective value of perceived control. Cerebral Cortex, 29(12), 5049–5060.
73.
WangK. S.KashyapM.DelgadoM. R. (2021). The influence of contextual factors on the subjective value of control. Emotion, 21(4), 881–891.
74.
WeinbergR.GouldD.JacksonA. (1979). Expectations and performance: An empirical test of Bandura’s self-efficacy theory. Journal of Sport and Exercise Psychology, 1(4), 320–331.
75.
WeinsteinS. M.MermelsteinR. (2007). Relations between daily activities and adolescent mood: The role of autonomy. Journal of Clinical Child and Adolescent Psychology, 36(2), 182–194.
76.
WestbrookA.BraverT. S. (2015). Cognitive effort: A neuroeconomic approach. Cognitive, Affective & Behavioral Neuroscience, 15(2), 395–415.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
