How do children and adults differ in their search for rewards? We considered three different hypotheses that attribute developmental differences to (a) children’s increased random sampling, (b) more directed exploration toward uncertain options, or (c) narrower generalization. Using a search task in which noisy rewards were spatially correlated on a grid, we compared the ability of 55 younger children (ages 7 and 8 years), 55 older children (ages 9–11 years), and 50 adults (ages 19–55 years) to successfully generalize about unobserved outcomes and balance the exploration–exploitation dilemma. Our results show that children explore more eagerly than adults but obtain lower rewards. We built a predictive model of search to disentangle the unique contributions of the three hypotheses of developmental differences and found robust and recoverable parameter estimates indicating that children generalize less and rely on directed exploration more than adults. We did not, however, find reliable differences in terms of random sampling.
AuerP. (2002). Using confidence bounds for exploitation-exploration trade-offs. Journal of Machine Learning Research, 3, 397–422.
2.
BellmanR. (1952). On the theory of dynamic programming. Proceedings of the National Academy of Sciences, USA, 38, 716–719.
3.
BlancoN. J.LoveB. C.RamscarM.OttoA. R.SmaydaK.MaddoxW. T. (2016). Exploratory decision-making as a function of lifelong experience, not cognitive decline. Journal of Experimental Psychology: General, 145, 284–297.
4.
BonawitzE. B.van SchijndelT. J.FrielD.SchulzL. (2012). Children balance theories and evidence in exploration, explanation, and learning. Cognitive Psychology, 64, 215–234.
5.
CauffmanE.ShulmanE. P.SteinbergL.ClausE.BanichM. T.GrahamS.WoolardJ. (2010). Age differences in affective decision making as indexed by performance on the Iowa gambling task. Developmental Psychology, 46, 193–207.
6.
DavidsonD. (1991). Developmental differences in children’s search of predecisional information. Journal of Experimental Child Psychology, 52, 239–255.
7.
DavidsonD. (1996). The effects of decision characteristics on children’s selective search of predecisional information. Acta Psychologica, 92, 263–281.
8.
DeckerJ. H.OttoA. R.DawN. D.HartleyC. A. (2016). From creatures of habit to goal-directed learners: Tracking the developmental emergence of model-based reinforcement learning. Psychological Science, 27, 848–858.
9.
FrankM. J.DollB. B.Oas-TerpstraJ.MorenoF. (2009). Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation. Nature Neuroscience, 12, 1062–1068.
10.
GershmanS. J. (2018). Deconstructing the human algorithms for exploration. Cognition, 173, 34–42.
11.
GopnikA.GriffithsT. L.LucasC. G. (2015). When younger learners can be better (or at least more open-minded) than older ones. Current Directions in Psychological Science, 24, 87–92.
12.
GopnikA.O’GradyS.LucasC. G.GriffithsT. L.WenteA.BridgersS.. . . DahlR. E. (2017). Changes in cognitive flexibility and hypothesis search across human life history from childhood to adolescence to adulthood. Proceedings of the National Academy of Sciences, USA, 114, 7892–7899.
13.
HagenJ. W.HaleG. A. (1973). The development of attention in children. ETS Research Report Series, 1973, i–37. doi:10.1002/j.2333-8504.1973.tb00453.x
14.
HartleyC. A.SomervilleL. H. (2015). The neuroscience of adolescent decision-making. Current Opinion in Behavioral Sciences, 5, 108–115.
15.
JosefA. K.RichterD.Samanez-LarkinG. R.WagnerG. G.HertwigR.MataR. (2016). Stability and change in risk-taking propensity across the adult life span. Journal of Personality and Social Psychology, 111, 430–450.
16.
KeresztesA.BenderA.BodammerN.LindenbergerU.ShingY. L.Werkle-BergnerM. (2017). Hippocampal maturity promotes memory distinctiveness in childhood and adolescence. Proceedings of the National Academy of Sciences, USA, 114, 9212–9217.
17.
KlahrD. (1982). Nonmonotone assessment of monotone development: An information processing analysis. In StraussS.StavyR. (Eds.), U-shaped behavioral growth (pp. 63–86). New York, NY: Academic Press.
18.
LucasC. G.BridgersS.GriffithsT. L.GopnikA. (2014). When children are better (or at least more open-minded)learners than adults: Developmental differences in learning the forms of causal relationships. Cognition, 131, 284–299.
19.
LucasC. G.GriffithsT. L.WilliamsJ. J.KalishM. L. (2015). A rational model of function learning. Psychonomic Bulletin & Review, 22, 1193–1215.
20.
MataR.WilkeA.CzienskowskiU. (2013). Foraging across the life span: Is there a reduction in exploration with aging?Frontiers in Neuroscience, 7, Article 53. doi:10.3389/fnins.2013.00053
21.
MehlhornK.NewellB. R.ToddP. M.LeeM. D.MorganK.BraithwaiteV. A.. . . GonzalezC. (2015). Unpacking the exploration–exploitation tradeoff: A synthesis of human and animal literatures. Decision, 2, 191–215.
22.
PalminteriS.KilfordE. J.CoricelliG.BlakemoreS.-J. (2016). The computational development of reinforcement learning during adolescence. PLOS Computational Biology, 12(6), Article e1004953. doi:10.1371/journal.pcbi.1004953
23.
PiagetJ. (1964). Part I: Cognitive development in children: Piaget development and learning. Journal of Research in Science Teaching, 2, 176–186.
24.
RasmussenC.WilliamsC. (2006). Gaussian processes for machine learning. Cambridge, MA: MIT Press.
25.
RiedmillerM.HafnerR.LampeT.NeunertM.DegraveJ.Van de WieleT.. . . SpringenbergJ. T. (2018). Learning by playing: Solving sparse reward tasks from scratch. Retrieved from arXiv: https://arxiv.org/abs/1802.10567
26.
RuggeriA.LombrozoT. (2015). Children adapt their questions to achieve efficient search. Cognition, 143, 203–216.
27.
SchulzE.KonstantinidisE.SpeekenbrinkM. (2017). Putting bandits into context: How function learning supports decision making. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44, 927–943.
28.
SchulzL. (2015). Infants explore the unexpected. Science, 348, 42–43.
29.
ShepardR. N. (1987). Toward a universal law of generalization for psychological science. Science, 237, 1317–1323.
30.
SollichP. (1999). Learning curves for Gaussian processes. In KearnsM. S.SollaS. A.CohnD. A. (Eds.), Advances in neural information processing systems (Vol. 11, pp. 344–350). Cambridge, MA: MIT Press.
31.
SomervilleL. H.SasseS. F.GarradM. C.DrysdaleA. T.Abi AkarN.InselC.WilsonR. C. (2017). Charting the expansion of strategic exploratory behavior during adolescence. Journal of Experimental Psychology: General, 146, 155–164.
32.
SrinivasN.KrauseA.KakadeS. M.SeegerM. (2009). Gaussian process optimization in the bandit setting: No regret and experimental design. Retrieved from arXiv: https://arxiv.org/abs/0912.3995
33.
TuringA. (1950). Computing intelligence and machinery. Mind, 59, 433–460.
34.
TymulaA.BelmakerL. A. R.RoyA. K.RudermanL.MansonK.GlimcherP. W.LevyI. (2012). Adolescents’ risk-taking behavior is driven by tolerance to ambiguity. Proceedings of the National Academy of Sciences, USA, 109, 17135–17140.
35.
WhiteJ. M. (2013). The role of delayed consequences in human decision-making (Unpublished doctoral dissertation). Princeton University, Princeton, NJ.
36.
WilsonR. C.GeanaA.WhiteJ. M.LudvigE. A.CohenJ. D. (2014). Humans use directed and random exploration to solve the explore–exploit dilemma. Journal of Experimental Psychology: General, 143, 2074–2081.
37.
WuC. M.SchulzE.SpeekenbrinkM.NelsonJ. D.MederB. (2018). Generalization guides human exploration in vast decision spaces. Nature Human Behaviour, 2, 915–924.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
