Sage Journals: Discover world-class research

Abstract

I review recent literature on information demand and its implications for attention control. I argue that this literature motivates a view of attention as a mechanism that reduces uncertainty by selectively sampling sensory stimuli on the basis of expected information gain (EIG). I discuss emerging evidence on how individuals estimate the two quantities that determine EIG, prior uncertainty and stimulus diagnosticity (predictive accuracy). I also discuss the neural mechanisms that compute EIG and integrate it with rewards in frontoparietal, executive, and neuromodulatory circuits. I end by considering the implications of this framework for a broader understanding of the factors that assign relevance to sensory stimuli and the role of attention in decision making and other cognitive functions.

Keywords

information seeking computational rationality uncertainty reward attention

Get full access to this article

View all access options for this article.

References

Awh

Belopolsky

A. V.

Theeuwes

(2012). Top-down versus bottom-up attentional control: A failed theoretical dichotomy. Trends in Cognitive Science, 16(8), 437–443.

Benjamin

D. J.

(2019). Errors in probabilistic reasoning and judgment biases. In Bernheim

B. D.

DellaVigna

Laibson

(Eds.), Handbook of behavioral economics: Applications and foundations (Vol. 2, pp. 69–186). Elsevier.

Bennett

Bode

Brydevall

Warren

Murawski

(2016). Intrinsic valuation of information in decision making under uncertainty. PLOS Computational Biology, 12(7), Article e1005020. https://doi.org/10.1371/journal.pcbi.1005020

Bisley

J. W.

Goldberg

M. E.

(2010). Attention, intention, and priority in the parietal lobe. Annual Review of Neuroscience, 33, 1–21.

Bossaerts

Murawski

(2017). Computational complexity and human decision making. Trends in Cognitive Sciences, 21(12), 917–929.

Bromberg-Martin

E. S.

Hikosaka

(2009). Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron, 63(1), 119–126.

Bromberg-Martin

E. S.

Sharot

(2020). The value of beliefs. Neuron, 106(4), 561–565.

Callaway

van Opheusden

Gul

Das

Krueger

P. M.

Griffiths

T. L.

Lieder

(2022). Rational use of cognitive resources in human planning. Nature Human Behavior, 6, 1112–1125.

Carleton

R. N.

(2016). Into the unknown: A review and synthesis of contemporary models involving uncertainty. Journal of Anxiety Disorders, 39, 30–43.

10.

Charpentier

C. J.

Bromberg-Martin

E. S.

Sharot

(2018). Valuation of knowledge and ignorance in mesolimbic reward circuitry. Proceedings of the National Academy of Sciences, USA, 115(31), E7255–E7264.

11.

Coenen

Nelson

J. D.

Gureckis

T. M.

(2019). Asking the right questions about the psychology of human inquiry: Nine open challenges. Psychonomic Bulletin & Review, 26, 1548–1587.

12.

Corbetta

Shulman

G. L.

(2011). Spatial neglect and attention networks. Annual Review of Neuroscience, 34, 569–599. https://doi.org/10.1146/annurev-neuro-061010-113731

13.

Foley

N. C.

Kelley

S. P.

Mhatre

Lopes

Gottlieb

(2017). Parietal neurons encode expected gains in instrumental information. Proceedings of the National Academy of Sciences, USA, 114(16), E3315–E3323.

14.

Gershman

S. J.

Horvitz

E. J.

Tenenbaum

J. B.

(2015). Computational rationality: A converging paradigm for intelligence in brains, minds, and machines. Science, 349(6245), 273–278.

15.

Gottlieb

Oudeyer

P. Y.

(2018). Toward a neuroscience of active sampling and curiosity. Nature Reviews Neuroscience, 19(12), 758–770.

16.

Gruber

M. J.

Ranganath

(2019). How curiosity enhances hippocampus-dependent memory: The prediction, appraisal, curiosity, and exploration (PACE) framework. Trends in Cognitive Science, 23(12), 1014–1025.

17.

Gureckis

T. M.

Markant

D. B.

(2012). Self-directed learning: A cognitive and computational perspective. Perspectives on Psychological Science, 7(5), 464–481.

18.

Hagmann

Loewenstein

(2021). Measuring information preferences. Semantic Scholar.

19.

Horan

Daddaoua

Gottlieb

(2019). Parietal neurons encode information sampling based on decision uncertainty. Nature Neuroscience, 22(8), 1327–1335.

20.

Hunt

L. T.

Rutledge

R. B.

Malalasekera

W. M.

Kennerley

S. W.

Dolan

R. J.

(2016). Approach-induced biases in human information sampling. PLOS Biology, 14(11), Article e2000638. https://doi.org/10.1371/journal.pbio.2000638

21.

Iigaya

Story

G. W.

Kurth-Nelson

Dolan

R. J.

Dayan

(2016). The modulation of savouring by prediction error and its effects on choice. eLife, 21(5), Article e13747. https://doi.org/10.7554/eLife.13747

22.

Jezzini

Bromberg-Martin

E. S.

Trambaiolli

L. R.

Haber

S. N.

Monosov

I. E.

(2021). A prefrontal network integrates preferences for advance information about uncertain rewards and punishments. Neuron, 109(14), 2339–2352.

23.

Kobayashi

Ravaioli

Baranès

Woodford

Gottlieb

(2019). Diverse motives for human curiosity. Nature Human Behaviour, 3(6), 587–595.

24.

Leong

Radulescu

Daniel

DeWoskin

Niv

(2017). Dynamic interaction between reinforcement learning and attention in multidimensional environments. Neuron, 93(2), 451–463.

25.

Levy

(2013). Ambiguous decisions in the human brain. In Crowley

P. H.

Zentall

T. R.

(Eds.), Comparative decision making (pp. 135–155). Oxford University Press.

26.

Daddaoua

Horan

Gottlieb

(2022). Uncertainty modulates visual maps during noninstrumental information demand. Nature Communications, 13(1), Article 5911. https://doi.org/10.1038/s41467-022-33585-2

27.

McGuire

J. T.

Nassar

M. R.

Gold

J. I.

Kable

J. W.

(2014). Functionally dissociable influences on learning rate in a dynamic environment. Neuron, 84(4), 870–881.

28.

Metcalfe

(2009). Metacognitive judgments and control of study. Current Directions in Psychological Science, 18(3), 159–163.

29.

Monosov

I. E.

(2017). Anterior cingulate is a source of valence-specific information about value and uncertainty. Nature Communications, 8(1), Article 134. https://doi.org/10.1038/s41467-017-00072-y

30.

Morvan

Maloney

L. T.

(2012). Human visual search does not maximize the post-saccadic probability of identifying targets. PLOS Computational Biology, 8(2), Article e1002342. https://doi.org/10.1371/journal.pcbi.1002342

31.

Nelson

McKenzie

Cottrell

Sejnowski

(2010). Experience matters: Information acquisition optimizes probability gain. Psychological Science, 21(7), 960–969.

32.

Petitet

Attaallah

Manohar

S. G.

Husain

(2021). The computational cost of active information sampling before decision-making under uncertainty. Nature Human Behavior, 5, 935–946.

33.

Renninger

K. A.

Hidi

S. E.

(2016). The power of interest for motivation and learning. Routledge.

34.

Reynolds

J. H.

Heeger

D. J.

(2009). The normalization model of attention. Neuron, 61(2), 168–185.

35.

Rich

A. S.

Gureckis

T. M.

(2018). The limits of learning: Exploration, generalization, and the development of learning traps. Journal of Experimental Psychology: General, 147(11), 1553–1570. https://doi.org/10.1037/xge0000466

36.

Rischall

Hunter

Jensen

Gottlieb

(in press). Inefficient prioritization of task-relevant attributes during instrumental information demand. Nature Communications.

37.

Ronfarda

Zambranab

I. M.

Hermansenb

T. K.

Kelemena

(2018). Question-asking in childhood: A review of the literature and a framework for understanding its development. Developmental Review, 49, 101–120.

38.

Rothe

Lake

Gureckis

T. M.

(2018). Do people ask good questions? Computational Brain and Behavior, 1, 68–69.

39.

Scherer

K. R.

(2013). The nature and dynamics of relevance and valence appraisals: Theoretical advances and recent evidence. Emotion Review, 5(2), 150–162.

40.

Sharot

Sunstein

C. R.

(2020). How people decide what they want to know. Nature Human Behaviour, 4(1), 14–19.

41.

Shenhav

Cohen

J. D.

Botvinick

M. M.

(2016). Dorsal anterior cingulate cortex and the value of control. Nature Neuroscience, 19(10), 1286–1291.

42.

Silvetti

Lasaponara

Daddaoua

Horan

Gottlieb

(2023). A reinforcement meta-learning framework of executive function and information demand. Neural Networks, 157, 103–113.

43.

Silvetti

Surinck

Verguts

(2013). Value and prediction error estimation account for volatility effects in ACC: A model-based fMRI study. Cortex, 49(6), 1627–1635.

44.

Son

Sethi

(2006). Metacognitive control and optimal learning. Cognitive Science, 30(4), 759–774.

45.

Taghizadeh

Foley

N. C.

Karimimehr

Cohanpour

Semework

Sheth

S. A.

Lashgari

Gottlieb

(2020). Reward uncertainty asymmetrically affects information transmission within the monkey fronto-parietal network. Communications Biology, 3(1), Article 594. https://doi.org/10.1038/s42003-020-01320-6

46.

Tatler

B. W.

Hayhoe

M. N.

Land

M. F.

Ballard

D. H.

(2011). Eye guidance in natural vision: Reinterpreting salience. Journal of Vision, 11(5), 5–25.

47.

Ten

Kaushik

Oudeyer

P. Y.

Gottlieb

(2021). Humans monitor learning progress in curiosity-driven exploration. Nature Communications, 12(1), Article 5972. https://doi.org/10.1038/s41467-021-26196-w

48.

White

J. K.

Bromberg-Martin

E. S.

Heilbronner

S. R.

Zhang

Pai

Haber

S. N.

Monosov

I. E.

(2019). A neural network for information seeking. Nature Communications, 10, Article 5168. https://doi.org/10.1038/s41467-019-13135-z

49.

C. M.

Meder

Filimon

Nelson

J. D.

(2017). Asking better questions: How presentation formats influence information search. Journal of Experimental Psychology: Learning, Memory, and Cognition, 43(8), 1274–1297.

50.

Yang

S. C.-H.

Lengyel

Wolpert

D. M.

(2016). Active sensing in the categorization of visual patterns. eLife, 5, Article e12215. https://doi.org/10.7554/eLife.12215

Emerging Principles of Attention and Information Demand

Abstract

Keywords

Get full access to this article

References