We discuss a recent approach to investigating cognitive control, which has the potential to deal with some of the challenges inherent in this endeavour. In a model-based approach, the researcher defines a formal, computational model that performs the task at hand and whose performance matches that of a research participant. The internal variables in such a model might then be taken as proxies for latent variables computed in the brain. We discuss the potential advantages of such an approach for the study of the neural underpinnings of cognitive control and its pitfalls, and we make explicit the assumptions underlying the interpretation of data obtained using this approach.
AkaikeH.Information theory as an extension of the maximum likelihood principle.Second international symposium on information theory,PetrovB.N.CsakiF.Akademiai KiadoBudapest, Hungary1973267–281.
2.
BehrensT.E. J.HuntL.T.WoolrichM.W.RushworthM.F. S.Associative learning of social value.Nature,2008456, 245–250.
3.
BehrensT.E. J.WoolrichM.W.WaltonM.E.RushworthM.F. S.Learning the value of information in an uncertain world.Nature Neuroscience,200710, 1214–1221.
4.
BestmannS.HarrisonL.M.BlankenburgF.MarsR.B.HaggardP.FristonK.J.Influences of contextual uncertainty and surprise on human corticospinal excitability during preparation for action.Current Biology,200818, 775–780.
5.
BotvinickM.M.BraverT.S.BarchD.M.CarterC.S.CohenJ.D.Conflict monitoring and cognitive control.Psychological Review,2001108, 624–652.
6.
BrownS.D.HeathcoteA.J.The simplest complete model of choice reaction time: Linear ballistic accumulation.Cognitive Psychology,200857, 153–178.
7.
BrownJ.W.ReynoldsJ.R.BraverT.S.A computational model of fractionated conflict-control mechanisms in task-switching.Cognitive Psychology,200755, 37–85.
8.
BurnhamK.P.AndersonD.R.Model selection and multi-model inference. A practical information-theoretic approach 2,SpringerNew York2002.
9.
BurnhamK.P.AndersonD.R.Multimodel inference: Understanding AIC and BIC in model selection.Sociological Methods Research,200433, 261–304.
10.
CohenJ.D.DunbarK.McClellandJ.L.On the control of automatic processes: A parallel distributed processing account of the Stroop effect.Psychological Review,199097, 332–361.
11.
CohenM.X.Individual differences and the neural representations of reward expectation and reward prediction errors.Social Cognitive and Affective Neuroscience,20072, 20–30.
12.
CohenM.X.Neurocomputational mechanisms of reinforcement-guided learning in humans: A review.Cognitive, Affective, and Behavioral Neuroscience,20088, 113–125.
13.
CohenM.X.RanganathC.Reinforcement learning signals predict future decisions.Journal of Neuroscience,200727, 371–378.
14.
CorradoG.DoyaK.Understanding neural coding through the model-based analysis of decision making.Journal of Neuroscience,200727, 8178–8180.
15.
CorradoG.S.SugrueL.P.BrownJ.R.NewsomeW.T.The trouble with choice: Studying decision variables in the brain.Neuroeconomics: Decision making and the brain,GlimcherP.W.CamererC.F.FehrE.PoldrackR.A.ElsevierAmsterdam2009463–480.
16.
CritchleyH.D.MathiasC.J.JosephsO.O'DohertyJ.ZaniniS.DewarB.K.Human cingulate cortex and autonomic control: Converging neuroimaging and clinical evidence.Brain,2003126, 2139–2152.
17.
D'ArdenneK.McClureS.M.NystromL.E.CohenJ.D.BOLD responses reflecting dopaminergic signals in the human ventral tegmental area.Science,2008319, 1264–1267.
18.
DehaeneS.PosnerM.I.TuckerD.M.Localization of a neural system for error detection and compensation.Psychological Science,19945, 303–305.
19.
Den OudenH.E. M.FristonK.J.DawN.D.McIntoshA.R.StephanK.E.A dual role for prediction error in associative learning.Cerebral Cortex,200919, 1175–1185.
20.
DolanR.J.Neuroimaging of cognition: Past, present, and future.Neuron,200860, 496–502.
21.
DonchinE.ColesM.G. H.Is the P300 component a manifestation of context updating?.Behavioral and Brain Science,198811, 357–374.
22.
DuncanJ.OwenA.M.Common regions of the human frontal lobe recruited by diverse cognitive demands.Trends in Neurosciences,200023, 475–483.
23.
Duncan-JohnsonC.DonchinE.On quantifying surprise: The variation of event-related brain potentials with subjective probability.Psychophysiology,197714, 456–467.
24.
ForstmannB.U.DutilhG.BrownS.NeumannJ.Von CramonD.Y.RidderinkhofK.R.Striatum and pre-SMA facilitate decision-making under time pressure.Proceedings of the National Academy of Sciences USA,2008105, 17538–17542.
25.
FristonK.Learning and inference in the brain.Neural Networks,200316, 1325–1352.
26.
GilbertS.J.ShalliceT.Task switching: A PDP model.Cognitive Psychology,200244, 297–337.
27.
Godfrey-SmithP.The strategy of model-based science.Biology and Philosophy,200621, 725–740.
28.
GoldJ.I.ShadlenM.N.The neural basis of decision making.Annual Reviews of Neuroscience,200730, 535–574.
29.
HamptonA.N.BossaertsP.O'DohertyJ.P.The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans.Journal of Neuroscience,200626, 8360–8367.
30.
HaynesJ.D.SakaiK.ReesG.GilbertS.FrithC.PassinghamR.E.Reading hidden intentions in the human brain.Current Biology,200717, 323–328.
HolroydC.B.ColesM.G. H.The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.Psychological Review,2002109, 679–709.
33.
HolroydC.B.NieuwenhuisS.MarsR.B.ColesM.G. H.Anterior cingulate cortex, selection for action, and error processing.Cognitive neuroscience of attention,PosnerM.I.Guilford PressNew York2004219–231.
34.
KassR.E.RafteryA.E.Bayes factors and model uncertainty,University of Washington, Seattle, WA1993(Tech. Rep. No. 254).
35.
KiebelS.J.GarridoM.I.MoranR.ChenC.C.FristonK.J.Dynamic causal modelling for EEG and MEG.Human Brain Mapping,200920, 1866–1876.
36.
LauB.GlimcherP.W.Dynamic response-by-response models of matching behaviour in rhesus monkeys.Journal of the Experimental Analysis of Behavior,200584, 555–579.
37.
LogothetisN.K.PaulsJ.AuguthM.TrinathT.OeltermannA.Neurophysiological investigation of the basis of the fMRI signal.Nature,2001412, 150–152.
MarrD.Vision. A computational investigation into the human representation and processing of visual information,W.H. Freeman and CompanyNew York1982.
40.
MarsR.B.ColesM.G. H.GrolM.J.HolroydC.B.NieuwenhuisS.HulstijnW.Neural dynamics of error processing in human medial frontal cortex.NeuroImage,200528, 1007–1013.
41.
MarsR.B.DebenerS.GladwinT.E.HarrisonL.M.HaggardP.RothwellJ.C.Trial-by-trial fluctuations in the event-related electroencephalogram reflect dynamic changes in the degree of surprise.Journal of Neuroscience,200828, 12539–12545.
42.
MillerE.K.The prefrontal cortex and cognitive control.Nature Reviews Neuroscience,20001, 59–65.
43.
MonsellS.Task switching.Trends in Cognitive Sciences,20037, 134–140.
44.
NieuwenhuisS.Aston-JonesG.CohenJ.D.Decision making, the P3, and the locus coeruleus-norepinephrine system.Psychological Bulletin,2005131, 510–532.
45.
NieuwenhuisS.RidderinkhofK.R.TalsmaD.ColesM.G. H.HolroydC.B.KokA.A computational account of altered error processing in older age: Dopamine and the error-related negativity.Cognitive, Affective, and Behavioral Neuroscience,20022, 19–36.
46.
O'DohertyJ.P.HamptonA.KimH.Model-based fMRI and its application to reward learning and decision making.Annals of the New York Academy of Sciences,20071104, 35–53.
47.
RescorlaR.A.WagnerA.R.A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement.Classical conditioning. II: Current research and theory,BlackA.H.ProkasyW.F.Appleton-Century-CroftsNew York197264–99.
48.
RidderinkhofK.R.UllspergerM.CroneE.A.NieuwenhuisS.The role of the medial frontal cortex in cognitive control.Science,2004306, 443–447.
49.
RoeschM.R.CaluD.J.SchoenbaumG.Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards.Nature Neuroscience,200710, 1615–1624.
50.
RosaM.J.BestmannS.HarrisonL.PennyW.Bayesian model selection maps for group studies.NeuroImage,201049, 217–224.
51.
RushworthM.F. S.BehrensT.E. J.Choice, uncertainty and value in prefrontal and cingulate cortex.Nature Neuroscience,200811, 389–397.
52.
RushworthM.F. S.MarsR.B.SummerfieldC.General mechanisms for making decisions?.Current Opinion in Neurobiology,200919, 75–83.
53.
SchultzW.DayanP.MontagueP.R.A neural substrate of prediction and reward.Science,1997275, 1593–1599.
54.
ShannonC.E.A mathematical theory of communication.Bell Systems Technical Journal,194827, 379–423.
55.
SterretS.G.Physical models and fundamental laws: Using one piece of the world to tell about another.Mind & Society,20025, 51–66.
56.
SuttonR.S.BartoA.G.Toward a modern theory of adaptive networks: Expectation and prediction.Psychological Review,198188, 135–170.
57.
SuttonR.S.BartoA.G.Reinforcement learning: An introduction,MIT PressCambridge, MA1998.
58.
Van VeenV.CarterC.S.The timing of action-related processes in the anterior cingulate cortex.Journal of Cognitive Neuroscience,200214, 593–602.
59.
WaltonM.E.MarsR.B.Probing human and monkey anterior cingulate cortex in variable environments.Cognitive, Affective, and Behavioral Neuroscience,20077, 413–422.
60.
WeisbergM.Who is a modeler?.British Journal for Philosophy of Science,200758, 207–233.
61.
YuA.DayanP.Uncertainty, neuromodulation, and attention.Neuron,200546, 681–692.
