People show a tendency to devalue rewards when they are delayed in time. This so-called delay discounting often happens to an extent that seems irrational from an economical perspective. Research studying outcomes of delay discounting decisions has successfully derived descriptive models for such choice preferences. However, this outcome-based approach faces limitations in integrating the influence of contextual factors on the decision. Recently, this outcome-centred perspective on delay discounting has been complemented by a focus on the process dynamics leading to delay discounting decisions. Here, we embrace and add to this approach: We show how an attractor model can extend discounting descriptive discounting curves into the temporal dimension. From the model, we derive three predictions and study the predictions in a delay discounting experiment based on mouse tracking. We find differences in discounting depending on the order of option presentation and more direct movements to options presented first. Together with the analysis of specific temporal patterns of information integration, these results show that considering the continuous process dynamics of delay discounting decisions and harvesting them with continuous behavioural measures allow the integration of contextual factors into existing models of delay discounting, not as noise but as a signal on their own.
AinslieG. (1991). Derivation of ‘Rational’ economic behavior from hyperbolic discount curves. The American Economic Review, 81, 334–340.
2.
BallardK.KnutsonB. (2009). Dissociable neural representations of future reward magnitude and delay during temporal discounting. Neuroimage, 45, 143–150.
3.
BogaczR.UsherM.ZhangJ.McClellandJ. L. (2007). Extending a biologically inspired model of choice: multi-alternatives, nonlinearity and value-based multidimensional choice. Philosophical Transactions of the Royal Society B: Biological Sciences, 362, 1655–1670.
4.
BrainardD. H. (1997). The psychophysics toolbox. Spatial Vision, 10, 433–436.
5.
CoulsonM.NunnS. (1999). The detection of catastrophe flags in personally relevant decisions. In TschacherW. (Ed.), Dynamics, synergetics, autonomous agents (pp. 241–255). Singapore: World Scientific Publishing Company.
6.
CummingG. (2013). Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis. New York, NY: Routledge.
7.
DaiJ.BusemeyerJ. R. (2014). A probabilistic, dynamic, and attribute-wise model of intertemporal choice. Journal of Experimental Psychology: General, 143, 1489–1514.
8.
DaleR.KehoeC.SpiveyM. J. (2007). Graded motor responses in the time course of categorizing atypical exemplars. Memory & Cognition, 35, 15–28.
9.
DiederichA. (2003). Decision making under conflict: Decision time as a measure of conflict strength. Psychonomic Bulletin & Review, 10, 167.
10.
DoyleJ. (2013). Survey of time preference, delay discounting models. Judgment and Decision Making, 8, 116–135.
11.
DshemuchadseM.ScherbaumS.GoschkeT. (2012). How decisions emerge: Action dynamics in intertemporal decision making. Journal of Experimental Psychology: General, 142, 151–185.
12.
DuranN. D.DaleR. (2014). Perspective-taking in dialogue as self-organization under social constraints. New Ideas in Psychology, 32, 131–146.
Franco-WatkinsA. M.MattsonR. E.JacksonM. D. (2015). Now or later? Attentional processing and intertemporal choice. Journal of Behavioral Decision Making, 29, 2–3.
15.
FrankT. D.RichardsonM. J.Lopresti-GoodmanS. M.TurveyM. T. (2009). Order parameter dynamics of body-scaled hysteresis and mode transitions in grasping behavior. Journal of Biological Physics, 35, 127–147.
16.
FrederickS.LoewensteinG.O’DonoghueT. (2002). Time discounting and time preference: A critical review. Journal of Economic Literature, 40, 351–401.
17.
FreemanJ. B.AmbadyN.RuleN. O.JohnsonK. L. (2008). Will a category cue attract you? Motor output reveals dynamic competition across person construal. Journal of Experimental Psychology: General, 137, 673–690.
18.
GilbertS. J.HadjipavlouN.RaoelisonM. (2013). Automaticity and control in prospective memory: A computational model. PLoS ONE, 8, e59852.
19.
GlöcknerA.BetschT. (2008). Modeling option and strategy choices with connectionist networks: Towards an integrative model of automatic and deliberate decision making. SSRN eLibrary. Retrieved from http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1090866
20.
González VallejoC.ChengJ.PhillipsN.ChimeliJ.BellezzaF.HarmanJ.… LindbergM. J. (2014). Early positive information impacts final evaluations: No deliberation-without-attention effect and a test of a dynamic judgment model. Journal of Behavioral Decision Making, 27, 209–225.
21.
GreenL.FristoeN.MyersonJ. (1994). Temporal discounting and preference reversals in choice between delayed outcomes. Psychonomic Bulletin & Review, 1, 383–389.
22.
GrimmV.RevillaE.BergerU.JeltschF.MooijW. M.RailsbackS. F.. . . DeAngelisD. L. (2005). Pattern-oriented modeling of agent-based complex systems: Lessons from ecology. Science, 310, 987–991.
23.
HardistyD. J.ThompsonK. F.KrantzD. H.WeberE. U. (2013). How to measure time preferences: An experimental comparison of three methods. Judgment and Decision Making, 8, 236–249.
24.
KahnemanD.TverskyA. (1984). Choices, values, and frames. American Psychologist, 39, 341–350.
25.
KangM. J.RangelA.CamusM.CamererC. F. (2011). Hypothetical and real choice differentially activate common valuation areas. The Journal of Neuroscience, 31, 461–468.
26.
KelsoJ. A. S. (1997). Dynamic patterns: The self-organization of brain and behavior. Cambridge, MA: The MIT Press.
27.
KrajbichI.CamererC.RangelA. (2012). The attentional drift-diffusion model extends to simple purchasing decisions. Frontiers in Cognitive Science, 3, 193.
28.
LagorioC. H.MaddenG. J. (2005). Delay discounting of real and hypothetical rewards III: Steady-state assessments, forced-choice trials, and all real rewards. Behavioural Processes, 69, 173–187.
29.
LempertK. M.PhelpsE. A. (2016). The malleability of intertemporal choice. Trends in Cognitive Sciences, 20, 64–74.
30.
MaddenG. J.BegotkaA. M.RaiffB. R.KasternL. L. (2003). Delay discounting of real and hypothetical rewards. Experimental and Clinical Psychopharmacology, 11,139–145.
31.
MaddenG. J.RaiffB. R.LagorioC. H.BegotkaA. M.MuellerA. M.HehliD. J.WegenerA. A. (2004). Delay discounting of potentially real and hypothetical rewards: II. Between-and within-subject comparisons. Experimental and Clinical Psychopharmacology, 12, 251–261.
32.
McKinstryC.DaleR.SpiveyM. J. (2008). Action dynamics reveal parallel competition in decision making. Psychological Science, 19, 22–24.
33.
MiklM.MarecekR.HlustíkP.PavlicováM.DrastichA.ChlebusP.. . . KrupaP. (2008). Effects of spatial smoothing on fMRI group inferences. Magnetic Resonance Imaging, 26, 490–503.
34.
MüllerM. M. (2008). Location and features of instructive spatial cues do not influence the time course of covert shifts of visual spatial attention. Biological Psychology, 77, 292–303.
35.
MüllerM. M.AndersenS. K.KeilA. (2007). Time course of competition for visual processing resources between emotional pictures and foreground task. Cerebral Cortex, 18, 1892–1899.
36.
MyersonJ.GreenL. (1995). Discounting of delayed rewards: Models of individual choice. Journal of the Experimental Analysis of Behavior, 64, 263.
37.
O’HoraD.DaleR.PiiroinenP. T.ConnollyF. (2013). Local dynamics in decision making: The evolution of preference within and across decisions. Scientific Reports, 3, 2210.
38.
OnnisL.SpiveyM. J. (2012). Toward a new scientific visualization for the language sciences. Information, 3, 124–150.
39.
OullierO.KirmanA. P.KelsoJ. A. S. (2008). The coordination dynamics of economic decision making: A multilevel approach to social neuroeconomics. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 16, 557–571.
40.
PelliD. G. (1997). The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10, 437–442.
41.
RatcliffR.SmithP. L. (2004). A comparison of sequential sampling models for two-choice reaction time. Psychological Review, 111, 333–367.
42.
RoblesE.VargasP. A. (2008). Parameters of delay discounting assessment: Number of trials, effort, and sequential effects. Behavioural Processes, 78, 285–290.
43.
RodriguezC. A.TurnerB. M.McClureS. M. (2014). Intertemporal choice as discounted value accumulation. PLoS ONE, 9, e90138.
44.
RodriguezC. A.TurnerB. M.Van ZandtT.McClureS. M. (2015). The neural basis of value accumulation in intertemporal choice. European Journal of Neuroscience, 42, 2179–2189.
45.
RoeR. M.BusemeyerJ. R.TownsendJ. T. (2001). Multialternative decision field theory: A dynamic connectionist model of decision making. Psychological Review, 108, 370–392.
46.
SamuelsonP. A. (1937). A note on measurement of utility. The Review of Economic Studies, 4, 155–161.
47.
ScherbaumS.DshemuchadseM.FischerR.GoschkeT. (2010). How decisions evolve: The temporal dynamics of action selection. Cognition, 115, 407–416.
48.
ScherbaumS.DshemuchadseM.GoschkeT. (2012). Building a bridge into the future: Dynamic connectionist modeling as an integrative tool for research on intertemporal choice. Frontiers in Cognition, 3, 514.
49.
ScherbaumS.DshemuchadseM.KalisA. (2008). Making decisions with a continuous mind. Cognitive, Affective, & Behavioral Neuroscience, 8, 454–474.
50.
ScherbaumS.DshemuchadseM.LeibergS.GoschkeT. (2013). Harder than expected: Increased conflict in clearly disadvantageous intertemporal choices in a computer game. PLoS ONE, 8, e79310.
51.
ScherbaumS.FischerR.DshemuchadseM.GoschkeT. (2011). The dynamics of cognitive control: Evidence for within-trial conflict adaptation from frequency-tagged EEG. Psychophysiology, 48, 591–600.
52.
ScherbaumS.FrischS.LeibergS.LadeS. J.GoschkeT.DshemuchadseM. (2016). Process dynamics in delay discounting decisions: An attractor dynamics approach. Journal of Judgement and Decision Making, 11, 472–495.
53.
ScherbaumS.GottschalkC.DshemuchadseM.FischerR. (2015). Action dynamics in multitasking: The impact of additional task factors on the execution of the prioritized motor movement. Frontiers in Cognition, 6, 934.
54.
ScholtenM.ReadD. (2006). Discounting by intervals: A generalized model of intertemporal choice. Management Science, 52(9), 1424–1436.
55.
ScholtenM.ReadD. (2010). The psychology of intertemporal tradeoffs. Psychological Review, 117, 925–944.
56.
SongJ. H.NakayamaK. (2008). Numeric comparison in a visually-guided manual reaching task. Cognition, 106, 994–1003.
57.
SongJ. H.NakayamaK. (2009). Hidden cognitive states revealed in choice reaching tasks. Trends in Cognitive Sciences, 13, 360–366.
58.
SpiveyM. J.DaleR. (2004). On the continuity of mind: Toward a dynamical account of cognition. The Psychology of Learning and Motivation: Advances in Research and Theory, 45, 87–142.
59.
SpiveyM. J.DaleR. (2006). Continuous dynamics in real-time cognition. Current Directions in Psychological Science, 15, 207–211.
60.
SpiveyM. J.GrosjeanM.KnoblichG. (2005). Continuous attraction toward phonological competitors. Proceedings of the National Academy of Sciences of the United States of America, 102, 10393–10398.
61.
SummerfieldC.TsetsosK. (2012). Building bridges between perceptual and economic decision-making: Neural and computational mechanisms. Frontiers in Neuroscience, 6. doi:10.3389/fnins.2012.00070.
62.
SvyantekD. J.DeshonR. P.SilerM. T. (1991). The illusion of certainty: A catastrophe model of decision framing. Current Psychology, 10, 199–209.
63.
TakahashiT.OonoH.RadfordM. H. (2008). Psychophysics of time perception and intertemporal choice models. Physica A: Statistical Mechanics and Its Applications, 387, 2066–2074.
64.
ThelenE.SmithL. B. (1996). A dynamic systems approach to the development of cognition and action. Cambridge, MA: The MIT Press.
65.
TownsendJ. T.BusemeyerJ. R. (1989). Approach-avoidance: Return to dynamic decision behavior. In IzawaC. (Ed.), Current issues in cognitive processes: The Tulane Flowerree symposium on cognition. Hillsdale, NJ: Lawrence Erlbaum.
66.
TownsendJ. T.BusemeyerJ. R. (1995). A dynamic representation of decision-making. In PortR. F.van GelderT. (Eds.), Mind as motion: Explorations in the dynamics of cognition (pp. 101–120). Cambridge, MA: The MIT Press.
67.
TullerB.CaseP.DingM.KelsoJ. A. S. (1994). The nonlinear dynamics of speech categorization. Journal of Experimental Psychology: Human Perception and Performance, 20, 3–16.
68.
UsherM.McClellandJ. L. (2001). The time course of perceptual choice: The leaky, competing accumulator model. Psychological Review, 108, 550–592.
69.
UsherM.McClellandJ. L. (2004). Loss aversion and inhibition in dynamical models of multialternative choice. Psychological Review, 111, 757–769.
70.
van RooijM. M.FavelaL. H.MaloneM.RichardsonM. J. (2013). Modeling the dynamics of risky choice. Ecological Psychology, 25, 293–303.
71.
VossA.VossJ. (2007). Fast-dm: A free program for efficient diffusion model analysis. Behavior Research Methods, 39, 767–775.
72.
WangX. J. (2008). Decision making in recurrent neuronal circuits. Neuron, 60, 215–234.
73.
WeberE. U.JohnsonE. J.MilchK. F.ChangH.BrodschollJ. C.GoldsteinD. G. (2007). Asymmetric discounting in intertemporal choice a query-theory account. Psychological Science, 18, 516–523.
74.
ZaubermanG.KimB. K.MalkocS. A.BettmanJ. R. (2009). Discounting time and time discounting: Subjective time perception and intertemporal preferences. Journal of Marketing Research, 46, 543–556.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
