Choice between two reinforcers differing in magnitude and delay was investigated in rats using a discrete-trials schedule in which the two reinforcers were associated with two levers (A and B); in each session 5 free-choice trials (A and B both available) were interspersed among 44 forced-choice trials (A alone, 22 trials; B alone, 22 trials). In Experiment 1, preference for the more concentrated of two sucrose solutions declined as the delay to that reinforcer was progressively increased. In Experiment 2, progressively increasing the delay to both reinforcers by the same amount resulted in a shift in preference away from the less concentrated solution. In Experiment 3, it was found that the decline in preference for the more concentrated solution as a function of the delay to that reinforcer was steeper when the rats were maintained at 90% than when they were maintained at 80% of their free-feeding body weights. This effect of deprivation level on choice is inconsistent with some current models of “self-control”.
Get full access to this article
View all access options for this article.
References
1.
AinslieG. W. (1974). Impulse control in pigeons.Journal of the Experimental Analysis of Behavior21, 485–489.
2.
AinslieG.HerrnsteinR. J. (1981). Preference reversal and delayed reinforcement.Animal Learning and Behavior9, 476–482.
3.
BaumW. M.RachlinH. C. (1969). Choice as time allocation.Journal of the Experimental Analysis of Behavior12, 861–874.
4.
BradshawCMSzabadiE. (1988). Quantitative analysis of human operant behavior.Human operant behavior and behavior modification.DaveyG.CullenC.Chichester: Wiley225–259.
5.
BradshawC. M.SzabadiE.RuddleH. V.PearsE. (1983). Herrnstein's equation: Effect of deprivation level on performance in variable-interval schedules.Behaviour Analysis Letters3, 267–273.
6.
Christensen-SzalanskiJ. J.J.GoldbergA. D.AndersonM. E.MitchellT. R. (1980). Deprivation, delay of reinforcement and the selection of behavioral strategies.Animal Behaviour28, 341–346.
7.
ChungS.-H. (1964). Effects of delayed reinforcement in a concurrent situation.Journal of the Experimental Analysis of Behavior8, 439–444.
8.
DavisonM.McCarthyD. (1988). The matching lawHillsdale, NJ: Lawrence Erlbaum Associates, Inc.
9.
DelutyM. Z. (1981). Self-control and impulsiveness involving short-term and long-term punishing events.Quantification of steady-state operant behaviour.BradshawC. M.SzabadiE.LoweC. F.Amsterdam: Elsevier/North-Holland127–138.
10.
de VilliersP. A. (1977). Choice in concurrent schedules and a quantitative formulation of the law of effect.Handbook of operant behavior.HonigW. K.StaddonJ. E.R.Englewood Cliffs, NJ: Prentice-Hall233–287.
11.
EisenbergerR.MastersonF. A. (1987). Effects of prior learning and current motivation on self-control.Quantitative analyses of behavior, vol. V: The effect of delay and intervening events.CommonsM. L.MazurJ. E.NevinJ. A.RachlinH.Hillsdale, NJ: Lawrence Erlbaum Associates, Inc267–282.
12.
EisenbergerR.MastersonF. A.LowmanK. (1982). Effects of previous delay of reward, generalized effort, and deprivation on impulsiveness.Learning and Motivation13, 378–389.
13.
GreenL.SnydermanM. (1980). Choice between rewards differing in amount and delay: Toward a choice model of self-control.Journal of the Experimental Analysis of Behavior34, 135–147.
14.
GreenL.FisherE. B.PerlowS.ShermanL. (1981). Preference reversal and self-control: Choice as a function of reward amount and delay.Behaviour Analysis Letters1, 43–51.
15.
HamiltonA. L.StellarJ. R.HartE. B. (1985). Reward, performance, and the response strength method in self-stimulating rats: Validnation and neuroleptics.Physiology and Behavior35, 897–904.
16.
HerrnsteinR. J. (1970). On the law of effect.Journal of the Experimental Analysis of Behavior13, 243–266.
17.
HerrnsteinR. J. (1981). Self-control as response strength.Quantification of steady-state operant behaviour.BradshawC. M.SzabadiE.LoweC. F.Amsterdam: Elsevier/North-Holland3–20.
18.
HeymanG. M.MonaghanM. M. (1987). The effect of changes in the response requirement and deprivation on the parameters of the matching law equation: New data and review.Journal of Experimental Psychology: Animal Behavior Processes13, 384–394.
19.
HullC. L. (1943). Principles of behaviorNew York: Appleton-Century-Crofts.
20.
KilleenP. R.FantinoE. (1990). Unification of models for choice between delayed rein-forcers.Journal of the Experimental Analysis of Behavior53, 189–200.
21.
LoganF. A. (1965). Decision making by rats: Delay versus amount of food reward.Journal of Comparative and Physiological Psychology59, 1–12.
22.
LoganR. A.SpanierD. (1970). Relative effect of delay of food and water reward.Journal of Comparative and Physiological Psychology72, 102–104.
23.
LogueA. W. (1988). Research on self-control: An integrated framework.Behavioral and Brain Sciences11, 665–709.
24.
LogueA. W.Pena-CorrealT. E. (1985). The effect of food deprivation on self-control.Behavioural Processes10, 355–368.
25.
LogueA. W.ChavarroA.RachlinH.ReederR. W. (1988). Impulsiveness in pigeons living in the experimental chamber.Animal Learning and Behavior16, 31–39.
26.
LogueA. W.RodriguezM. L.Pena-CorrealT. E.MauroB. C. (1984). Choice in self-control paradigm: Quantification of experienced-based differences.Journal of the Experimental Analysis of Behavior41, 53–67.
27.
MazurJ. E. (1987). An adjusting procedure for studying delayed reinforcement.Quantitative analyses of behavior, vol. V: The effect of delay and intervening events.CommonsM. L.MazurJ. E.NevinJ. A.RachlinH.Hillsdale, NJ: Lawrence Erlbaum Associates, Inc55–73.
28.
MazurJ. E.HerrnsteinR. J. (1988). On the functions relating delay, reinforcer value and behavior.Behavioral and Brain Sciences11, 690–691.
29.
MazurJ. E.LogueA. W. (1978). Choice in a “self-control” paradigm: Effects of a fading procedure.Journal of the Experimental Analysis of Behavior30, 11–17.
30.
MillarA.NavarickD. J. (1984). Self-control and choice in humans: Effects of video game playing as a positive reinforcer.Learning and Motivation15, 203–218.
31.
NavarickD. M. (1982). Negative reinforcement and choice in humans.Learning and Motivation13, 361–377.
32.
NavarickD. J.FantinoE. (1976). Self-control and general models of choice.Journal of Experimental Psychology: Animal Behavior Processes2, 75–87.
33.
RachlinH. C.GreenL. (1972). Commitment, choice and self-control.Journal of the Experimental Analysis of Behavior17, 15–22.
34.
SolnickJ. V.KannenbergC. H.EckermanD. A.WallerM. B. (1980). An experimental analysis of impulsivity and impulse control in humans.Learning and Motivation11, 61–77.
35.
SnydermanM. (1983). Optimal prey selection: The effects of food deprivation.Behaviour Analysis Letters3, 359–369.
36.
VaughanW. M. (1985). Choice: A local analysis.Journal of the Experimental Analysis of Behavior43, 383–405.
