Three experiments investigated the effect of presenting a brief stimulus after a response sequence on the rate of lever-pressing by rats on differential reinforcement of high rate (DRH) schedules. In Experiment 1 enhanced responding was produced by a visual stimulus presented during a 500-msec delay of reinforcement compared to a condition in which no stimulus was presented. In Experiment 2 rats responded on a multiple DRH DRH schedule in which the DRH contingency was reinforced on a 50% schedule in each component. Equivalent levels of responding occurred in the components when reinforcement was signalled in one component and when the signal was presented following the non-reinforced schedules in the other components. A further group of rats received the stimulus presented after non-reinforced schedules in one component but not at all in the other component; responding was enhanced in the former component relative to the latter component. In Experiment 3 brief stimuli presented after the completion of DRH components on a second-order VR (DRH) schedule elevated response rates irrespective of whether the signal was presented paired or unpaired with reinforcement. The present data support the view that a brief signal may serve to mark a response sequence in memory and facilitate instrumental performance.
Get full access to this article
View all access options for this article.
References
1.
CohenS. L.CalistoG. (1981). The effect of brief-stimulus presentations in fixed-ratio second-order schedules.Journal of the Experimental Analysis of Behavior36, 329–334.
2.
CohenS. L.CalistoG.LentzB. E. (1979). Separating the reinforcing and discriminative properties of brief-stimulus presentations in second-order schedules.Journal of the Experimental Analysis of Behavior32, 149–156.
3.
FersterC. B.SkinnerB. F. (1957). Schedules of reinforcementEnglewood Cliffs, N.J.: Prentice-Hall.
4.
GriceG. R. (1948). The relation of secondary reinforcement to delayed reward in visual discrimination learning.Journal of Experimental Psychology38, 1–16.
5.
KeenanM.LeslieJ. L. (1981). Effects of fixed-time shocks and brief stimuli on food-maintained behavior of rats.Journal of the Experimental Analysis of Behavior36, 353–361.
6.
LiebermanD. A.DavidsonF. H.ThomasG. V. (1985). Marking in pigeons: The role of memory in delayed reinforcement.Journal of Experimental Psychology: Animal Behavior Processes11, 611–624.
7.
LiebermanD. A.McIntoshD. C.ThomasG. V. (1979). Learning when reward is delayed. A marking hypothesis.Journal of Experimental Psychology: Animal Behavior Processes5, 224–242.
8.
LiebermanD. A.ThomasG. V. (1986). Marking, memory, and superstition in the pigeon.Quarterly Journal of Experimental Psychology38B, 449–459.
9.
MackintoshN. J. (1983). Conditioning and associative learningOxford: Clarendon Press.
10.
MarrM. J. (1979). Second-order schedules and the generation of unitary response sequences.Advances in analysis of behaviour Vol. 1: Reinforcement and the organisation of behaviour.ZeilerM. D.HarzemP.Chichester: John Wiley223–260.
11.
MorseW. H. (1966). Intermittent reinforcement.Operant behavior: Areas of research and application.HonigW. K.Englewood Cliffs, N.J.: Prentice-Hall52–108.
12.
NeuringerA. J.ChungS-H. (1967). Quasi-reinforcement: Control of responding by a percentage reinforcement schedule.Journal of the Experimental Analysis of Behavior10, 45–54.
13.
PearceJ. M.HallG. (1978). Overshadowing the instrumental conditioning of a lever-press response by a more valid predictor of the reinforcer.Journal of Experimental Psychology: Animal Behavior Processes4, 356–367.
14.
PeeleD. B.CaseyJ.SilberbergA. (1984). Primacy of interresponse-time reinforcement in accounting for rates under variable-ratio and variable-interval schedules.Journal of Experimental Psychology: Animal Behavior Processes10, 149–167.
15.
RashotteM. E. (1981). Second-order autoshaping: Contributions to the research and theory of Pavlovian reinforcement by conditioned stimuli.Autoshaping and conditioning theory.LocurtoC. M.TerraceH. S.GibbonJ.New York: Academic Press.
16.
ReedP. (in press). The influence of interresponse time reinforcement in the effects of signalled reward.Journal of Experimental Psychology: Animal Behavior Processes.
17.
ReedP. (in press). The schedule dependency of the effects of reinforcement magnitude on response rate.
18.
ReedP.HallG. (1988). The schedule dependency of the signalled reinforcement effect.Learning and Motivation19, 387–407.
19.
ReedP.HallG. (in press). Quasi-reinforcement: The effects of stimuli presented uncorrelated with reinforcement on variable-ratio schedules.Learning and Motivation.
20.
ReedP.SchachtmanT. R.HallG. (1988a). Overshadowing and potentiation of instrumental responding in rats as a function of the schedule of reinforcement.Learning and Motivation19, 13–30.
21.
ReedP.SchachtmanT. R.HallG. (1988b). Potentiation of responding on a VR schedule by a stimulus correlated with reinforcement: Effects of diffuse and localized signals.Animal Learning and Behavior16, 75–82.
22.
RescorlaR. A. (1982). Effect of a stimulus intervening between CS and US in autoshaping.Journal of Experimental Psychology: Animal Behavior Processes8, 131–141.
23.
RobertsJ. E.TarpyR. N.LeaS. E. G. (1984). Stimulus response overshadowing: Effects of signalling reward on instrumental responding as measured by response rate and resistance to change.Journal of Experimental Psychology: Animal Behavior Processes10, 244–255.
24.
SchwartzB. (1980). Development of complex, stereotyped behavior in pigeons.Journal of the Experimental Analysis of Behavior33, 153–166.
25.
ShimpC. P. (1976). Organization in memory and behavior.Journal of the Experimental Analysis of Behavior26, 113–130.
26.
SquiresN.NorborgJ.FantinoE. (1975). Second-order schedules: Discrimination of components.Journal of the Experimental Analysis of Behavior24, 157–171.
27.
St. Claire-SmithR. J. (1979). The overshadowing of instrumental conditioning by a stimulus that predicts reinforcement better than the response.Animal Learning and Behavior7, 224–228.
28.
StubbsD. A. (1971). Second-order schedules and the problem of conditioned reinforcement.Journal of the Experimental Analysis of Behavior16, 289–313.
29.
TarpyR. M.LeaS. E. G.MidgelyM. (1983). The role of response-reward correlation in stimulus response overshadowing.Quarterly Journal of Experimental Psychology35B, 53–65.
30.
TarpyR. M.RobertsJ. E. (1985). Effects of signalled reward in instrumental conditioning: Enhanced learning on DRL and DRH schedules of reinforcement.Animal Learning and Behavior13, 6–12.
31.
TarpyR. M.St. Claire-SmithR. J.RobertsJ. E. (1986). The effect of informational stimuli on instrumental response rate: Signalling reward versus signalling the availability of reward.Quarterly Journal of Experimental Psychology38B, 173–189.
32.
ThomasG. V.RobertsonD.LiebermanD. A. (1987). Marking effects in Pavlovian trace conditioning.Journal of Experimental Psychology: Animal Behavior Processes13, 126–135.
33.
WilliamsB. A. (1982). Blocking the response-reinforcer association.Quantitative analysis of behavior, Vol. 3: Acquisition.CommonsM. L.HerrnsteinR. J.WagnerA. R.Cambridge, M.A.: Ballinger427–447.
