Associative learning theories strive to capture the processes underlying and driving the change in strength of the associations between representations of stimuli that develop as a result of experience of the predictive relationships between those stimuli. Historically, formal models of associative learning have focused on two potential factors underlying associative change, namely processing of the conditioned stimulus (in terms of changes in associability) and processing of the unconditioned stimulus (in terms of changes in error). This review constitutes an analysis of the proper role of these two factors, specifically with regard to the way in which they are influenced by associative history (the prior training undergone by cues). A novel “hybrid” model of associative learning is proposed and is shown to provide a more satisfactory account of the effects of associative history on subsequent learning than any previous single-process theory.
Get full access to this article
View all access options for this article.
References
1.
BakerA. G., & MackintoshN. J. (1977). Excitatory and inhibitory conditioning following uncorrelated presentations of CS and UCS. Animal Learning & Behavior, 5, 315–319.
2.
BakerA.G., & MackintoshN.J. (1979). Preexposure to the CS alone, or CS and US uncorrelated: Latent inhibition, blocking by context or learned irrelevance?Learning and Motivation, 10, 278–294.
3.
BennettC.H.MaldonadoA., & MackintoshN.J. (1995). Learned irrelevance is not the sum of exposure to CS and US. Quarterly Journal of Experimental Psychology, 48B, 117–128.
4.
BennettC.H.WillsS.J.OakeshottS.M., & MackintoshN.J. (2000). Is the context specificity of latent inhibition a sufficient explanation of learned irrelevance?Quarterly Journal of Experimental Psychology, 53B, 239–253.
5.
BonardiC., & HallG. (1996). Learned irrelevance: No more than the sum of CS and US preexposure effects?Journal of Experimental Psychology: Animal Behavior Processes, 22, 183–191.
6.
BonardiC., & OngS. Y. (2003). Learned irrelevance: A contemporary overview. Quarterly Journal of Experimental Psychology, 56B, 80–89.
7.
BoutonM. E. (1993). Context, time, and memory retrieval in the interference paradigms of Pavlovian learning. Psychological Bulletin, 114, 80–99.
8.
BoutonM. E. (1994). Conditioning, remembering, and forgetting. Journal of Experimental Psychology: Animal Behavior Processes, 20, 219–231.
9.
BrandonS. E.VogelE.H., & WagnerA. R. (2003). Stimulus representation in SOP: I. Theoretical rationalization and some implications. Behavioural Processes, 62, 5–25.
10.
BuhusiC. V., & SchmajukN. A. (1996). Attention, configuration and hippocampal function. Hippocampus, 6, 621–642.
11.
BushR. R., & MostellerF. (1951). A mathematical model for simple learning. Psychological Review, 58, 313–323.
12.
ChannellS., & HallG. (1983). Contextual effects in latent inhibition with an appetitive conditioning procedure. Animal Learning & Behavior, 11, 67–74.
13.
CottonM. M.GoodallG., & MackintoshN. J. (1982). Inhibitory conditioning resulting from a reduction in the magnitude of reinforcement. Quarterly Journal of Experimental Psychology, 34B, 163–180.
14.
De HouwerJ., & BeckersT. (2002). A review of recent developments in research and theories on human contingency learning. Quarterly Journal of Experimental Psychology, 55B, 289–310.
15.
DickinsonA.HallG., & MackintoshN.J. (1976). Surprise and the attenuation of blocking. Journal of Experimental Psychology: Animal Behavior Processes, 2, 313–322.
16.
DickinsonA., & MackintoshN. J. (1979). Reinforcer specificity in the enhancement of conditioning by posttrial surprise. Journal of Experimental Psychology: Animal Behavior Processes, 5, 162–177.
17.
DickinsonA.ShanksD.R., & EvendenJ. L. (1984). Judgement of act-outcome contingency: The role of selective attribution. Quarterly Journal of Experimental Psychology, 36A, 29–50.
18.
EstesW. K. (1950). Toward a statistical theory of learning. Psychological Review, 57, 94–107.
19.
GeorgeD. N., & PearceJ. M. (1999). Acquired distinctiveness is controlled by stimulus relevance not correlation with reward. Journal of Experimental Psychology: Animal Behavior Processes, 25, 363–373.
20.
HallG. (1991). Perceptual and associative learning. Oxford: Oxford University Press.
21.
HallG., & MinorH. (1984). A search for context-stimulus associations in latent inhibition. Quarterly Journal of Experimental Psychology, 36B, 145–169.
22.
HallG., & PearceJ. M. (1979). Latent inhibition of a CS during CS-US pairings. Journal of Experimental Psychology: Animal Behavior Processes, 3, 31–42.
23.
HallG., & PearceJ. M. (1982). Restoring the associability of a pre-exposed CS by a surprising event. Quarterly Journal of Experimental Psychology, 34B, 127–140.
24.
HearstE. (1972). Some persistent problems in the analysis of conditioned inhibition. In HallidayM. S. (Ed.), Inhibition and learning (pp. 5–39). London: Academic Press.
25.
HollandP. C. (1984). Unblocking in Pavlovian appetitive conditioning. Journal of Experimental Psychology: Animal Behavior Processes, 10, 476–497.
26.
HollandP. C. (1988). Excitation and inhibition in unblocking. Journal of Experimental Psychology: Animal Behavior Processes, 14, 261–279.
27.
KaminL. J. (1969). Predictability, surprise, attention and conditioning. In CampbellB. A.ChurchM.R. (Eds.), Punishment and aversive behavior. New York: Appleton-Century-Crofts.
28.
KayeH., & PearceJ. M. (1984). The strength of the orienting response during Pavlovian conditioning. Journal of Experimental Psychology: Animal Behavior Processes, 10, 90–109.
29.
KendlerT. S. (1971). Continuity theory and cue dominance. In SpenceJ. T. (Ed.), Essays in neobehaviorism: A memorial volume to Kenneth W. Spence. New York: Appleton-Century-Crofts.
30.
KhalladY., & MooreJ. (1996). Blocking, unblocking, and overexpectation in autoshaping with pigeons. Journal of the Experimental Analysis of Behavior, 65, 575–591.
31.
KonorskiJ. (1967). Integrative activity of the brain. Chicago: University of Chicago Press.
32.
KremerE.F. (1978). The Rescorla-Wagner model: Losses of associative strength in compound conditioned stimuli. Journal of Experimental Psychology: Animal Behavior Processes, 4, 22–36.
33.
KruschkeJ. K. (1992). ALCOVE: An exemplar-based connectionist model of category learning. Psychological Review, 99, 22–44.
34.
KruschkeJ. K. (2001). Towards a unified model of attention in associative learning. Journal of Mathematical Psychology, 45, 812–863.
35.
KruschkeJ. K., & BlairN. J. (2000). Blocking and backward blocking involve learned inattention. Psychonomic Bulletin & Review, 7, 636–645.
36.
LattalK.M., & NakajimaS. (1998). Overexpectation in appetitive Pavlovian and instrumental conditioning. Animal Learning & Behavior, 26, 351–360.
37.
Le PelleyM. E., & McLarenI. P. L. (2003). Learned associability and associative change in human causal learning. Quarterly Journal of Experimental Psychology, 56B, 68–79.
38.
LochmannT., & WillsA. J. (2003). Predictive history in an allergy prediction task. Proceedings of EuroCogSci 03: The European Conference of the Cognitive Science Society (pp. 217–222). Mahwah, NJ: Lawrence Erlbaum Associates Inc.
39.
LovibondP.F.PrestonG.C., & MackintoshN.J. (1984). Context specificity of conditioning and latent inhibition. Journal of Experimental Psychology: Animal Behavior Processes, 10, 360–375.
40.
LubowR.E. (1989). Latent inhibition and conditioned attention theory. Cambridge, UK: Cambridge University Press.
41.
MackintoshN.J. (1969). Further analysis of the overtraining reversal effect. Journal of Comparative and Physiological Psychology, 67, No. 2, Part 2.
42.
MackintoshN. J. (1973). Stimulus selection: Learning to ignore stimuli that predict no change in reinforcement. In HindeR. A. & HindeJ. S. (Eds.), Constraints on learning (pp. 75–96). London: Academic Press.
43.
MackintoshN. J. (1975). A theory of attention: Variations in the associability of stimuli with reinforcement. Psychological Review, 82, 276–298.
44.
MackintoshN.J. (1978). Cognitive or associative theories of conditioning: Implications of an analysis of blocking. In FowlerH.HonigW. K.PulseS. H. (Eds.), Cognitive processes in animal behavior (pp. 155–175). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
45.
MackintoshN. J., & CottonM. M. (1985). Conditioned inhibition from reinforcement reduction. In SpearN. E. (Ed.), Information processing in animals: Conditioned inhibition. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
46.
MackintoshN.J., & LittleL. (1969). Intradimensional and extradimensional shift learning by pigeons. Psychonomic Science, 14, 5–6.
47.
MackintoshN. J., & TurnerC. (1971). Blocking as a function of novelty of CS and predictability of UCS. Quarterly Journal of Experimental Psychology, 23, 359–366.
48.
MatzelL. D.SchachtmanT. R., & MillerR. R. (1988). Learned irrelevance exceeds the sum of CS-preexposure and US-preexposure deficits. Journal of Experimental Psychology: Animal Behavior Processes, 14, 311–319.
49.
McLarenI. P. L., KayeH., & MackintoshN. J. (1989). An associative theory of the representation of stimuli: Applications to perceptual learning and latent inhibition. In MorrisR. G. M. (Ed.), Parallel distributed processing: Implications for psychology and neurobiology (pp. 102–130). Oxford, UK: Oxford University Press.
50.
MillerR. R., & MatzelL. D. (1988). The comparator hypothesis: A response rule for the expression of associations. The Psychology of Learning and Motivation, 22, 51–92.
51.
MooreJ. W., & StickneyK.J. (1985). Antiassociations: Conditioned inhibition in attentional-associative networks. In MillerR. R. & SpearN. E. (Eds.), Information processing in animals: Conditioned inhibition. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
52.
NavarroJ. I.HallamS. C.MatzelL. D., & MillerR. R. (1989). Superconditioning and overshadowing. Learning and Motivation, 20, 130–152.
53.
OswaldC. J. P.YeeB. K.RawlinsJ. N. P.BannermanD. B.GoodM., & HoneyR. C. (2001). Involvement of the entorhinal cortex in a process of attentional modulation: Evidence from a novel variant of an IDS/EDS procedure. Behavioral Neuroscience, 115, 841–849.
54.
PearceJ. M. (1994). Similarity and discrimination: A selective review and a connectionist model. Psychological Review, 101, 587–607.
55.
PearceJ. M., & BoutonM. E. (2001). Theories of associative learning in animals. Annual Review of Psychology, 52, 111–139.
56.
PearceJ. M.GeorgeD. N., & RedheadE. S. (1998). The role of attention in the solution of conditional discriminations. In SchmajukN. A. & HollandP. C. (Eds.), Occasion setting: Associative learning and cognition in animals. Washington, DC: American Psychological Association.
57.
PearceJ. M., & HallG. (1980). A model for Pavlovian conditioning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review, 87, 532–552.
58.
PearceJ. M.KayeH., & HallG. (1981). Predictive accuracy and stimulus associability. In CommonsM. L.HerrnsteinR. J.WagnerA.R. (Eds.), Quantitative analyses of behavior: Acquisition (Vol. 3). Cambridge, MA: Ballinger.
59.
PearceJ. M.NicholasD. J., & DickinsonA. (1982). Loss of associability by a conditioned inhibitor. Quarterly Journal of Experimental Psychology, 34B, 149–162.
60.
PearceJ. M., & RedheadE. S. (1995). Supernormal conditioning. Journal of Experimental Psychology: Animal Behavior Processes, 21, 155–165.
61.
PradosJ.RedheadE. S., & PearceJ. M. (1999). Active preexposure enhances attention to the landmarks surrounding a Morris swimming pool. Journal of Experimental Psychology: Animal Behavior Processes, 25, 451–460.
62.
RandichA., & LoLordoV. M. (1979). Associative and non-associative theories of the UCS preexposure phenomenon: Implications for Pavlovian conditioning. Psychological Bulletin, 5, 25–28.
63.
RedheadE.S.PradosJ., & PearceJ.M. (2001). The effects of pre-exposure on escape from a Morris pool. Quarterly Journal of Experimental Psychology, 54B, 353–367.
64.
ReidL. S. (1953). The development of noncontinuity behavior through continuity learning. Journal of Experimental Psychology, 46, 107–112.
65.
RescorlaR. A. (1969a). Conditioned inhibition of fear resulting from negative CS-US contingencies. Journal of Comparative and Physiological Psychology, 67, 504–509.
66.
RescorlaR. A. (1969b). Pavlovian conditioned inhibition. Psychological Bulletin, 72, 77–94.
67.
RescorlaR. A. (1970). Reduction in the effectiveness of reinforcement after prior excitatory conditioning. Learning and Motivation, 1, 372–381.
68.
RescorlaR. A. (1971). Variations in the effectiveness of reinforcement and nonreinforcement following prior inhibitory conditioning. Learning and Motivation, 2, 113–123.
69.
RescorlaR. A. (2000). Associative changes in excitors and inhibitors differ when they are conditioned in compound. Journal of Experimental Psychology: Animal Behavior Processes, 26, 428–438.
70.
RescorlaR. A. (2001). Unequal associative changes when excitors and neutral stimuli are conditioned in compound. Quarterly Journal of Experimental Psychology, 54B, 53–68.
71.
RescorlaR. A. (2002). Effect of following an excitatory-inhibitory compound with an intermediate reinforcer. Journal of Experimental Psychology: Animal Behavior Processes, 28, 163–174.
72.
RescorlaR. A., & WagnerA. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and non-reinforcement. In BlackA. H. & ProkasyW. F. (Eds.), Classical conditioning II: Current research and theory (pp. 64–99). New York: Appleton-Century-Crofts.
73.
RobertsA.C.RobbinsT.W., & EverittB.J. (1988). The effects of intradimensional and extradimensional shifts on visual discrimination learning in humans and non-human primates. Quarterly Journal of Experimental Psychology, 40B, 321–341.
74.
RodriguezG.LombasS., & AlonsoG. (2002, March). Previous blocking trials impede conditioning of the added element when US intensity is increased. Poster presented at the Sixth Associative Learning Symposium, Gregynog, Wales.
75.
RosasJ. M., & BoutonM. E. (1997). Additivity of the effects of retention interval and context change on latent inhibition: Toward resolution of the context forgetting paradox. Journal of Experimental Psychology: Animal Behavior Processes, 23, 283–294.
76.
SchmajukN. A., & MooreJ. W. (1985). Real-time attentional models for classical conditioning and the hippocampus. Physiological Psychology, 13, 278–290.
77.
SchwartzR. M.SchwartzM., & TeasR. C. (1971). Optional intradimensional and extradimensional shifts in the rat. Journal of Comparative and Physiological Psychology, 77, 470–475.
78.
SeraganianP. (1979). Extradimensional transfer in the easy-to-hard effect. Learning and Motivation, 10, 39–57.
79.
SheppB.E., & SchrierA.M. (1969). Consecutive intradimensional and extradimensional shifts in monkeys. Journal of Comparative and Physiological Psychology, 67, 199–203.
80.
SuretM. B. S., & McLarenI. P. L. (2003). Representation and discrimination on an artificial dimension. Quarterly Journal of Experimental Psychology, 56B, 30–42.
81.
SutherlandN. S., & MackintoshN. J. (1971). Mechanisms of animal discrimination learning. New York: Academic Press.
82.
SwanJ. A., & PearceJ. M. (1988). The orienting response as an index of stimulus associability in rats. Journal of Experimental Psychology: Animal Behavior Processes, 4, 292–301.
83.
SwartzentruberD., & BoutonM. E. (1986). Contextual control of negative transfer produced by prior CS-US pairings. Learning and Motivation, 17, 366–385.
84.
ThorndikeE. L. (1898). Animal intelligence: An experimental study of the associative processes in animals. Psychological Review Monograph Supplements (No. 8) [entire issue].
85.
TrobalonJ.B.MiguelezD.McLarenI.P.L., & MackintoshN.J. (2003). Intradimensional and extradimensional shifts in spatial learning. Journal of Experimental Psychology: Animal Behavior Processes, 29, 143–152.
86.
TurrisiF. D.SheppB. E., & EimasP. D. (1969). Intra- and extra-dimensional shifts with constant- and variable-irrelevant dimensions in the rat. Psychonomic Science, 14, 19–20.
87.
WagnerA. R. (1971). Elementary associations. In SpenceJ. T. (Ed.), Essays in neobehaviorism: A memorial volume to Kenneth W. Spence. New York: Appleton-Century-Crofts.
88.
WagnerA. R. (1981). SOP: A model of automatic memory processing in animal behaviour. In SpearN. E. & MillerR. R. (Eds.), Information processing in animals: Memory mechanisms (pp. 5–47). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
WagnerA. R., & BrandonS. E. (2001). A componential theory of Pavlovian conditioning. In KleinS. B. (Ed.), Handbook of contemporary learning theories. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
91.
WagnerA. R.LoganF. A.HaberlandtK., & PriceT. (1968). Stimulus selection in animal discrimination learning. Journal of Experimental Psychology, 76, 171–180.
92.
WagnerA. R.MazurJ. E.DoneganN. H., & PfautzP. L. (1980). Evaluation of blocking and conditioned inhibition to a CS signalling a decrease in US intensity. Journal of Experimental Psychology: Animal Behavior Processes, 6, 376–385.
93.
WassermanE. A. (1974). Stimulus-reinforcer predictiveness and selective discrimination learning in pigeons. Journal of Experimental Psychology, 103, 284–297.
94.
WhitneyL., & WhiteK.G. (1993). Dimensional shift and the transfer of attention. Quarterly Journal of Experimental Psychology, 46B, 225–252.
95.
WilliamsB. A., & McDevittM. A. (2002). Inhibition and superconditioning. Psychological Science, 13, 454–459.
96.
WilsonP.N.BoumphreyP., & PearceJ.M. (1992). Restoration of the orienting response to a light by a change in its predictive accuracy. Quarterly Journal of Experimental Psychology, 44B, 17–36.
