Postponed Conditioning: Testing a Hypothesis About Synaptic Strengthening

Abstract

A connectionist neural circuit model of motivated behavior that uses a variant on Hebbian synaptic plasticity (Halperin, 1990, 1991) predicts that transient excitatory conditioning should occur to a stimulus presented after the US has been removed, provided that this CS presentation is postponed until just before the end of a behavioral afterdischarge. We report here some experimental confirmations of this prediction, using the social display system of male Siamese fighting fish, in which afterdischarge is visually observable. A mirror was presented and removed, to elicit social display followed by display afterdischarge. A CS object was presented just as the afterdischarge faded. After 10 to 12 such pairings, the CS shown alone elicited display. The model, however, also predicts that no excitatory conditioning should occur to a CS presented near the beginning of a long afterdischarge. This arrangement and an unpaired CS condition were used as controls, and the prediction was confirmed. However, the model further suggests that a CS presented at the beginning of an afterdischarge should show excitatory conditioning if the display afterdischarge could be artificially shortened so that the CS presentation would come just before the end of the afterdischarge. In a second experiment, the CS was presented immediately after mirror removal, and then afterdischarge was ended by feeding the fighting fish a guppy. Since the CS now predicted the arrival of food as well as the end of the afterdischarge, we depressed conditioned feeding responses by food-satiating the fish before presenting the CS alone. Display conditioning was confirmed. Controls were included for the effects of feeding.

Keywords

connectionism synaptic strengthening conditioning learning,backward conditioning aggression motivation Betta splendens

Get full access to this article

View all access options for this article.

References

Fantino, E. , & Logan, C.A. (1979). The experimental analysis of behavior: A biological approach. San Francisco: Freeman .

Franchina, J.J. (1989). Effects of flavor salience on aversion performance following relatively long-delay backward conditioning procedures. Behavioral and Neural Biology, 51, 127-135.

Hallam, J. , & Halperin, J.R.P. (1991). Terminal testing program for brain and neuron. Unpublished program.

Halperin, J.R.P. (1990). A connectionist neural network model of aggression . Unpublished doctoral dissertation, University of Toronto , Toronto.

Halperin, J.R.P. (1991). Machine motivation. In J.-A. Meyer & S. W Wilson (Eds.), From animals to animats: Proceedings of the first international conference on simulation of adaptive behavior. Cambridge, MA: The MIT Press.

Halperin, J.R.P. , Dunham, D.W. , & Ye, S. (in press). Social isolation increases primed agressive display but decreases display readiness in Betta splendens.

Halperin, J.R.P. , Hallam, J. , & Forster, P.M. (in preparation). Implementation of a correctionist model of learning and motivation on an autonomous robot.

Halperin, J.R.P. , Halperin, J.S. , & Rutherford, P. (1991). A neuro-connector simulation for the IRIS. Unpublished program.

Hearst, E. (1989). Backward associations: Differential learning about stimuli that follow the presence versus the absence of food in pigeons. Animal Learning and Behavior, 17, 280-290.

10.

Keith-Lucas, T. , & Guttman, N. (1975). Robust single-trial delayed backward conditioning . Journal of Comparative and Physiological Psychology, 88, 468-476.

11.

Lack, D. (1943). The life of the robin. Cambridge , Engl.: Cambridge University Press.

12.

Matsumiya, Y. (1960). The effects of US intensity and CS-US pattern on conditioned emotional response. Japanese Psychological Research, 2, 35-42.

13.

McFarland, D.J. (1989). The teleological imperative. In A. C. R. G. Montefiore & D. Noble (Eds.), Goals, no-goals and own goals. London: Unwin-Hyman.

14.

Meck, W.C. (1985). Postreinforcement signal processing. Journal of Experimental Psychology: Animal Behavior Processes, 11, 52-70.

15.

Moskovitch, A. , & LoLordo, V M. (1968). Role of safety in the Pavlovian fear conditioning procedure. Journal of Comparative and Physiological Psychology, 66, 673-678.

16.

Noakes, D.L.G. (1982). Effects of chemical signals in Betta splendens . Revue Canadienne de Biologie Experimentale, 41, 217-219.

17.

Pinel, J.P.J. , Mana, M.J. , & Wilkie, D.M. (1986). Postshock learning and defensive burying. Animal Learning and Behavior, 14, 301-304.

18.

Rescorla, R.A. (1988). Behavioral studies of Pavlovian conditioning. Annual Review of Neuroscience, 11, 329-352.

19.

Rozin, P. , & Kalat, J.W. (1971). Specific hungers and poison avoidance as adaptive specializations of learning. Psychological Review, 78, 459-486.

20.

Segundo, J.P. , Galeano, C. , Sommer-Smith, J.A. , & Roig, J.A. (1961). Behavioral and EEG effects of tones "reinforced" by cessation of painful stimuli. In J. F. Delafresnaye (Ed.), Brain mechanisms and learning. Oxford, Engl.: Blackwell Scientific Publications.

21.

Siegel, S. (1956). Nonparametricstatisticsfor the behavioral sciences . New York: McGraw-Hill.

22.

Simpson, M.J.A. (1968). The display of the Siamese fighting fish, Betta splendens Animal Behaviour Monographs, 1, 1-74.

23.

Sinclair, J.D. (1981). The rest principle: A neurophysiological theory of behavior. Hillsdale, NJ: Lawrence Erlbaum Associates.

24.

Spetch, M.L. , Wilkie, D.M. , & Pinel, P.J.P. (1981). Backward conditioning: A reevaluation of the empirical evidence. Psychological Bulletin, 89, 163-175.

25.

Sutton, R.S. , & Barto, A.G. (1981). Toward a modern theory of adaptive networks: Expectation and prediction. Psychological Review, 88, 135-171.

26.

Sutton, R.S. , & Barto, A.G. (1987). A temporal-difference model of classical conditioning . Proceedings of the Ninth Conference of the Cognitive Science Society, Vol. 9, 355-378.

27.

Sutton, R.S. , & Barto, A.G. (in press). Time-derivative models of Pavlovian reinforcement. In M. Gabriel & J. W Moore (Eds.), Learning and computational neuroscience . Cambridge, MA: The MIT Press.

28.

Wagner, A.R. , & Terry, W.S. (1975). Backward conditioning to a CS followed by an expected vs. a surprising UCS. Animal Learning and Behavior, 3, 370-374.