Place Learning and the Dynamics of Spatial Navigation: A Neural Network Approach

Abstract

This study presents a real-time neural network capable of describing place learning and the dynamics of spatial navigation. The network incorporates detectors that can be tuned to the values of visual angles of different landmarks as perceived from the spatial location where a reinforcing event is encountered. After a detector has been tuned its output generates an effective stimulus that peaks at the distance from the landmark where positive or negative reinforcement was encountered previously. The outputs of the tuned detectors become associated with the reinforcing event. The network generates spatial generalization surfaces that can guide navigation from any location that is within view of familiar landmark cues, even if that location has never been visited before. Spatial navigation is accomplished by adopting a stimulus-approach principle-that is, by approaching appetitive places and avoiding aversive places. When generalization surfaces are assumed to represent forces exerted by the animal, the dynamics of spatial movements can be described. Computer simulations were carried out for appetitive, aversive, and aversive-appetitive place learning. This article shows that the network correctly describes the navigational trajectories and dynamics of many spatial learning tasks.

Keywords

place learning spatial mapping cognitive mapping neural networks

Get full access to this article

View all access options for this article.

References

Amsel, A. , Rashotte, M.E. , & MacKinnon, J.R. (1966). Partial reinforcement effects within subjects and between subjects. Psychological Monograph: General and Applied, 80 (20, Whole #628).

Barto, A.G. , & Sutton, R.S. (1981). Landmark learning: An illustration of associative search. Biological Cybernetics, 42, 1-8.

Brown, J.S. (1942). The generalization of approach responses as a function of stimulus intensity and strength of motivation. Journal of Comparative Psychology, 33, 209-226.

Hull, C.L. (1932). The goal gradient hypothesis and maze learning . Psychological Review, 42, 117-121.

Hull, C.L. (1952). A behavioral system. New Haven : Yale University Press.

Jarrard, L.E. (1983). Selective hippocampal lesions and behavior: Effects of kainic acid lesions on performance of place and cue tasks. Behavioral Neuroscience, 97, 873-889.

Killeen, P.R. , & Amsel, A. (1987). The kinematics of locomotion toward a goal. Journal of Experimental Psychology: Animal Behavior Processes, 13, 92-101.

Levine, M.W. , & Shefner, J.M. (1981). Fundamentals of sensation and perception. Reading, MA: Addison-Wesley.

Lewin, K. (1935). A dynamic theory of personality. New York: McGraw-Hill.

10.

Mackintosh, N.J. (1974). The psychology of animal learning. London: Academic Press.

11.

Miller, N.E. (1944). Experimental studies in conflict. In J. McV Hunt (Ed.), Personality and the behavior disorders. New York: Ronald Press .

12.

Miller, N.E. (1959). Liberalization of basic S-R concepts: Extensions to conflict behavior, motivation, and social learning. In S. Koch (Ed.), Psychology: A study of a science (Vol. 2). New York: McGraw-Hill.

13.

Miller, N.E. , Brown, J.S. , & Lipovsky, H. (1943). A theoretical and experimental analysis of conflict behavior: III. Approach-avoidance conflict as a function of strength of drive and strength of shock. (Cited in Miller [1944].)

14.

Milner, P.M. (1960). Learning in neural systems. In M. C. Yovits & S. Cameron (Eds.), Self-organizing systems (pp. 190-202). New York: Pergamon.

15.

Morris, R.G.M. (1981). Spatial location does not require the presence of local cues. Learning and Motivation, 12, 239-260.

16.

Olton, D.S. (1978). Characteristics of spatial memory. In H. S. Hulse , H. Fowler , & W K. Honig (Eds.), Cognitive processes in animal behavior (pp. 341-373). New York: John Wiley.

17.

Pearce, J.M. , & Hall, G. (1980). A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological Review, 87, 532-552.

18.

Rescorla, R.A. , & Wagner, A.R. (1972). A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and non-reinforcement. In A. H. Black & W F. Prokasy (Eds.), Classical conditioning II: Theory and research (pp. 64-99). New York: Appleton-Century-Crofts.

19.

Schmajuk, N.A. (1990). Role of the hippocampus in temporal and spatial navigation : An adaptive neural network. Behavioral Brain Research, 39, 205-229.

20.

Schmajuk, N.A. , & Di Carlo, J.J. (1992). Stimulus configuration, classical conditioning, and hippocampal function. Psychological Review, 99, 268-305.

21.

Schmajuk, N.A. , & Thieme, A.D. (1992). Purposive behavior and cognitive mapping : A neural network model. Biological Cybernetics, 67, 165-174.

22.

Sutton, R.S. , & Barto, A.G. (1981). Toward a modern theory of adaptive networks: Expectation and prediction. Psychological Review, 88, 135-170.

23.

Tipler, P.A. (1982). Physics. New York: Worth Publishers.

24.

Tolman, E.C. (1932). Cognitive maps in rats and men. Psychological Review, 55, 189-208.

25.

Townsend, J.T. , & Busemeyer, J.R. (1989). Approach-avoidance: Return to dynamic decision behavior. In C. Izawa (Ed.), Current issues in cognitive processes: Tulane Flowerree symposium on cognition (pp. 107-133). Hillsdale, NJ: Erlbaum Associates.

26.

Wagner, A.R. (1961). Effects of amount and percentage of reinforcement and number of acquisition trials on conditioning and extinction. Journal of Experimental Psychology, 62, 234-242.

27.

Widrow, B. , & Hoff, M.E. (1960). Adaptive switching circuits (1960 IRE WESCON Convention Record, Part 4, 96-104).

28.

Whishaw, I.Q. (1991). Latent learning in a swimming pool place task by rats: Evidence for the use of associative and not cognitive mapping processes . The Quarterly Journal of Experimental Psychology, 43B, 83-103.

29.

Wilkie, D.M. , & Palfrey, R. (1987). A computer simulation model of rat's place navigation in the Morris water maze. Behavior Research Methods, Instruments, and Computers, 19, 400-403.

30.

Zipser, D. (1985). A computational model of hippocampal place fields . Behavioral Neuroscience, 99, 1006-1018.

31.

Zipser, D. (1986). Biologically plausible models of place recognition and goal location. In J. L. McClelland & D. E. Rumelhart (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition: Vol. 2. Psychological and biological models (pp. 432-470). Cambridge, MA: MIT Press.