If behavior networks, which use spreading activation to select actions, are analogous to connectionist methods of pattern recognition, then we suggest that recurrent behavior networks, which use energy minimization, are analogous to Hopfield networks. Hopfield networks memorize patterns by making them attractors. We argue that, similarly, each behavior of a recurrent behavior network should be an attractor of the network, to inhibit fruitless, repeated switching between different behaviors in response to small changes in the environment and in motivations. We demonstrate that the performance in a test domain of the Do the Right Thing recurrent behavior network is improved by redesigning it to create desirable attractors and basins of attraction. We further show that this performance increase is correlated with an increase in persistence and a decrease in undesirable behavior switching.
Agre, P.E., & Chapman, D. (1987). Pengi: An implementation of a theory of activity . Proceedings of the American Association for Artificial Intelligence-87. Los Altos, CA: Morgan Kaufmann.
2.
Amari, S. (1972). Learning patterns and pattern sequences by self-organizing nets of threshold elements. IEEE Transactions on Computers , C-21 (11), 1197-1206.
3.
Anderson, J.R. (1983). Retrieval of information from long-term memory . Science, 220, 25-30.
4.
Audi, R. (Ed.) (1995). The Cambridge dictionary of philosophy. Cambridge, Engl.: Cambridge University Press.
5.
Baerends, G. (1976). The functional organisation of behavior. Animal Behavior, 24, 726-735.
6.
Baker, G., & Gollub, J. (1990). Chaotic dynamics: An introduction. Cambridge, Engl.: Cambridge University Press.
7.
Beer, R., Chiel, H., & Sterling, L. (1990). A biological perspective on autonomous agent design . In P. Maes (Ed.), Designing autonomous agents. Cambridge, MA: MIT Press.
8.
Blumberg, B. (1994). Action-selection in Hamsterdam: Lessons from ethology . In Cliff, D., Husbands, P., Meyer, J.-A., & Wilson, S. W (Eds.), From animals to animats 3: Proceedings of the Third International Conference on Simulation of Adaptive Behavior. Cambridge, MA: MIT Press.
9.
Blumberg, B., & Galyean, T. (1995). Multi-level direction of autonomous creatures for real-time virtual environments. Proceedings of SIGGRAPH '95 (Los Angeles). In Cook, R. (Ed.), Computer graphics proceedings, annual conference series. New York: ACM.
10.
Borowski, E.J., & Borwein, J.M. (1991). Dictionary of mathematics. New York: Harper-Collins.
11.
Brooks, R.A. (1985). A robust layered control system for a mobile robot (Tech. Rep. No. 864). Cambridge, MA: AI Labs, MIT.
12.
de Carvalho, L.A. (1994). Modeling the thalamocortical loop. International journal of Bio-Medical Computing35, 267-296.
13.
de Carvalho, L.A., & Roitman, V. (1995). A computational model for the neurobiological substrates of visual attention. International Journal of Bio-Medical Computing, 38, 33-45.
14.
Chomsky, N. (1959). Review of Verbal behavior. Language , 35, 26-58.
15.
Dias, E., & Bruce, C. (1994). Physiological correlate of fixation disengagement in the primate's frontal eye field. Journal of Neurophysiology , 72(5), 2532-2537.
16.
Ekeberg, O., Lansner, A., & Grillner, S. (1995). The neural control of fish swimming studied through numerical simulations. Adaptive Behavior, 3(4), 363-384.
17.
Fikes, R.E., & Nilsson, N.J. (1971). STRIPS: A new approach to the application of theorem proving to problem solving. Artificial Intelligence, 5(2), 189-208. Reprinted in J. Allen, J. Hendler, & A. Tate (Eds.), Readings in planning. San Mateo, CA: Morgan Kaufmann, 1990.
18.
Goetz, P. (1997). Attractors in recurrent behavior networks. Doctoral thesis, State University of New York at Buffalo.
19.
Halperin, J. (1995). Cognition and emotion in animals and machines . In H. L. Roitblat & J. A. Meyer (Eds.), Comparative approaches to cognitive science. Cambridge, MA: MIT Press.
20.
Hamilton, A., Madison, J., & Jay, J. (1948). The federalist, or the new constitution. London: J. M. Dent & Sons. (Original work published 1787-1788.)
21.
Harmon, L.D. (1964). Neuromimes: Action of a reciprocally inhibitory pair. Science, 146, 1323-1325.
22.
Hopfield, J.J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences, 79, 2554-2558. (Reprinted in J. A. Anderson & E. Rosenfeld (Eds.), Neurocomputing: Foundations of research . Cambridge, MA: MIT Press, 1988.)
23.
Humphreys, L.G. (1939). Acquisition and extinction of verbal expectations in a situation analogous to conditioning. Journal of Experimental Psychology, 25, 294-301.
24.
Humphreys, L.G. (1943). Measures of strength of conditioned eyelid responses . The Journal of General Psychology, 29, 101-111.
25.
Lukashin, A.V., Amirikian, B.R., Mozhaev, V.L., Wilcox, G.L., & Georgopoulos, A.P. (1996). Modeling motor cortical operations by an attractor network of stochastic neurons. Biological Cybernetics, 74, 255-261.
26.
Maes, P. (1989a). How to do the right thing. AI Lab Memo No. 1180 , MIT, Cambridge, MA.
27.
Maes, P. (1989b). The dynamics of action selection. In Sridharan, N. S. (Ed.), Proceedings of the Eleventh International Joint Conference on Artificial Intelligence (IJCAI-89). San Mateo, CA: Morgan Kaufmann.
28.
Maes, P. (1990). Situated agents can have goals. In Maes, P (Ed.), Designing autonomous agentsCambridge, MA: MIT Press.
29.
Maes, P. (1991a). Adaptive action selection. In Proceedings of the Thirteenth Annual Conference of the Cognitive Science SocietyHillsdale, NJ: Lawrence Erlbaum Associates .
30.
Maes, P. (1991b). Learning behavior networks from experience. In Varela, F. J., & Bourgine, P. (Eds.), Proceedings of the First European Conference on Artificial Life. Cambridge, MA: MIT Press.
31.
Minsky, M. (1980). K-lines: A theory of memory. Cognitive Science, 4, 117-133.
32.
Minsky, M. (1986). The society of mind. New York : Simon & Schuster.
33.
Nelson, K. (1973). Does the holistic study of behavior have a future? In P. P G. Bateson & P H. Klopfer (Eds.), Perspectives in ethology . New York: Plenum Press.
34.
Numaoka, C. (1994). Phase transitions in instigated collective decision making. Adaptive Behavior, 3(2), 185-223.
35.
Razran, G.H.S. (1935). Conditioned responses: An experimental study and a theoretical analysis. Archives of Psychology, No. 191.
36.
Roitblat, H. (1991). Cognitive action theory as a control architecture . In J. A. Meyer & S. Wilson (Eds.), From animals to animats: Proceedings of the First International Conference on Simulation of Adaptive Behavior. Cambridge, MA: MIT Press.
37.
Rosenblatt, J.K., & Payton, D.W. (1989). A fine-grained alternative to the subsumption architecture for mobile robot control. In Proceedings of the IEEE/INNS International Joint Conference on Neural Networks (Vol. 2). Washington, DC: IEEE Press. (Available at http://www.cs.cmu.edu/afs/cs.cmu.edu/user/jkr/www./papers/ Plan_Guided_Reaction.ps.Z.)
38.
Rosenblatt, J.K., & Charles Thorpe (1995). Combining multiple goals in a behavior-based architecture. In Proceedings of the 1995 International Conference on Intelligent Robots and Systems (IROS) . Pittsburgh, PA. (See http://www.cs.cmu.edu/afs/cs/project/alv/member/www./projects/DAMN.html for a complete set of publications.)
39.
Rumelhart, D.E., Hinton, G.E., & Williams, R.J. (1986). Learning internal representations by error propagation. In J. L. McClelland , D. E. Rumelhart, & the PDP Research Group, Parallel distributed processing (Vol. 2). Cambridge, MA: MIT Press.
40.
Schroeder, M. (1991). Fractals, chaos, power laws. New York: Freeman.
41.
Skarda, C.A., & Freeman, W.J. (1987). How brains make chaos in order to make sense of the world. Behavioral and Brain Sciences, 10, 161-195.
42.
Spector, L. (1992). Supervenience in dynamic-world planning. Doctoral thesis, Department of Computer Science, University of Maryland, College Park, MD. (Available through the author at spector@cs.umd.edu.)
43.
Tyrrell, T. (1991). Computer simulation of an animal environment. In J. A. Meyer & S. Wilson (Eds.), From animals to animats: Proceedings of the First International Conference on Simulation of Adaptive Behavior. Cambridge, MA: MIT Press.
44.
Tyrrell, T. (1993). Computational mechanisms for action selection. (Tech. rep. No. EUCCS/PHD 72). [Doctoral thesis.] Edinburgh : Centre for Cognitive Science, University of Edinburgh . (Available via ftp at ftp.ed.ac.uk:/pub/lrtt .)
45.
Tyrrell, T. (1994). An evaluation of Maes's bottom-up mechanism for behavior selection. Journal of Adaptive Behavior, 2(4), 307-348.
46.
Woodcock, A., & Davis, A. (1978). Catastrophe theory. New York : Dutton.
