This work concerns practical issues surrounding the application of learning and memory in a real mobile robot with the goal of optimal navigation in dynamic environments. A novel hierarchical adaptive controller that contains two-level units was developed and trained in a physical mobile robot “e-Puck.” In the low-level unit, the robot holds a number of biologically inspired Aplysia -like spiking neural networks that have the property of spike time-dependent plasticity. Each of these networks is trained to become an expert in a particular local environment(s). All the trained networks are stored in a tree-type memory structure that is located in the high-level unit. These stored networks are used as experiences for the robot to enhance its navigation ability in both new and previously trained environments. The robot's memory is designed to hold memories of various lengths and has a simple searching mechanism. Forgetting and dynamic clustering techniques are used to control the memory size. Experimental results show that the proposed model can produce a robot with learning and memorizing capabilities that enable it to survive in complex and highly dynamic environments.
Albus, J.S. (2000). 4-D/ RCS Reference model architecture for unmanned ground vehicles. In Proceedings of IEEE International Conference on Robotics and Automation (pp. 3260-3265). New York: IEEE.
2.
Alnajjar, F., & Murase, K. (2006a). An autonomous mobile robot controlled by a spike neuron network with one hidden-layer neuron having spike timing-dependent plasticity. In Proceedings of 3rd International Conference on Soft Computing and Intelligent Systems and 7th International Symposium on Advanced Intelligent Systems (pp. 207-212), Tokyo, Japan.
3.
Alnajjar, F., & Murase, K. (2006b). Self organization of spiking neural network that generates autonomous behavior in a real mobile robot. International Journal of Neural Systems, 16, 229-239.
4.
Alnajjar, F., & Murase, K. (2008a). Sensor-fusion in spiking neural network that generates autonomous behavior in real mobile robot. In Proceedings of International Joint Conference on Neural Networks (pp. 2201-2207).
5.
Alnajjar, F., & Murase, K. (2008b). A simple adaptive controller for autonomous mobile robot: An Aplysia-like spiking neural network with one hidden-layer neuron and spike timing-dependent plasticity. Adaptive Behavior, 16, 306-324.
6.
Branke, J. (2002): Evolutionary optimization in dynamic environments . In Series of genetic algorithms and evolutionary computation, Vol.3. Norwell, MA: Kluwer Academic Publishers.
7.
Craik, F.I.M., & Lockhart, R.S. (1972). Levels of processing: A framework for memory research. Journal of Verbal Learning and Verbal Behavior, 11, 671-684.
8.
Dempsey, P.W., Vaidya, S.A., & Cheng, G. (2003). The art of war: Innate and adaptive immune responses . Cellular and Molecular Life Sciences, 60, 2604-21.
9.
Dissanayake, M.W.M.G., Newman, P., Clark, S., Durrant Whyte, H.F., & Csorba, M. (2001). A solution to the simultaneous localization and map building (SLAM) problem. IEEE Transactions on Robotics and Automation, 17, 229-241.
10.
Floreano, D., & Mattiussi, C. (2008). Bio-inspired artificial intelligence: Theories, methods, and technologies. Cambridge, MA: MIT Press.
11.
Floreano, D., Zufferey, J.C., & Nicoud, J.D. (2005). From wheels to wings with evolutionary spiking neurons. Artificial Life, 11, 121-138.
12.
Gantovnik, V.B., Anderson-Cook, C.M., Gurdal, Z., & Watson, L.T. (2003). A genetic algorithm with memory for mixed discrete-continuous design optimization. Computers & Structures, 81, 2003-2009.
13.
Glickman, M., Balthrop, J., & Forrest, S. (2005). A machine learning evaluation of an artificial immune system. Evolutionary Computation, 3, 179-212.
14.
Kira, Z., & Arkin, R.C. (2004). Forgetting bad behavior: Memory management for casebased navigation. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (Vol. 4, pp. 3145-3152).
15.
Kumar, R., & Stover, J.A. (1998). A behavior-based intelligent control architecture . In Proceedings of the 1998 IEEE International Symposium on Intelligent Control (pp. 549- 553), Gaithersburg, MD.
16.
Leake, D., & Wilson, D. (1999). When experience is wrong: Examining CBR for changing tasks and environments. In Proceedings of the 3rd International Conference on Case-Based Reasoning (pp. 218-232). Springer: Berlin.
17.
Lehman, T.J., & Carey, M.J. (1986). A study of index structures for main memory database management systems. In Proceedings of the 12th International Conference on Very Large Data Base Endowment (pp. 294-303).
18.
Likhachev, M.Kaess, M., & Arkin, R.C. (2002). Learning behavioral parameterization using spatio-temporal casebased reasoning. In Proceedings of IEEE International Conference on Robotics and Automation (Vol. 2, pp. 1282-1289).
19.
Lin, L.J. (1992). Self-improving reactive agents based on reinforcement learning and teaching. Machine Learning, 8, 293-321.
20.
McCallum, M.K. (1996). Reinforcement learning with selective perception and hidden state. Unpublished doctoral dissertation, Doctoral dissertation, Department of Computer Science, Rochester University, New York, USA.
21.
McClelland, J. (2005). How far can you go with Hebbian learning, and when does it lead you astray? In Y. Munakata & M. H. Johnson (Eds.), Attention and performance XXI: Processes of change in brain and cognitive development. Oxford: Oxford University Press.
22.
Moore, A.W. (1990). Efficient memory-based learning for robot control . Ph.D. Thesis, Technical Report No. 229, Computer Laboratory, University of Cambridge.
23.
Nielsen, J., & Lund, H.H. (2003). Spiking neural building block robot with Hebbian learning. In Proceedings of International Conference in Intelligent Robots and Systems (pp. 1363-1369). Las Vegas , Nevada.
24.
Noice, H., & Noice, T. (2006). What studies of actors and acting can tell us about memory and cognitive functioning. Current Directions in Psychological Science, 15, 14-18.
25.
Nowostawski, M., Epiney, L., & Purvis, M. (2005). Self-adaptation and dynamic environment experiments with evolvable virtual machines. In: S. Brueckner , G.Di. Marzo Serugendo, D. Hales, & F. Zambonelli (Eds.), Proceedings of the 3rd International Workshop on Engineering Self-Organizing Applications (pp. 46-60). Berlin : Springer-Verlag.
26.
Paine, R.W., & Tani, J. (2005). How hierarchical control self-organizes in artificial adaptive systems. Adaptive Behavior, 13, 211-225.
27.
Song, S., Miller, K.D., & Abbott, L.F. (2000). Competitive Hebbian learning through spike-timing dependent synaptic plasticity. Nature Neuroscience, 3, 919-926.
28.
Squire, L., Bloom, F., McConnell, S., Roberts, J., Spitzer, N., & Zigmond, M. (2007). Fundamental neuroscience (2nd ed.) (pp. 1277-1283). San Diego: Academic Press.
29.
Stening, J., Jacobsson, H., & Ziemke, T. (2005). Imagination and abstraction of sensorimotor flow: towards a robot model. In Proceedings of the Symposium on Next Generation Approaches to Machine Consciousness (pp. 50-58), UK.
30.
Tan, M. (1991). Cost-sensitive reinforcement learning for adaptive classification and control. In Proceedings of the 9th National Conference on Artificial Intelligence (pp. 774-780). San Jose, CA : AAAI Press.
31.
Tani, J., & Nolfi, S. (1999). Learning to perceive the world as articulated: an approach for hierarchical learning in sensory-motor systems. In R. Pfeifer, B. Blumberg, J. A. Meyer, & S. W. Wilson (Eds.), Proceedings of 5th International Conference on Simulation of Adaptive Behavior (pp. 270-279). Cambridge, MA: MIT Press. (The revised version is in Neural Networks, 12, 1131-1141, 1999 .)
32.
Vasudecan, C., & Ganesan, K. (1994). Case-based path planning for autonomous underwater vehicles. In Proceedings of IEEE International Symposium on Intelligent Control (pp. 160-165).
33.
Verschure, P.F.M. J., & Althaus, P. (2003). A real-world rational agent: Unifying old and new AI. Cognitive Science, 27, 561-590.
34.
Verschure, P.F.M.J., Voegtlin, T., & Douglas, R.J. (2003). Environmentally mediated synergy between perception and behavior in mobile robots. Nature, 425, 620-624.
35.
Xiao, J., Michalewicz, Z., Zhang, L., & Trojanowski, K. (1997). Adaptive evolutionary planner/navigator for mobile robots. IEEE Transactions of Evolutionary Computation , 1, 18-28.
36.
Zimmermann, A. (2003). Context-awareness in user modeling: Requirements analysis for a case-based reasoning application. In K. D. Ashley, & D. G. Bridge, (Eds.), Case-based reasoning research and development. Lecture Notes in Artificial Intelligence, 2689/2003, (pp. 718-732). Berlin: Springer-Verlag.
37.
Zin, I., Alnajjar, F., Murase, K. (2009) Adaptation of real autonomous mobile robot in complex environment using pattern association network controller (PAN-C). Journal of Advanced Computational Intelligence and Intelligent Informatics , 13(3).
