This article describes a biomimetic control architecture affording an animat both action selection and navigation functionalities. It satisfies the survival constraint of an artificial metabolism and supports several complementary navigation strategies. It builds upon an action selection model based on the basal ganglia of the vertebrate brain, using two interconnected cortico-basal-ganglia–thalamo-cortical loops: A ventral one concerned with appetitive actions and a dorsal one dedicated to consummatory actions. The performances of the resulting model are evaluated in simulation. The experiments assess the prolonged survival permitted by the use of high-level navigation strategies and the com plementarity of navigation strategies in dynamic environments. The correctness of the behavioral choices in situations of antagonistic or synergetic internal states are also tested. Finally, the modeling choices are discussed with regard to their biomimetic plausibility, while the experimental results are estimated in terms of animat adaptivity.
Alexander, G. E. , DeLong, M. R. , & Strick., P. L. (1986). Parallel organization of functionally segregated circuits linking basal ganglia and cortex . Annual Review of Neuroscience, 9, 357–381 .
2.
Arleo, A. , & Gerstner, W. (2000). Spatial cognition and neuromimetic navigation: A model of hippocampal place cell activity . Biological Cybernetics, 83, 287–299 .
3.
Ashby, W. R. (1952). Design for a brain. London: Chapman and Hall .
4.
Chevalier, G. , & Deniau, M. (1990). Disinhibition as a basic process of striatal functions . Trends in Neurosciences, 13, 277–280 .
5.
Dayan, P. & Balleine, B.W. (2000). Reward, motivation and reinforcement learning . Neuron, 36, 285–298 .
6.
Dennett, D. C. (1978). Why not a whole iguana?Behavioral and Brain Sciences, 1, 103–104 .
7.
Filliat, D. (2001). Cartographie et estimation globale de la position pour un robot mobile autonome. Ph.D. thesis, LIP6/AnimatLab, Université Paris 6, France.
8.
Filliat, D. , Girard, B. , Guillot, A. , Khamassi, M. , Lachèze, L. , & Meyer, J.-A. (2004). State of the artificial rat psikharpax. In S. Schaal , A. Ijspeert , A. Billard , S. Vijayakumar , J. Hallam , & J.-A. Meyer (Eds.), From animals to animats 8 (pp. 2–12). Cambridge, MA: MIT Press .
9.
Filliat, D. & Meyer, J.-A. (2003). Map-based navigation in mobile robots. I. A review of localization strategies . Journal of Cognitive Systems Research, 4(4), 243–282 .
10.
Gaussier, P. , Leprêtre, S. , Quoy, M. , Revel, A. , Joulain, C. , & Banquet, J.-P. (2000). Experiments and models about cognitive map learning for motivated navigation. In J. Demiris & A. Birk (Eds.), Interdisciplinary approaches to robot learning, volume 24 of Robotics and intelligent systems (pp. 53–94). Singapore: World Scientific .
11.
Girard, B. , Cuzin, V. , Guillot, A. , Gurney, K. N. , & Prescott, T. J. (2003). A basal ganglia inspired model of action selection evaluated in a robotic survival task . Journal of Integrative Neuroscience, 2(2), 179–200 .
12.
Girard, B. , Filliat, D. , Meyer, J.-A. , Berthoz, A. , & Guillot, A. (2004). An integration of two control architectures of action selection and navigation inspired by neural circuits in the vertebrate: the basal ganglia. In H. Bowman and C. Labiouse (Eds.), Connectionist models of cognition and perception II, volume 15 of Progress in neural processing (pp. 72–81). Singapore: World Scientific .
13.
Guazzelli, A. , Corbacho, F. J. , Bota, M. , & Arbib, M. A. (1998). Affordances, motivations and the world graph theory . Adaptive BehaviorSpecial issue on biologically inspired models of spatial navigation, 6(3/4), 435–471 .
14.
Gurney, K. , Prescott, T. J. , & Redgrave, P. (2001a). A computational model of action selection in the basal ganglia: I. A new functional anatomy . Biological Cybernetics, 84, 401–410 .
15.
Gurney, K. , Prescott, T. J. , & Redgrave, P. (2001b). A computational model of action selection in the basal ganglia: II. Analysis and simulation of behaviour . Biological Cybernetics, 84, 411–423 .
16.
Humphries, M. D. , Gurney, K. , & Prescott, T. J. (2005). Is there an integrative center in the vertebrate brain-stem? A robotic evaluation of a model of the reticular formation viewed as an action selection device. Adaptive Behavior, this issue.
17.
Joel, D. & Weiner, I. (1994). The organization of the basal ganglia-thalamocortical circuits: Open interconnected rather than closed segregated . Neuroscience, 63, 363–379 .
18.
Joel, D. & Weiner, I. (2000). The connections of the dopaminergic system with the striatum in rats and primates: An analysis with respect to the functional and compartmental organization of the striatum . Neuroscience, 96(3), 452–474 .
19.
Kelley, A. E. (1999). Neural integrative activities of nucleus accumbens subregions in relation to learning and motivation . Psychobiology, 27, 198–213 .
20.
Khamassi, M. , Girard, B. , Berthoz, A. , & Guillot, A. (2004). Comparing three critic models of reinforcement learning in the basal ganglia connected to a detailed actor part in a S-R task. In F. Groen , N. Amato , A. Bonarini , E. Yoshida , & B. Kröse (Eds.), Proceedings of the Eighth International Conference on Intelligent Autonomous Systems (IAS8) (430–437). Amsterdam: IOS Press .
21.
Kolomiets, B.P. , Deniau, J. M. , Glowinski, J. , & Thierry, A. M. (2003). Basal ganglia and processing of cortical information: functional interactions between trans-striatal and trans-subthalamic circuits in the substantia nigra pars reticulata . Neuroscience, 117(4), 931–938 .
22.
Kolomiets, B.P. , Deniau, J.-M. , Mailly, P. , Glowinski, A. M. J. , & Thierry, A.-M. (2001). Segregation and convergence of information flow through the cortico-subthalamic pathways . Journal of Neuroscience, 21(15), 5764–5772 .
23.
Maes, P. (1991). A bottom-up architecture for behavior selection in an artificial creature. In J.-A. Meyer , & S. Wilson (Eds.), From animals to animats 1 (pp. 478–485). Cambridge, MA: MIT Press .
24.
Mailly, P. , Charpier, S. , Menetrey, A. , & Deniau, J.-M. (2003). Three-dimensional organization of the recurrent axon collateral network of the substantia nigra pars reticulata neurons in the rat . Journal of Neuroscience, 23(12), 5247–5257 .
25.
Martin, P. D. , & Ono, T. (2000). Effects of reward anticipation, reward presentation, and spatial parameters on the firing of single neurons recorded in the subiculum and nucleus accumbens of freely moving rats . Behavioural Brain Research, 116(1), 23–28 .
26.
Maurice, N. , Deniau, J.-M. , Glowinski, J. , & Thierry, A.-M. (1999). Relationships between the prefrontal cortex and the basal ganglia in the rat: Physiology of the corticonigral circuits . Journal of Neuroscience, 19(11), 4674–4681 .
27.
Maurice, N. , Deniau, J.-M. , Menetrey, A. , Glowinski, J. , & Thierry, A.-M. (1997). Position of the ventral pallidum in the rat prefrontal cortex-basal ganglia circuit . Neuroscience, 80(2), 523–534 .
28.
Meyer, J.-A. , & Filliat, D. (2003). Map-based navigation in mobile robots. II. A review of map-learning and path-planning strategies . Journal of Cognitive Systems Research, 4(4), 283–317 .
29.
Montes-Gonzalez, F. , Prescott, T. J. , Gurney, K. N. , Humphries, M. , & Redgrave, P. (2000). An embodied model of action selection mechanisms in the vertebrate brain. In J.-A.Meyer , A. Berthoz , Floreano , H. Roitblat , & S. W. Wilson (Eds.), From animals to animats 6: Vol. 1 (pp. 157–166). Cambridge, MA: The MIT Press .
30.
Mulder, A. B. , Tabuchi, E. , and Wiener, S. I. (2004). Neurons in hippocampal afferent zones of rat striatum parse routes into multi-pace segments during maze navigation . European Journal of Neuroscience, 19(7), 1923–1932 .
31.
O’Keefe, J. , & Nadel, L. (1978). The Hippocampus as a cognitive map. Oxford: Clarendon .
32.
Parent, A. , & Hazrati, L.-N. (1995). Functional anatomy of the basal ganglia. II. The place of subthalamic nucleus and external pallidum in basal ganglia circuitry . Brain Research Reviews, 20, 128–154 .
33.
Prescott, T. J. , Redgrave, P. , & Gurney, K. N. (1999). Layered control architectures in robot and vertebrates . Adaptive Behavior, 7(1), 99–127 .
34.
Quoy, M. , Laroque, P. , & Gaussier, P. (2002). Learning and motivational couplings promote smarter behaviors of an animat in an unknown world . Robotics and Autonomous Systems, 38, 149–156 .
35.
Redgrave, P. , Prescott, T. J. , & Gurney, K. (1999). The basal ganglia: A vertebrate solution to the selection problem?Neuroscience, 89(4), 1009–1023 .
36.
Rosenblatt, J. K. , & Payton, D. (1989). A fine-grained alternative to the subsumption architecture for mobile robot control. In Proceedings of the IEEE/INNS International Joint Conference on Neural Networks (Vol. 2 pp. 317–324). Washington, DC: IEEE .
37.
Seamans, J. K. , & Phillips, A. G. (1994). Selective memory impairments produced by transient lidocaine-induced lesions of the nucleus accumbens in rats . Behavioral Neuroscience, 108, 456–468 .
38.
Seth, A. K. (1998). Evolving action selection and selective attention without actions, attention, or selection. In R.Pfeifer , B. Blumberg , J.-A. Meyer , & S. W. Wilson (Eds.), From animals to animats 5 (pp. 139–147). Cambridge, MA: The MIT Press .
39.
Strösslin, T. (2004). A connectionist model of spatial learning in the rat. Ph.D. thesis, EPFL–Swiss Federal Institute of Technology.
40.
Thierry, A.-M. , Gioanni, Y. , Dégénetais, E. , & Glowinski, J. (2000). Hippocampo-prefrontal cortex pathway: Anatomical and electrophysiological characteristics . Hippocampus, 10, 411–419 .
41.
Zahm, D. S. , & Brog, J. S. (1992). Commentary: On the significance of the core-shell boundary in the rat nucleus accumbens . Neuroscience, 50, 751–767 .
