Is There an Integrative Center in the Vertebrate Brain-Stem? A Robotic Evaluation of a Model of the Reticular Formation Viewed as an Action Selection Device

Abstract

Neurobehavioral data from intact, decerebrate, and neonatal rats suggests that the reticular formation provides a brainstem substrate for action selection in the vertebrate central nervous system. In this article, Kilmer, McCulloch and Blum’s (1969) landmark reticular formation model (see also Kilmer, 1997) is described and re-evaluated, both in simulation and, for the first time, as a mobile robot con troller. Particular model configurations are found to provide effective action selection mechanisms in a robot survival task using either simulated or physical robots. The model’s competence is dependent on the organization of afferents from model sensory systems, and a genetic algorithm search identi fied a class of afferent configurations which have long survival times. The results support our proposal that the reticular formation evolved to provide effective arbitration between innate behaviors and, with the forebrain basal ganglia, may constitute the integrative, “centrencephalic” core of vertebrate brain architecture. Additionally, the results demonstrate that the Kilmer et al. model provides an alternative form of robot controller to those usually considered in the adaptive behavior literature.

Keywords

action selection reticular formation genetic algorithms robot

Get full access to this article

View all access options for this article.

References

Baerends, G. (1970). A model of the functional organization of the incubation behaviour . Behaviour Supplement, 17, 263–312 .

Barto, A. (1985). Learning by statistical cooperation of self-interested neuron-like computing elements . Human Neurobiology, 4, 229–256 .

Berntson, G. , & Micco, D. (1976). Organization of brainstem behavioral systems . Brain Research Bulletin, 1, 471–483 .

Berridge, K. (1994). The development of action patterns. In J. Hogan & J. Bolhuis (Eds.), Causal mechanisms of behavioural development (pp. 147–180). Cambridge, UK: Cambridge University Press .

Blumberg, B. (1994). Action selection in Hamsterdam: Lessons from ethology. In D. Cliff , P. Husbands , J. Meyer & S. Wilson (Eds.), From animals to animats 3: Proceedings of the Third International Conference on Simulation of Adaptive Behavior (pp. 22–29). Cambridge, MA: MIT Press .

Bowsher, D. , & Westman, J. (1970). The gigantocellular reticular region and its spinal afferents: A light and electron microscope study in the cat . Journal of Anatomy, 106(1), 23–36 .

Bryson, J. (2000). Cross-paradigm analysis of autonomous agent architecture . Journal of Experimental and Theoretical Artificial Intelligence, 12, 165–189 .

Cherniak, C. (1994). Component placement optimization in the brain . Journal of Neuroscience, 14(4), 2418–2427 .

Delgado, A. , Mira, J. , & Moreno-Diaz, R. (1989). A neurocybernetic model of modal co-operative decisions in the Kilmer–McCulloch space . Kybernetes, 18(3), 48–57 .

10.

Delwaide, P. , Pepin, J. , De Pasqua, V. , & Noordhout, A. de. (2000). Projections from basal ganglia to tegmentum: a subcortical route for explaining the pathophysiology of Parkinson’s disease signs? Journal of Neurology, 247 Suppl 2, 75–81 .

11.

Girard, B. , Cuzin, V. , Guillot, A. , Gurney, K. N. , & Prescott, T. J. (2003). A basal ganglia inspired model of action selection evaluated in a robotic survival task . Journal of Integrative Neuroscience, 2(2), 179–200 .

12.

Gurney, K. , Prescott, T. , & Redgrave, P. (2001). A computational model of action selection in the basal ganglia . Biological Cybernetics, 85, 401–423 .

13.

Hall, W. (1979). Feeding and behavioral activation in infant rats . Science, 205(4402), 206–209 .

14.

Humphries, M. (2003). A critique of the Kilmer-McCulloch model of reticular formation function. ABRG 4 (Tech. Rep.). Department of Psychology, University of Sheffield, UK .

15.

Jones, B. (1995). Reticular formation: Cytoarchitecture, transmitters, and projections. In G. Paxinos (Ed.), The rat nervous system, (2nd ed., pp. 155–171). New York: Academic Press .

16.

Kilmer, W. (1997). A command computer for complex autonomous systems . Neurocomputing, 17, 47–59 .

17.

Kilmer, W. , McCulloch, W. , & Blum, J. (1969). A model of the vertebrate central command system . International Journal of Man–Machine Studies, 1, 279–309 .

18.

Kobayashi, Y. , Matsuyama, K. , & Mori, S. (1994). Distribution of serotonin cells projecting to the pontomedullary reticular formation in the cat . Neuroscience Research, 20(1), 43–55 .

19.

Leibetseder, M. , & Kamolz, T. (2004). Are depressive persons capable of describing changes in their reactions without being able to explain them? A proof of a cybernetic hypothesis of depression . Psychopathology, 37(2), 86–91 .

20.

Maes, P. (1995). Modeling adaptive autonomous agents. In C. Langton (Ed.), Artificial life (pp. 135–162). Cambridge, MA: MIT Press .

21.

Montes-Gonzalez, F. , Prescott, T. , Gurney, K. , Humphries, M. , & Redgrave, P. (2001). An embodied model of action selection mechanisms in the vertebrate brain. In J. Meyer , A. Berthoz , D. Floreano , H. Roitblat & S. Wilson (Eds.), From animals to animats 6: Proceedings of the Sixth International Conference on Simulation of Adaptive Behaviour (pp. 157–166). Cambridge, MA: MIT Press .

22.

Newman, D. (1985). Distinguishing rat brainstem reticulospinal nuclei by their neuronal morphology. I. Medullary nuclei . Journal für Hirnforschung, 26(2), 187–226 .

23.

Penfield, W. (1958). Centrencephalic integrating system . Brain, 81, 231–234 .

24.

Prescott, T. , Redgrave, P. , & Gurney, K. (1999). Layered control architectures in robots and vertebrates . Adaptive Behavior, 7, 99–127 .

25.

Redgrave, P. , Prescott, T. , & Gurney, K. (1999). The basal ganglia: A vertebrate solution to the selection problem? Neuroscience, 89(4), 1009–1023 .

26.

Scheibel, M. , & Scheibel, A. (1967). Anatomical basis of attention mechanisms in vertebrate brains. In G. Quarton , T. Melnechuk & F. Schmitt (Eds.), The neurosciences: A study program (pp. 577–602). New York: The Rockefeller University Press .

27.

Schneider, J. , Manetto, C. , & Lidsky, T. (1985). Substantia nigra projection to medullary reticular formation: Relevance to oculomotor and related motor functions in the cat . Neuroscience Letters, 62(1), 1–6 .

28.

Stevens, D. , McCarley, R. , & Greene, R. (1994). The mechanism of noradrenergic alpha 1 excitatory modulation of pontine reticular formation neurons . Journal of Neuroscience, 14(11), 6481–6487 .

29.

Thompson, R. (1993). Centrencephalic theory, the general learning system, and subcortical dementia . Annals of the New York Academy of Sciences, 702, 197–223 .

30.

Tyrell, T. (1993). Computational mechanisms for action selection. Ph.D. thesis, University of Edinburgh.

31.

Yates, B. , & Stocker, S. (1998). Integration of somatic and visceral inputs by the brainstem: Functional considerations .Experimental Brain Research, 119(3), 269–275 .