In this article a series of agent-based models support the hypothesis that behaviors adapted to a group situation may be suboptimal (or “irrational”) when expressed by an isolated individual. These models focus on two areas of current concern in behavioral ecology and experimental psychology: the “interference function” (which relates the intake rate of a focal forager to the density of conspecifics) and the “matching law” (which formalizes the observation that many animals match the frequency of their response to different stimuli in proportion to the reward obtained from each stimulus type). Each model employs genetic algorithms to evolve foraging behaviors for multiple agents in spatially explicit environments, structured at the level of situated perception and action. A second concern of this article is to extend the understanding of both matching and interference per se by modeling at this level.
Barkow, J. , Cosmides, L. , & Tooby, J. (Eds.). (1992). The adapted mind: Evolutionary psychology and the generation of culture. Oxford: Oxford University Press.
2.
Baum, W. , & Kraft, J. (1998). Group choice: Competition, travel, and the ideal free distribution . Journal of the Experimental Analysis of Behavior, 69(3), 227–245.
3.
Bonabeau, E. , Dorigo, M. , & Theraulaz, G. (1999). Swarm intelligence. Oxford: Oxford University Press.
4.
Charnov, E., & Orians, G. (1973). Optimal foraging: Some theoretical explorations. Unpublished manuscript.
5.
Dallery, J. , & Baum, W. (1991). The functional equivalence of operant behavior and foraging . Animal Learning and Behavior, 19(2), 146–152.
6.
Davison, M. , & McCarthy, D. (1988). The matching law. Hillsdale, NJ: Erlbaum.
7.
Di Paolo, E. (2001). Artificial life and historical processes. In J. Kelemen & P. Sosik (Eds.), Proceedings of the Sixth European Conference on Artificial Life(pp. 649–658). Berlin: Springer.
8.
Fagen, R. (1987). A generalized habitat matching law . Evolutionary Ecology, 1, 5–10.
9.
Ferber, J. , & Drogoul, A. (1992). Using reactive multi-agent systems in simulation and problem-solving. In N. Avouris & L. Gasser (Eds.), Distributed artifical intelligence: Theory and praxis(pp. 53–80). Dordrecht, The Netherlands: Kluwer.
10.
Free, C. , Beddington, J. , & Lawton, J. (1977). On the inadequacy of simple models of natural interference for parasitism and predation . Journal of Animal Ecology, 46, 543–554.
11.
Fretwell, S. (1972). Populations in seasonal environments. Princeton, NJ: Princeton University Press.
12.
Gallistel, C. , Brown, A. , Carey, S. , Gelman, R. , & Keil, F. (1991). Lessons from animal learning for the study of cognitive development. In S. Carey & R. Gelman (Eds.), The epigenesis of mind(pp. 3–37). Hillsdale, NJ: Erlbaum.
13.
Gigerenzer, G. , Todd, P. M. , & the ABC Research Group . (1999). Simple heuristics that make us smart. New York: Oxford University Press.
14.
Goldberg, D. , & Mataric, M. (1997). Interference as a tool for designing and evaluating multi-robot controllers. In B. J. Kuipers & B. Webber (Eds.), Proceedings of the Fourteenth National Conference on Artifical Intelligence (pp. 637–642). Menlo Park, CA: AAAI Press.
15.
Hassell, M. , & Varley, G. (1969). New inductive population model for insect parasites and its bearing on biological control . Nature, 223, 1133–1136.
16.
Herrnstein, R. (1961). Relative and absolute strength of responses as a function of frequency of reinforcement . Journal of the Experimental Analysis of Behavior, 4, 267–272.
17.
Herrnstein, R. (1970). On the law of effect . Journal of the Experimental Analysis of Behavior, 13, 243–266.
18.
Houston, A. (1986). The matching law applies to wagtails' foraging in the wild . Journal of the Experimental Analysis of Behavior, 45, 15–18.
19.
Kacelnik, A. (1997). Normative and descriptive models of decision making: Time discounting and risk sensitivity. In G. R. Block & G. Cardew (Eds.), Characterising human psychological adaptations(pp. 51–70). Chichester: Wiley.
20.
Maes, P. (1990). A bottom-up mechanism for behaviourselection in an artifical creature. In J-A. Meyer & S. Wilson (Eds.), From animals to animats: Proceedings of the First International Conference on the Simulation of Adaptive Behavior(pp. 238–246). Cambridge, MA: MIT Press.
21.
Matarićc, M. (1995). Issues and approaches in the design of collective autonomous agents . Robotics and Autonomous Systems, 16, 321–331.
22.
Maynard Smith, J. (1974). Models in ecology. Cambridge: Cambridge University Press.
23.
Niv, Y. , Joel, D. , Meilijson, I. , & Ruppin, E. (2001). Evolution of reinforcement learning in uncertain environments: Emergence of risk aversion and matching. In J. Kelemen & P. Sosik (Eds.), Proceedings of the Sixth European Conference on Artifical Life(pp. 252–261). Berlin: Springer.
24.
Rachlin, H. , & Laibson, D. I. (Eds.), (1997). The matching law. A posthumous collection of the papers of R. J. Herrnstein. Cambridge, MA: Harvard University Press.
25.
Ruxton, G. , Gurney, W. , & Ross, A. (1992). Interference and generation cycles . Theoretical Population Biology, 42, 235–253.
26.
Seth, A. (1998). Evolving action selection and selective attention without actions, attention, or selection. In R. PfeiferB. BlumbergJ-A. Meyer , & S. Wilson (Eds.), From animals to animats 5: Proceedings of the Fifth International Conference on the Simulation of Adaptive Behaviour(pp. 139–147). Cambridge, MA: MIT Press.
27.
Seth, A. (2000a). On the relations between behaviour, mechanism, and environment: Explorations in artificial evolution. Unpublished doctoral dissertation, University of Sussex.
28.
Seth, A. (2000b). Unorthodox optimal foraging theory. In J-A. Meyer , A. Berthoz , D. Floreano , H. Roitblat , & S. Wilson (Eds.), From animals to animats 6: Proceedings of the Sixth International Conference on the Simulation of Adaptive Behavior(pp. 471–481). Cambridge, MA: MIT Press.
29.
Shettleworth, S. (1988). Foraging as operant behavior and operant behavior as foraging: What have we learned? In G. Bower (Ed.), The psychology of learning and motivation: Advances in research and theory(Vol. 22, pp. 1–49). New York: Academic Press.
30.
Smithers, T. (1994). On why better robots make it harder. In D. Cliff , P. Husbands , J-A. Meyer , & S. Wilson (Eds.), From animals to animats 3: Proceedings of the Third International Conference on the Simulation of Adaptive Behavior(pp. 64–72). Cambridge, MA: MIT Press.
31.
Staddon, J. (1992). Rationality, melioration, and law-of-effect models for choice . Psychological Science, 3, 136–141.
32.
Stephens, D. , & Krebs, J. (1986). Foraging theory. Monographs in behaviour and ecology. Princeton, NJ: Princeton University Press.
33.
Stillman, R. , Goss-Custard, J. , & Caldow, R. (1997). Modelling interference from basic foraging behaviour . Journal of Animal Ecology, 66, 692–703.
34.
Sutherland, W. (1983). Aggregation and the ‘ideal free’ distribution . Journal of Animal Ecology, 52, 821–828.
35.
Thuisjman, F. , Peleg, B. , Amitai, M. , & Shmida, A. (1995). Automata, matching, and foraging behaviour of bees . Journal of Theoretical Biology, 175, 305–316.
36.
Tyrrell, T. (1993). Computational mechanisms for action selection. Unpublished doctoral dissertation, University of Edinburgh.
37.
Van der Meer, J. , & Ens, B. (1997). Models of interference and their consequences for the spatial distribution of ideal and free predators . Journal of Animal Ecology, 66, 846–858.
38.
Weber, T. (1998). News from the realm of the ideal free distribution . Trends in Ecology and Evolution, 13(3), 89–90.
39.
Williams, B. (1994). Reinforcement and choice. In N. Mackintosh (Ed.), Animal learning and cognition (pp. 81–108). New York: Academic Press.
