On the Acquisition and Evolution of Compositional Languages: Sparse Input and the Productive Creativity of Children

Abstract

This paper investigates the productive creativity of children in a computational model of the emergence and evolution of compositional structures in language. In previous models it was shown that compositional structures can emerge in language when the language is transmitted from one generation to the next through a transmission bottleneck. Due to the fact that in these models language is transmitted only in a vertical direction where adults only speak to children and children only listen, this bottleneck needs to be imposed by the experimenter. In the current study, this bottleneck is removed and instead of having a vertical transmission of language, the language is—in most simulations— transmitted horizontally (i.e., any agent can speak to any other agent). It is shown that such a horizontal transmission scenario does not need an externally imposed bottleneck, because the children face an implicit bottleneck when they start speaking early in life. The model is compared with the recent development of Nicaraguan Sign Language, where it is observed that children are a driving force for inventing grammatical (or compositional) structures, possibly due to a sparseness of input (i.e., an implicit bottleneck). The results show that in the studied model children are indeed the creative driving force for the emergence and stable evolution of compositional languages, thus suggesting that this implicit bottleneck may—in part—explain why children are so typically good at acquiring language and, moreover, why they may have been the driving force for the emergence of grammar in language.

Keywords

evolution of language language acquisition compositionality iterated learning language games

Get full access to this article

View all access options for this article.

References

Belpaeme, T. , & Bleys, J. (2005). Explaining universal colour categories through a constrained acquisition process. Adaptive Behavior. This issue.

Bickerton, D. (1984). The language bioprogram hypothesis . Behavioral and Brain Sciences, 7, 173–212 .

Bickerton, D. (1990). Language and species. Chicago: University of Chicago Press .

Bloom, P. (2000). How children learn the meanings of words. Cambridge, MA: MIT Press .

Braine, M. D. S. (1971). The acquisition of language in infant and child. In C. Reed (Ed.), The learning of language. New York: Scribners .

Brighton, H. (2002). Compositional syntax from cultural transmission . Artificial Life, 8(1), 25–54 .

Briscoe, E. J. (Ed.). (2002). Linguistic evolution through language acquisition: Formal and computational models. Cambridge, UK: Cambridge University Press .

Cangelosi, A. , & Parisi, D. (Eds.). (2002). Simulating the evolution of language. London: Springer .

Cavalli-Sforza, L. L. , & Feldman, M. W. (1981). Cultural transmission and evolution: A quantitative approach. Princeton, NJ: Princeton University Press .

10.

Chomsky, N. (1980). Rules and representations . Behavioral and Brain Sciences, 3, 1–61 .

11.

Cover, T. M. , & Hart, P. E. (1967). Nearest neighbour pattern classification . Institute of Electrical and Electronics Engineers Transactions on Information Theory, 13, 21–27 .

12.

Darwin, C. (1968). The origin of species. Harmondsworth, UK: Penguin Books .

13.

De Jong, E. D. (1999). Analyzing the evolution of communication from a dynamical systems perspective. In D. Floreano , J.-D. Nicoud , & F. Mondada (Eds.). Proceedings of the Fifth European Conference on Artificial Life(pp. 689–693) ECAL'99. Berlin: Springer .

14.

Deacon, T. (1997). The symbolic species. New York: Norton .

15.

Frege, G. (1892). On concept and object. Reprinted (1984) in B. McGuiness (Ed.), Collected papers on mathematics, logic, and philosophy (pp. 182–194). Oxford: Blackwell .

16.

Gärdenfors, P. (2000). Conceptual spaces. Cambridge, MA: MIT Press/Bradford Books .

17.

Gilbert, N. , Schuster, S. , den Besten, M. , & Yang, L. (2005). Environment design for emerging artificial societies. In B. Edmonds , N. Gilbert , S. Gustafson , D. Hales , & N. Krasnogor (Eds), Proceedings of AISB 2005: Socially inspired computing joint symposium, (pp. 57–63). Hatfied, UK: AISB .

18.

Goldin-Meadow, S. (1982). The resilience of recursion: a study of a communication system developed without a conventional language model. In E. Wanner , & L. Gleitman , (Eds.). Language acquisition: The state of the art(pp. 51–77). New York: Cambridge University Press .

19.

Jackendoff, R. (1999). Possible stages in the evolution of the language capacity . Trends in Cognitive Science, 3(7), 272–279 .

20.

Kegl, J. , & Iwata, G. (1989). Lenguaje de Signos Nicaragüense: A pidgin sheds light on the “creole?”. In R. Carlson , S. DeLancey , S. Gilden , D. Payne , & A. Saxena (Eds.). Proceedings of the Fourth Annual Meeting of the Pacific Linguistics Conference, Eugene. University of Oregon, Department of Linguistics .

21.

Kirby, S. (2001). Spontaneous evolution of linguistic structure: an iterated learning model of the emergence of regularity and irregularity . IEEE Transactions on Evolutionary Computation, 5(2), 102–110 .

22.

Kirby, S. (2002). Learning, bottlenecks and the evolution of recursive syntax. In Briscoe, T. (Ed.). Linguistic evolution through language acquisition: Formal and computational models. Cambridge, UK: Cambridge University Press .

23.

Lieven, E. , Behrens, H. , Speares, J. , & Tomasello, M. (2003). Early syntactic creativity: a usage-based approach . Journal of Child Language, 30(2), 333–370 .

24.

Peters, A. M. (1983). The units of language acquisition. Cambridge, UK: Cambridge University Press .

25.

Pinker, S. , & Bloom, P. (1990). Natural language and natural selecion . Behavioral and Brain Sciences, 13, 707–789 .

26.

Prigogine, I. , & Strengers, I. (1984). Order out of chaos. New York: Bantam .

27.

Sankoff, G. , & Laberge, S. (1973). On the acquisition of native speakers by a language . Kivung, 6, 32–47 .

28.

Sebba, M. (1997). Contact languages: Pidgins and Creoles. New York: Palgrave .

29.

Senghas, A. , & Coppola, M. (2001). Children creating language: How Nicaraguan Sign Language acquired a spatial grammar . Psychological Science, 12,(4), 323–328 .

30.

Senghas, A. , Kita, S. , & Özyürek, A. (2004). Children creating core properties of language: Evidence from an emerging sign language in Nicaragua . Science, 305(5691), 1779–1782 .

31.

Smith, A. D. M. (2005). The inferential transmission of language. Adaptive Behavior. This issue.

32.

Smith, K. , Brighton, H. , & Kirby, S. (2003). Complex systems in language evolution: the cultural emergence of compositional structure . Advances in Complex Systems, 6(4), 537–558 .

33.

Smith, K. , & Hurford, J. R. (2003). Language evolution in populations: extending the iterated learning model. In W. Banzhaf , T. Christaller , J. Ziegler , P. Dittrich , & J. T. Kim (Eds.). Advances in artificial life: Proceedings of the Seventh European Conference on Artificial Life, Lecture Notes in Artificial Intelligence (pp. 507–516). Berlin: Springer .

34.

Steels, L. (1996a). Emergent adaptive lexicons. In P. Maes (Ed.). From animals to animats 4: Proceedings of the Fourth International Conference on Simulating Adaptive Behavior(pp. 562–567). Cambridge, MA: MIT Press .

35.

Steels, L. (1996b). Perceptually grounded meaning creation. In M. Tokoro (Ed.). Proceedings of the International Conference on Multi-Agent Systems(pp. 338–344), Menlo Park, CA: AAAI Press .

36.

Steels, L. (2004). Constructivist development of grounded construction grammars. In D. Scott , W. Daelemans & M. Walker (Eds.), Proceedings Annual Meeting of Association for Computational Linguistics Conference. Barcelona: ACL , (pp. 9–16).

37.

Steels, L. , & Belpaeme, T. (2005). Coordinating perceptually grounded categories through language. A case study for colour . Behavioral and Brain Sciences. 28(4), 469–529 .

38.

Steels, L. , Kaplan, F. , McIntyre, A. , & Van Looveren, J. (2002). Crucial factors in the origins of word-meaning. In A. Wray (Eds.), The transition to language(pp. 252–271). Oxford: Oxford University Press .

39.

Tomasello, M. (2000). Do young children have adult syntactic competence? Cognition, 74, 209–253 .

40.

van Zaanen, M. (2000). ABL: Alignment-based learning. In M. Kaufmann (Ed.), Proceedings of the 18th International Conference on computational linguistics (coling)(pp. 961–967).

41.

Vogt, P. (2003). THSim v3.2: The Talking Heads simulation tool. In W. Banzhaf , T. Christaller , P. Dittrich , J. T. Kim , & J. Ziegler (Eds.). Advances in artificial life: Proceedings of the Seventh European Conference on Artificial Life (ECAL) 535–544. Berlin: Springer .

42.

Vogt, P. (2005a). The emergence of compositional structures in perceptually grounded language games . Artificial Intelligence, 167(1–2), 206–242 .

43.

Vogt, P. (in press). Meaning development versus predefined meanings in language evolution models. In L. Kaelbling & A. Saffiotti (Eds.). Proceedings of IJCAI-05.

44.

Vogt, P. (2005c). Stability conditions in the evolution of compositional languages: issues in scaling population sizes . In Proceedings of the European Conference on Complex Systems, ECCS'05.

45.

Vogt, P. , & Divina, F. (2005). Language evolution in large populations of autonomous agents: issues in scaling . In Proceedings of AISB 2005: Socially inspired computing joint symposium.

46.

Vogt, P. , & Smith, A. D. M. (2005). Learning colour words is slow: a cross-situational learning account . Behavioral and Brain Sciences. 28(4), 509–510 .

47.

Wray, A. (1998). Protolanguage as a holistic system for social interaction . Language and Communication, 18, 47–67 .

48.

Zipf, G. K. (1949). Human behaviour and the principle of least effort: An introduction to human ecology. Cambridge, MA: Addison-Wesley .