Gaze following is the ability to redirect one's gaze to the location where another agent is looking. We present a computational model of how human infants or other agents may acquire gaze following by learning to predict the locations of interesting sights from the looking behavior of other agents through reinforcement learning. The model accounts for many findings about the development of gaze following in human infants. During learning, the model develops pre-motor representations that exhibit many properties characteristic of mirror neurons, but they are specific to looking behaviors. The existence of such a new class of mirror neurons is the main prediction of our model. The model also offers a parsimonious account of how these and possibly other mirror neurons may acquire their special response properties. In this account, visual representations of other agents' actions become associated with pre-motor neurons that represent the intention to perform corresponding actions. The model also demonstrates how this development may be obstructed in autism spectrum disorder, giving rise to specific physiological and anatomical differences in the mirror system.
Adrien, J.L., Lenoir, P., Martineau, J., Perrot, A., Hameury, L., Larmande, C., & Sauvage, D. (1993). Blind ratings of early symptoms of autism based upon family home movies. Journal of the American Academy of Child and Adolescent Psychiatry, 32, 617—626.
2.
Baron-Cohen, S. (1995). Mindblindness: An essay on autism and theory of mind. Cambridge, MA: MIT Press.
3.
Brass, M., & Heyes, C. (2005). Imitation: Is cognitive neuroscience solving the correspondence problem? Trends in Cognitive Sciences, 9, 489—495.
4.
Butterworth, G.E., & Jarrett, N. (1991). What minds have in common in space: Spatial mechanisms serving joint visual attention in infancy. British Journal of Developmental Psychology, 9, 55—72.
5.
Carlson, E., & Triesch, J. (2004). A computational model of the emergence of gaze following. In H. Bowman & C. Labiouse (Eds.), Connectionist models of cognition and perception II (pp. 105—114). Singapore: World Scientific.
6.
Caron, A.J., Butler, S.C., & Brooks, R. (2002). Gaze following at 12 and 14 months: Do the eyes matter?British Journal of Developmental Psychology, 20, 225—239.
7.
Casey, B., Gordon, C., Manheim, G., & Rumsey, J. (1993). Dysfunctinoal attention in autistic savants. Journal of Clinical and Experimental Neuropsychology, 15, 933— 946.
8.
Chawarska, K., Klin, A., & Volkmar, F. (2003). Automatic attention cueing through eye movement in 2-year-old children with autism. Child Development, 74, 1108—1122.
9.
Corkum, V., & Moore, C. (1995). Development of joint visual attention in infants . In C. Moore & P. J. Dunham (Eds.), Joint attention: Its origins and role in development (pp. 61—83). Hillsdale, NJ: Erlbaum.
10.
Dapretto, M., Davies, M., Pfeifer, J., Scott, A., Sigman, M., Bookheimer, S., & Iacoboni, M. (2006). Understanding emotions in others: Mirror neuron dysfunction in children with autism spectrum disorders. Nature Neuroscience, 9, 28—30.
11.
Dawson, G., Meltzoff, A.N., Osterling, J., Rinaldi, J., & Brown, E. (1998). Children with autism fail to orient to naturally occurring social stimuli. Journal of Autism and Developmental Disorders, 28, 479—485.
12.
Dawson, G., Toth, K., Abbott, R., Osterling, J., Munson, J., Estes, A., & Liaw, J. (2004). Early social attention impairments in autism: Social orienting, joint attention, and attention to distress. Developmental Psychology, 40, 271—283.
13.
Dayan, P., & Abbott, L.F. (2001). Theoretical neuroscience. Cambridge, MA: MIT Press.
14.
Deák, G.O., Flom, R., & Pick, A.D. (2000). Perceptual and motivational factors affecting joint visual attention in 12- and 18-month-olds. Developmental Psychology, 36, 511—523.
15.
D'Entremont, B., Hains, S., & Muir, D. (1997). A demonstration of gaze following in 3- to 6-month-olds . Infant Behavior and Development, 20, 569—572.
16.
Farroni, T., Massaccesi, S., Pividori, D., & Johnson, M.H. (2004). Gaze following in newborns. Infancy , 5, 39—60.
17.
Fasel, I., Deák, G.O., Triesch, J., & Movellan, J. (2002). Combining embodied models and empirical research for understanding the development of shared attention. In Proceedings of the International Conference on Development and Learning (ICDL) , Cambridge, MA. Los Alamitos, CA : IEEE Computer Society Press.
18.
Flom, R., Deák, G., Phill, C.G., & Pick, A.D. (2003). Nine-month-olds' shared visual attention as a function of gesture and object location. Infant Behavior and Development, 27, 181—194.
19.
Gallese, V., Keysers, C., & Rizzolatti, G. (2004). A unifying view of the basis of social cognition. Trends in Cognitive Sciences, 8, 396—403.
20.
Goldberg, M., Lasker, A., Zee, D., Garth, E., Tien, A., & Landa, R. (2002). Deficits in the initiation of eye movements in the absence of a visual target in adolescents with high functioning autism . Neuropsychologica, 40, 2039—2049.
21.
Hadjikhani, N., Joseph.,R., Snyder, J., & Tager-Flusberg, H. (2006). Anatomical differences in the mirror neuron system and social cognition network in autism. Cerebral Cortex, 16, 1276—1282.
22.
Haith, M.M., Hazan, C., & Goodman, G.S. (1988). Expectation and anticipation of dynamic visual events by 3.5-month-old babies. Child Development, 59, 467—479.
23.
Harris, N., Courchesne, E., Townsend, J., Carper, R., & Lord, C. (1999). Neuroanatomic contributions to slowed orienting of attention in children with autism. Cognitive Brain Research , 8, 61—71.
24.
Hayhoe, M., Land, M., & Shrivastava, A. (1999). Coordination of eye and hand movements in a normal environment. Investigative Opthalmology and Vision Science, 40, S380.
25.
Heyes, C. (2001). Causes and consequences of imitation. Trends in Cognitive Sciences, 5, 253—261.
26.
Hoffman, M., Grimes, D., Shon, A., & Rao, R. (2006). A probabilistic model of gaze imitation and shared attention. Neural Networks, 19, 299—310.
27.
Hutt, C., & Ounsted, C. (1966). The biological significance of gaze aversion with particular reference to the syndrome of infantile autism. Behavioral Science, 11, 346—356.
28.
Iacoboni, M., Molnar-Szakacs, I., Gallese, V., Buccino, G., Mazziotta, J., & Rizzolatti, G. (2005). Grasping the intentions of others with one's own mirror neuron system. PLoS Biology , 3, 529—535.
29.
Iacoboni, M., Woods, R., Brass, M., Bekkering, H., Mazziotta, J., & Rizzolatti, G. (1999). Cortical mechanisms of human imitation. Science, 286, 2526—2528.
30.
Jasso, H., & Triesch, J. (2005). A virtual reality platform for modeling cognitive development. In G. Palm & S. Wermter (Eds.), Biomimetic neural learning for intelligent robots. Berlin: Springer.
31.
Jasso, H., & Triesch, J. (2006). Using eye direction cues for gaze following — a developmental model. In C. Yu, L. B. Smith, & O. Sporns , Proceedings of the International Conference on Development and Learning (ICDL 2006). Bloomington, IN : Indiana University.
32.
Jasso, H., Triesch, J., Teuscher, C., & Deák, G. (2006). A reinforcement learning model explains the development of gaze following. In Proceedings of the International Conference on Cognitive Modeling (ICCM)Trieste, Italy. Bagnaria Arsa, Italy: Edizioni Goliardiche.
33.
Jenkins, R., Beaver, J., & Calder, A. (2006). I thought you were looking at me: Direction-specific aftereffects in gaze perception. Psychological Science, 17, 506—513.
34.
Jones, S.S. (2006). Infants learn to imitate by being imitated. In C. Yu, L. B. Smith, & O. Sporns, Proceedings of the International Conference on Development and Learning (ICDL) . Bloomington, IN: Indiana University .
35.
Keysers, C., & Perrett, D. (2004). Demystifying social cognition: A Hebbian perspective. Trends in Cognitive Sciences, 8, 501—507.
36.
Klin, A., Jones, W., Schultz, R., & Volkmar, F. (2003). The enactive mind, or from actions to cognition: Lessons from autism. Philosophical Transactions of the Royal Society of London B, 358, 345—360.
37.
Kohler, E., Keysers, C., Umiltà, M.A., Fogassi, L., Gallese, V., & Rizzolatti, G. (2002). Hearing sounds, understanding actions: Action representation in mirror neurons. Science , 297, 846—848.
38.
Kumashiro, M., Ishibashi, H., Uchiyama, Y., Itakura, S., Mrata, A., & Iriki, A. (2003). Natural imitation induced by joint attention in Japanese monkeys. International Journal ofPsychophysiology , 50, 81—99.
39.
Landry, R., & Bryson, S. (2004). Impaired disengagement of attention in young children with autism. Journal of Child Psychology and Psychiatry, 45, 1115—1122.
40.
Lau, B., & Triesch, J. (2004). Learning gaze following in space: A computational model. In J. Triesch & T. Jebara (Eds.), Proceedings of the International Conference on Development and Learning (ICDL), La Jolla, CA. University of California at San Diego, CA: Institute for Neural Computation .
41.
Leslie, A.M. (1987). Pretense and representation — the origins of theory of mind. Psychological Review, 94, 412—426.
42.
Maestro, S., Muratori, F., Cavallaro, M.C., Pei, F., Stern, D., Golse, B., & Palacio-Espasa, F. (2002). Attentional skills during the first 6 months of age in autism spectrum disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 41, 1239—1245.
43.
Matsuda, G., & Omori, T. (2001). Learning of joint visual attention by reinforcement learning. In E. M. Altmann & A. Cleeremans (Eds.), Proceedings of the International Conference on Cognitive Modeling (ICCM), Fairfax, VA (pp. 157—162). Mahwah, NJ: Lawrence Erlbaum Associates.
44.
Meltzoff, A.N. (2005). Imitation and other minds: The “like me” hypothesis. In S. Hurley & N. Chater (Eds.), Perspectives on imitation: From neuroscience to social science (pp. 55—77). Cambridge, MA: MIT Press.
Moore, C., & Corkum, V. (1994). Social understanding at the end of the first year of life. Developmental Review, 14, 349—372.
47.
Nagai, Y. (2005). Joint attention development in infant-like robot based on head movement imitation. In Proceedings of the Third International Symposium on Imitation in Animals and Artifacts (AISB'05), University of Hertfordshire, Hatfield, UK (pp. 87—96). Brighton, UK: Society for the Study of Artificial Intelligence and the Simulation of Behaviour .
48.
Nagai, Y., Hosoda, K., Morita, A., & Asada, M. (2003). A constructive model for the development of joint attention. ConnectionScience, 15, 211—229.
49.
Oberman, L., Hubbard, E., McCleery, J., Altschuler, E., Ramachandran, V., & Pineda, J. (2005). EEG evidence for mirror neuron dysfunction in autism spectrum disorders. Cognitive Brain Research, 24, 190—198.
50.
Osterling, J., & Dawson, G. (1994). Early recognition of children with autism: A study of first birthday home video tapes. Journal of Autism and Developmental Disorders, 24, 247— 257.
51.
Oztop, E., & Arbib, M. (2002). Schema design and implementation of the grasp-related mirror neuron system. BiologicalCybernetics, 87, 116—140.
52.
Oztop, E., Kawato, M., & Arbib, M. (2006). Mirror neurons and imitation: A computationally guided review. Neural Networks, 19, 254—271.
53.
Pobric, G., & Hamilton, A.F. (2006). Action understanding requires the left inferior frontal cortex. Current Biology, 16, 524—529.
54.
Rizzolatti, G. (2005). The mirror neuron system and its function in humans . Anatomy and Embryology, 210, 419—421.
55.
Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27, 169—192.
56.
Sai, F., & Bushnell, W.R. (1989). The perception of faces in different poses by 1-month-olds. British Journal of Developmental Psychology, 6, 35—41.
57.
Scaife, M., & Bruner, J.S. (1975). The capacity for joint visual attention in the infant. Nature, 253, 265—266.
58.
Scassellati, B. (2002). Theory of mind for a humanoid robot. Autonomous Robots, 12, 13—24.
59.
Schaal, S. (1999). Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences, 3, 233—242.
60.
Schultz, R. (2005). Developmental deficits in social perception in autism: The role of the amygdala and fusiform face area. International Journal of Developmental Neuroscience, 23, 125—141.
61.
Schultz, W., Dayan, P., & Montague, P.R. (1997). A neural substrate of prediction and reward. Science, 275, 1593— 1599.
62.
Stanley, J. (1976). Computer simulation of a model of habituation . Nature, 261, 146—148.
63.
Sutton, R.S., & Barto, A.G. (1998). Reinforcement learning: an introduction. Cambridge, MA: MIT Press.
64.
Tantam, D., Holmes, D., & Cordess, C. (1993). Nonverbal expression in autism of Asperger type . Journal of Autism and Developmental Disorders, 23, 111—133.
65.
Teuscher, C., & Triesch, J. (in press). To each his own: The caregiver's role in a computational model of gaze following. Neurocomputing (2007 ), doi:10.1016/j.neucom.2006.02.023
66.
Tomasello, M. (1999). The cultural origins of human cognition. Cambridge, MA: Harvard University Press.
67.
Triesch, J., Jasso, H., & Deák, G. (2006a). Emergence of mirror neurons in a model of gaze following. In C. Yu, L. B. Smith, & O. Sporns , Proceedings of the International Conference on Development and Learning (ICDL 2006). Bloomington, IN : Indiana University.
Umiltà, M., Kohler, E., Gallese, V., Fogassi, L., Fadiga, L., Keysers, C., & Rizzolatti, G. (2001). I know what you are doing: A neurophysiological study. Neuron, 31, 155—165.
70.
Wainwright-Sharp, J., & Bryson, S. (1993). Visual orienting deficits in high-functioning people with autism. Journal of Autism and Developmental Disorders , 13, 1—13.
71.
Weber, C., Wermter, S., & Elshaw, M. (2006). A hybrid generative and predictive model of the motor cortex. Neural Networks, 19, 339—353.
72.
Williams, J., Whiten, A., & Singh, T. (2004). A systematic review of action imitation in autistic spectrum disorder. Journal of Autism and Developmental Disorders , 34, 285— 299.
