From birth, human infants are immersed in a social environment that allows them to learn by leveraging the skills and capabilities of their caregivers. A critical pre-cursor to this type of social learning is the ability to maintain interaction levels that are neither overwhelming nor under-stim ulating. In this paper, we present a mechanism for an autonomous robot to regulate the intensity of its social interactions with a human. Similar to the feedback from infant to caregiver, the robot uses expressive displays to modulate the interaction intensity. This mechanism is integrated within a general framework that combines perception, attention, drives, emotions, behavior selection, and motor acts. We present a specific implementation of this architecture that enables the robot to react appropriately to both social stimuli (faces) and non-social stimuli (moving toys) while maintaining a suitable interaction intensity. We present results from both face-to-face interactions and interactions mediated through a toy.
Note: This paper was submitted in June, 1998.
Get full access to this article
View all access options for this article.
References
1.
Arkin, R. (1988). Homeostatic control for a mobile robot: dynamic replanning in hazardous environments. In W Wolfe (Ed.), Mobile Robots III (pp. 407-413). Bellingham, WA: The International Society for Optical Engineering (SPIE).
2.
Aslin, R.N. (1987). Visual and auditory development in infancy. In J. D. Osofksy (Ed.), Handbook of infant development (2nd ed.). New York: Wiley.
3.
Balch, R. & Arkin, R. (1994). Communication in reactive multiagent robotic systems . Autonomous Robots, 1, 27-52.
4.
Bates, J., Loyall, B. & Reilly, S. (1992). An architecture for action, emotion, and social behavior (Report No. CMU—CS—92—144). Pittsburgh, PA: Carnegie Mellon University Computer Science Department.
5.
Billard, A. & Dautenhahn, K. (1997). Grounding communication in situated, social robots (Report No. UMCS—97—9—1). Manchester, England: University of Manchester .
6.
Blumberg, B. (1996). Old tricks, new dogs: Ethology and interactive creatures. Doctoral Dissertation, Massachusetts Institute of Technology, Cambridge, MA.
7.
Breazeal, C. (1998). A motivational system for regulating human-robot interaction. Proceedings of the Fifteenth National Conference on Artificial Intelligence (AAAI-98). Menlo Park, CA: AAAI Press, 54—61.
8.
Brooks, R.A. (1986). A robust layered control system for a mobile robot . IEEE Journal of Robotics and Automation, RA-2, 253-262.
9.
Brooks, R.A. (1991). Intelligence without reason. In J. Mylopoulos and R. Reiter (Eds.), Proceedings of the 1991 International Joint Conference on Artificial Intelligence, San Mateo, CA: Morgan Kaufmann, 569—595.
10.
Brooks, R.A., Ferrell, C., Irie, R., Kemp, C.C., Marjanovic, M., Scassellati, B., & Williamson M. (1998). Alternative essences of intelligence. Proceedings of the Fifteenth National Conference on Artificial Intelligence (AAAI-98). Menlo Park, CA: AAAI Press, 961—967.
11.
Bullowa, M. (1979). Before speech: The beginning of interpersonal communication. London: Cambridge University Press.
12.
Carey, S. & Gelman, R. (1991). The epigenesis of mind. Hillsdale, NJ: Lawrence Erlbaum Associates.
13.
Cassell, J., Pelachaud, C., Badler, N.I., Steedman, M., Achorn, B., Becket, T., Douville, B., Prevost, S., and Stone, M. (1994). Animated conversation : Rule-based generation of facial expression, gesture and spoken intonation for multiple conversational agents. Proceedings of the 21st International ACM Conference on Computer Graphics & Interactive Techniques (SIGGRAPH-94) . New York: Association for Computing Machinery, 413-420.
14.
Chappell, P. & Sander, L. (1979). Mutual regulation of the neonatal-maternal interactive process: Context for the origins of communication. In M. Bullowa (Ed.), Before speech: The beginning of interpersonal communication (pp. 191-206). London: Cambridge University Press.
15.
Coombs, D.J. (1992). Real-time gaze holding in binocular robot vision (Report No. TR415). Rochester, NY: University of Rochester.
16.
Ekman, P. & Davidson, R. (1994). The nature of emotion: Fundamental questions. New York: Oxford University Press.
17.
Ekman, P. & Friesen, W. (1978). Facial action coding system: A technique for the measurement of facial movement. Palo Alto, CA: Consulting Psychologists Press.
18.
Elliot, C.D. (1992). The affective reasoner: A process model of emotions in a multi-agent system. Doctoral Dissertation, Institute for the Learning Sciences, Northwestern University.
19.
Goldstein, E.B. (1989). Sensation and perception. New York: Wadsworth Publishing Company.
20.
Halliday, M. (1975). Learning how to mean: explorations in the development of language. New York: Elsevier .
21.
Horn, B.K.P. (1986). Robot vision. Cambridge, MA : MIT Press.
22.
Izard, C. (1993). Four systems for emotion activation : Cognitive and non-cognitive processes. Psychological Review, 100, pp. 68-90.
23.
Kaye, K. (1979). Thickening thin data: The maternal role in developing communication and language. In M. Bullowa (Ed.), Before speech (pp. 191—206). London : Cambridge University Press.
24.
Lorenz, K. (1973). Foundations of ethology. New York: Springer-Verlag.
25.
Maes, P. (1992). Learning behavior networks from experience. In F. Varela and P. Bourgine (Eds.), Proceedings of the First European Conference on Artificial Life (ECAL-90). Cambridge, MA: MIT Press, 48—57.
26.
Mataric, M. (1995). Issues and approaches in the design of collective autonomous agents. Robotics and Autonomous Systems, 16, 321-331.
27.
McFarland, D. & Bosser, T. (1993). Intelligent behavior in animals and robots. Cambridge, MA: MIT Press.
28.
Milani, M. (1986). The body language and emotion of dogs. New York: William Morrow and Company.
29.
Minsky, M. (1988). The society of mind. New York : Simon & Schuster.
30.
Newson, J. (1979). The growth of shared understandings between infant and caregiver. In M. Bullowa (Ed.), Before speech (pp. 207-222). London: Cambridge University Press.
31.
Niedenthal, P. & Kityama, S. (1994). The heart's eye: emotional influences in perception and attention. San Diego, CA: Academic Press.
32.
Ortony, A., Clore, G., & Collins, A. (1988). The cognitive structure of emotion. London: Cambridge University Press.
33.
Reilly, S. (1996). Believable social and emotional agents. Doctoral Dissertation. Carnegie Mellon School of Computer Science , Pittsburgh, PA.
34.
Rowley, H., Baluja, S. & Kanade, T. (1995). Human face detection in visual scenes (Report No. CMU-CS-95-158). Pittsburgh, PA: Carnegie Mellon University School of Computer Science.
35.
Scassellati, B. (1996). Mechanisms of shared attention for a humanoid robot. In M. Mataric (Ed.), Embodied Cognition and Action: Papers from the 1996American Association of Artificial Intelligence Fall Symposium. Menlo Park, CA: AAAI Press, 102—106.
36.
Scassellati, B. (1998a). A binocular, foveated active vision system (Report No. 1628). Cambridge, MA: Massachusetts Institute of Technology Artificial Intelligence Lab.
37.
Scassellati, B. (1998b). Finding eyes and faces with a foveated vision system. Proceedings of the Fifteenth National Conference on Artificial Intelligence (AAAI-98). Menlo Park, CA: AAAI Press, 969— 976.
38.
Scassellati, B. (1998c). Imitation and mechanisms of shared attention: A developmental structure for building social skills (Report No. 98-1-005) . Aizu-Wakamatsu, Japan: University of Aizu.
39.
Sharkey, P.M., Murray, D.W., Vandevelde, S., Reid, I.D., & McLauchlan, P.F. (1993). A modular head/eye platform for real-time reactive vision. Mechatronics Journal, 3, 517-535.
40.
Sinha, P. (1994). Object recognition via image invariants: A case study. Investigative Ophthalmology and Visual Science, 35, 1735-1740.
41.
Sinha, P. (1996). Perceiving and recognizing three-dimensional forms . Doctoral Dissertation. Massachusetts Institute of Technology , Cambridge, MA.
42.
Steels, L. (1995). When are robots intelligent autonomous agents . Robotics and Autonomous Systems, 15, 3-9.
43.
Sung, K.-K. & Poggio, T. (1994). Example-based learning for view-based human face detection (Report No. 1521). Cambridge, MA: Massachusetts Institute of Technology Artificial Intelligence Laboratory.
44.
Tinbergen, N. (1951). The study of instinct. New York: Oxford University Press.
45.
Trevarthen, C. (1979). Communication and cooperation in early infancy: a description of primary intersubjectivity (pp. 321—348). In M. Bullowa (Ed.), Before speech. London : Cambridge University Press.
46.
Triesman, A. (1986). Features and objects in visual processing. Scientific American, 255, 114B-125.
47.
Tronick, E., Als, H., & Adamson, L. (1979). Structure of early face-to-face communicative interactions (pp. 349—370). In M. Bullowa (Ed.), Before speech. London: Cambridge University Press.
48.
Turk, M. & Pentland, A. (1991). Eigenfaces for recognition. Journal of Cognitive Neuroscience, 3, 71—86.
49.
Velasquez, J. (1996). Cathexis, a computational model for the generation of emotions and their influence in the behavior of autonomous agents. Master's ThesisCambrdige, MA: Massachusetts Institute of Technology.
50.
Wood, D., Bruner, J.S., & Ross, G. (1976). The role of tutoring in problem-solving. Journal of Child Psychology and Psychiatry, 17, pp. 89— 100.
