Mirror mirror on the wall

Abstract

Future Intelligent Environments will feature fixed and mobile display screens with socially-aware virtual embodied agents. This paper addresses the potential of virtual embodied agents to generate a social connection with the inhabitants of Intelligent Environments. The goal of the study is to explore to what extent users mimic the behavior of an interactive agent. An experiment is conducted in which participants interact verbally with a virtual embodied agent. During the interaction, both the vocal pitch and the affective facial expressions of the agent are locally manipulated and the consecutive vocal and facial expressions of the participants registered. Computational analyses of the recorded expressions reveal vocal and facial mimicry as a sign of unconscious affect recognition and social connection. The implications of these results regarding the design of future Intelligent Environments are discussed.