Audiovisual Prosody—Introduction to the Special Issue

Barkhuysen, P. , Krahmer, E. , & Swerts, M. (2005). Problem detection in human- machine interactions based on facial expressions of users. Speech Communication , 45(3), 343-359.

Barkhuysen P. , Krahmer, E. , & Swerts, M. (2008). The interplay between the auditory and visual modality for end-of-utterance detection. Journal of the Acoustical Society of America, 123(1), 354-365.

Barkhuysen P. , Krahmer, E. , & Swerts, M. (2010). Cross-modal and incremental perception of audiovisual cues to emotional speech. Language and Speech, in press.

Benoît, C. , & LE Goff, B. (1998). Audio-visual speech synthesis from French text: Eight years of models, designs and evaluation at the ICP. Speech Communication, 26, 117-129.

Beskow, J. (1995). Rule-based visual speech synthesis. In Proceedings of the 4th European conference on speech communication and technology (EUROSPEECH 95) Madrid (pp.299-302).

Cassell, J. , Sullivan, J. , Prevost, S. , & Churchill, E. (2000). Embodied conversational agents. Cambridge, MA: MIT Press.

Cavé, C. , Guaïtella, I. , Bertrand, R. , Santi, S. , Harlay, F. , & Espesser, R. (1996). About the relationship between eyebrow movements and F0 variations. In Proceedings of the International Conference on Spoken Language Processing (ICSLP) Philadelphia (pp.2175-2179).

Clark, H. & Krych, M. (2004), Speaking while monitoring addressees for understanding . Journal of Memory and Language, 50, 62-81.

De Gelder, B. , Böcker, K. , Tuomainen, J. , Hensen, M. , & Vroomen, J. (1999). The combined perception of emotion from face and voice: Early interaction revealed by human electric brain responses. Neuroscience Letters, 260, 133-136.

Erickson, D. , Fujimura, O. , & Pardo, B. (1998). Articulatory correlates of prosodic control: Emotion and emphasis. Language and Speech, 41(3-4), 399-417.

Granström, B. , House, D. , & Lundeberg, M. (1999). Prosodic cues to multimodal speech perception . In Proceedings 14th International Conference of the Phonetic Sciences (ICPhS), San Francisco.

Granström, B. , House, D. , & Swerts, M. (2002). Multimodal feedback cues in human- machine interactions . In Proceedings of Speech Prosody 2002 Aix en Provence, France (pp.347-350).

Hadar, U. , Steiner, T.J. , Grant, E.C. , & Rose, F.C. (1983). Head movement correlates of juncture and stress at sentence level. Language and Speech, 26, 117-129.

Krahmer, E. & Swerts, M. (2004). More about brows: a cross-linguistic analysis-by-synthesis study. In C. Pelachaud & Z. S. Ruttkay (Eds.), From brows to trust: Evaluating embodied conversational agents, Kluwer Academic Publishers.

Krahmer, E. & Swerts, M. (2005). How children and adults produce and perceive uncertainty in audiovisual speech. Language and Speech, 48(1), 29-54.

Krahmer, E. & Swerts, M. (2007). The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57(3), 396-414.

Massaro, D. (1998). Perceiving talking faces: From speech perception to a behavioral principle, Cambridge, MA: The MIT Press.

McGurk, H. & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.

Munhall, K. , Jones, J. , Callan, D. , Kuratate, T. , & Vatikiotis-Bateson, E. (2004). Visual prosody and speech intelligibility: Head movement improves auditory speech perception. Psychological Science, 15, 133-137.

Nakano, Y.I. , Reinstein, G. , Stocky, T. , & Cassell, J. (2003). Towards a model of face-to-face grounding. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL) Sapporo, Japan.

Pelachaud, C. , Badler, N. , & Steedman, M. (1996). Generating facial expressions for speech. Cognitive Science, 20, 1-46.

Srinivasan, R. & Massaro, D. (2003). Perceiving prosody from the face and voice: Distinguishing statements from echoic questions in English. Language and Speech, 46, 1-22.

Swerts, M. & Krahmer, E. (2005). Audiovisual prosody and feeling of knowing. Journal of Memory and Language, 53(1), 81-94.

Swerts, M. & Krahmer, E. (2008). Facial expressions and prosodic prominence: Comparing modalities and facial areas. Journal of Phonetics, 36(2), 219-238.