Following our work on the relationship between eyebrow movements and the fundamental frequency of the voice, this article presents the results of a study on this phenomenon, and also on the temporal location of rapid eyebrow movements with respect to speaking turns during dialogue. We used an automatic movement-acquisition system coupled with the simultaneous, synchronized recording of the vocal production. This procedure permits an objective analysis of eyebrow movements in relation to the vocal production. The data obtained showed that the speakers' rapid eyebrow movements were associated both with turn-taking (occurring right before or right after speaking turn onset) and with changes in the fundamental frequency. These findings suggest that rapid eyebrow movements are mainly linked to motivation and the intention to communicate, and may also act as a focus marker in speech.
Barkhuysen, P., Krahmer, E., & Swerts, M. (2008). The interplay between the auditory and visual modality for end-of-utterance detection. The Journal of the Acoustical Society of America, 123, 354-336.
2.
Beskow, J., Granström, B., & House, D. (2006). Visual correlates to prominence in several expressive modes. In Proceedings of the International Conference on Spoken Language Processing-Interspeech 2006 (pp.1272-1275). Pittsburgh, PA: Interspeech 2006-ICSLP.
3.
Birdwhistell, R.L. (1970). Kinesics and context: Essays on Body Motion Communication . Philadelphia: University of Pennsylvania Press.
4.
Bolinger, D.L. (1998). Intonation in American English [preliminary version of article not published in its entirety). In D. J. Hirst & A. Di Cristo (Eds.), Intonation systems: a survey of twenty languages (pp.45-55). Cambridge : Cambridge University Press.
5.
Branderud, P. (1985). Movetrack-A movement tracking system. In Proceedings of the French Swedish Symposium on Speech (pp.113-122). Grenoble: GALF.
6.
Cavé, C., Guaïtella, I., Bertrand, R., Santi, S., Harlay, F., & Espesser, R. (1996). About the relationship between eyebrow movements and F0 variations. In H. T. Bunnell & W. Isardi (Eds.), Proceedings of the 4th International Conference on Spoken Language Processing (pp.2175-2178). Philadelphia, PA: University of Delaware and Alfred I. duPont Institute.
7.
Cavé, C., Guaïtella, I., & Santi, S. (2001). Oralité et gestualité: Interaction et comportements multimodaux dans la communication. Paris: L'Harmattan.
8.
Cavé, C., Guaïtella, I., & Santi, S. (2002). Eyebrow movements and voice variations in dialogue situations. In J. H. L. Hansen & B. Pellom (Eds.), Proceedings of the 7th International Conference on Spoken Language Processing (pp.2353-2356). Denver, CO.
9.
Condon, W.S. (1976). An analysis of behavioral organization. Sign Language Studies, 13, 285-318.
10.
D'Amoco, M., & Ferrigno, G. (1990). Technique for the evaluation of derivatives from noisy biomechanical displacement data using a model-based bandwidth-selection procedure. Medical and Biological Engineering and Computing , 28, 407-415.
11.
Darwin, C.R. (1872). The expression of the emotions in man and animals . London: John Murray.
12.
Ekman, P. (1979). About brows: Emotional and conversational signals . In M. von Cranach, K. Foppa, W. Lepenies , & D. Ploog (Eds.), Human ethology: Claims and limits of a new discipline (pp.169-202). Cambridge University Press.
13.
Ekman, P., & Friesen, W. (1975). Unmasking the face: A guide to recognizing emotions from facial clues. Englewood Cliffs, NJ: Prentice Hall.
14.
Ferrigno, G., & Pedotti, A. (1985). ELITE: A digital dedicated hardware system for movement analysis via real-time TV signal processing. IEEE Transactions on Biomedical Engineering, 32(11), 943-950.
15.
Fraisse, P. (1974). Psychologie du rythme. Paris : Presses Universitaires de France.
16.
French, P., & Local, J. (1983). Turn-competitive incomings. Journal of Pragmatics, 7(1), 17-38.
17.
Guaïtella, I. (1991). Rythme et parole: Comparaison critique du rythme de la lecture oralisée et de la parole spontanée. Doctoral thesis, Université de Provence, Aix-en-Provence, France.
18.
Guaïtella, I. (1995). Mélodie du geste, mimique vocale? Semiotica, 103(3/4), 253-276.
19.
Guaïtella, I. (1999). Rhythm in speech: What rhythmic organizations reveal about cognitive processes in spontaneous speech production versus reading aloud. Journal of Pragmatics, 31(4), 509-523.
20.
Guaïtella, I., Cavé, C., & Santi, S. (1993). Relations entre geste et voix: Le cas des sourcils et de la fréquence fondamentale. In Images et Langages: Multimodalité et modélisation cognitive. Actes du colloque interdisciplinaire du Comité National de la Recherche Scientifique (pp.261-268). Paris: CNRS.
21.
Guaïtella, I., Dolbec, J., Yehouenou, B., Santi, S., & Diallo, A.M. (1998). Étude prosodique de l'hésitation vocale: universalité et variation culturelle. Actes du colloque N'Wave, 26.
22.
Guaïtella, I., Santi, S., Autesserre, D., Boyer, J., Lagrue, B., & Purson, A. (2001). Voix mêlées, regards croisés, tissage de l'interaction . In C. Cavé, I. Guaïtella & S. Santi (Eds.), Oralité et gestualité: Interactions et comportements multimodaux dans la communication (pp.464-469). Paris: L'Harmattan.
23.
Guaïtella, I., Santi, S., Cavé, C., Bertrand, R., Boyer, J., Faraco, M., Lagrue, B., Mignard, P., Paboudjian, C., & Purson, A. (1998). Les relations voco-gestuelles dans la communication interpersonnelle: Emergence d'une problématique et carrefour interdisciplinaire . In S. Santi, I. Guaïtella, C. Cavé , & G. Konopczynski (Eds.), Oralité et gestualité: Communication multimodale, interaction (pp.13-24). Paris : L'Harmattan.
24.
Hirst, D.J. (1983). Structures and categories in prosodic representations . In A. Cutler & D. R. Ladd (Eds.), Prosody models and measurements (pp.93-109). Berlin: Springer Verlag.
25.
Hirst, D. J., & Di Cristo, A. (Eds.). (1998). Intonation systems: A survey of twenty languages. Cambridge: Cambridge University Press.
26.
Hutois, M., & Scotto DICarlo, N. (2006). Analyse anatomo-physiologique des systèmes ostéo-articulaire et ventilatoire impliqués dans le chant. Médecine des Arts , 57, 8-17.
27.
Krahmer, E., & Swerts, M. (2004). More about brows. In Z. Ruttkay & C. Pelachaud (Eds.), From brows to trust: Evaluating embodied conversational agents (pp.194-216). Dordrecht: Kluwer Academic Press.
28.
Krahmer, E., & Swerts, M. (2007). The effects of visual beats on prosodic prominence: acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57, 396-414.
29.
Nguyen, N. (2000). A MATLAB toolbox for the analysis of articulatory data in the production of speech. Behavior Research Methods, Instruments, and Computers, 32, 464-467.
30.
Purson, A., Bertrand, R., Guaïtella, I., Boyer, J., Cavé, C., Santi, S., ET AL. (1998). Mouvements de sourcils dans le questionnement: Relation entre geste et voix. In S. Santi , I. Guaïtella, C. Cavé, & G. Konopczynski (Eds.), Oralité et gestualité: communication multimodale, interaction (pp.561-566). Paris: L'Harmattan.
31.
Santi, S., Guaïtella, I., Cavé, C., & Konopczinsky, G. (1998). Oralité et gestualité: communication multimodale, interaction. Paris: L'Harmattan.
32.
Scotto DICarlo, N. (1973). Analyse sémiologique des gestes et mimiques des chanteurs d'opéra. Semiotica, 9(4), 289-317.
33.
Swerts, M., & Krahmer, E. (2008). Facial expression and prosodic prominence: Effects of modality and facial area. Journal of Phonetics, 36, 219-238.
