The eyebrows are used as conversational signals in face-to-face spoken interaction (Ekman, 1979). In Sign Language of the Netherlands (NGT), the eyebrows are typically furrowed in content questions, and raised in polar questions (Coerts, 1992). On the other hand, these eyebrow positions are also associated with anger and surprise, respectively, in general human communication (Ekman, 1993). This overlap in the functional load of the eyebrow positions results in a potential conflict for NGT signers when combining these functions simultaneously. In order to investigate the effect of the simultaneous realization of both functions on the eyebrow position we elicited instances of both question types with neutral affect and with various affective states. The data were coded using the Facial Action Coding System (FACS: Ekman, Friesen, & Hager, 2002) for type of brow movement as well as for intensity. FACS allows for the coding of muscle groups, which are termed Action Units (AUs) and which produce facial appearance changes. The results show that linguistic and affective functions of eyebrows may influence each other in NGT. That is, in surprised polar questions and angry content question a phonetic enhancement takes place of raising and furrowing, respectively. In the items with contrasting eyebrow movements, the grammatical and affective AUs are either blended (occur simultaneously) or they are realized sequentially. Interestingly, the absence of eyebrow raising (marked by AU 1+2) in angry polar questions, and the presence of eyebrow furrowing (realized by AU 4) in surprised content questions suggests that in general AU 4 may be phonetically stronger than AU 1 and AU 2, independent of its linguistic or affective function.
Baker-Shenk, C. (1983). A microanalysis of the nonmanual components of questions in American Sign Language. Berkeley, CA: University of California.
2.
Baker-Shenk, C. (1986). Factors affecting the form of question signals in American Sign Language. In D. Sankoff (Ed.), Diversity and diachrony (pp.407-414). Amsterdam/ Philadelphia, PA: Benjamins.
3.
Bergman, B. (1984). Non-manual components of signed language: Some sentence types in Swedish Sign Language. In F. Loncke, P. Boyes Braem, & Y. Lebrun (Eds.), Recent research on European sign languages (Proceedings of the European Meeting of Sign Language Research held in Brusssels, September 19-25, 1982) (pp.49-59). Lisse: Swets & Zeitlinger.
4.
Brugman, H., & Russell, A. (2004). Annotating multimedia/multi-modal resources with ELAN. Paper presented at the LREC 2004, Fourth International Conference on Language Resources and Evaluation, Lisbon, Portugal. Retrieved November 26, 2008, from: http://www.lat-mpi.eu/papers/papers-2004/Brugman-ELAN.pdf
5.
Campbell, R., Woll, B., Benson, P.J., & Wallace, S.B. (1999). Categorical perception of face actions: Their role in sign language and in communicative facial displays. Quarterly Journal of Experimental Psychology: Section A, 52(1), 67-95.
6.
Coerts, J. (1992). Nonmanual grammatical markers. An analysis of interrogatives, negations and topicalisations in Sign Language of the Netherlands . Amsterdam: Universiteit van Amsterdam .
7.
Colville, M.D., Denmark, M., Mason, C., Denmark, C., & Brennan, M. (1984). Edinburgh Non-manual Coding System (ENCS). Edinburgh: Edinburgh BSL Research Project, Moray House College.
8.
Corina, D.P., Bellugi, U., & Reilly, J.S. (1999). Neuropsychological studies of linguistic and affective facial expressions in Deaf signers. Speech and Language, 42(2&3), 307-331.
9.
Crasborn, O. (2001). Phonetic implementation of phonological categories in Sign Language of the Netherlands. Utrecht: LOT.
10.
Crasborn, O., & Sloetjes, H. (2008, June). Enhanced ELAN functionality for sign language corpora. Paper presented at the LREC 2008, Sixth International Conference on Language Resources and Evaluation, Marrakech, Morocco.
11.
Dachkovsky, S. (2005). Facial expression as intonation in Israeli Sign Language: The case of conditionals. Unpublished manuscript.
12.
Darwin, C. (1872). The expression of emotions in man and animals . London: John Murray.
13.
de Vos, C. (2006). Mixed signals: Combining affective and linguistic functions of eyebrows in Sign Language of the Netherlands. M.A. thesis, Radboud University Nijmegen, the Netherlands. Retrieved, November 26, 2008, from http://www.let.ru.nl/sign-lang/docs/ConniedeVos2006MixedSignals.pdf
14.
Ekman, P. (1973). Cross-cultural studies of facial expression. In P. Ekman (Ed.), Darwin and facial expression: A century of research in review (pp.169-222). New York: Academic Press.
15.
Ekman, P. (1979). About brows: emotional and conversational signals . In M. von Cranach, K. Foppa, W. Lepenies , & D. Ploog (Eds.), Human ethology: Claims and limits of a new discipline (pp.169-202). Cambridge: Cambridge University Press.
16.
Ekman, P. (1993). Facial expression and emotion. American Psychologist, 48(4), 384-392.
Ekman, P., Friesen, W.V., & Hager, J.C. (2002). Facial Action Coding System. Salt Lake City, UT: Research Nexus.
19.
Frijda, N. (1986). The emotions. Cambridge: Cambridge University Press.
20.
Gussenhoven, C. (2004). The phonology of tone and intonation. Cambridge: Cambridge University Press.
21.
Izard, C.E. (1977). Human emotions. New York: Plenum.
22.
Izard, C.E. (1994). Innate and universal facial expressions: Evidence from developmental and cross-cultural research. Psychological Bulletin, 115(2), 288-299.
23.
Jouitteau, M. (2004). Gestures as expletives: Multichannel syntax. In A. K. Vineeta Chand, A. J. Rodríguez, & B. Schmeiser (Eds.), 23rd West Coast Conference on Formal Linguistics (pp.422-435). Somerville, MA: Cascadilla Press.
24.
Keltner, D., Ekman, P., Gonzaga, G.C., & Beer, J. (2003). Facial expression of emotion. In K. J. Davidson & K. Scherer (Eds.), Handbook of affective sciences (pp.415-433). Oxford: Oxford University Press.
25.
Krahmer, E., & Swerts, M. (2004). More about brows: a cross-linguistic analysis-by-synthesis study. In C. Pelachaud & Z. Ruttkay (Eds.), From brows to trust: Evaluating embodied conversational agents (pp.191-216). Dordrecht: Kluwer Academic Publishers.
26.
Kyle, J., & Woll, B. (1985). Sign language: The study of deaf people and their language. Cambridge: Cambridge University Press.
27.
Ladd, B. (1997). Intonational phonology. Cambridge : Cambridge University Press.
28.
Lane, H. (1984). When the mind hears. New York : Random House.
29.
Liddell, S. (1980). American Sign Language syntax. The Hague: Mouton.
30.
McCullough, S., Emmorey, K., & Sereno, M. (2005). Neural organization for recognition of grammatical and emotional facial expressions in deaf ASL signers and hearing nonsigners . Cognitive Brain Research, 22, 193-203.
31.
Meier, R. P., Cormier, K. , & Quinto-Pozos, D. (Eds.). (2002). Modality and structure in signed and spoken languages . Cambridge, UK: Cambridge University Press.
32.
Morgan, M. (2006). Interrogatives and negatives in Japanese Sign Language (JSL). In U. Zeshan (Ed.), Interrogatives and negatives in signed languages (pp.91-127). Nijmegen : Ishara Press.
33.
Nederlands Gebarencentrum (2002). Standaard Lexicon NGT deel 1 en 2. Retrieved June 17, 2008, from http://www.gebarencentrum.nl/woordenboek.asp?color=y&idrelease=28
34.
Nespor, M., & Sandler, W. (1999). Prosody in Israeli Sign Language. Language and Speech, 42(2-3), 143-176.
35.
Nespor, M., & Vogel, I. (1986). Prosodic phonology. Dordrecht : Foris.
36.
Reagan, T. (1995). A sociocultural understanding of Deafness: American Sign Language and the culture of Deaf people. International Journal of Intercultural Relations, 19(2), 239-252.
37.
Reilly, J.S., & Bellugi, U. (1996). Competition on the face: Affect and Language in ASL motherese. Journal of Child Language, 23(1), 219-239.
38.
Reilly, J.S., McIntire, M.L., & Seago, H. (1992). Affective prosody in American Sign Language. Sign Language Studies, 21(75), 113-128.
39.
Russell, J.A., & Fernández-Dols, J.M. (1997). What does a facial expression mean? In J. A. Russell & J. M. Fernández-Dols (Eds.), The psychology of facial expression (pp.3-30). Cambridge: Cambridge University Press.
40.
Sandler, W. (1999). Prosody in two natural language modalities. Language and Speech, 42(2&3), 127-142.
41.
Sandler, W., & Lillo-Martin, D. (2006). Sign language and linguistic universals. Cambridge: Cambridge University Press.
42.
Scherer, K. (1986). Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99(2), 143-165.
43.
Scherer, K., & Johnstone, T. (2003). Vocal expression of emotion. In K. J. Davidson & K. Scherer (Eds.), Handbook of affective sciences (pp.433-456). Oxford: Oxford University Press.
44.
van Bezooijen, R. (1984). Chracteristics and recognizability of vocal expressions of emotion. Unpublished Ph.D. thesis, Radboud University Nijmegen.
45.
van der Kooij, E., Crasborn, O., & Emmerik, W. (2006). Explaining body leans in Sign Language of the Netherlands: Pragmatics required. Journal of Pragmatics, 38(10), 1598-1614.
46.
Wilbur, R.B. (2000). Phonological and prosodic layering of nonmanuals in American Sign Language. In K. Emmorey & H. Lane (Eds.), The signs of language revisited: An anthology to honor Ursula Bellugi and Edward Klima (pp.215-244). Mahwah, NJ: Lawrence Erlbaum Associates .
47.
Wilbur, R.B. (2003). Modality and the structure of language: Sign languages versus signed systems. In M. Marschark & P. E. Spencer (Eds.), Oxford handbook of Deaf studies, language, and education (pp.332-346). Oxford: Oxford University Press.
48.
Wittenburg, P., Brugman, H., Russel, A., Klassmann, A., & Sloetjes, H. (2006). ELAN: A professional framework for multimodality research. Paper presented at the LREC 2006, Fifth Conference on Language Resources and Evaluation, Las Palmas . Retrieved November 26, 2008, from http://www.lat-mpi.eu/papers/papers-2006/elan-paper-final.pdf
