Eeva A. Elliott | Department of Experimental and Neurocognitive Psychology, Freie Universität Berlin, Germany
Arthur M. Jacobs | Dahlem Institute for Neuroimaging of Emotion (D.I.N.E.), Berlin, Germany
In this study, we verify the observation that signs for emotion related concepts are articulated with the congruent facial movements in German Sign Language using a corpus. We propose an account for the function of these facial movements in the language that also explains the function of mouthings and other facial movements at the lexical level. Our data, taken from 20 signers in three different conditions, show that for the disgust related signs, a disgust related facial movement with temporal scope only over the individual sign occurred in most cases. These movements often occurred in addition to disgust related facial movements that had temporal scope over the entire clause. Using the Facial Action Coding System, we found some variability in how exactly the facial movement was instantiated, but most commonly, it consisted of tongue protrusion and an open mouth. We propose that these lexically related facial movements be regarded as an additional layer of communication with both phonological and morphological properties, and we extend this proposal to mouthings as well. The relationship between this layer and manual lexical items is analogous in some ways to the gesture-word relationship, and the intonation-word relationship.
Aarons, Debra, Ben Bahan, Judy Kegl & Carol Neidle
1992Clausal structure and a tier for grammatical marking in American Sign Language. Nordic Journal of Linguistics 151. 103–142.
Anderson, Diane E. & Judy S. Reilly
1997The puzzle of negation: How children move from communicative to grammatical negation in ASL. Applied Psycholinguistics 18(4). 411–429.
Aryani, Arash, Markus Conrad & Arthur M. Jacobs
2013Extracting salient sublexical units from written texts: ‘Emophon’, a corpus-based approach to phonological iconicity. Frontiers in Psychology 41.654. .
Baker-Shenk, Charlotte
1983A micro-analysis of the non-manual components of questions in American Sign Language. PhD dissertation, University of California, Berkeley, CA.
Bartels, Christine
1999The intonation of English statements and questions: A compositional interpretation. New York/London: Garland Publishing.
Blevins, Juliette
2012Duality of patterning: Absolute universal or statistical tendency?Language and Cognition 41. 275–296.
Boer, Bart de, Wendy Sandler & Simon Kirby
(eds.)2012New perspectives on duality of patterning: Introduction to the special issue. Language and Cognition 41. 251–259.
Crasborn, Onno & Els van der Kooij
2013The phonology of focus in Sign Language of the Netherlands. Journal of Linguistics 49(3). 515–565. .
Crasborn, Onno, Els van der Kooij, Dafydd Waters, Bencie Woll & Johanna Mesch
2009Visual intonation in the prosody of a sign language. Language and Speech 52(2/3). 287–314.
Darwin, Charles
1904 [1872]The expression of the emotions in man and animals. London: John Murray.
Ebbinghaus, Horst & Jens Heßmann
2001Sign language as multidimensional communication: Why manual signs, mouthings, and mouth gestures are three different things. In Penny Boyes Braem & Rachel Sutton-Spence (eds.), The hands are the head of the mouth, 133–152. Hamburg: Signum.
Eibl-Eibesfeldt, I
1975Similarities and differences between cultures in expressive movements. In Robert A. Hinde (ed.), Non-verbal communication, 297–312. Cambridge: Cambridge University Press.
Ekman, Paul
1972Universals and cultural differences in facial expressions of emotion. In James K. Cole (ed.), Nebraska symposium on motivation, 207–283. Lincoln, NE: University of Nebraska Press.
Ekman, Paul
1975The universal smile: Face muscles talk every language, Psychology TodaySeptember. 35–39.
Ekman, Paul
1992An argument for basic emotions. Cognition and Emotion 61. 169–200.
Ekman, Paul
2004Emotional and conversational nonverbal signals. In Jesús M. Larrazabel & Luis A.Pérez Miranda (eds.), Language, knowledge, and representation, 39–50. Dordrecht: Kluwer Academic Publishers.
Ekman, Paul, Wallace V. Friesen & Joseph C. Hager
2002aFacial action coding system: Investigator’s guide. Salt Lake City, UT: A Human Face.
Ekman, Paul, Wallace V. Friesen & Joseph C. Hager
2002bFacial action coding system: The manual. Salt Lake City, UT: A Human Face.
Elliott, Eeva A., Mario Braun, Michael Kuhlmann & Arthur M. Jacobs
2012A dual-route cascaded model of reading by deaf adults: Evidence for grapheme to viseme conversion. Journal of Deaf Studies and Deaf Education 17(2). 227–243.
Elliott, Eeva A. & Arthur M. Jacobs
2013Facial expressions, emotions, and sign languages. Frontiers in Psychology 41. .
Fridlund, Alan J
1997The new ethology of human facial expressions. In James A. Russell & José-Miguel Fernandez-Dols (eds.), The psychology of facial expression, 103–129. Cambridge: Cambridge University Press.
Fuks, Orit & Yishai Tobin
2008The signs B and B-bent in Israeli Sign Language according to the theory of phonology as human behavior. Clinical Linguistics & Phonetics 22(4-5). 391–400.
Gussenhoven, Carlos
2002Intonation and interpretation: Phonetics and phonology. In
Proceedings of the 1st International Conference on Speech Prosody
, Aix-en-Provence, France, 47–57.
Happ, Daniela & Marc-Oliver Vorköper
2006Deutsche Gebärdensprache: Ein Lehr- und Arbeitsbuch. Frankfurt am Main: Fachhochschulverlag.
Hockett, Charles
1960The origin of speech. Scientific American 203(3). 88–96.
Hofmann, Markus, Lars Kuchinke, Sascha Tamm, Melissa L.H. Vo & Arthur M. Jacobs
2009Affective processing within 1/10th of a second: High arousal is necessary for early facilitative processing of negative but not positive words. Cognitive Affective & Behavioral Neuroscience 9(4). 389–397.
Hohenberger, Annette & Daniela Happ
2001The linguistic primacy of signs and mouth gestures over mouthings: Evidence from language production in German Sign Language (DGS). In Penny Boyes Braem & Rachel Sutton-Spence (eds.), The hands are the head of the mouth, 153–190. Hamburg: Signum.
Izard, Carroll E
2010The many meanings/aspects of emotion: Definitions, functions, activation, and regulation. Emotion Review 2(4). 363–370.
Izard, Carroll E., Christina A. Fantauzzo, Janine M. Castle, O. Maurice Haynes, Maria F. Rayias & Priscilla H. Putnam
1995The ontogeny and significance of infants’ facial expressions in the first 9 months of life. Developmental Psychology 31(6). 997–1013.
Johnston, Trevor & Adam Schembri
2006Issues in the creation of a digital archive of a signed language. In Linda Barwick & Nicholas Thieberger (eds.), Sustainable data from digital fieldwork, 7–16. Sydney: Sydney University Press.
Keller, Jörg
2001Multimodal representations and the linguistic status of mouthings in German Sign Language (DGS). In Penny Boyes Braem & Rachel Sutton-Spence (eds.), The hands are the head of the mouth, 191–230. Hamburg: Signum.
Kelly, Spencer D., Aslı Özyürek & Eric Maris
2010Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science 21(2). 260–267.
Klima, Edward & Ursula Bellugi
1979The rate of speaking and signing. In Edward Klima & Ursula Bellugi (eds.), The signs of language, 181–194. Cambridge, MA: Harvard University Press.
Krahmer, Emiel & Marc Swerts
2009Audiovisual prosody – Introduction to the Special Issue. Language and Speech 521. 129–133.
Ladd, D. Robert
1996Intonational phonology. Cambridge: Cambridge University Press.
1980American Sign Language syntax. The Hague: Mouton.
Liddell, Scott K
2003Grammar, Gesture, and Meaning in American Sign Language. Cambridge: Cambridge University Press.
Matsumoto, David & Bob Willingham
2009Spontaneous facial expressions of emotion of congenitally and noncongenitally blind individuals. Journal of Personality and Social Psychology 96(1). 1–10.
Mayberry, Rachel, Joselynne Jacques & Gayle DeDe
1998What stuttering reveals about the development of the gesture-speech relationship. New Directions for Child Development 791. 77–87.
McIntire, Marina L. & Judy S. Reilly
1988Nonmanual behaviors in L1 and L2 learners of American Sign Language. Sign Language Studies 611. 351–375.
McNeill, David
1992Hand and mind: What gestures reveal about thought. Chicago: Chicago University Press.
Müller, Cornelia & Roland Posner
(eds.)2002The semantics and pragmatics of everyday gestures. The Berlin conference. Berlin: Weidler Verlag.
Neidle, Carol, Judy Kegl, Dawn MacLaughlin, Ben Bahan & Robert G. Lee
2000The syntax of American Sign Language. Functional categories and hierarchical structure. Cambridge, MA: MIT Press.
Nespor, Marina & Wendy Sandler
1999Prosody in Israeli Sign Language. Language & Speech 42(2/3). 143–176.
Pellegrino, Francois, Christophe Coupe & Egidio Marsico
2011A cross-language perspective on speech information rate. Language 87(3). 539–558.
Pittam, Jeffery & R. Klaus Scherer
1993Vocal expression and communication of emotion. In Michael Lewis & Jeannette M. Haviland (eds.), Handbook of emotions, 185–197. New York/London: Guilford Press.
Reilly, Judy S
2005How faces come to serve grammar: The development of nonmanual morphology in American Sign Language. In Brenda Schick, Mark Marschark & Patricia E. Spencer (eds.), Advances in the sign language development of deaf children, 262–290. Oxford: Oxford University Press.
Reilly, Judy S., Marina McIntire & Ursula Bellugi
1990The acquisition of conditionals in American Sign Language – grammaticized facial expressions. Applied Psycholinguistics 11(4). 369–392.
Reilly, Judy S., Marina McIntire & Howie Seago
1992Affective prosody in American Sign Language. Sign Language Studies 751. 113–128.
Russell, James A
1980A circumplex model of affect. Journal of Personality and Social Psychology 39(6). 1161–1178.
Russell, James A. & José-Miguel Fernandez-Dols
(eds.)1997The psychology of facial expression. Cambridge: Cambridge University Press.
1999bProsody in two natural language modalities. Language and Speech 42(2-3). 127–142.
Sandler, Wendy
2009Symbiotic symbolization by hand and mouth in sign language. Semiotica 1741. 241–275.
Sandler, Wendy & Diane Lillo-Martin
2006Sign language and linguistic universals. Cambridge: Cambridge University Press.
Taub, Sarah
2001Language from the body: Iconicity and metaphor in American Sign Language. New York: Cambridge University Press.
Tobin, Yishai
1997Phonology as human behaviour. Durham & London: Duke University Press.
Vo, Melissa L.H., Markus Conrad, Lars Kuchinke, Karolina Urton, Markus J. Hofmann & Arthur M. Jacobs
2009The Berlin affective word list reloaded (BAWL-R). Behaviour Research Methods 41(2). 534–538.
Vos, Connie de, Els van der Kooij & Onno Crasborn
2009Mixed signals: Combining linguistic and affective functions of eyebrows in questions in Sign Language of the Netherlands. Language and Speech 52(2/3). 315–339.
Waleschkowski, Eva
2009Focus in German Sign Language. Poster presented at Workshop “Nonmanuals in Sign Languages”. University of Frankfurt/Main.
Wierzbicka, Anna
1996Semantics: Primes and universals. New York: Oxford University Press.
Wierzbicka, Anna
1999Emotions across languages and cultures. Cambridge: Cambridge University Press.
Wilbur, Ronnie B
2009Effects of varying rate of signing on ASL manual signs and nonmanual markers. Language and Speech 52(2/3). 245–285.
2001The sign that dares to speak its name: Echo phonology in British Sign Language (BSL). In Penny Boyes Braem & Rachel Sutton-Spence (eds.), The hands are the head of the mouth, 87–98. Hamburg: Signum.
Zipf, George Kingsley
2012 [1949]Human behaviour and the principle of least effort: An introduction to human ecology. Mansfield Centre: Martino Fine Books.
Cited by
Cited by 1 other publications
Aryani, Arash & Arthur Jacobs
2018. Affective Congruence between Sound and Meaning of Words Facilitates Semantic Decision. Behavioral Sciences 8:6 ► pp. 56 ff.
This list is based on CrossRef data as of 14 april 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.