Cover not available
Article published In:
Gesture
Vol. 19:1 (2020) ► pp.72–96

The more you move, the more action you construct

A motion capture study on head and upper-torso movements in constructed action in Finnish Sign Language narratives

| University of Jyväskylä,
| University of Jyväskylä,
| University of Jyväskylä,
| University of Jyväskylä,
This paper investigates, with the help of motion capture data processed on corpus principles, the characteristics of head and upper-torso movements in constructed action and regular narration (i.e., signing without constructed action) in FinSL. Specifically, the paper evaluates the validity of two arguments concerning constructed action: that constructed action forms a continuum with regular narration, and that constructed action divides into three subtypes (i.e., overt, reduced, and subtle). The results presented in the paper support the first argument but not directly the second one. Because of the ambiguous position of reduced constructed action in between subtle and overt constructed action, we argue in the paper that the present three-part typology of constructed action may need revising. As an alternative way of subcategorizing the phenomenon we propose a division between strong and weak constructed action.
Keywords: constructed action, narration, motion capture, kinematics, sign language, Finnish Sign Language
Article outline
  • Introduction
  • Constructed action, its degrees and articulation
  • Data and methodology
    • Motion capture data
    • Annotation
    • Sampling, processing, and analysis
  • Results
  • Discussion
  • Conclusion
  • Acknowledgements
  • References
Published online: 18 May 2021
DOI logo
https://doi.org/10.1075/gest.19042.jan
References (26)
References
Burger, Birgitta, Saarikallio, Suvi, Luck, Geoff, Thompson, Marc, & Toiviainen, Petri. (2013). Relationships between perceived emotions in music and music-induced movement. Music Perception, 30 (5), 519–535. DOI logoGoogle Scholar
Burger, Birgitta & Toiviainen, Petri. (2013). MoCap Toolbox: A Matlab toolbox for computational analysis of movement data. In Roberto Bresin (Ed.), Proceedings of the 10th Sound and Music Computing Conference, Stockholm, Sweden (pp. 172–178). Berlin: Logos.Google Scholar
Burger, Birgitta, Puupponen, Anna, & Jantunen, Tommi. (2018). Synchronizing eye tracking and optical motion capture: How to bring them together. Journal of Eye Movement Research, 11 (2), 5. DOI logoGoogle Scholar
Cormier, Kearsy, Smith, Sandra, & Sevcikova Sehyr, Zed. (2015). Rethinking constructed action. Sign Language & Linguistics, 18 (2), 167–204. DOI logoGoogle Scholar
Crasborn, Onno & Sloetjes, Han. (2008). Enhanced ELAN functionality for sign language corpora. In Onno Crasborn, Elene Efthimiou, Thomas Hanke, Ernst D. Thoutenhoofd, & Inge Zwitserlood (Eds.), Proceedings of the 3rd Workshop on the Representation and Processing of Sign Languages: Construction and Exploitation of Sign Language Corpora (pp. 39–43). Paris: ELRA.Google Scholar
De Beuzeville, Louise, Johnston, Trevor, & Schembri, Adam. (2009). The use of space with indicating verbs in Australian Sign Language: A corpus-based investigation. Sign Language & Linguistics, 12 (1), 52–83. DOI logoGoogle Scholar
Enfield, Nick. (2009). The anatomy of meaning: Speech, gesture, and composite utterances. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Engberg-Pedersen, Elisabeth. (2015). Perspective in signed discourse: The privileged status of the signer’s locus and gaze. Open Linguistics, 11, 411–431. DOI logoGoogle Scholar
Ferrara, Lindsay & Johnston, Trevor. (2014). Elaborating who’s what: A study of constructed action and clause structure in Auslan (Australian Sign Language). Australian Journal of Linguistics, 34 (2), 193–215. DOI logoGoogle Scholar
Ferrara, Lindsay & Hodge, Gabrielle. (2018). Language as description, indication, and depiction. Frontiers in Psychology, 9, 716. DOI logoGoogle Scholar
Herrmann, Annika & Steinbach, Markus. (2012). Quotation in sign languages: A visible context shift. In Ingrid van Alphen & Isabelle Buchstaller (Eds.), Quotatives: Cross-linguistic and cross-disciplinary perspectives (pp. 203–230). Amsterdam: John Benjamins. DOI logoGoogle Scholar
Hodge, Gabrielle & Cormier, Kearsy. (2019). Reported speech as enactment. Linguistic Typology, 23 (1), 185–196. DOI logoGoogle Scholar
Hodge, Gabrielle & Ferrara, Lindsay. (2014). Showing the story: Enactment as performance in Auslan narratives. In Lauren Gawne & Jill Vaughan (Eds.), Selected papers from the 44th Conference of the Australian Linguistic Society, 2013 (pp. 372–397). Melbourne: University of Melbourne.Google Scholar
Jantunen, Tommi. (2013). Signs and transitions: Do they differ phonetically and does it matter? Sign Language Studies, 13 (2), 211–237. DOI logoGoogle Scholar
. (2017). Constructed action, the clause and the nature of syntax in Finnish Sign Language. Open Linguistics, 31, 65–85. DOI logoGoogle Scholar
. (2018). Viittomakielet hybridisysteemeinä: hämärärajaisuus ja epäkonventionaalisuus osana viittomakielten rakennetta [Sign languages as hybrid systems: Gradience and unconventionality as a part of the structure of sign languages]. Puhe ja kieli, 38 (3), 109–126. DOI logoGoogle Scholar
Jantunen, Tommi, Burger, Birgitta, & Puupponen, Anna. (2018). Constructed action types and eye behavior in Finnish Sign Language. Paper presented at the 8th Conference of the International Society for Gesture Studies (ISGS 8). Cape Town, South Africa, July 4–8, 2018.
Jantunen, Tommi, Puupponen, Anna, & Burger, Birgitta. (2020). What comes first: Combining motion capture and eye tracking data to study the order of articulators in constructed action in sign language narratives. In Proceedings of the 12th International Conference on Language Resources and Evaluation (LREC 2020) (pp. 6003–6007). Paris: ELRA.Google Scholar
Johnston, Trevor. (2010). From archive to corpus: Transcription and annotation in the creation of signed language corpora. International Journal of Corpus Linguistics, 15 (1), 106–131. DOI logoGoogle Scholar
Kendon, Adam. (2004). Gesture: Visible action as utterance. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Lillo-Martin, Dianne. (2012). Utterance reports and constructed action. In Roland Pfau, Markus Steinbach, & Bencie Woll (Eds.), Sign language: An international handbook (pp. 365–387). Berlin: De Gruyter Mouton. DOI logoGoogle Scholar
Puupponen, Anna. (2018). The relationship between the movements and positions of the head and the torso in Finnish Sign Language. Sign Language Studies, 18 (2), 175–214. DOI logoGoogle Scholar
. (2019). Towards understanding nonmanuality: A semiotic treatment of signers’ head movements. Glossa: A Journal of General Linguistics, 4 (1), 39. DOI logoGoogle Scholar
Puupponen, Anna, Wainio, Tuija, Burger, Birgitta, & Jantunen, Tommi. (2015). Head movements in Finnish Sign Language on the basis of Motion Capture data: A study of the form and function of nods, nodding, head thrusts, and head pulls. Sign Language & Linguistics, 18 (1), 41–89. DOI logoGoogle Scholar
Salonen, Juhana, Wainio, Tuija, Kronqvist, Antti, & Keränen, Jarkko. (2018). Suomen viittomakielten korpusprojektin (CFINSL) annotointiohjeet. 11. versio. Kielija viestintätieteiden laitos, Jyväskylän yliopisto.Google Scholar
Tyrone, Martha & Mauk, Claude. (2010). Sign lowering and phonetic reduction in American Sign Language. Journal of Phonetics, 381, 317–328. DOI logoGoogle Scholar
Cited by (12)

Cited by 12 other publications

Hernández, Doris, Anna Puupponen, Jarkko Keränen, Gerardo Ortega & Tommi Jantunen
2024. Between bodily action and conventionalized structure: The neural mechanisms of constructed action in sign language comprehension. Brain and Language 252 ► pp. 105413 ff. DOI logo
Puupponen, Anna, Gabrielle Hodge, Benjamin Anible, Juhana Salonen, Tuija Wainio, Jarkko Keränen, Doris Hernández & Tommi Jantunen
2024. Opening up Corpus FinSL: enriching corpus analysis with linguistic ethnography in a study of constructed action. Linguistics 0:0 DOI logo
Stamp, Rose, David Cohn, Hagit Hel-Or & Wendy Sandler
2024. Kinect-ing the Dots: Using Motion-Capture Technology to Distinguish Sign Language Linguistic From Gestural Expressions. Language and Speech 67:1 ► pp. 255 ff. DOI logo
Sun, Zhenyi & Yunlong Cui
2024. Exploring the Path of Innovative College Dance Teaching Models with Motion Capture Technology. Applied Mathematics and Nonlinear Sciences 9:1 DOI logo
Mesch, Johanna
2023. Chapter 9. Creating a multifaceted corpus of Swedish Sign Language. In Advances in Sign Language Corpus Linguistics [Studies in Corpus Linguistics, 108], ► pp. 242 ff. DOI logo
Napoli, Donna Jo & Rachel Sutton-Spence
2023. The nature of torso articulation in human expression: signing and dancing. Journal of Cultural Cognitive Science 7:3 ► pp. 269 ff. DOI logo
Napoli, Donna Jo & Rachel Sutton-Spence
2024. Torso articulation in sign languages. Sign Language & Linguistics 27:1 ► pp. 1 ff. DOI logo
Martinod, Emmanuella
2022. Role-taking in two micro-community sign languages: Phylogenetic insights. Frontiers in Communication 7 DOI logo
Puupponen, Anna, Laura Kanto, Tuija Wainio & Tommi Jantunen
2022. Variation in the use of constructed action according to discourse type and age in Finnish Sign Language. Language & Communication 83 ► pp. 16 ff. DOI logo
Quinto-Pozos, David, Fey Parrill & Caitie Coons
2022. The interface between grammar and bodily enactment in ASL and English. Languages in Contrast 22:2 ► pp. 195 ff. DOI logo
Vandenitte, Sébastien
2022. Making Referents Seen and Heard Across Signed and Spoken Languages: Documenting and Interpreting Cross-Modal Differences in the Use of Enactment. Frontiers in Psychology 13 DOI logo
Vandenitte, Sébastien
2023. When referents are seen and heard. In Reference [Studies in Language Companion Series, 228], ► pp. 127 ff. DOI logo

This list is based on CrossRef data as of 4 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.