Article In:
Gesture: Online-First ArticlesIndexing turn-beginnings in Norwegian Sign Language conversation
It is well known that signers and speakers routinely produce finger points during interaction. While the referential functions of such finger points have received great attention from researchers, they are also used to manage interactions between interlocutors. These functions are less understood and have received less research focus. The current study helps to redress this gap in the literature by investigating how finger pointing is used to index and coordinate turn-beginnings in a corpus of 11 semi-naturalistic (Norwegian) signed language conversations, involving between two to five signers (3.4 hours of signing). The data was initially annotated in ELAN and then further qualitative analysis was conducted. This investigation revealed that finger pointing effectively indexes previous and upcoming discourse, thereby binding sequences of conversational moves and guiding their trajectory, helping signers to coordinate turn transitions and interaction as it unfolds.
Keywords: pointing, indexicality, interaction, turn-taking, Norwegian Sign language
Article outline
- Coordinating and collaborating in multimodal conversation
- Finger points as symbolic indexicals
- Multimodal turn-beginnings in spoken and signed languages
- Turn-beginnings, pre-beginnings, and presegments
- Eye gaze, pointing, and other bodily actions during turn-beginnings
- Data and analysis for the current study
- Designing turn-beginnings and indexing meanings across moves in Norwegian Sign Language conversations with finger pointing
- Responding to a question
- Responding to a comment by an interlocutor
- Pointing to coordinate turn trajectory and to collaborate on a joint word search
- Discussion
- Conclusion
- Acknowledgements
- Notes
-
References
This content is being prepared for publication; it may be subject to changes.
References
Auer, Peter
(2005) Projection
in Interaction and Projection in Grammar. Text – Interdisciplinary Journal for the Study of
Discourse,
25
(1), 7–36. 
(2018) Gaze,
addressee selection and turn-taking in three-party
interaction. In Geert Brône & Bert Oben (Eds.), Eye-tracking
in Interaction: Studies on the role of eye gaze in
dialogue (pp. 197–232). Amsterdam: John Benjamins.
Baker, Charlotte
(1977) Regulators
and turn-taking in American Sign Language discourse. In Lynn A. Friedman (Ed.), On
the other hand: New perspectives on American Sign
Language (pp. 215–236). New York: Academic Press.
Bavelas, Janet B.
(1994) Gestures as part of speech:
methodological implications. Research on Language & Social
Interaction,
27
(3), 201–221.
Bavelas, Janet B., Coates, Linda, & Johnson, Trudy
(2002) Listener
responses as a collaborative process: The role of gaze. Journal of
Communication,
52
(3), 566–580.
Bavelas, Janet B., Chovil, Nicole, Lawrie, Douglas A., & Wade, Allan
(1992) Interactive
gestures. Discourse
Processes,
15
(4), 469–489.
Beattie, Geoffrey W.
(1978) Floor apportionment and gaze
in conversational dyads. British Journal of Social and Clinical
Psychology,
17
(1), 7–15.
Beukeleers, Inez
(2020) On
the role of eye gaze in Flemish Sign Language: A multifocal eye-tracking study on the phenomena of online turn processing and
depicting. (Ph.D dissertation), KU Leuven, Belgium.
Brône, Geert, Oben, Bert, Jehoul, Annelies, Vranjes, Jelena, & Feyaerts, Kurt
(2017) Eye
gaze and viewpoint in multimodal interaction management. Cognitive
Linguistics,
28
(3), 449–483.
Cibulka, Paul
(2015) When
the hands do not go home: A micro-study of the role of gesture phases in sequence suspension and
closure. Discourse
Studies,
17
(1), 3–24.
Clark, Herbert H.
(1996) Using
language. Cambridge, England: Cambridge University Press.
(2003) Pointing and
placing. In Sotaro Kita (Ed.), Where
language, culture, and cognition
meet (pp. 243–268). Mahwah, NJ: Lawrence Erlbaum Associates.
(2005) Coordinating with each other
in a material world. Discourse
Studies,
7
(4–5), 507–525.
Clark, Herbert H., & Brennan, Susan E.
(1991) Grounding in
communication. In Lauren B. Resnick, John M. Levine, & Stephanie D. Teasley (Eds.), Perspectives
on socially shared
cognition (pp. 127–149). Washington, DC: American Psychological Association.
Clark, Herbert H., & Wilkes-Gibbs, Deanne
(1986) Referring
as a collaborative
process. Cognition,
22
1, 1–39.
Cormier, Kearsy, Schembri, Adam, & Woll, Bencie
(2013) Pronouns
and pointing in sign
languages. Lingua,
137
1, 230–247.
Deppermann, Arnulf
(2013) Turn-design
at turn-beginnings: Multimodal resources to deal with tasks of turn-construction in
German. Journal of
Pragmatics,
46
(1), 91–121.
Deppermann, Arnulf, & Streeck, Jürgen
(2018) The
body in interaction: Its multiple modalities and
temporalities. In Arnulf Deppermann & Jürgen Streeck (Eds.), Time
in embodied interaction: Synchronicity and sequentiality of multimodal
resources (pp. 1–29). Amsterdam/Philadelphia: John Benjamins.
De Stefani, Elwys, & Horlacher, Anne-Sylvie
(2008) Topical
and sequential backlinking in a French radio phone-in program: Turn shapes and sequential
placements. Pragmatics,
18
(3), 381–406.
de Vos, Connie de, Torreira, Francisco, & Levinson, Stephen C.
(2015) Turn-timing in signed
conversations: coordinating stroke-to-stroke turn boundaries. Frontiers in
Psychology,
6
(268).
Dressel, Dennis
(2020) Multimodal
word searches in collaborative storytelling: On the local mobilization and negotiation of
coparticipation. Journal of
Pragmatics,
170
1, 37–54.
Duncan, Starkey Jr
(1972) Some signals and rules for
taking speaking turns in conversations. Journal of Personality and Social
Psychology,
23
(1), 283–292.
Enfield, Nick J.
(2009) The anatomy of meaning: Speech,
gesture, and composite utterances. Cambridge: Cambridge University Press.
Engberg-Pedersen, Elisabeth
(2003) From
pointing to reference and predication: pointing signs, eyegaze, and head and body orientation in Danish Sign
Language. In S. Kita (Ed.), Pointing:
Where language, culture and cognition
meet (pp. 269–292). Mahwah, NJ: Lawrence Erlbaum Associates.
Ferrara, Lindsay
(2020) Some
interactional functions of finger pointing in signed language conversations. Glossa: A journal
of general
linguistics,
5
(1), 1–26.
Ferrara, Lindsay and Bø, Vibeke
(2022) Norwegian
Sign Language Corpus – Pilot Corpus (Conversations). Common Language Resources and Technology Infrastructure Norway (CLARINO) Bergen Repository. [URL]
Ferrara, Lindsay and Ringsø, Torill
(2021) Norwegian
Sign Language corpus – Depicting Perspective. Common Language Resources and Technology Infrastructure Norway (CLARINO) Bergen Repository. [URL]
Ford, Cecilia E., Fox, Barbara A., & Thompson, Sandra A.
Girard-Groeber, Simone
(2015) The
management of turn transition in signed interaction through the lens of overlaps. Frontiers in
Psychology,
6
1, 741.
(2018) Participation
by hard-of-hearing students in integration classroms: Facets of interactional
competence. Berlin, Germany: Frank & Timme.
Goodwin, Charles
(1981) Conversational
organization: Interaction between speakers and hearers. New York: Academic Press.
(1986) Gestures
as a resource for the organization of mutual
orientation. Semiotica,
62
(1–2), 29–49.
(2000) Action
and embodiment within situated human interaction. Journal of
Pragmatics,
32
1, 1489–1522.
(2002) Time
in action. Current
Anthropology,
43
(S4).
Goodwin, Marjorie Harness, & Goodwin, Charles
(1986) Gesture
and coparticipation in the activity of searching for a
word. Semiotica,
62
(1–2), 51–75.
Hayashi, Makoto
(2005) Joint
turn construction through language and the body: Notes on embodiment in coordinated participation in situated
activities. Semiotica,
156
(1–4), 21–53.
Heritage, John
(1984a) Garfinkel
and ethnomethodology. Cambridge, UK: Polity Press.
(1984b) A
change-of-state token and aspects of its sequential
placement. In J. Maxwell Atkinson & John C. Heritage (Eds.), Structures
of social action: Studies in conversation
analysis (pp. 299–345). Cambridge, UK: Cambridge University Press.
Holler, Judith, Turner, Kylie, & Varcianna, Trudy
(2013) It’s
on the tip of my fingers: Co-speech gestures during lexical retrieval in different social
contexts. Language and Cognitive
Processes,
28
(10), 1509–1518.
Iwasaki, Shimako
(2009) Initiating
interactive turn spaces in Japanese conversation: Local projection and collaborative
action. Discourse
Processes,
46
(2–3), 226–246.
Johnston, Trevor
(2013a) Towards
a comparative semiotics of pointing actions in signed and spoken
languages. Gesture,
13
(2), 109–142.
(2013b) Formational
and functional characteristics of pointing signs in a corpus of Auslan (Australian sign language): Are the data sufficient to
posit a grammatical class of ‘pronouns’ in Auslan? Corpus Linguistics and Linguistic
Theory,
9
(1), 109–159.
Kalma, Akko
(1992) Gazing
in triads: A powerful signal in floor apportionment. British Journal of Social
Psychology,
31
1, 21–39.
Keevallik, Leelo
(2018) What
does embodied interaction tell us about grammar? Research on Language & Social
Interaction,
51
(1), 1–21.
Kendon, Adam
(1967) Some
functions of gaze-direction in social interaction. Acta
Psychological,
26
1, 22–63.
(2004) Gesture:
Visible action as utterance. Cambridge: Cambridge University Press.
Kidwell, Mardi
(2013) Framing,
grounding, and coordinating conversational interaction: Posture, gaze, facial expression, and movement in
space. In Cornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill, & Jana Bressem (Eds.), Body –
Language –
Communication (Vol. I1, pp. 100–113). Berlin/Boston: Mouton De Gruyter.
Kita, Sotaro
(Ed.) (2003) Pointing:
Where language, culture, and cognition meet. Mahwah, NJ: Lawrence Erlbaum Associates.
Krauss, Robert M., & Fussell, Susan R.
(1991) Constructed shared
communicative environments. In Lauren B. Resnick, John M. Levine, & Sephanie D. Teasley (Eds.), Perspectives
on socially shared
cognition (pp. 172–200). Washington, DC: American Psychological Association.
Kääntä, Leila
(2012) Teachers’
embodied allocations in instructional interaction. Classroom
Discourse,
3
(2), 166–186.
Lepeut, Alysson
(2020) Framing
language through gesture: Palm-up, index finger-extended gestures, and holds in spoken and signed language interactions in
French-speaking and signing Belgium. (Ph.D
dissertation), University of Namur, Belgium.
Lerner, Gene H.
(2003) Selecting Next Speaker: The
Context-Sensitive Operation of a Context-Free Organization. Language in
society,
32
(2), 177–201.
Li, Xiaoting
(2014) Multimodality,
interaction and turn-taking in Mandarin Chinese. Amsterdam and Philadelphia, PA: John Benjamins.
Liddell, Scott K.
(2003) Grammar, gesture, and meaning in
American Sign Language. New York: Cambridge University Press.
Lindström, Jan
(2006) Grammar
in the service of interaction: Exploring turn organization in Swedish. Research on Language
& Social
Interaction,
39
(1), 81–117.
Linell, Per
(2009) Rethinking
language, mind, and world dialogically. Charlotte, NC: Information Age Publishing.
Local, John
(2004) Getting
back to prior talk: and-uh(m) as a back-connecting device in British and American
English. In Elizabeth Couper-Kuhlen & Cecilia E. Ford (Eds.), Sound
patterns in interaction: Cross-linguistic studies from
conversation (pp. 377–400). Amsterdam/Philadelphia: John Benjamins.
Martinez, Liza B.
(1995) Turn-taking and eye gaze in
sign conversations between Deaf Filipinos. In Ceil Lucas (Ed.), Sociolinguistics
in Deaf
communities (pp. 272–306). Washington, D.C.: Gallaudet University Press.
Mazeland, Harrie, & Huiskes, Mike
(2001) Dutch
‘but’ as a sequential conjunction: Its use as a resumption
marker. In Margret Selting & Elizabeth Couper-Kuhlen (Eds.), Studies
in interactional
linguistics (pp. 141–169). Amsterdam/Philadelphia: John Benjamins.
McCleary, Leland, & Leite, Tarcísio de Arantes
(2013) Turn-taking
in Brazilian Sign Language: Evidence from overlap. Journal of Interactional Research in
Communication
Disorders,
4.1
1, 123–154.
McIlvenny, Paul
(1995) Seeing
conversations: Analyzing sign language talk. In Paul Ten Have & George Psathas (Eds.), Situated
order: Studies in the social organization of talk and embodied
activities (pp. 129–150). Washington, DC: International Institute for Ethnomethodology and Conversation Analysis & University Press of America.
Mittelberg, Irene
(2019) Peirce’s
universal categories: On their potential for gesture theory and multimodal
analysis. Semiotica,
228
1, 193–222.
Mondada, Lorenza
(2007) Multimodal
resources for turn-taking: pointing and the emergence of possible next speakers. Discourse
Studies,
9
(2), 194–225.
(2009) Emergent
focused interactions in public places: A systematic analysis of the multimodal achievement of a common interactional
space. Journal of
Pragmatics,
41
1, 1977–1997.
(2013) Embodied
and spatial resources for turn-taking in institutional multi-party interactions: Participatory democracy
debates. Journal of
Pragmatics,
46
1, 39–68.
(2018) Multiple
temporalities of language and body in interaction: Challenges for transcribing
multimodality. Research on Language & Social
Interaction,
51
(1), 85–106.
Rossano, Fredrico
(2013) Gaze
in conversation. In Jack Sidnell & Tanya Stivers (Eds.), The
handbook of conversation
analysis (pp. 308–329). West Sussex, UK: Blackwell Publishing.
Rutter, D. R., Stephenson, G. M., Ayling, K., & White, P. A.
(1978) The
timing of looks in dyadic conversation. British Journal of Social and Clinical
Psychology,
17
(1), 17–21.
Ryttervik, Magnus
(2015) Gesten PU i svenskt teckenspråk: En studie i dess form och funktion [Palms up gesture in Swedish Sign Language: An investigation of its form and
function]. (Masters thesis), Stockholm University, Stockholm. Retrieved
from [URL]
Sacks, Harvey, Schegloff, Emanuel A., & Jefferson, Gail
(1974) A
simplest systematics for the organization of turn-taking for
conversation. Language,
50
(4), 696–735.
Schegloff, Emanuel A.
(1984) On some gestures’ relation to
talk. In J. Maxwell Atkinson & John Heritage (Eds.), Structures
of social action: studies in conversation
analysis (pp. 266–295). Cambridge, England: Cambridge University Press.
(1996) Turn organization: one
intersection of grammar and interaction. In Emanuel A. Schegloff, Elinor Ochs, & Sandra A. Thompson (Eds.), Interaction
and
grammar (pp. 52–133). Cambridge, UK: Cambridge University Press.
Schober, Michael F., & Clark, Herbert H.
(1989) Understanding by
addressees and overhearers. Cognitive
Psychology,
21
(2), 211–232.
Shaw, Emily
(2019) Gesture
in multiparty interaction. Washington, D.C.: Gallaudet University Press.
Sidnell, Jack
(2006) Coordinating
gesture, talk, and gaze in reenactments. Research on Language & Social
Interaction,
39
(4), 377–409.
Streeck, Jürgen
(1995) On
projection. In Esther N. Goody (Ed.), Social
intelligence and interaction: Expressions and implications of the social bias in human
intelligence (pp. 87–110). Cambridge: Cambridge University Press.
(2009a) Forward-gesturing. Discourse
Processes,
46
(2–3), 161–179.
Streeck, Jürgen, & Hartge, Ulrike
(1992) Previews:
Gestures at the transition place. In Aldo Di Luzio & Peter Auer (Eds.), The
contextualization of
language (pp. 135–157). Amsterdam: John Benjamins.
Streeck, Jürgen, & Jordan, J. Scott
(2009) Projection and
Anticipation: The Forward-Looking Nature of Embodied Communication. Discourse
Processes,
46
(2–3), 93–102.
Tiitinen, Sanni, & Ruusuvuori, Johanna
(2012) Engaging
parents through gaze: Speaker selection in three-party interactions in maternity
clinics. Parent Education and
Counseling,
89
1, 38–43.
Van Herreweghe, Mieke
(2002) Turn-taking
mechanisms and active participation in meetings with deaf and hearing participants in
Flanders. In Ceil Lucas (Ed.), Turn-taking,
fingerspelling, and contact in signed
languages (Vol. 81, pp. 73–103). Washington D.C.: Gallaudet University Press.
Wilkes-Gibbs, Deanne
(1997) Studying
language use as collaboration. In Gabriele Kasper & Eric Kellerman (Eds.), Communication
strategies: Psycholinguistic and sociolinguistic
perspectives (pp. 238–274). London/New York: Addison Wesley Longman Limited.