Article published In:
GestureVol. 21:1 (2022) ► pp.1–27
Indexing turn-beginnings in Norwegian Sign Language conversation
It is well known that signers and speakers routinely produce finger points during interaction. While the referential functions of such finger points have received great attention from researchers, they are also used to manage interactions between interlocutors. These functions are less understood and have received less research focus. The current study helps to redress this gap in the literature by investigating how finger pointing is used to index and coordinate turn-beginnings in a corpus of 11 semi-naturalistic (Norwegian) signed language conversations, involving between two to five signers (3.4 hours of signing). The data was initially annotated in ELAN and then further qualitative analysis was conducted. This investigation revealed that finger pointing effectively indexes previous and upcoming discourse, thereby binding sequences of conversational moves and guiding their trajectory, helping signers to coordinate turn transitions and interaction as it unfolds.
Keywords: pointing, indexicality, interaction, turn-taking, Norwegian Sign Language
Article outline
- Coordinating and collaborating in multimodal conversation
- Finger points as symbolic indexicals
- Multimodal turn-beginnings in spoken and signed languages
- Turn-beginnings, pre-beginnings, and presegments
- Eye gaze, pointing, and other bodily actions during turn-beginnings
- Data and analysis for the current study
- Designing turn-beginnings and indexing meanings across moves in Norwegian Sign Language conversations with finger pointing
- Responding to a question
- Responding to a comment by an interlocutor
- Pointing to coordinate turn trajectory and to collaborate on a joint word search
- Discussion
- Conclusion
- Acknowledgements
- Notes
- Abbreviations
-
References
References
Auer, P.
(2005) Projection
in interaction and projection in grammar. Text – Interdisciplinary Journal for the Study of
Discourse,
25
(1), 7–36. 
(2018) Gaze,
addressee selection and turn-taking in three-party
interaction. In G. Brône, & B. Oben (Eds.), Eye-tracking
in Interaction: Studies on the role of eye gaze in
dialogue (pp. 197–232). Amsterdam: John Benjamins.
Baker, C.
(1977) Regulators
and turn-taking in American Sign Language discourse. In L. A. Friedman (Ed.), On
the other hand: New perspectives on American Sign
Language (pp. 215–236). New York: Academic Press.
Bavelas, J. B.
(1994) Gestures
as part of speech: methodological implications. Research on Language & Social
Interaction,
27
(3), 201–221.
Bavelas, J. B., Coates, L., & Johnson, T.
(2002) Listener
responses as a collaborative process: The role of gaze. Journal of
Communication,
52
(3), 566–580.
Bavelas, J. B., Chovil, N., Lawrie, D. A., & Wade, A.
(1992) Interactive
gestures. Discourse
Processes,
15
(4), 469–489.
Beattie, G. W.
(1978) Floor
apportionment and gaze in conversational dyads. British Journal of Social and Clinical
Psychology,
17
(1), 7–15.
Beukeleers, I.
(2020) On
the role of eye gaze in Flemish Sign Language: A multifocal eye-tracking study on the phenomena of online turn processing and
depicting. Leuven: KU Leuven PhD dissertation.
Brône, G., Oben, B., Jehoul, A., Vranjes, J., & Feyaerts, K.
(2017) Eye
gaze and viewpoint in multimodal interaction management. Cognitive
Linguistics,
28
(3), 449–483.
Cibulka, P.
(2015) When
the hands do not go home: A micro-study of the role of gesture phases in sequence suspension and
closure. Discourse
Studies,
17
(1), 3–24.
Clark, H. H.
(1996) Using
language. Cambridge: Cambridge University Press.
(2003) Pointing
and placing. In S. Kita (Ed.), Where
language, culture, and cognition
meet (pp. 243–268). Mahwah, NJ: Lawrence Erlbaum Associates.
(2005) Coordinating
with each other in a material world. Discourse
Studies,
7
(4–5), 507–525.
Clark, H. H., & Brennan, S. E.
(1991) Grounding
in communication. In L. B. Resnick, J. M. Levine, & S. D. Teasley (Eds.), Perspectives
on socially shared
cognition (pp. 127–149). Washington, DC: American Psychological Association.
Clark, H. H., & Wilkes-Gibbs, D.
(1986) Referring
as a collaborative
process. Cognition,
22
1, 1–39.
Cormier, K., Schembri, A., & Woll, B.
(2013) Pronouns
and pointing in sign
languages. Lingua,
137
1, 230–247.
Deppermann, A.
(2013) Turn-design
at turn-beginnings: Multimodal resources to deal with tasks of turn-construction in
German. Journal of
Pragmatics,
46
(1), 91–121.
Deppermann, A., & Streeck, J.
(2018) The
body in interaction: Its multiple modalities and
temporalities. In A. Deppermann, & J. Streeck (Eds.), Time
in embodied interaction: Synchronicity and sequentiality of multimodal
resources (pp. 1–29). Amsterdam: John Benjamins.
De Stefani, E., & Horlacher, A.-S.
(2008) Topical
and sequential backlinking in a French radio phone-in program: Turn shapes and sequential
placements. Pragmatics,
18
(3), 381–406.
de Vos, C., Torreira, F., & Levinson, S. C.
(2015) Turn-timing
in signed conversations: coordinating stroke-to-stroke turn boundaries. Frontiers in
Psychology,
6
(268).
Dressel, D.
(2020) Multimodal
word searches in collaborative storytelling: On the local mobilization and negotiation of
coparticipation. Journal of
Pragmatics,
170
1, 37–54.
Duncan, S. Jr.
(1972) Some
signals and rules for taking speaking turns in conversations. Journal of Personality and Social
Psychology,
23
(1), 283–292.
Enfield, N. J.
(2009) The
anatomy of meaning: Speech, gesture, and composite
utterances. Cambridge: Cambridge University Press.
Engberg-Pedersen, E.
(2003) From
pointing to reference and predication: pointing signs, eyegaze, and head and body orientation in Danish Sign
Language. In S. Kita (Ed.), Pointing:
Where language, culture and cognition
meet (pp. 269–292). Mahwah, NJ: Lawrence Erlbaum Associates.
Ferrara, L.
(2020) Some
interactional functions of finger pointing in signed language conversations. Glossa: A journal
of general
linguistics,
5
(1), 1–26.
Ferrara, L. and Bø, V.
(2022) Norwegian
Sign Language Corpus – Pilot Corpus (Conversations). Common Language Resources and Technology Infrastructure Norway (CLARINO) Bergen Repository. Available at [URL] (last
access 23 April
2023).
Ferrara, L., & Ringsø, T.
(2021) Norwegian
Sign Language corpus – Depicting Perspective. Common Language Resources and Technology Infrastructure Norway (CLARINO) Bergen Repository. Available at [URL] (last
access 23 April
2023).
Ford, C. E., Fox, B. A., & Thompson, S. A.
Girard-Groeber, S.
(2015) The
management of turn transition in signed interaction through the lens of overlaps. Frontiers in
Psychology,
6
1, 741.
(2018) Participation
by hard-of-hearing students in integration classroms: Facets of interactional
competence. Berlin: Frank & Timme.
Goodwin, C.
(1981) Conversational
organization: Interaction between speakers and hearers. New York: Academic Press.
(1986) Gestures
as a resource for the organization of mutual
orientation. Semiotica,
62
(1–2), 29–49.
(2000) Action
and embodiment within situated human interaction. Journal of
Pragmatics,
32
1, 1489–1522.
(2002) Time
in action. Current
Anthropology,
43
(S4).
Goodwin, M. H., & Goodwin, C.
(1986) Gesture
and coparticipation in the activity of searching for a
word. Semiotica,
62
(1–2), 51–75.
Hayashi, M.
(2005) Joint
turn construction through language and the body: Notes on embodiment in coordinated participation in situated
activities. Semiotica,
156
(1–4), 21–53.
Heritage, J.
(1984a) Garfinkel
and ethnomethodology. Cambridge: Polity Press.
(1984b) A
change-of-state token and aspects of its sequential
placement. In J. M. Atkinson, & J. C. Heritage (Eds.), Structures
of social action: Studies in conversation
analysis (pp. 299–345). Cambridge: Cambridge University Press.
Holler, J., Turner, K., & Varcianna, T.
(2013) It’s
on the tip of my fingers: Co-speech gestures during lexical retrieval in different social
contexts. Language and Cognitive
Processes,
28
(10), 1509–1518.
Iwasaki, S.
(2009) Initiating
interactive turn spaces in Japanese conversation: Local projection and collaborative
action. Discourse
Processes,
46
(2–3), 226–246.
Johnston, T.
(2013a) Towards
a comparative semiotics of pointing actions in signed and spoken
languages. Gesture,
13
(2), 109–142.
(2013b) Formational
and functional characteristics of pointing signs in a corpus of Auslan (Australian sign language): Are the data sufficient to
posit a grammatical class of ‘pronouns’ in Auslan? Corpus Linguistics and Linguistic
Theory,
9
(1), 109–159.
Kalma, A.
(1992) Gazing
in triads: A powerful signal in floor apportionment. British Journal of Social
Psychology,
31
1, 21–39.
Keevallik, L.
(2018) What
does embodied interaction tell us about grammar? Research on Language & Social
Interaction,
51
(1), 1–21.
Kendon, A.
(1967) Some
functions of gaze-direction in social interaction. Acta
Psychological,
26
1, 22–63.
(2004) Gesture:
Visible action as utterance. Cambridge: Cambridge University Press.
Kidwell, M.
(2013) Framing,
grounding, and coordinating conversational interaction: Posture, gaze, facial expression, and movement in
space. In C. Müller, A. Cienki, E. Fricke, S. H. Ladewig, D. McNeill, & J. Bressem (Eds.), Body –
Language –
Communication (Vol. I1, pp. 100–113). Berlin: De Gruyter Mouton.
Kita, S.
(Ed.) (2003) Pointing:
Where language, culture, and cognition meet. Mahwah, NJ: Lawrence Erlbaum Associates.
Krauss, R. M., & Fussell, S. R.
(1991) Constructed
shared communicative environments. In L. B. Resnick, J. M. Levine, & S. D. Teasley (Eds.), Perspectives
on socially shared
cognition (pp. 172–200). Washington, DC: American Psychological Association.
Kääntä, L.
(2012) Teachers’
embodied allocations in instructional interaction. Classroom
Discourse,
3
(2), 166–186.
Lackner, A.
(2009) Turn-Taking
und Dialogstruktur in der Oesterreichischen Gebärdensprache. Eine Gesprächsanalyse der Salzburger
Variante, Vol. 811. Hamburg: Das Zeichen.
Lepeut, A.
(2020) Framing
language through gesture: Palm-up, index finger-extended gestures, and holds in spoken and signed language interactions in
French-speaking and signing
Belgium. Namur: University of Namur PhD dissertation.
Lerner, G. H.
(2003) Selecting
Next Speaker: The Context-Sensitive Operation of a Context-Free Organization. Language in
society,
32
(2), 177–201.
Li, X.
Liddell, S. K.
(2003) Grammar,
gesture, and meaning in American Sign
Language. Cambridge: Cambridge University Press.
Lindström, J.
(2006) Grammar
in the service of interaction: Exploring turn organization in Swedish. Research on Language
& Social
Interaction,
39
(1), 81–117.
Linell, P.
(2009) Rethinking
language, mind, and world dialogically. Charlotte, NC: Information Age Publishing.
Local, J.
(2004) Getting
back to prior talk: and-uh(m) as a back-connecting device in British and American
English. In E. Couper-Kuhlen, & C. E. Ford (Eds.), Sound
patterns in interaction: Cross-linguistic studies from
conversation (pp. 377–400). Amsterdam: John Benjamins.
Martinez, L. B.
(1995) Turn-taking
and eye gaze in sign conversations between Deaf Filipinos. In C. Lucas (Ed.), Sociolinguistics
in Deaf
communities (pp. 272–306). Washington, D.C.: Gallaudet University Press.
Mazeland, H., & Huiskes, M.
(2001) Dutch
‘but’ as a sequential conjunction: Its use as a resumption
marker. In M. Selting, & E. Couper-Kuhlen (Eds.), Studies
in interactional
linguistics (pp. 141–169). Amsterdam: John Benjamins.
McCleary, L., & de Arantes Leite, T.
(2013) Turn-taking
in Brazilian Sign Language: Evidence from overlap. Journal of Interactional Research in
Communication
Disorders,
4.1
1, 123–154.
McIlvenny, P.
(1995) Seeing
conversations: Analyzing sign language talk. In P. Ten Have, & G. Psathas (Eds.), Situated
order: Studies in the social organization of talk and embodied
activities (pp. 129–150). Washington, DC: International Institute for Ethnomethodology and Conversation Analysis & University Press of America.
Mittelberg, I.
(2019) Peirce’s
universal categories: On their potential for gesture theory and multimodal
analysis. Semiotica,
228
1, 193–222.
Mondada, L.
(2007) Multimodal
resources for turn-taking: pointing and the emergence of possible next speakers. Discourse
Studies,
9
(2), 194–225.
(2009) Emergent
focused interactions in public places: A systematic analysis of the multimodal achievement of a common interactional
space. Journal of
Pragmatics,
41
1, 1977–1997.
(2013) Embodied
and spatial resources for turn-taking in institutional multi-party interactions: Participatory democracy
debates. Journal of
Pragmatics,
46
1, 39–68.
(2018) Multiple
temporalities of language and body in interaction: Challenges for transcribing
multimodality. Research on Language & Social
Interaction,
51
(1), 85–106.
Rossano, F.
(2013) Gaze
in conversation. In J. Sidnell, & T. Stivers (Eds.), The
handbook of conversation
analysis (pp. 308–329). Hoboken: Blackwell Publishing.
Rutter, D. R., Stephenson, G. M., Ayling, K., & White, P. A.
(1978) The
timing of looks in dyadic conversation. British Journal of Social and Clinical
Psychology,
17
(1), 17–21.
Ryttervik, M.
(2015) Gesten PU i svenskt teckenspråk: En studie i dess form och funktion [Palms up gesture in Swedish Sign Language: An investigation of its form and
function]. Stockholm: Stockholm University MA thesis. Available at [URL] (last
access 23 April
2023).
Sacks, H., Schegloff, E. A., & Jefferson, G.
(1974) A
simplest systematics for the organization of turn-taking for
conversation. Language,
50
(4), 696–735.
Schegloff, E. A.
(1984) On
some gestures’ relation to talk. In J. M. Atkinson, & J. Heritage (Eds.), Structures
of social action: studies in conversation
analysis (pp. 266–295). Cambridge: Cambridge University Press.
(1996) Turn
organization: one intersection of grammar and interaction. In E. A. Schegloff, E. Ochs, & S. A. Thompson (Eds.), Interaction
and
grammar (pp. 52–133). Cambridge: Cambridge University Press.
Schober, M. F., & Clark, H. H.
(1989) Understanding
by addressees and overhearers. Cognitive
Psychology,
21
(2), 211–232.
Shaw, E.
(2019) Gesture
in multiparty interaction. Washington, D.C.: Gallaudet University Press.
Sidnell, J.
(2006) Coordinating
gesture, talk, and gaze in reenactments. Research on Language & Social
Interaction,
39
(4), 377–409.
Streeck, J.
(1995) On
projection. In E. N. Goody (Ed.), Social
intelligence and interaction: Expressions and implications of the social bias in human
intelligence (pp. 87–110). Cambridge: Cambridge University Press.
(2009a) Forward-gesturing. Discourse
Processes,
46
(2–3), 161–179.
Streeck, J., & Hartge, U.
(1992) Previews:
Gestures at the transition place. In A. Di Luzio, & P. Auer (Eds.), The
contextualization of
language (pp. 135–157). Amsterdam: John Benjamins.
Streeck, J., & Jordan, J. S.
(2009) Projection
and anticipation: The forward-looking nature of embodied communication. Discourse
Processes,
46
(2–3), 93–102.
Tiitinen, S., & Ruusuvuori, J.
(2012) Engaging
parents through gaze: Speaker selection in three-party interactions in maternity
clinics. Parent Education and
Counseling,
89
1, 38–43.
Van Herreweghe, M.
(2002) Turn-taking
mechanisms and active participation in meetings with deaf and hearing participants in
Flanders. In C. Lucas (Ed.), Turn-taking,
fingerspelling, and contact in signed
languages (Vol. 81, pp. 73–103). Washington D.C.: Gallaudet University Press.
Wilkes-Gibbs, D.
(1997) Studying
language use as collaboration. In G. Kasper, & E. Kellerman (Eds.), Communication
strategies: Psycholinguistic and sociolinguistic
perspectives (pp. 238–274). London: Addison Wesley Longman.