This chapter discusses the findings of a study that used mobile eye-tracking in the context of a naturally occurring interpreter-mediated dialogue. This type of interaction is particularly interesting for the study of gaze and other (non-) verbal resources, as the primary interlocutors have no or limited access to each other’s languages and have to rely on the interpreter and other modalities for the successful accomplishment of the social interaction. The aim of the study was to examine the role of gaze in the multimodal displays of recipiency (backchannel responses) in one interpreter-mediated therapeutic encounter. Our study reveals asymmetrical gaze patterns of the three participants while listening to the ongoing talk. The analysis also shows that backchannel responses are found on different levels of communication and between all participants in an interpreter-mediated conversation. Moreover, this contribution demonstrates how eye-tracking technology can help us reveal specific micro-events between the participants in the conversation, which can strengthen our understanding of the interpreter-mediated talk as a joint action.
Allwood, J. & Cerrato, L. (2003). A study of gestural feedback expressions. In P. Paggioet al. (Eds.), Proceedings of the First Nordic Symposium on Multimodal Communication, 7–22.
Bavelas, J., Coates, L. & Johnson, T. (2002). Listener responses as a collaborative process: The role of gaze. Journal of Communication, 52, 566–580.
Bertrand R., Ferré, G., Blache, P., Espesser, R. & Rauzy, S. (2007). Backchannels revisited from a multimodal perspective. Proceedings of Auditory-Visual Speech Processing 2007 (AVSP2007) 2007, Kasteel Groenendaal, Hilvarenbeek, The Netherlands.
Bot, H. (2005). Dialogue Interpreting in Mental Health. Amsterdam and New York: Rodopi Publishers.
Brône, G. and B. Oben. (2015). InSight Interaction. A multimodal and multifocal dialogue corpus, Language Resources and Evaluation, 49, 195–214.
Clark, H. H. (1996). Using Language. Cambridge: Cambridge University Press.
Clark, H. and Brennan, S. (1991). Grounding in communication. In L. B. Resnick, J. M. Levine, & S.D. Teasley (Eds.), Perspectives on socially shared cognition (pp.127–149). Washington: APA Books.
Davitti, E. & Pasquandrea, S. (2016). Embodied participation: What multimodal analysis can tell us about interpreter-mediated encounters in pedagogical settings. Journal of Pragmatics, 107, 105–128.
De Kok, I. & Heylen D. (2012). Analyzing nonverbal listener responses using parallel recordings of multiple listeners. Cognitive Processing, 13, 499–506.
Dittmann, A. & Llewellyn, L. (1968). Relationship between vocalizations and head nods as listener responses. Journal of Personality and Social Psychology, 9(2), 79–84.
Drummond, K. & Hopper, R. (1993). Back channels revisited. Acknowledgment tokens and speakership incipiency. Research on Language and Social Interaction, 26, 157–178.
Duchowski, A. (2007). Eye Tracking Methodology: Theory and Practice. London: Springer-Verlag.
Gavioli, L. (2012). Minimal responses in interpreter-mediated medical talk. In L. Baraldi & C. Gavioli (Eds.), Coordinating Participation in Dialogue Interpreting (pp.201–228). Amsterdam/ Philadelphia: Benjamins Publishing.
Gerhardt, J. & Beyerle, S. (1997). “What if Socrates had been a woman? The therapist’s use of acknowledgment tokens (mm-hm, yeah, sure, right) as a nonreflective means of intersubjective involvement”. Contemporary Psychoanalysis, 33(2), 367–410.
Goffman, E. (1981). Forms of Talk. Philadelphia: University of Pennsylvania Press.
Goodwin, C. (1980). Restarts,pauses, and the achievement of a state of mutual gaze at turn-beginning. Sociological Inquiry, 50, 272–302.
Goodwin, C. (1981). Conversational Organization. Interaction between Speakers and Hearers. New York, London.
Gullberg, M. & Kita, S. (2009). Attention to speech-accompanying gestures: Eye movements and information uptake. Journal of Nonverbal Behaviour, 33, 251–277.
Holler, J. & Kendrick, K. H. (2015). Unaddressed participants’ gaze in multi-person interaction: Optimizing recipiency. Frontiers in Psychology, 6, 1–14.
Edmondson, W. J. (1986). Cognition, conversing and interpreting. In J. House, & S. Blum-Kulka (Eds.), Interlingual and Intercultural Communication (pp.129–138). Tübingen: Gunter Narr.
Jokinen, K. (2010). Non-verbal signals for turn-taking & feedback.
Proceedings of 7th International Conference on Language Resources & Evaluation (LREC) International Universal Communication Symposium
.
Kendon, A. (1967). Some functions of gaze-direction in social interaction. Acta Psychologica, 26, 22–63.
Krystallidou, D. (2014). Gaze and body orientation as an apparatus for patient inclusion into exclusion from a patient-centred framework of communication. The Interpreter and Translator Trainer, 8(3), 399–417.
Lang, R. (1978). Behavioral aspects of liaison interpreters in Papua New Guinea: some preliminary observations. In D. Gerver & H. W. Sinaiko (Eds.), Language Interpretation and Communication (pp.231–244). New York/London: Plenum Press.
Lerner, G. H. (2003). Selecting next speaker: The context-sensitive operation of a context-free organization. Language in Society, 32, 177–201.
Linell, P., Wadensjö, C. & Jönsson, L. (1992). Establishing Communicative Contact through a Dialogue Interpreter. In A. Grindsted, & J. Wagner (Eds.), Communication for Specific Purposes – Fachsprachliche Kommunikation (pp.125–142). Tübingen: Gunter Narr Verlag.
Oben, B. & Brône, G. (2015). What you see is what you do: On the relation between gaze and gesture in multimodal alignment. Language and Cognition, 7(4), 546–562.
Pasquandrea, S. (2011). Managing multiple actions through multimodality: Doctors’ involvement in interpreter-mediated interactions. Language in Society, 40(4), 455–481.
Pasquandrea, S. (2012). Co-constructing dyadic sequences in healthcare interpreting: A multimodal account. New Voices in Translation Studies, 8, 132–157.
Peräkylä, A. (2013). Conversation Analysis in Psychotherapy. In J. Sidnell & T. Stivers (Eds.), The Handbook of Conversation Analysis (pp.251–274). Malden: Wiley-Blackwell.
Rea, L. M. & Parker, R. A. (1992). Designing and conducting survey research. San Francisco, CA: Jossey– Bass.
Rossano, F. (2013). Gaze in Conversation. In J. Sidnell & T. Stivers (Eds.), The Handbook of Conversation Analysis (pp.308–329). Oxford: Wiley-Blackwell.
Sacks H., Schegloff E. A. & Jefferson, G.. (1974). A simplest systematics for the organization of turn-taking in conversation. Language, 50, 696–735.
Stivers, T. (2008). Stance, alignment and affiliation during story telling: when nodding is a token of preliminary affiliation. Research on Language in Social Interaction, 41, 29–55.
Stivers, T. & Rossano, F. (2010). Mobilizing Response. Research on Language and Social Interaction, 43(1), 3–31.
Wadensjö, C. (1998). Interpreting as interaction. London and New York: Longman.
Wadensjö, C. (2001). Interpreting in Crisis: The Interpreters Position in Therapeutic Encounters. In I. Mason (Ed.), Triadic Exchanges. Studies in Dialogue Interpreting (pp.71–85). Manchester: St. Jerome Publishing.
Wittenburg, P., H. Brugman, A. Russel, A. Klassmann & Sloetjes, H. (2006). ELAN: a Professional Framework for Multimodality Research. In: Proceedings of LREC 2006, Fifth International Conference on Language Resources and Evaluation.
Yngve, V. H. (1970). On getting a word in edgewise. In Papers from the Sixth Regional Meeting of the Chicago Linguistic Society (pp.567–577). Chicago: Chicago Linguistic Society.
This list is based on CrossRef data as of 11 january 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.