847025958
03
01
01
JB
John Benjamins Publishing Company
01
JB code
BTL 149 Eb
15
9789027261809
06
10.1075/btl.149
13
2019043190
DG
002
02
01
BTL
02
0929-7316
Benjamins Translation Library
149
01
Linking up with Video
Perspectives on interpreting practice and research
01
btl.149
01
https://benjamins.com
02
https://benjamins.com/catalog/btl.149
1
B01
Heidi Salaets
Salaets, Heidi
Heidi
Salaets
KU Leuven
2
B01
Geert Brône
Brône, Geert
Geert
Brône
KU Leuven
01
eng
246
vi
240
LAN023000
v.2006
CFP
2
24
JB Subject Scheme
TRAN.INTERP
Interpreting
24
JB Subject Scheme
TRAN.TRANSL
Translation Studies
06
01
This volume is intended as an innovating reader for both interpreting practitioners as well as scholars, engaging with the multifaceted question addressed in the title “Why linking up with video?”. The chapters in this volume deal with this question from different perspectives. On the one hand, the volume continues the ongoing discussion on the pros and cons of video-based interaction for the interpreting profession, exploring the implications and applications when interpreters and their clients <i>link up</i> through video technology. On the other hand, the chapters also explore the potential of video technology for research on interpreting, hence raising the question in which way high-quality video recordings of interpreters in the booth, participants involved in interpreter-mediated talk, etc. may be instrumental in gaining new insights. In this sense, the volume strongly ties in with the fast-growing field of multimodal (interaction) studies, which makes use of video recordings to study the relationship between verbal and nonverbal resources, such as gestures, postural orientation, gaze and head movements, in the construction of meaning in communication.
05
Studies of this kind can provide much needed data on how interpreters manage turn-taking both verbally and non-verbally in face-to-face situations and, in turn, inform the on-going development of distance interpreting practices to overcome the current limitations of video-conferencing technology. Published in early 2020, the book has been made all the more relevant by the on-going COVID-19 pandemic, which has made video-mediated communication an everyday occurrence for all of us, whether in monolingual or in interpreter-mediated multilingual settings.
Annalisa Sandrelli, Università degli Studi Internazionali di Roma - UNINT, in Journal of Pragmatics 176 (2021).
05
I recommend this volume to all researchers, educators and students of interpreting who are interested in the ways in which video can be linked to interpreting practice and interpreting research. I would also like to see an updated edition for a post-pandemic world where, first, we can evaluate the long-lasting impact of Covid-19 on the use of technology in interpreting and, second, we can compare the changes so as to gauge the extent to which the use of video has become a legacy that is here to stay.
Jemina Napier, Heriot-Watt University, in Interpreting 24:1 (2022).
04
09
01
https://benjamins.com/covers/475/btl.149.png
04
03
01
https://benjamins.com/covers/475_jpg/9789027204653.jpg
04
03
01
https://benjamins.com/covers/475_tif/9789027204653.tif
06
09
01
https://benjamins.com/covers/1200_front/btl.149.hb.png
07
09
01
https://benjamins.com/covers/125/btl.149.png
25
09
01
https://benjamins.com/covers/1200_back/btl.149.hb.png
27
09
01
https://benjamins.com/covers/3d_web/btl.149.hb.png
10
01
JB code
btl.149.01bro
1
11
11
Introduction
1
01
Introduction
Why linking up with video?
1
A01
Geert Brône
Brône, Geert
Geert
Brône
KU Leuven
2
A01
Heidi Salaets
Salaets, Heidi
Heidi
Salaets
KU Leuven
10
01
JB code
btl.149.02poc
13
45
33
Chapter
2
01
Chapter 1. “Going video”
Mediality and multimodality in interpreting
1
A01
Franz Pöchhacker
Pöchhacker, Franz
Franz
Pöchhacker
University of Vienna
01
This chapter explores the link between interpreting and video mainly by engaging in a conceptual analysis drawing on insights from social semiotics and communication studies. Departing from an understanding of speech as a semiotic mode in the oral-aural modality, the development of interpreting practices since the early twentieth century is reviewed with respect to the use of technology as a sign-conveying medium. Special emphasis is given to the introduction of “telephonic” interpreting and its implications for “visibility” in interpreter-mediated communication before the introduction of audiovisual transmission systems. Based on the examination of some existing models of multimodal language use, and further theoretical reflection, a conceptual framework is suggested to account more explicitly for different medium-based forms of interpreting and for the communicative dynamics shaped by the mediality of these practices. On this foundation, video is discussed as a technological medium supporting novel professional practices as well as research approaches.
10
01
JB code
btl.149.03bra
47
78
32
Chapter
3
01
Chapter 2. “You are just a disembodied voice really”
Perceptions of video remote interpreting by legal interpreters and police officers
1
A01
Sabine Braun
Braun, Sabine
Sabine
Braun
University of Surrey
01
This contribution is devoted to the voices of users of video remote interpreting (VRI) in a particular setting, namely legal interpreters and police officers. Focusing on an aspect that has received little attention to date, viz. the interpreters’ and legal stakeholders’ perceptions of VRI as a novel configuration in the legal setting, we use the Social Construction of Technology (SCOT) as a theoretical framework to analyse a set of interviews that were conducted with interpreters and police officers after they had completed a simulated VRI session. As a first step, the participants were prompted to compare this simulated experience to their real-life experience to check the degree of reality of the simulated encounters. Next, they were asked to talk about attitudes towards VRI and to reflect on their experience with VRI during the simulation. Among the key outcomes of this investigation is that the two social groups – police officers and interpreters – have different views, but also that there is a considerable degree of variation among the interpreters, indicating a low degree of stabilisation of VRI as a concept and practice among the interpreters.
10
01
JB code
btl.149.04boe
79
105
27
Chapter
4
01
Chapter 3. Remote interpreting in dialogic settings
A methodological framework for investigating the impact of telephone and video interpreting on quality in healthcare interpreting
1
A01
Esther de Boe
Boe, Esther de
Esther
de
Boe
University of Antwerp
01
Just as remote communication by telephone and through the internet has become an integral part of our daily lives and professional environments, it has also gained a firm footing in the practice of interpreting. In medical settings, remote interpreting is increasingly being welcomed as a means to enable better access to healthcare and increased cost-efficiency. Studies on healthcare interpreting over the telephone or by video link have generated predominantly positive results concerning the use of remote modes of interpreting. However, most of these studies originate from medical science and measure user satisfaction with the interpreting mode (face-to-face, telephone interpreting or video interpreting) rather than the possible impact of the different modes on interpreting quality. In interpreting studies, empirical research investigating remote interpreting in medical settings is scarce, but studies on remote interpreting in settings such as conference, business and legal interpreting indicate that the remote conditions are at the very least perceived by users to influence the interpreter’s performance and the communication.
<br />In this chapter, we introduce a methodological framework for a systematic assessment of the quality of remote interpreting and the effectiveness of the communication in dialogic healthcare settings, drawing on methods from both interpreting studies and medicine. Central to the research design is a corpus of simulations of interpreter-mediated doctor – patient encounters, performed in the modes face-to-face, telephone and video interpreting. These simulations were submitted to a comparative, multi-modal analysis, the results of which were triangulated with the subjective assessment by the participants.
<br />We will first touch upon research issues and caveats relevant to remote healthcare interpreting, emerging from medical studies and interpreting studies. Subsequently, the research design of the present study will be elaborated, followed by a discussion of the preliminary findings of the first series of simulations. Although the data analysis is work in progress, the first outcomes suggest that the use of technology in interpreter-mediated health care impacts mostly on the interactional dynamics of the communication.
10
01
JB code
btl.149.05lee
107
125
19
Chapter
5
01
Chapter 4. Role-space in VRS and VRI
1
A01
Robert G. Lee
Lee, Robert G.
Robert G.
Lee
University of Central Lancashire
01
This chapter explores issues related to Video Relay Services (VRS), a telephone access service for Deaf people and Video Remote Interpreting (VRI). First there is a discussion of Deaf people and specifically users of sign language and how they negotiate remote communicative interactions (initially without direct access to audio-only technologies such as the telephone). Similarities and differences between VRS services for Deaf people and remote interpreted interactions (which can involve signed and spoken or solely spoken language interlocutors) are then explored.
<br />The concept of role-space (Llewellyn-Jones and Lee 2014) is then introduced as a lens through which these interactions can be analysed. A discussion of VRI situations through the role-space dimensions of interaction management, participant alignment and presentation of self is presented. Finally, recommendations for factors to be considered to make VRI situations more effective are presented.
10
01
JB code
btl.149.06hey
127
149
23
Chapter
6
01
Chapter 5. The importance of video recordings in signed language interpreting research
1
A01
Isabelle Heyerick
Heyerick, Isabelle
Isabelle
Heyerick
University of Warwick KU Leuven?
01
In signed language interpreting studies, researchers have devoted attention to the role of video recordings in data collection since the very beginning. Given the visual nature of signed languages, such recordings are imperative in order to investigate various aspects of signed language interpreting such as for instance interpreting strategies, interpreting quality, and interactional aspects of the interpreter mediated communication.
<br />This differs from studies looking at spoken language interpreting, where traditionally audio recordings were and to some extent still are the primary source of data in research.
<br />In this chapter I claim that, in line with recent shifts in the understanding of communication and interaction (Mondada 2011), any research on interpreting – which is a communicative act – should be based on multimodal data, including the visual, audiological, gestural and any other layers of interaction.
<br />As a way of introduction, the chapter gives an overview of how and to which extent video recordings as a data collection tool have been used in three research fields in spoken and signed languages; spoken interaction studies, sign linguistics and interpreting studies, drawing primarily on Erickson (2011), Lucas et al. (2013), and Napier & Leeson (2016).
<br />This chapter goes on to discuss the advantages and possible challenges of the use of video as a recording tool in signed language interpreting research, based on a case study on interpreting strategies used by Flemish Sign Language interpreters (Heyerick forthcoming). The same example also illustrates the role of video as an elicitation tool within signed language interpreting research.
<br />While the chapter explores the benefits, opportunities and potential obstacles of working with video in research on signed language interpreting, I argue that including video recordings in any research examining communication and/or interaction has the potential to provide very rich data. Video allows for interactive events to be registered in their full multimodal effect and to be regarded and researched as multimodal events (Mondada 2011). This approach can broaden the understanding of human interaction in any field of study.
10
01
JB code
btl.149.07gal
151
179
29
Chapter
7
01
Chapter 6. Gesture functions and gestural style in simultaneous interpreting
1
A01
Elena Zagar Galvão
Zagar Galvão, Elena
Elena
Zagar Galvão
01
In recent decades, the advent of affordable digital video-recording technology and freely downloadable specialised software for storing, viewing, editing, and annotating video and audio has contributed to a reassessment of the importance of the relation between the body, language, and communication in a variety of scientific domains, such as psychology, linguistics, anthropology, sociology, cognitive sciences and several others (Müller et al 2013, 2014). One of the consequences has also been the emergence of a new interdiscipline – Gesture Studies – entirely devoted to the investigation of the gestural modality in human interaction. However, while gesture and its relation to speech have been examined in face-to-face conversations, oral narratives, public speaking, task-based discourse, as well as other types of communicative situations, only a handful of studies to date have documented, analysed and described the range and functions of the gestures produced by conference interpreters in the booth. One of the possible reasons for this lack of attention to the body in interpreting has to do with the emphasis on decontextualised cognitive processes in the simultaneous interpreting (SI) mode, which dominated the academic field of conference interpreting research since its beginning in the 1950s until the mid-1990s (Diriker 2004: 7; Gile 1998: 70; Pöchhacker 1995: 33). In addition, the historical shift from consecutive to simultaneous interpreting in conference settings and the now more generalised use of remote interpreting resulted in a removal of the interpreter’s body from the public eye. All this, coupled with the still prevalent notion that simultaneous interpreting (SI) is an essentially verbal and monologic endeavour, as well as the difficulty in finding interpreters willing to be filmed and/or securing permission for filming, led to a dearth of multimodal data in Conference Interpreting Research. The present volume constitutes a first clear attempt at redressing this imbalance by ‘linking up with video’, while this specific chapter hopes to start filling this gap by contributing to a better understanding of the role played by gesture in SI discourse and by introducing the reader to a qualitative microanalytical approach to gestural behaviour that may be applied to the study of other modes of interpreting.
<br />After defining gesture and its structural properties within the framework of an integrated multimodal view of language and communication and introducing some working concepts from the field of Gesture Studies, the chapter presents a video-based quasi-experimental study with four professional conference interpreters working simultaneously from English into European Portuguese (henceforth ‘Portuguese’). The study constitutes the first part of a larger research project which explores gesture production in SI by triangulating the data, methods and results from the open quasi-experiment described here, an observational field study with the same subjects, and in-depth semi-structured interviews with a larger number of interpreters. Due to space limitations, however, this chapter will only cover the first investigation. The findings offer an insight into the rich range of gestures deployed in the booth and shed some light on the multimodal nature of meaning-making in simultaneous interpreting.
10
01
JB code
btl.149.08kry
181
202
22
Chapter
8
01
Chapter 7. <i>Going video</i>: Understanding interpreter-mediated clinical communication through the video lens
1
A01
Demi Krystallidou
Krystallidou, Demi
Demi
Krystallidou
KU Leuven
01
Most of the research on dialogue interpreting has been conducted by taking only verbal interaction into account. Although the existing research has managed to shed some light on the complexity of interpreter-mediated interaction, there is still a lot to be unravelled by adopting a multimodal stance and including non-verbal cues in the analysis of verbal interaction. This study builds on the findings of recent research by Davitti (2013); Davitti & Pasquandrea (2017); Krystallidou (2013, 2014, 2016); Pasquandrea (2011, 2012). In this study, I draw on data taken from a corpus of authentic video-recorded interpreter-mediated consultations at a large urban hospital in Belgium. By applying multimodal analysis to data and comparing it to analysis based on transcripts alone, I highlight a set of interactional dynamics that touch upon new aspects of the complexity of interpreter-mediated interaction and which a transcript-based analysis alone would have failed to capture. It will be shown that participants’ gaze, gestures and body orientation, along with verbal interaction, are used by the interpreter as semiotic resources that do affect the doctor’s and the patient’s participation in interaction. However, the weight the interpreter seems to attach to the primary participants’ semiotic resources seems to be subject to the participation status of each participant.
10
01
JB code
btl.149.09vra
203
233
31
Chapter
9
01
Chapter 8. Eye-tracking in interpreter-mediated talk
From research to practice
1
A01
Jelena Vranjes
Vranjes, Jelena
Jelena
Vranjes
University of Ghent
2
A01
Geert Brône
Brône, Geert
Geert
Brône
KU Leuven
01
A starting point for a multimodal analysis of interpreter-mediated interaction is the discussion on the pros and cons of new technologies especially for new forms of distant, remote or offsite interpreting. More specifically, in this contribution is argued that empirical multimodal analyses of participants’ and interpreters’ behavior in real-life interpreting settings may provide much-needed groundwork that helps to fuel this discussion. As one of the most central points of criticism raised by interpreting practitioners is that distant forms of interpreting lack certain characteristics that are typical for on-site or face-to-face interpreting (i.e. distant solutions are not <i>true-to-life</i>, Van Rotterdam & van den Hoogen 2011). It becomes increasingly important to pinpoint what these typical and natural characteristics are. Empirically grounded insights into these characteristics may then, in a research-technology-application loop, feed into innovative technologies, rendering novel interpreting solutions that are more true-to-life.
<br />In this empirical analysis we focus on one specific phenomenon that has received increased attention in the recent literature in multimodal interaction analysis as well as interpreting studies, viz. eye gaze as a semiotic resource employed by speakers as well as hearers. The main questions here are how interpreters typically manage the turn-taking process in real-life interaction, among others by means of gaze, and how important visual access is to the co-participants for a smooth exchange. In order to answer the research questions, the researchers make use of eye-tracking technology to gain detailed information on interpreters’ and primary participants’ gaze behavior.
10
01
JB code
btl.149.ind
235
240
6
Miscellaneous
10
01
Index
02
JBENJAMINS
John Benjamins Publishing Company
01
John Benjamins Publishing Company
Amsterdam/Philadelphia
NL
04
20200113
2020
John Benjamins B.V.
02
WORLD
13
15
9789027204653
01
JB
3
John Benjamins e-Platform
03
jbe-platform.com
09
WORLD
21
01
00
95.00
EUR
R
01
00
80.00
GBP
Z
01
gen
00
143.00
USD
S
385025957
03
01
01
JB
John Benjamins Publishing Company
01
JB code
BTL 149 Hb
15
9789027204653
13
2019043189
BB
01
BTL
02
0929-7316
Benjamins Translation Library
149
01
Linking up with Video
Perspectives on interpreting practice and research
01
btl.149
01
https://benjamins.com
02
https://benjamins.com/catalog/btl.149
1
B01
Heidi Salaets
Salaets, Heidi
Heidi
Salaets
KU Leuven
2
B01
Geert Brône
Brône, Geert
Geert
Brône
KU Leuven
01
eng
246
vi
240
LAN023000
v.2006
CFP
2
24
JB Subject Scheme
TRAN.INTERP
Interpreting
24
JB Subject Scheme
TRAN.TRANSL
Translation Studies
06
01
This volume is intended as an innovating reader for both interpreting practitioners as well as scholars, engaging with the multifaceted question addressed in the title “Why linking up with video?”. The chapters in this volume deal with this question from different perspectives. On the one hand, the volume continues the ongoing discussion on the pros and cons of video-based interaction for the interpreting profession, exploring the implications and applications when interpreters and their clients <i>link up</i> through video technology. On the other hand, the chapters also explore the potential of video technology for research on interpreting, hence raising the question in which way high-quality video recordings of interpreters in the booth, participants involved in interpreter-mediated talk, etc. may be instrumental in gaining new insights. In this sense, the volume strongly ties in with the fast-growing field of multimodal (interaction) studies, which makes use of video recordings to study the relationship between verbal and nonverbal resources, such as gestures, postural orientation, gaze and head movements, in the construction of meaning in communication.
05
Studies of this kind can provide much needed data on how interpreters manage turn-taking both verbally and non-verbally in face-to-face situations and, in turn, inform the on-going development of distance interpreting practices to overcome the current limitations of video-conferencing technology. Published in early 2020, the book has been made all the more relevant by the on-going COVID-19 pandemic, which has made video-mediated communication an everyday occurrence for all of us, whether in monolingual or in interpreter-mediated multilingual settings.
Annalisa Sandrelli, Università degli Studi Internazionali di Roma - UNINT, in Journal of Pragmatics 176 (2021).
05
I recommend this volume to all researchers, educators and students of interpreting who are interested in the ways in which video can be linked to interpreting practice and interpreting research. I would also like to see an updated edition for a post-pandemic world where, first, we can evaluate the long-lasting impact of Covid-19 on the use of technology in interpreting and, second, we can compare the changes so as to gauge the extent to which the use of video has become a legacy that is here to stay.
Jemina Napier, Heriot-Watt University, in Interpreting 24:1 (2022).
04
09
01
https://benjamins.com/covers/475/btl.149.png
04
03
01
https://benjamins.com/covers/475_jpg/9789027204653.jpg
04
03
01
https://benjamins.com/covers/475_tif/9789027204653.tif
06
09
01
https://benjamins.com/covers/1200_front/btl.149.hb.png
07
09
01
https://benjamins.com/covers/125/btl.149.png
25
09
01
https://benjamins.com/covers/1200_back/btl.149.hb.png
27
09
01
https://benjamins.com/covers/3d_web/btl.149.hb.png
10
01
JB code
btl.149.01bro
1
11
11
Introduction
1
01
Introduction
Why linking up with video?
1
A01
Geert Brône
Brône, Geert
Geert
Brône
KU Leuven
2
A01
Heidi Salaets
Salaets, Heidi
Heidi
Salaets
KU Leuven
10
01
JB code
btl.149.02poc
13
45
33
Chapter
2
01
Chapter 1. “Going video”
Mediality and multimodality in interpreting
1
A01
Franz Pöchhacker
Pöchhacker, Franz
Franz
Pöchhacker
University of Vienna
01
This chapter explores the link between interpreting and video mainly by engaging in a conceptual analysis drawing on insights from social semiotics and communication studies. Departing from an understanding of speech as a semiotic mode in the oral-aural modality, the development of interpreting practices since the early twentieth century is reviewed with respect to the use of technology as a sign-conveying medium. Special emphasis is given to the introduction of “telephonic” interpreting and its implications for “visibility” in interpreter-mediated communication before the introduction of audiovisual transmission systems. Based on the examination of some existing models of multimodal language use, and further theoretical reflection, a conceptual framework is suggested to account more explicitly for different medium-based forms of interpreting and for the communicative dynamics shaped by the mediality of these practices. On this foundation, video is discussed as a technological medium supporting novel professional practices as well as research approaches.
10
01
JB code
btl.149.03bra
47
78
32
Chapter
3
01
Chapter 2. “You are just a disembodied voice really”
Perceptions of video remote interpreting by legal interpreters and police officers
1
A01
Sabine Braun
Braun, Sabine
Sabine
Braun
University of Surrey
01
This contribution is devoted to the voices of users of video remote interpreting (VRI) in a particular setting, namely legal interpreters and police officers. Focusing on an aspect that has received little attention to date, viz. the interpreters’ and legal stakeholders’ perceptions of VRI as a novel configuration in the legal setting, we use the Social Construction of Technology (SCOT) as a theoretical framework to analyse a set of interviews that were conducted with interpreters and police officers after they had completed a simulated VRI session. As a first step, the participants were prompted to compare this simulated experience to their real-life experience to check the degree of reality of the simulated encounters. Next, they were asked to talk about attitudes towards VRI and to reflect on their experience with VRI during the simulation. Among the key outcomes of this investigation is that the two social groups – police officers and interpreters – have different views, but also that there is a considerable degree of variation among the interpreters, indicating a low degree of stabilisation of VRI as a concept and practice among the interpreters.
10
01
JB code
btl.149.04boe
79
105
27
Chapter
4
01
Chapter 3. Remote interpreting in dialogic settings
A methodological framework for investigating the impact of telephone and video interpreting on quality in healthcare interpreting
1
A01
Esther de Boe
Boe, Esther de
Esther
de
Boe
University of Antwerp
01
Just as remote communication by telephone and through the internet has become an integral part of our daily lives and professional environments, it has also gained a firm footing in the practice of interpreting. In medical settings, remote interpreting is increasingly being welcomed as a means to enable better access to healthcare and increased cost-efficiency. Studies on healthcare interpreting over the telephone or by video link have generated predominantly positive results concerning the use of remote modes of interpreting. However, most of these studies originate from medical science and measure user satisfaction with the interpreting mode (face-to-face, telephone interpreting or video interpreting) rather than the possible impact of the different modes on interpreting quality. In interpreting studies, empirical research investigating remote interpreting in medical settings is scarce, but studies on remote interpreting in settings such as conference, business and legal interpreting indicate that the remote conditions are at the very least perceived by users to influence the interpreter’s performance and the communication.
<br />In this chapter, we introduce a methodological framework for a systematic assessment of the quality of remote interpreting and the effectiveness of the communication in dialogic healthcare settings, drawing on methods from both interpreting studies and medicine. Central to the research design is a corpus of simulations of interpreter-mediated doctor – patient encounters, performed in the modes face-to-face, telephone and video interpreting. These simulations were submitted to a comparative, multi-modal analysis, the results of which were triangulated with the subjective assessment by the participants.
<br />We will first touch upon research issues and caveats relevant to remote healthcare interpreting, emerging from medical studies and interpreting studies. Subsequently, the research design of the present study will be elaborated, followed by a discussion of the preliminary findings of the first series of simulations. Although the data analysis is work in progress, the first outcomes suggest that the use of technology in interpreter-mediated health care impacts mostly on the interactional dynamics of the communication.
10
01
JB code
btl.149.05lee
107
125
19
Chapter
5
01
Chapter 4. Role-space in VRS and VRI
1
A01
Robert G. Lee
Lee, Robert G.
Robert G.
Lee
University of Central Lancashire
01
This chapter explores issues related to Video Relay Services (VRS), a telephone access service for Deaf people and Video Remote Interpreting (VRI). First there is a discussion of Deaf people and specifically users of sign language and how they negotiate remote communicative interactions (initially without direct access to audio-only technologies such as the telephone). Similarities and differences between VRS services for Deaf people and remote interpreted interactions (which can involve signed and spoken or solely spoken language interlocutors) are then explored.
<br />The concept of role-space (Llewellyn-Jones and Lee 2014) is then introduced as a lens through which these interactions can be analysed. A discussion of VRI situations through the role-space dimensions of interaction management, participant alignment and presentation of self is presented. Finally, recommendations for factors to be considered to make VRI situations more effective are presented.
10
01
JB code
btl.149.06hey
127
149
23
Chapter
6
01
Chapter 5. The importance of video recordings in signed language interpreting research
1
A01
Isabelle Heyerick
Heyerick, Isabelle
Isabelle
Heyerick
University of Warwick KU Leuven?
01
In signed language interpreting studies, researchers have devoted attention to the role of video recordings in data collection since the very beginning. Given the visual nature of signed languages, such recordings are imperative in order to investigate various aspects of signed language interpreting such as for instance interpreting strategies, interpreting quality, and interactional aspects of the interpreter mediated communication.
<br />This differs from studies looking at spoken language interpreting, where traditionally audio recordings were and to some extent still are the primary source of data in research.
<br />In this chapter I claim that, in line with recent shifts in the understanding of communication and interaction (Mondada 2011), any research on interpreting – which is a communicative act – should be based on multimodal data, including the visual, audiological, gestural and any other layers of interaction.
<br />As a way of introduction, the chapter gives an overview of how and to which extent video recordings as a data collection tool have been used in three research fields in spoken and signed languages; spoken interaction studies, sign linguistics and interpreting studies, drawing primarily on Erickson (2011), Lucas et al. (2013), and Napier & Leeson (2016).
<br />This chapter goes on to discuss the advantages and possible challenges of the use of video as a recording tool in signed language interpreting research, based on a case study on interpreting strategies used by Flemish Sign Language interpreters (Heyerick forthcoming). The same example also illustrates the role of video as an elicitation tool within signed language interpreting research.
<br />While the chapter explores the benefits, opportunities and potential obstacles of working with video in research on signed language interpreting, I argue that including video recordings in any research examining communication and/or interaction has the potential to provide very rich data. Video allows for interactive events to be registered in their full multimodal effect and to be regarded and researched as multimodal events (Mondada 2011). This approach can broaden the understanding of human interaction in any field of study.
10
01
JB code
btl.149.07gal
151
179
29
Chapter
7
01
Chapter 6. Gesture functions and gestural style in simultaneous interpreting
1
A01
Elena Zagar Galvão
Zagar Galvão, Elena
Elena
Zagar Galvão
01
In recent decades, the advent of affordable digital video-recording technology and freely downloadable specialised software for storing, viewing, editing, and annotating video and audio has contributed to a reassessment of the importance of the relation between the body, language, and communication in a variety of scientific domains, such as psychology, linguistics, anthropology, sociology, cognitive sciences and several others (Müller et al 2013, 2014). One of the consequences has also been the emergence of a new interdiscipline – Gesture Studies – entirely devoted to the investigation of the gestural modality in human interaction. However, while gesture and its relation to speech have been examined in face-to-face conversations, oral narratives, public speaking, task-based discourse, as well as other types of communicative situations, only a handful of studies to date have documented, analysed and described the range and functions of the gestures produced by conference interpreters in the booth. One of the possible reasons for this lack of attention to the body in interpreting has to do with the emphasis on decontextualised cognitive processes in the simultaneous interpreting (SI) mode, which dominated the academic field of conference interpreting research since its beginning in the 1950s until the mid-1990s (Diriker 2004: 7; Gile 1998: 70; Pöchhacker 1995: 33). In addition, the historical shift from consecutive to simultaneous interpreting in conference settings and the now more generalised use of remote interpreting resulted in a removal of the interpreter’s body from the public eye. All this, coupled with the still prevalent notion that simultaneous interpreting (SI) is an essentially verbal and monologic endeavour, as well as the difficulty in finding interpreters willing to be filmed and/or securing permission for filming, led to a dearth of multimodal data in Conference Interpreting Research. The present volume constitutes a first clear attempt at redressing this imbalance by ‘linking up with video’, while this specific chapter hopes to start filling this gap by contributing to a better understanding of the role played by gesture in SI discourse and by introducing the reader to a qualitative microanalytical approach to gestural behaviour that may be applied to the study of other modes of interpreting.
<br />After defining gesture and its structural properties within the framework of an integrated multimodal view of language and communication and introducing some working concepts from the field of Gesture Studies, the chapter presents a video-based quasi-experimental study with four professional conference interpreters working simultaneously from English into European Portuguese (henceforth ‘Portuguese’). The study constitutes the first part of a larger research project which explores gesture production in SI by triangulating the data, methods and results from the open quasi-experiment described here, an observational field study with the same subjects, and in-depth semi-structured interviews with a larger number of interpreters. Due to space limitations, however, this chapter will only cover the first investigation. The findings offer an insight into the rich range of gestures deployed in the booth and shed some light on the multimodal nature of meaning-making in simultaneous interpreting.
10
01
JB code
btl.149.08kry
181
202
22
Chapter
8
01
Chapter 7. <i>Going video</i>: Understanding interpreter-mediated clinical communication through the video lens
1
A01
Demi Krystallidou
Krystallidou, Demi
Demi
Krystallidou
KU Leuven
01
Most of the research on dialogue interpreting has been conducted by taking only verbal interaction into account. Although the existing research has managed to shed some light on the complexity of interpreter-mediated interaction, there is still a lot to be unravelled by adopting a multimodal stance and including non-verbal cues in the analysis of verbal interaction. This study builds on the findings of recent research by Davitti (2013); Davitti & Pasquandrea (2017); Krystallidou (2013, 2014, 2016); Pasquandrea (2011, 2012). In this study, I draw on data taken from a corpus of authentic video-recorded interpreter-mediated consultations at a large urban hospital in Belgium. By applying multimodal analysis to data and comparing it to analysis based on transcripts alone, I highlight a set of interactional dynamics that touch upon new aspects of the complexity of interpreter-mediated interaction and which a transcript-based analysis alone would have failed to capture. It will be shown that participants’ gaze, gestures and body orientation, along with verbal interaction, are used by the interpreter as semiotic resources that do affect the doctor’s and the patient’s participation in interaction. However, the weight the interpreter seems to attach to the primary participants’ semiotic resources seems to be subject to the participation status of each participant.
10
01
JB code
btl.149.09vra
203
233
31
Chapter
9
01
Chapter 8. Eye-tracking in interpreter-mediated talk
From research to practice
1
A01
Jelena Vranjes
Vranjes, Jelena
Jelena
Vranjes
University of Ghent
2
A01
Geert Brône
Brône, Geert
Geert
Brône
KU Leuven
01
A starting point for a multimodal analysis of interpreter-mediated interaction is the discussion on the pros and cons of new technologies especially for new forms of distant, remote or offsite interpreting. More specifically, in this contribution is argued that empirical multimodal analyses of participants’ and interpreters’ behavior in real-life interpreting settings may provide much-needed groundwork that helps to fuel this discussion. As one of the most central points of criticism raised by interpreting practitioners is that distant forms of interpreting lack certain characteristics that are typical for on-site or face-to-face interpreting (i.e. distant solutions are not <i>true-to-life</i>, Van Rotterdam & van den Hoogen 2011). It becomes increasingly important to pinpoint what these typical and natural characteristics are. Empirically grounded insights into these characteristics may then, in a research-technology-application loop, feed into innovative technologies, rendering novel interpreting solutions that are more true-to-life.
<br />In this empirical analysis we focus on one specific phenomenon that has received increased attention in the recent literature in multimodal interaction analysis as well as interpreting studies, viz. eye gaze as a semiotic resource employed by speakers as well as hearers. The main questions here are how interpreters typically manage the turn-taking process in real-life interaction, among others by means of gaze, and how important visual access is to the co-participants for a smooth exchange. In order to answer the research questions, the researchers make use of eye-tracking technology to gain detailed information on interpreters’ and primary participants’ gaze behavior.
10
01
JB code
btl.149.ind
235
240
6
Miscellaneous
10
01
Index
02
JBENJAMINS
John Benjamins Publishing Company
01
John Benjamins Publishing Company
Amsterdam/Philadelphia
NL
04
20200113
2020
John Benjamins B.V.
02
WORLD
08
585
gr
01
JB
1
John Benjamins Publishing Company
+31 20 6304747
+31 20 6739773
bookorder@benjamins.nl
01
https://benjamins.com
01
WORLD
US CA MX
21
84
30
01
02
JB
1
00
95.00
EUR
R
02
02
JB
1
00
100.70
EUR
R
01
JB
10
bebc
+44 1202 712 934
+44 1202 712 913
sales@bebc.co.uk
03
GB
21
30
02
02
JB
1
00
80.00
GBP
Z
01
JB
2
John Benjamins North America
+1 800 562-5666
+1 703 661-1501
benjamins@presswarehouse.com
01
https://benjamins.com
01
US CA MX
21
1
30
01
gen
02
JB
1
00
143.00
USD