Cover not available
Article published In:
Developments in Cognitive Translation and Interpreting Studies
Edited by Kairong Xiao and Sandra L. Halverson
[Cognitive Linguistic Studies 8:2] 2021
► pp. 277–306

Embodied cognition in the booth

Referential and pragmatic gestures in simultaneous interpreting

ORCID logo | Universidad de Las Palmas de Gran Canaria
ORCID logo | Universidad de Las Palmas de Gran Canaria
From an enactivist perspective, cognition can be described as embodied, since it is determined by our bodily, multisensory, affective interaction with the environment, in particular by our social interaction. In recent years, interpreting has been defined as a multimodal, embodied cognitive activity of inter-lingual mediation, and research on gestures in conference interpreting has found that simultaneous interpreters, although not visible for their audience, do gesture in the booth. However, gestures in interpreting are yet understudied. This paper presents an exploratory, in-depth descriptive study with the aim of generating hypotheses about the cognitive functions of gestures in simultaneous interpreting. To this end, we investigate the different types of gesture that emerge throughout a whole process of simultaneous interpreting, in conjunction with the concurrent speech, the interpreter’s interaction with her environment and her own description of her production of mental images and gestures. The research question guiding our investigation is: What functions do the different types of gestures play in the interpreting process? The results suggest that, in the analyzed material, referential gestures tend to support the construction of meanings, while the main role of pragmatic gestures consists in helping to manage the progress of the interpreting process.
Keywords: cognition, enactivism, embodiment, simultaneous interpreting, gestures
Article outline
  • 1.Introduction
  • 2.Enactive cognition
    • 2.1Embodied language
    • 2.2Co-speech gesture as embodied cognition
      • 2.2.1Types and functions of gesture
      • 2.2.2Gesture and mental simulation
      • 2.2.3Gesture as external support to cognition
  • 3.Gestures in simultaneous interpreting
  • 4.The study
    • 4.1Objective and research question
    • 4.2Data collection
    • 4.3Analysis of the data
  • 5.Results and discussion
    • 5.1Overall picture
    • 5.2Referential gestures
      • 5.2.1Iconic gestures: Drawing contents in the air
      • 5.2.2Deictic gestures: Organizing ideas metaphorically in the booth
    • 5.3Pragmatic gestures: Managing speech production
  • 6.Conclusions
  • Acknowledgements
  • Notes
  • References
Published online: 22 November 2021
DOI logo
https://doi.org/10.1075/cogls.00079.mar
References (56)
References
Adam, C. (2013). La relación gesto/complejidad textual en la interpretación simultánea: Un estudio descriptivo. PhD thesis. Universidad de Concepción, Chile.
Adam, C., & Castro, G. (2013). Schlaggesten beim Simultandolmetschen – Auftreten und Funktionen, Lebende Sprachen 58(1), 71–82. DOI logoGoogle Scholar
Barsalou, L. W. (1999). Perceptual symbol systems, Behavioral and Brain Sciences, 221, 577–660. DOI logoGoogle Scholar
Bergen, B. (2012). Louder than words. The new science of how the mind makes meaning. New York: Basic Books.Google Scholar
(2015). Embodiment, simulation and meaning. In N. Riemer (Ed.), The Routledge handbook of semantics (pp. 142–157). London: Routledge.Google Scholar
Berkelaar, M. (2020). Interface to ‘Lp_solve’ v. 5.5 to Solve Linear/Integer Programs. [URL]
Chaparro Inzunza, W. B. (2017). Gesticulación y calidad de la interpretación simultánea – Un estudio experimental. Magister thesis, Universidad de Concepción, Chile.
Clark, A. (2013). Gesture as thought. In Z. Radman (Ed.), The hand, an organ of the mind: What the manual tells the mental (pp. 255–268). Cambridge, MA: MIT Press.Google Scholar
ELAN (Version 6.0) [Computer software]. (2020). Nijmegen: Max Planck Institute for Psycholinguistics, The Language Archive. Retrieved from [URL]
Fernández Santana, A., & Martín de León, C. (2021). Con la voz y las manos: Gestos icónicos en interpretación simultánea. With voice and hands: Iconic gestures in simultaneous interpreting. Hermēneus. Revista de Traducción e Interpretación, 231.Google Scholar
Galhano-Rodrigues, I. (2007). Body in interpretation – Nonverbal communication of speaker and interpreter and its relation to words and prosody. In P. A. Schmitt & H. Jüngst (Eds.), Translationsqualität (pp. 739–753). Frankfurt: Peter Lang.Google Scholar
Galhano-Rodrigues, I., & Zagar Galvão, E. (2010). The importance of listening with one’s eyes: A case study of multimodality in simultaneous interpreting. In J. Díaz Cintas, A. Matamala & J. Neves (Eds.), New insights into audiovisual translation and media accessibility (pp. 241–253). Amsterdam: Rodopi.Google Scholar
Gallagher, S. (2017). Enactivist interventions. rethinking the mind. Oxford: Oxford University Press. DOI logoGoogle Scholar
Gamer, M., Lemon, J. & Fellows Puspendra Singh, I. (2019). Package ‘irr’, version 0.84.1. [URL]
Gibson, J. J. (1977). The theory of affordances. In R. Shaw & J. Bransford (Eds.), Perceiving, acting, and knowing (pp. 67–82). Hilldale, NJ: Erlbaum.Google Scholar
Glenberg, A. M., Schroeder, J. L., & Robertson, D. A. (1998). Averting the gaze disengages the environment and facilitates remembering. Memory & Cognition 26(4), 651–658. DOI logoGoogle Scholar
Goldin-Meadow, S., & Alibali, M. W. (2013). Gesture’s Role in Speaking, Learning, and Creating Language. Annual Review of Psychology 641, 257–283. DOI logoGoogle Scholar
Hostetter, A. B. (2014). Action attenuates the effect of visibility on gesture rates. Cognitive Science, 38(7): 1468–1481. DOI logoGoogle Scholar
Hostetter, A. B., & Alibali, M. W. (2008). Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15(3), 495–514. DOI logoGoogle Scholar
Iverson, J. M., & Goldin-Meadow, S. (1998). Why people gesture when they speak. Nature 3961, 228. DOI logoGoogle Scholar
Iverson, J. M., & Thelen, E. (1999). Hand, mouth and brain. The dynamic emergence of speech and gesture. Journal of Consciousness Studies, 6(11–12), 19–40.Google Scholar
Johnson, M. (1987). The body in the mind: The bodily basis of meaning, imagination, and reason. Chicago: University of Chicago Press. DOI logoGoogle Scholar
Kendon, A. (1980). Gesticulation and speech: Two aspects of the process of utterance. In M. R. Key (Ed.), The relation between verbal and nonverbal communication (pp. 207–227). The Hague: Mouton. DOI logoGoogle Scholar
(1995). Gestures as illocutionary and discourse structure markers in Southern Italian conversation. Journal of Pragmatics, 231, 247–279. DOI logoGoogle Scholar
(2004). Gesture: Visible action as utterance. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Kosslyn, S. M., Ganis, G., & Thompson, W. L. (2001). Neural foundations of imagery. Nature Reviews Neuroscience, 21, 635–642. DOI logoGoogle Scholar
Krippendorff, K. (1970). Estimating the reliability, systematic error, and random error of interval data. Educational and Psychological Measurement, 30(2), 61–70. DOI logoGoogle Scholar
(2004). Content analysis: An introduction to its methodology. Thousand Oaks, CA: SAGE Publications.Google Scholar
Kumcu, A., & Thompson, L. R. (2020). Less imageable words lead to more looks to blank locations during memory retrieval. Psychological Research, 84(3), 667–684. DOI logoGoogle Scholar
Lakoff, G. (1987). Women, fire, and dangerous things: what categories reveal about the mind. Chicago: University of Chicago Press. DOI logoGoogle Scholar
Lakoff, G., & Johnson, M. (1980). Metaphors we live by. Chicago: University of Chicago Press.Google Scholar
Masson-Carro, I., Goudbeek, M., & Krahmer, E. (2016). Can you handle this? The impact of object affordances on how co-speech gestures are produced. Language, Cognition and Neuroscience, 31(3), 430–440. DOI logoGoogle Scholar
McNeill, D. (1992). Hand and mind: what gestures reveal about thought. Chicago: University of Chicago Press.Google Scholar
(2005). Gesture and thought. Chicago: Chicago University Press. DOI logoGoogle Scholar
Mellinger, C. D., & Hanson, T. A. (2017). Quantitative research methods in translation and interpreting studies. London/New York: Routledge.Google Scholar
Mittelberg, I., & Evola, V. (2014). Iconic and representational gestures. In C. Müller, A. Cienki, E. Fricke, S. H. Ladewig, D. McNeill & J. Bressem (Eds.), Body – language – communication: An international handbook on multimodality in human interaction (pp. 1732–1746). Berlin/Boston: De Gruyter Mouton. DOI logoGoogle Scholar
Olivetti Belardinelli, M., Palmiero, M., & Di Matteo, R. (2011). How fMRI technology contributes to the advancement of research in mental imagery: A review. In J. F. P. Peres (Ed.), Neuroimaging for clinicians – Combining research and practise (pp. 320–346). London: IntechOpen. DOI logoGoogle Scholar
Paivio, A. (1991). Dual coding theory: Retrospect and current status. Canadian Journal of Psychology/Revue Canadienne de Psychologie, 45(3), 255–287. DOI logoGoogle Scholar
Pouw, W. T. J. L., de Nooijer, J. A., van Gog, T., Zwaan, R. A., & Paas, F. (2014). Toward a more embedded/extended perspective on the cognitive function of gestures. Frontiers in Psychology, 51, Article 359. DOI logoGoogle Scholar
R Core Team. (2017). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. [URL]
Rohrer, T. (2006). Three dogmas of embodiment: Cognitive linguistics as a cognitive science. In G. Kristiansen, M. Achard, R. Dirven & F. J. Ruiz de Mendoza Ibáñez (Eds.), Cognitive Linguistics: Current applications and future perspectives (pp. 119–146). Berlin, New York: Mouton de Gruyter.Google Scholar
RStudio Team. (2020). RStudio: Integrated Development for R. RStudio, PBC, Boston, MA. [URL]
Seeber, K. (2015). Simultaneous interpreting. In H. Mikkelson & R. Jourdenais (Eds.), The Routledge handbook of interpreting (pp. 79–95). London: Routledge.Google Scholar
(2017). Multimodal processing in simultaneous interpreting. In J. W. Schwieter & A. Ferreira (Eds.), The handbook of translation and cognition (pp. 461–475). Howoken, NJ: Wiley Blackwell. DOI logoGoogle Scholar
Sloetjes, H., & Wittenburg, P. (2008). Annotation by category – ELAN and ISO DCR. In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC 2008) (pp. 816–820).Google Scholar
Stachowiak-Szymczak, K. (2019). Eye movements and gestures in simultaneous and consecutive interpreting. Cham: Springer. DOI logoGoogle Scholar
Thompson, E. & Varela, F. (2001). Radical embodiment: Neural dynamics and consciousness. Trends in Cognitive Sciences, 5(10), 418–425. DOI logoGoogle Scholar
Timarová, Š., Dragsted, B., & Hansen, I. G. (2011). Time lag in translation and interpreting. In C. Alvstad, A. Hild, & E. Tiselius (Eds.), Methods and strategies of process research: Integrative approaches in Translation Studies (pp. 121–146). Amsterdam/Philadelphia: John Benjamins. DOI logoGoogle Scholar
Ward, D., & Stapleton, M. (2012). Es are good. Cognition as enacted, embodied, embedded, affective and extended. In F. Paglieri (Ed.), Consciousness in interaction: The role of the natural and social context in shaping consciousness (pp. 89–104). Philadelphia: Benjamins. DOI logoGoogle Scholar
Wassenburg, S. I., de Koning, B. B., & van der Schooot, M. (2018). In which direction to move? Facilitative and interference effects of gestures on problem solvers’ thinking. Journal of Cognitive Psychology, 30(3), 307–313. DOI logoGoogle Scholar
Wesp, R., Hesse, J., Keutmann, D., & Wheaton, K. (2001). Gestures maintain spatial imagery. American Journal of Psychology, 1141, 591–600. DOI logoGoogle Scholar
Zagar Galvão, E. (2009). Speech and Gesture in the Booth – A Descriptive Approach to Multimodality in Simultaneous Interpreting. In D. de Crom (Ed.), Selected Papers of the CETRA Research Seminar in Translation Studies 2008. Retrieved from <[URL]>
(2013). Hand gestures and speech production in the booth: do simultaneous interpreters imitate the speaker? In C. Carapinha & I. A. Santos (Eds.), Estudos de linguística, vol II1 (pp. 115–129). Coimbra: Imprensa da Universidade de Coimbra.Google Scholar
(2019). Gesture functions and gestural style in simultaneous interpreting. In H. Salaets & G. Brône (Eds.), Linking up with video: Perspectives on interpreting practice and research (pp. 151–179). Amsterdam: John Benjamins.Google Scholar
Cited by (7)

Cited by seven other publications

Cienki, Alan
2024. Variable embodiment of stance-taking and footing in simultaneous interpreting. Frontiers in Psychology 15 DOI logo
Hirvonen, Maija
2024. Shared cognition in the translation process: Information processing and meaning production as interactive accomplishments. Translation Studies ► pp. 1 ff. DOI logo
Olza, Inés
2024. Gestural Alignment in Spoken Simultaneous Interpreting: A Mixed-Methods Approach. Languages 9:4 ► pp. 151 ff. DOI logo
Sannholm, Raphael & Hanna Risku
2024. Situated minds and distributed systems in translation. Target. International Journal of Translation Studies 36:2 ► pp. 159 ff. DOI logo
Dyrmo, Tomasz
2023. Levels of metaphor in gesture. Pragmatics & Cognition 30:2 ► pp. 330 ff. DOI logo
Haapaniemi, Riku
2023. How production and distribution processes shape translations in organisations. Translation Spaces 12:1 ► pp. 74 ff. DOI logo
Mellinger, Christopher D.
2023. Chapter 8. Embedding, extending, and distributing interpreter cognition with technology. In Interpreting Technologies – Current and Future Trends [IVITRA Research in Linguistics and Literature, 37], ► pp. 195 ff. DOI logo

This list is based on CrossRef data as of 13 october 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.