Article published in:Interaction and Iconicity in the Evolution of Language
Edited by Stefan Hartmann, Michael Pleyer, James Winters and Jordan Zlatev
[Interaction Studies 18:3] 2017
► pp. 465–488
Multimodal-first or pantomime-first?
Communicating events through pantomime with and without vocalization
A persistent controversy in language evolution research has been whether language emerged in the gestural-visual or in the vocal-auditory modality. A “dialectic” solution to this age-old debate has now been gaining ground: language was fully multimodal from the start and remains so to this day. In this paper, we show this solution to be too simplistic and outline a more specific theoretical proposal, which we designate as pantomime-first. To decide between the multimodal-first and pantomime-first alternatives, we review several lines of interdisciplinary evidence and complement it with a cognitive-semiotic experiment. In the study, the participants saw – and then matched to hand-drawn images – recordings of short transitive events enacted by 4 actors in two conditions: visual (only body movement) and multimodal (body movement accompanied by nonlinguistic vocalization). Significantly, the matching accuracy was greater in the visual than the multimodal condition, though a follow-up experiment revealed that the emotional profiles of the events enacted in the multimodal condition could be reliably detected from the sound alone. We see these results as supporting the proposed pantomime-first scenario.
Keywords: bodily mimesis, pantomime, multimodal origins, multimodality, language origins, language evolution, gesture
Published online: 08 December 2017
Armstrong, D. F., Stokoe, W. C., & Wilcox, S. E.
Armstrong, D. F., & Wilcox, S. E.
Brown, J. E.
(2012) The evolution of symbolic communication: An embodied perspective. PhD Thesis, University of Edinburgh.
Call, J., & Tomasello, M.
Clay, Z., & Zuberbühler, K.
Corballis, M. C.
Fay, N., Arbib, M., & Garrod, D.
Fay, N., Lister, C. J., Ellison, T. M., & Goldin-Meadow, S.
Galantucci, B., & Garrod, S.
Gardner, R. A., & Gardner, B. T.
Hewes, G. W.
Hobaiter, C. & Byrne, R. W.
Kemmerer, D., Chandrasekaran, B., & Tranel, D.
Kita, S., & Özyurek, A.
Landau, B., & Gleitman, L. R.
Levinson, S. C., & Holler, J.
Lock, A., & Zukow-Goldring, P.
Meir, I., Aronoff, M., Börstell, C., Hwang, S., Ilkbasaran, D., Kastner, I., Lepic, R., Ben Basat, A. L., Padden, C., & Sandler, W.
Schel, A. M., Townsend, S. W., Machanda, Z., Zuberbühler, K., & Slocombe, K. E.
Taglialatela, J. P., Russell, J. L., Schaeffer, J. A., & Hopkins, W. D.
Vigliocco, G., Perniss, P., & Vinson, D.
Volterra, V., Caselli, M., Caprici, O., & Pizzuto, E.
Wacewicz, S., Zywiczynski, P., & Orzechowski, S.
Zywiczynski, P., & Wacewicz, S.
Cited by 8 other publications
Adornetti, Ines, Francesco Ferretti, Alessandra Chiera, Slawomir Wacewicz, Przemysław Żywiczyński, Valentina Deriu, Andrea Marini, Rita Magni, Laura Casula, Stefano Vicari & Giovanni Valeri
Brown, Steven, Emma Mittermaier, Tanishka Kher & Paul Arnold
Ferretti, Francesco & Ines Adornetti
Macuch Silva, Vinicius, Judith Holler, Asli Ozyurek & Seán G. Roberts
Zywiczynski, Przemyslaw, Nathalie Gontier & Slawomir Wacewicz
Żywiczyński, Przemysław, Marta Sibierska, Sławomir Wacewicz, Joost van de Weijer, Francesco Ferretti, Ines Adornetti, Alessandra Chiera & Valentina Deriu
Żywiczyński, Przemysław, Sławomir Wacewicz & Casey Lister
This list is based on CrossRef data as of 14 september 2021. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.