Chapter published in:
Sources of Variation in First Language Acquisition: Languages, contexts, and learners
Edited by Maya Hickmann †, Edy Veneziano and Harriet Jisa
[Trends in Language Acquisition Research 22] 2018
► pp. 123–138

Chapter 6
Cross-linguistic variation in children’s multimodal utterances

| Radboud University Nijmegen & Max Planck Institute for Psycholinguistics
Our ability to use language is multimodal and requires tight coordination between what is expressed in speech and in gesture, such as pointing or iconic gestures that convey semantic, syntactic and pragmatic information related to speakers’ messages. Interestingly, what is expressed in gesture and how it is coordinated with speech differs in speakers of different languages. This paper discusses recent findings on the development of children’s multimodal expressions taking cross-linguistic variation into account. Although some aspects of speech-gesture development show language-specificity from an early age, it might still take children until nine years of age to exhibit fully adult patterns of cross-linguistic variation. These findings reveal insights about how children coordinate different levels of representations given that their development is constrained by patterns that are specific to their languages.
Keywords: gesture, pointing, manner of motion, path of motion, Turkish, multimodal, Interface Hypothesis
Article outline
  • 1.Introduction
  • 2.Gesture and language development: General milestones
  • 3.Cross-linguistic variation in adult multimodal utterances
  • 4.Cross-linguistic variation in children’s multimodal utterances
    • 4.1Late development: Mastering motion event expressions and discourse
    • 4.2Early development: Action and motion event representations
  • 5.Conclusions
  • Notes
  • References
Published online: 22 February 2018
https://doi.org/10.1075/tilar.22.07ozy
References
Allen, S., Özyürek, A., Kita, S., Brown, A., Furman, R., Ishizuka, T. & Fujii, M.
2007 Language-specific and universal influences in children’s packaging of manner and path: A comparison of English, Japanese, and Turkish. Cognition 102(1): 16–48. CrossrefGoogle Scholar
Bates, E.
1976 Language and Context: The Acquisition of Pragmatics. New York NY: Academic Press.Google Scholar
Bates, E., Benigni, L., Bretherton, I., Camaioni, L. & Volterra, V.
1979 The Emergence of Symbols: Cognition-Communication in Infancy. New York NY: Academic Press.Google Scholar
Brown, P.
2008 Verb specificity and argument realization in Tzeltal child language. In Crosslinguistic Perspectives on Argument Structure, M. Bowerman & P. Brown, 167–189. New York NY: Lawrence Erlbaum Associates.Google Scholar
Cardini, F.
2010 Evidence against Whorfian effects in motion conceptualization. Journal of Pragmatics 42(5): 1442–1459. CrossrefGoogle Scholar
Cartmill, E. A., Demir, Ö.E. & Goldin-Meadow, S.
2012 Studying gesture. In Research Methods in Child Language: A Practical Guide, E. Hoff (ed.), 208–225. Oxford: Wiley-Blackwell. CrossrefGoogle Scholar
Choi, S. & Bowerman, M.
1991 Learning to express motion events in English and Korean: The influence of language-specific lexicalization patterns. Cognition 41(1–3): 83–121. CrossrefGoogle Scholar
Colletta, J., Guidetti, M., Capirci, O., Cristilli, C., Demir, O., Kunene-Nicolas, R. & Levine, S.
2014 Effects of age and language on co-speech gesture production: an investigation of French, American, and Italian children’s narratives. Journal of Child Language 42(1): 122–145. CrossrefGoogle Scholar
Demir, Ö. E., So, W. -C., Özyürek, A. & Goldin-Meadow, S.
2012 Turkish- and English-speaking children display sensitivity to perceptual context in the referring expressions they produce in speech and gesture. Language and Cognitive Processes 27(6): 844–867. CrossrefGoogle Scholar
Furman, R.
2012 Caused Motion Events in Turkish: Verbal and Gestural Representation in Adults and Children. PhD dissertation, Radboud University Nijmegen.Google Scholar
Furman, R., Kuntay, A. & Özyürek, A.
2014 Early language-specificity of children’s event encoding in speech and gesture: Evidence from caused motion in Turkish. Language, Cognition and Neuroscience 29: 620–634. CrossrefGoogle Scholar
Gentner, D.
1982 Why are nouns learned before verbs: Linguistic relativity versus natural partitioning. In Language Development: Language, Thought and Culture, Vol. 2, S. A. Kuczaj (ed.), 301–334. Hillsdale NJ: Lawrence Erlbaum Associates.Google Scholar
Goldin-Meadow, S. & Alibali, M. W.
2013 Gesture’s role in speaking, learning, and creating language. Annual Review of Psychology 123: 448–453. Crossref.Google Scholar
Göksun, T., Hirsh-Pasek, K. & Golinkoff, R. M.
2010 How do preschoolers express cause in gesture and speech? Cognitive Development 25(1): 56–68. CrossrefGoogle Scholar
Greenfield, P. & Smith, J.
1976 The Structure of Communication in Early Language Development. New York NY: Academic Press.Google Scholar
Gu, Y., Mol, L., Hoetjes, M. & Swerts, M.
2014 Does language shape the production and perception of gestures? A study on late Chinese-English bilinguals’ conceptions about time. In Proceedings of the 36th Annual Meeting of the Cognitive Science Society, P. Bello, M. Guarini, M. McShane & B. Scassellati (eds). https://​mindmodeling​.org​/cogsci2014/ (19 December 2016).
Gullberg, M.
2011 Language-specific encoding of placement events in gestures. In Event Representation in Language and Cognition, J. Bohnemeyer & E. Pederson (eds), 166–188. Cambridge: CUP.Google Scholar
Gullberg, M., Hendricks, H. & Hickmann, M.
2008 Learning to talk and gesture about motion in French. First Language 28(2): 200–36. CrossrefGoogle Scholar
Gullberg, M. & Narasimhan, B.
2010 What gestures reveal about how semantic distinctions develop in Dutch children’s placement verbs. Cognitive Linguistics 21(2): 239–262. CrossrefGoogle Scholar
Hickmann, M., Taranne, P. & Bonnet, P.
2009 Motion in first language acquisition: Manner and path in French and English child language. Journal of Child Language 36(4): 705–741. CrossrefGoogle Scholar
Hostetter, A. B. & Alibali, M. W.
2008 Visible embodiment: Gestures as simulated action. Psychonomic Bulletin and Review 15: 495–514. CrossrefGoogle Scholar
Iverson, J. M., Capirci, O. & Caselli, M. C.
1994 From communication to language in two modalities. Cognitive Development 9(1): 23–43. CrossrefGoogle Scholar
Iverson, J. M., Capirci, O., Volterra, V. & Goldin-Meadow, S.
2008 Learning to talk in a gesture-rich world: Early communication in Italian vs. American children. First Language 28(2): 164–181. CrossrefGoogle Scholar
Iverson, J. M. & Goldin-Meadow, S.
2005 Gesture paves the way for language development. Psychological Science 16(5): 367–371. CrossrefGoogle Scholar
Kendon, A.
2004 Gesture: Visible Action as Utterance. Cambridge: CUP. CrossrefGoogle Scholar
Ketrez, N. & Aksu-Koc, A.
2002 Acquisition of noun and verb categories in Turkish. In Studies in Turkish Linguistics: Proceedings of the Xth International Conference on Turkish Linguistics, A. S. Özsoy, D. Akar, M. Nakipoğlu-Demiralp, E. Erguvanlı-Taylan & A. Koc (eds), 239–246. Istanbul: Boğaziçi University PressGoogle Scholar
Kita, S.
2009 Cross-cultural variation of speech-accompanying gesture: A review. Language and Cognitive Processes 24(2): 145–167. CrossrefGoogle Scholar
Kita, S. & Özyürek, A.
2003 What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language 48 (1): 16–32. CrossrefGoogle Scholar
Kita, S., Özyürek, A., Allen, S., Brown, A., Furman, R. & Ishizuka, T.
2007 Relations between syntactic encoding and co-speech gestures: Implications for a model of speech and gesture production. Language and Cognitive Processes, 22(8): 1212–1236. CrossrefGoogle Scholar
Küntay, A. & Slobin, D. I.
1996 Listening to a Turkish mother: Some puzzles for acquisition. In Social Interaction, Social Context, and Language, D. I. Slobin, J. Gerhardt, A. Kyratzis & J. Guo (eds), 265–286. Mahwah NJ: Lawrence Erlbaum Associates.Google Scholar
Liszkowski, U., Brown, P., Callaghan, T., Takada, A. & De Vos, C.
2012 A prelinguistic gestural universal of human communication. Cognitive Science 36(4): 698–713. CrossrefGoogle Scholar
McNeill, D.
1992 Hand and Mind. Chicago IL: University of Chicago Press.Google Scholar
Namy, L. L., Campbell, A. L. & Tomasello, M.
2004 The changing role of iconicity in non-verbal symbol learning: A U-shaped trajectory in the acquisition of arbitrary gestures. Journal of Cognition and Development 5: 37–57. (Special issue). CrossrefGoogle Scholar
Nicoladis, E.
2002 Some gestures develop in conjunction with spoken language development and others don’t: Evidence from bilingual preschoolers. Journal of Nonverbal Behavior 26(4): 241–266. CrossrefGoogle Scholar
Nicoladis, E., Mayberry, R. I. & Genesee, F.
1999 Gesture and early bilingual development. Developmental Psychology 35(2): 514–526. CrossrefGoogle Scholar
Oh, K.
2003 Language, Cognition and Development: Motion Events in English and Korean. PhD dissertation, University of California Berkeley.Google Scholar
Özçalışkan, Ş.
2007 Metaphors we move by: Children’s developing understanding of metaphorical motion in typologically distinct languages. Metaphor & Symbol 22(2): 147–68. CrossrefGoogle Scholar
2012 When gesture does and does not follow speech in describing motion. In Online supplement for the Proceedings of the 36th Boston University Conference on Language Development, A. Biller, E. Chung & A. Kimball (eds). http://​www​.bu​.edu​/bucld​/proceedings​/supplement/ (19 December 2016).
Özçalışkan, Ş., Gentner, D. & Goldin-Meadow, S.
2014 Do iconic gestures pave the way for children’s early verbs? Applied Psycholinguistics 35: 1143–1162. CrossrefGoogle Scholar
Özçalışkan, Ş. & Goldin-Meadow, S.
2005 Gesture is at the cutting edge of early language development. Cognition 96(3): B101–B113. CrossrefGoogle Scholar
2009 When gesture-speech combinations do and do not index linguistic change. Language and Cognitive Processes 24(2): 190–217. CrossrefGoogle Scholar
2011 Is there an iconic gesture spurt at 26 months? In Integrating Gestures: The Interdisciplinary Nature of Gesture [Gesture Studies 4], G. Stam & M. Ishino (eds), 163–174. Amsterdam: John Benjamins. CrossrefGoogle Scholar
Özçalışkan, Ş. & Slobin, D. I.
1999 Learning ‘how to search for the frog’: Expression of manner of motion in English, Spanish and Turkish. In Proceedings of the 23rd Boston University Conference on Language Development, A. Greenhill, H. Littlefield & C. Tano (eds), 541–552. Somerville MA: Cascadilla Press.Google Scholar
Özyürek, A., Furman, R. & Goldin-Meadow, S.
2014 On the way to language: Event segmentation in homesign and gesture. Journal of Child Language 42: 64–94. CrossrefGoogle Scholar
Özyürek, A., Kita, S., Allen, S., Furman, R. & Brown, A.
2005 How does linguistic framing of events influence co-speech gestures? Insights from crosslinguistic variations and similarities. Gesture 5(1–2): 219–240. CrossrefGoogle Scholar
Özyürek, A., Kita, S., Allen, S., Furman, R., Brown, A. & Ishizuka, T.
2008 Development of cross-linguistic variation in speech and gesture: Motion events in English and Turkish. Developmental Psychology 44(4): 1040–1054. CrossrefGoogle Scholar
Papafragou, A., Massey, C. & Gleitman, L.
2002 Shake, rattle, 'n' roll: The representation of motion in language and cognition. Cognition 84: 189–219. CrossrefGoogle Scholar
2006 When English proposes what Greek presupposes: The cross-linguistic encoding of motion events. Cognition 98: B75–87. CrossrefGoogle Scholar
Rowe, M. & Goldin-Meadow, S. G.
2009 Differences in early gesture explain SES disparities in child vocabulary size at school entry. Science 323: 951–953. CrossrefGoogle Scholar
Talmy, L.
1985 Lexicalization patterns: Semantic structure in lexical forms. In Language Typology and Semantic Description, Vol. III: Grammatical Categories and the Lexicon, T. Shopen (ed.), 36–149. Cambridge: CUP.Google Scholar
2000 Toward a Cognitive Semantics: Vol. II: Typology and Process in Concept Structuring. Cambridge MA: The MIT Press.Google Scholar