Cover not available
Part of
Bilingualism through the Prism of Psycholinguistics: In honour of Albert Costa
Edited by Mikel Santesteban, Jon Andoni Duñabeitia and Cristina Baus
[Bilingual Processing and Acquisition 17] 2023
► pp. 159–180

Chapter 5
Unravelling cross-language effects in bimodal bilingualism

| Pompeu Fabra University
| University of Barcelona
Suppose we are good tennis players and want to learn to play ping-pong. Does the way we play tennis affect how we play ping-pong? Would we play ping-pong in the same way if we were not tennis experts? This was one of Albert’s recurring metaphors when drawing a line of thought toward language interactions in bilingual language processing. The argument behind the anecdote referred to what extent the sustained interaction between bilinguals’ two languages results in structural changes within the language network. This chapter aims to push the tennis metaphor one step further by asking whether playing tennis affects how we play football, a sport involving quite different skills. Bringing the sports metaphor into language, this chapter reviews interactions occurring between bilinguals’ two languages involving different articulatory and perceptual mechanisms, such as sign and oral languages. This chapter is then devoted to bimodal bilingualism, reviewing the most relevant results on cross-linguistic interactions across modalities.
Article outline
  • Introduction
  • Characterising cross-linguistic interactions from phonological relationships
  • A brief note about phonology in sign languages
  • Bimodal bilingual populations and their diverse linguistic profiles
  • Cross-linguistic effects of sign language during oral language processing
  • Cross-linguistic effects of oral language during sign language processing
  • Modelling cross-linguistic effects in bimodal bilingualism
  • Epilogue: The end of the beginning
  • Note
  • References
Published online: 1 September 2023
DOI logo
https://doi.org/10.1075/bpa.17.05gim
References (51)
References
Bélanger, N. N., & Rayner, K. (2015). What eye movements reveal about deaf readers. Current Directions in Psychological Science, 24(3), 220–226. DOI logoGoogle Scholar
Brentari, D. (1998). A prosodic model of sign language phonology. The Mit Press. DOI logoGoogle Scholar
Brentari, D., Fenlon, J., Cormier, K., Brentari, D., Fenlon, J., & Cormier, K. (2018). Sign language phonology. In Oxford research encyclopedia of linguistics. DOI logoGoogle Scholar
Chiu, Y., Kuo, W. J., Lee, C. Y., & Tzeng, O. J. L. (2016). The explicit and implicit phonological processing of Chinese characters and words in Taiwanese deaf signers. Language and Linguistics, 17(1), 63–87. DOI logoGoogle Scholar
Chiu, Y., & Wu, M.-D. (2016). Use of phonological representations of Taiwan Sign Language in Chinese reading: Evidence from deaf signers. 特殊教育研究學刊, 41(1), 91–109. DOI logoGoogle Scholar
Costa, A., Pannunzi, M., Deco, G., & Pickering, M. J. (2017). Do bilinguals automatically activate their native language when they are not using it? Cognitive Science, 41(6), 1629–1644. DOI logoGoogle Scholar
(2019). Does bilingualism alter lexical structure? Response to Oppenheim, Wu, and Thierry (2018). Cognitive Science, 43(2), e12707. DOI logoGoogle Scholar
Cripps, J. H., Mcbride, K. A., & Forster, K. I. (2005). Lexical processing with deaf and hearing: Phonology and orthographic masked priming. Journal of Second Language Acquisition and Teaching, 12, 31–44.Google Scholar
Dijkstra, T., Grainger, J., & van Heuven, W. J. B. (1999). Recognition of cognates and interlingual homographs: The neglected role of phonology. Journal of Memory and Language, 41(4), 496–518. DOI logoGoogle Scholar
Dijkstra, T., & van Heuven, W. J. B. (2002). The architecture of the bilingual word recognition system: From identification to decision. Bilingualism: Language and Cognition, 5(3), 175–197. DOI logoGoogle Scholar
Giezen, M. R., Blumenfeld, H. K., Shook, A., Marian, V., & Emmorey, K. (2015). Parallel language activation and inhibitory control in bimodal bilinguals. Cognition, 141, 9–25. DOI logoGoogle Scholar
Giezen, M. R., & Emmorey, K. (2016). Language co-activation and lexical selection in bimodal bilinguals: Evidence from picture-word interference. Bilingualism, 19(2), 264–276. DOI logoGoogle Scholar
Gimeno-Martínez, M., Mädebach, A., & Baus, C. (2021). Cross-linguistic interactions across modalities: Effects of the oral language on sign production. Bilingualism: Language and Cognition, 24(4), 779–790. DOI logoGoogle Scholar
Grote, K., & Linz, E. (2003). The influence of sign language iconicity on semantic conceptualization. In W. G. Müller & O. Fischer (Eds.), From sign to signing (pp. 23–40). John Benjamins. DOI logoGoogle Scholar
Guo, T., Misra, M., Tam, J. W., & Kroll, J. F. (2012). On the time course of accessing meaning in a second language: An electrophysiological and behavioral investigation of translation recognition. Journal of Experimental Psychology: Learning Memory and Cognition, 38(5), 1165–1186. DOI logoGoogle Scholar
Hermans, D., Bongaerts, T., de Bot, K., & Schreuder, R. (1998). Producing words in a foreign language: Can speakers prevent interference from their first language? Bilingualism: Language and Cognition, 1(3), 213–229. DOI logoGoogle Scholar
Hermans, D., Knoors, H., Ormel, E., & Verhoeven, L. (2008). Modeling reading vocabulary learning in deaf children in bilingual education programs. Journal of Deaf Studies and Deaf Education, 13(2), 155–174. DOI logoGoogle Scholar
Hosemann, J., Mani, N., Herrmann, A., Steinbach, M., & Altvater-Mackensen, N. (2020). Signs activate their written word translation in deaf adults: An ERP study on cross-modal co-activation in German Sign Language. Glossa: A Journal of General Linguistics, 5(1), 57. DOI logoGoogle Scholar
Jiang, N. (2000). Lexical representation and development in a second language. Applied Linguistics, 21(1), 47–77. DOI logoGoogle Scholar
Kroll, J. F., & Stewart, E. (1994). Category interference in translation and picture naming: Evidence for asymmetric connections between bilingual memory representations. Journal of Memory and Language, 33(2), 149–174. DOI logoGoogle Scholar
Kubus, O., Villwock, A., Morford, J. P., & Rathmann, C. (2015). Word recognition in deaf readers: Cross-language activation of German Sign Language and German. Applied Psycholinguistics, 36(4), 831–854. DOI logoGoogle Scholar
Kutas, M., & Federmeier, K. D. (2011). Thirty years and counting: Finding meaning in the N400 component of the Event-related Brain Potential (ERP). Annual Review of Psychology, 62(1), 621–647. DOI logoGoogle Scholar
Lee, B., Meade, G., Midgley, K. J., Holcomb, P. J., & Emmorey, K. (2019). ERP evidence for co-activation of English words during recognition of American Sign Language Signs. Brain Sciences, 9(6), 148. DOI logoGoogle Scholar
Luk, G., & Bialystok, E. (2013). Bilingualism is not a categorical variable: Interaction between language proficiency and usage. Journal of Cognitive Psychology, 25(5), 605–621. DOI logoGoogle Scholar
Marian, V., & Spivey, M. (2003). Bilingual and monolingual processing of competing lexical items. Applied Psycholinguistics, 24(2), 173–193. DOI logoGoogle Scholar
Meade, G., Midgley, K. J., Sevcikova Sehyr, Z., Holcomb, P. J., & Emmorey, K. (2017). Implicit co-activation of American Sign Language in Deaf readers: An ERP study. Brain and Language, 170, 50–61. DOI logoGoogle Scholar
Mendoza, E., & Jackson-Maldonado, D. (2020). Lectura de palabras por personas sordas usuarias de lengua de señas mexicana. Revista de Logopedia, Foniatria y Audiologia, 40(1), 4–11. DOI logoGoogle Scholar
Morford, J. P., Kroll, J. F., Piñar, P., & Wilkinson, E. (2014). Bilingual word recognition in deaf and hearing signers: Effects of proficiency and language dominance on cross-language activation. Second Language Research, 30(2), 251–271. DOI logoGoogle Scholar
Morford, J. P., Occhino-Kehoe, C., Piñar, P., Wilkinson, E., & Kroll, J. F. (2017). The time course of cross-language activation in deaf ASL-English bilinguals. Bilingualism: Language and Cognition, 20(2), 337–350. DOI logoGoogle Scholar
Morford, J. P., Occhino, C., Zirnstein, M., Kroll, J. F., Wilkinson, E., & Piñar, P. (2019). What is the source of bilingual cross-language activation in deaf bilinguals? The Journal of Deaf Studies and Deaf Education, 24(4), 356–365. DOI logoGoogle Scholar
Morford, J. P., Wilkinson, E., Villwock, A., Piñar, P., & Kroll, J. F. (2011). When deaf signers read English: Do written words activate their sign translations? Cognition, 118(2), 286–292. DOI logoGoogle Scholar
Ormel, E. (2008). Visual word recognition in bilingual deaf children (Doctoral dissertation). Radboud University, Nijmegen. Retrieved on 5 March 2023 from [URL]
Ormel, E., & Giezen, M. (2014). Bimodal bilingual cross-language interaction: Pieces of the puzzle. In M. Marschark, Gladys Tang, & Harry Knoors (Eds.), Bilingualism and bilingual deaf education (pp. 74–101). Oxford University Press. DOI logoGoogle Scholar
Ormel, E., Hermans, D., Knoors, H., & Verhoeven, L. (2012). Cross-language effects in written word recognition: The case of bilingual deaf children. Bilingualism, 15(2), 288–303. DOI logoGoogle Scholar
Pan, J., Shu, H., Wang, Y., & Yan, M. (2015). Parafoveal activation of sign translation previews among deaf readers during the reading of Chinese sentences. Memory and Cognition, 43(6), 964–972. DOI logoGoogle Scholar
Pfau, R., & Quer, J. (2010). Nonmanuals: Their grammatical and prosodic roles. In D. Brentari (Ed.), Sign Languages (pp. 381–402). Cambridge University Press. DOI logoGoogle Scholar
Quandt, L. C., & Kubicek, E. (2018). Sensorimotor characteristics of sign translations modulate EEG when deaf signers read English. Brain and Language, 187(June), 9–17. DOI logoGoogle Scholar
Ritter, P., Moosmann, M., & Villringer, A. (2009). Rolandic alpha and beta EEG rhythms’ strengths are inversely related to fMRI-BOLD signal in primary somatosensory and motor cortex. Human Brain Mapping, 30(4), 1168–1187. DOI logoGoogle Scholar
Shook, A., & Marian, V. (2010). Language processing across modalities: Insights from bimodal bilingualism. Cognitive Sciences, 5(1), 57–98.Google Scholar
(2012). Bimodal bilinguals co-activate both languages during spoken comprehension. Cognition, 124(3), 314–324. DOI logoGoogle Scholar
(2013). The bilingual language interaction network for comprehension of speech. Bilingualism. Language and Cognition, 16(2), 304–324. DOI logoGoogle Scholar
(2019). Covert co-activation of bilinguals’ non-target language. Linguistic Approaches to Bilingualism, 9(2), 228–252. DOI logoGoogle Scholar
Stokoe, W. C. (1960). Sign language structure: An outline of the visual communication systems of the American deaf. Journal Of Deaf Studies and Deaf Education, 10(1), 3–37. DOI logoGoogle Scholar
Thierfelder, P., Wigglesworth, G., & Tang, G. (2020). Sign phonological parameters modulate parafoveal preview effects in deaf readers. Cognition, 201. DOI logoGoogle Scholar
Thierry, G., & Wu, Y. J. (2007). Brain potentials reveal unconscious translation during foreign-language comprehension. Proceedings of the National Academy of Sciences of the United States of America, 104(30), 12530–12535. DOI logoGoogle Scholar
Treffers-Daller, J. (2019). What defines language dominance in bilinguals? Annual Review of Linguistics, 5, 375–393. DOI logoGoogle Scholar
Treiman, R., & Hirsh-Pasek, K. (1983). Silent reading: Insights from second-generation deaf readers. Cognitive Psychology, 15(1), 39–65. DOI logoGoogle Scholar
Villameriel, S., Dias, P., Costello, B., & Carreiras, M. (2016). Cross-language and cross-modal activation in hearing bimodal bilinguals. Journal of Memory and Language, 87, 59–70. DOI logoGoogle Scholar
Villwock, A., Wilkinson, E., Piñar, P., & Morford, J. P. (2021). Language development in deaf bilinguals: Deaf middle school students co-activate written English and American Sign Language during lexical processing. Cognition, 211(February), 104642. DOI logoGoogle Scholar
Williams, J., & Newman, S. (2016). Interlanguage dynamics and lexical networks in nonnative L2 signers of ASL: Cross-modal rhyme priming. Bilingualism: Language and Cognition, 19(3), 453–470. DOI logoGoogle Scholar
Wu, Y. J., & Thierry, G. (2010). Chinese-English bilinguals reading English hear Chinese. Journal of Neuroscience, 30(22), 7646–7651. DOI logoGoogle Scholar