Cover not available
Article published In:
Translation, Cognition & Behavior
Vol. 1:2 (2018) ► pp.221–250

Iconic culture-specific images influence language non-selective translation activation in bilinguals

Evidence from eye movements

| University of Hyderabad
| University of Hyderabad

Two experiments using the visual-world paradigm examined whether culture-specific images influence the activation of translation equivalents during spoken-word recognition in bilinguals. In Experiment 1, the participants performed a visual-world task during which they were asked to click on the target after the spoken word (L1 or L2). In Experiment 2, the participants were presented with culture-specific images (faces representing L1, L2 and Neutral) during the visual world task. Time-course analysis of Experiment 1 revealed that there were a significantly higher number of looks to TE-cohort member compared to distractors only when participants heard to L2 words. In Experiment 2, when the cultural-specific images were congruent with the spoken word’s language, participants deployed higher number of looks to TE-cohort member compared to distractors. This effect was seen in both the language directions but not when the culture-specific images were incongruent with the spoken word. The eyetracking data suggest that culture-specific images influence cross-linguistic activation of semantics during bilingual audio-visual language processing.

Keywords: culture-specific images, visual-world paradigm, spoken-word recognition, bilingualism, non-selective translation activation, language proficiency
Article outline
  • 1.Experiment 1
    • 1.1Methods
      • 1.1.1Participants
      • 1.1.2Control tasks
    • 1.2Stimulus images used for visual world
      • 1.2.1Selection of stimuli
      • 1.2.2Distractors
    • 1.3Procedure
    • 1.4Data analysis
      • Proportion of fixations
      • Saccade latency
      • Manual responses
    • 1.5Results
      • First-time window: 200–400 ms
      • Second-time window: 400–600 ms
      • Third-time window: 600–800 ms
      • Fourth-time window: 800–1000 ms
      • Saccade latency
      • Manual responses
    • 1.6Discussion
  • 2.Experiment 2
    • 2.1Methods
      • 2.1.1Participants
      • 2.1.2Stimuli images
    • 2.2Procedure
    • 2.3Data analysis
      • Proportion of fixations
      • Saccade latency
      • Manual responses
    • 2.4Results
      • 2.4.1Time course analysis
        • First time window: 200–400 ms
        • Second time window: 400–600 ms
        • Third time window: 600–800 ms
        • Fourth time window: 800–1000 ms
        • Saccade latency
        • Manual responses
    • 2.5Discussion
  • 3.General discussion
  • Acknowledgements
  • References
Published online: 27 September 2018
DOI logo
https://doi.org/10.1075/tcb.00010.kap
References

References

Barr, Dale J.
2008 “Analyzing ‘Visual World’ Eyetracking Data Using Multilevel Logistic Regression.” Journal of Memory and language 59 (4): 457–474. DOI logoGoogle Scholar
Blumenfeld, Henrike K., and Viorica Marian
2007 “Constraints on Parallel Activation in Bilingual Spoken Language Processing: Examining Proficiency and Lexical Status Using Eye-tracking.” Language and Cognitive Processes 22 (5): 633–660. DOI logoGoogle Scholar
2011 “Bilingualism Influences Inhibitory Control in Auditory Comprehension.” Cognition 118 (2): 245–257. DOI logoGoogle Scholar
2013 “Parallel Language Activation and Cognitive Control during Spoken Word Recognition in Bilinguals.” Journal of Cognitive Psychology 25 (5): 547–567. DOI logoGoogle Scholar
De Groot, Annette M. B., Philip Delmaar, and Stephen J. Lupker
2000 “The Processing of Interlexical Homographs in Translation Recognition and Lexical Decision: Support for Non-selective Access to Bilingual Memory.” The Quarterly Journal of Experimental Psychology. Section A 53 (2): 397–428. DOI logoGoogle Scholar
Dijkstra, Ton, and Walter J. B. Van Heuven
2002 “The Architecture of the Bilingual Word Recognition System: From Identification to decision.” Bilingualism: Language and Cognition 5 (3): 175–197. DOI logoGoogle Scholar
Dimitropoulou, Maria, Jon Andoni Duñabeitia, and Manuel Carreiras
2011 “Masked Translation Priming Effects with Low Proficient Bilinguals.” Memory & Cognition 39 (2): 260–275. DOI logoGoogle Scholar
Grainger, Jonathan, Mathieu Declerck, and Yousri Marzouki
2017 “On National Flags and Language Tags: Effects of Flag-Language Congruency in Bilingual Word Recognition.” Acta Psychologica 1781: 12–17. DOI logoGoogle Scholar
Hartsuiker, Robert J., and Mathieu Declerck
2009 “Albert Costa y Julio Iglesias move up, but Fidel Castro stays put: Language attraction in bilingual language production.” In AMLaP 2009 Conference, Barcelona, Spain.Google Scholar
Huettig, Falk, Joost Rommers, and Antje S. Meyer
2011 “Using the Visual World Paradigm to Study Language Processing: A Review and Critical Evaluation.” Acta Psychologica 137 (2): 151–171. DOI logoGoogle Scholar
Huettig, Falk, Niharika Singh, and Ramesh Kumar Mishra
2011 “Language-mediated Visual Orienting Behavior in Low and High Literates.” Frontiers in Psychology 2 (285).Google Scholar
Kroll, Judith F., Janet G. Van Hell, Natasha Tokowicz, and David W. Green
2010 “The Revised Hierarchical Model: A Critical Review and Assessment.” Bilingualism: Language and Cognition 13 (3): 373–381. DOI logoGoogle Scholar
Lemhöfer, Kristin, and Mirjam Broersma
2012 “Introducing LexTALE: A Quick and Valid Lexical Test for Advanced Learners of English.” Behavior Research Methods 44, (2): 325–343. DOI logoGoogle Scholar
Leys, Christophe, Christophe Ley, Olivier Klein, Philippe Bernard, and Laurent Licata
2013 “Detecting Outliers: Do Not Use Standard Deviation Around the Mean, Use Absolute Deviation around the Median.” Journal of Experimental Social Psychology 49 (4): 764–766. DOI logoGoogle Scholar
Li, Yunqing, Jing Yang, K. Suzanne Scherf, and Ping Li
2013 “Two Faces, Two Languages: An fMRI Study of Bilingual Picture Naming.” Brain and Language 127 (3): 452–462. DOI logoGoogle Scholar
Marian, Viorica, and Michael Spivey
2003 “Competing Activation in Bilingual Language Processing: Within-band Between-language Competition.” Bilingualism: Language and Cognition 6 (3): 97–115. DOI logoGoogle Scholar
Marian, Viorica, Michael Spivey, and Joy Hirsch
2003 “Shared and Separate Systems in Bilingual Language Processing: Converging Evidence from Eyetracking and Brain Imaging.” Brain and Language 86 (1): 70–82. DOI logoGoogle Scholar
Mishra, Ramesh Kumar, and Niharika Singh
2014 “Language Non-selective Activation of Orthography during Spoken Word Processing in Hindi—English Sequential Bilinguals: An Eye Tracking Visual World Study.” Reading and Writing 27 (1): 129–151. DOI logoGoogle Scholar
2016 “The Influence of Second Language Proficiency on Bilingual Parallel Language Activation in Hindi–English Bilinguals.” Journal of Cognitive Psychology 28 (4): 396–411. DOI logoGoogle Scholar
Molnar, Monika, Antonio Ibáñez Molina, and Manuel Carreiras
2015 “Interlocutor Identity Affects Language Activation in Bilinguals.” Journal of Memory and Language 811: 91–104. DOI logoGoogle Scholar
Pickering, Martin J., and Simon Garrod
2004 “The Interactive-alignment Model: Developments and Refinements.” Behavioral and Brain Sciences 27 (2): 212–225. DOI logoGoogle Scholar
Pivneva, Irina, Julie Mercier, and Debra Titone
2014 “Executive Control Modulates Cross-language Lexical Activation during L2 Reading: Evidence from Eye Movements.” Journal of Experimental Psychology: Learning, Memory, and Cognition 40 (3): 787.Google Scholar
Roychoudhuri, Kesaban S., Seema G. Prasad, and Ramesh K. Mishra
2016 “Iconic Native Culture Cues Inhibit Second Language Production in a Non-immigrant Population: Evidence from Bengali-English Bilinguals.” Frontiers in Psychology 71: 1516. DOI logoGoogle Scholar
Saslow, M. G.
1967 “Effects of Components of Displacement-step Stimuli upon Latency for Saccadic Eye Movement.” JOSA 57 (8): 1024–1029. DOI logoGoogle Scholar
Shook, Anthony, and Viorica Marian
2012 “Bimodal Bilinguals Co-activate Both Languages during Spoken Comprehension.” Cognition 124 (3) 314–324. DOI logoGoogle Scholar
2013 “The Bilingual Language Interaction Network for Comprehension of Speech.” Bilingualism: Language and Cognition 16 (2): 304–324. DOI logoGoogle Scholar
Singh, Niharika, and Ramesh Kumar Mishra
2015 “Unintentional Activation of Translation Equivalents in Bilinguals Leads to Attention Capture in a Cross-modal Visual Task.” PloS one 10 (3): e0120131. DOI logoGoogle Scholar
Snodgrass, Joan G., and Mary Vanderwart
1980 “A Standardized Set of 260 Pictures: Norms for Name Agreement, Image Agreement, Familiarity, and Visual Complexity.” Journal of Experimental Psychology: Human Learning and Memory 6 (2): 174.Google Scholar
Sunderman, Gretchen L., and Kanu Priya
2012 “Translation Recognition in Highly Proficient Hindi—English Bilinguals: The Influence of Different Scripts but Connectable Phonologies.” Language and Cognitive Processes 27 (9): 1265–1285. DOI logoGoogle Scholar
Tanenhaus, Michael K., Michael J. Spivey-Knowlton, Kathleen M. Eberhard, and Julie C. Sedivy
1995 “Integration of Visual and Linguistic Information in Spoken Language Comprehension.” Science 268 (5217) 1632–1634. DOI logoGoogle Scholar
Tanenhaus, Michael K., James S. Magnuson, Delphine Dahan, and Craig Chambers
2000 “Eye Movements and Lexical Access in Spoken-language Comprehension: Evaluating a Linking Hypothesis between Fixations and Linguistic Processing.” Journal of Psycholinguistic Research 29 (6): 557–580. DOI logoGoogle Scholar
Weber, Andrea, and Anne Cutler
2004 “Lexical Competition in Non-native Spoken-word Recognition.” Journal of Memory and Language 50 (1): 1–25. DOI logoGoogle Scholar
Wu, Yan Jing, and Guillaume Thierry
2010 “Investigating Bilingual Processing: the Neglected Role of Language Processing Contexts.” Frontiers in Psychology 11: 178. DOI logoGoogle Scholar
Zhang, Shu, Michael W. Morris, Chi-Ying Cheng, and Andy J. Yap
2013 “Heritage-culture Images Disrupt Immigrants’ Second-language Processing through Triggering First-language Interference.” Proceedings of the National Academy of Sciences 110 (28): 11272–11277. DOI logoGoogle Scholar
Zhang, Taoli, Walter JB Van Heuven, and Kathy Conklin
2011 “Fast Automatic Translation and Morphological Decomposition in Chinese-English Bilinguals.” Psychological Science 22 (10) 1237–1242. DOI logoGoogle Scholar
Cited by

Cited by 3 other publications

Bhandari, Pratik, Seema Prasad & Ramesh Kumar Mishra
2020. High proficient bilinguals bring in higher executive control when encountering diverse interlocutors. Journal of Cultural Cognitive Science 4:2 ► pp. 201 ff. DOI logo
Kapiley, Keerthana & Ramesh Kumar Mishra
2024. Language contexts induced by the interlocutors’ proficiencies modulate bilingual language monitoring. Bilingualism: Language and Cognition ► pp. 1 ff. DOI logo
Prasad, Seema & Ramesh Kumar Mishra
2021. Concurrent verbal working memory load constrains cross-linguistic translation activation: A visual world eye-tracking study on Hindi–English bilinguals. Bilingualism: Language and Cognition 24:2 ► pp. 241 ff. DOI logo

This list is based on CrossRef data as of 8 april 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.