Exploring sensory-motor influences in the recognition of American Sign Language
David P. Corina | Center for Mind and Brain, University of California, Davis
Eva Gutierrez | Departamento de Metodología de las Ciencias del Comportamiento, Universitat de València
Little is known about how individual signs that occur in naturally produced signed languages are recognized. Here we examine whether sign
understanding may be grounded in sensorimotor properties by evaluating a signer’s ability to make lexical decisions to American Sign
Language (ASL) signs that are articulated either congruent with or incongruent with the observer’s own handedness. Our results show little
evidence for handedness congruency effects for native signers’ perception of ASL, however handedness congruency effects were seen in
non-native late learners of ASL and hearing ASL-English bilinguals. The data are compatible with a theory of sign recognition that makes
reference to internally simulated articulatory control signals — a forward model based upon sensory-motor properties of one’s owns body. The
data suggest that sign recognition may rely upon an internal body schema when processing is non-optimal as a result of having learned ASL
later in life. Native signers however may have developed representations of signs which are less bound to the hand with which it is
performed, suggesting a different engagement of an internal forward model for rapid lexical decisions.
Adank, Patti, Shirley-Ann Rueschemeyer, & Harold Bekkering
(2013) The role of accent imitation in sensorimotor integration during processing of intelligible speech. Frontiers in Human Neuroscience, 7, Article 634.
Balota, David A. & James I. Chumbley
(1984) Are lexical decisions a good measure of lexical access? The role of word frequency in the neglected decision stage. Journal of Experimental Psychology: Human Perception and Performance, 10 (3), 340–357.
Callan, Akiko M., Daniel E. Callan, Keiichi Tajima, & Reiko Akahane-Yamada
(2006) Neural processes involved with perception of non-native durational contrasts. Neuroreport, 17 (12), 1353–1357.
Callan, Daniel E., Jeffery A. Jones, Akiko M. Callan, & Reiko Akahane-Yamada
(2004) Phonetic perceptual identification by native- and second-language speakers differentially activates brain regions involved with acoustic phonetic processing and those involved with articulatory-auditory/orosensory internal models. Neuroimage, 22 (3), 1182–1194.
Callan, Daniel, Akiko Callan, & Jeffery A. Jones
(2014) Speech motor brain regions are differentially recruited during perception of native and foreign-accented phonemes for first and second language listeners. Frontiers in Neuroscience, 81, 1–15.
Corina, David & Heather Knapp
(2006) Sign language processing and the mirror neuron system. Cortex, 42 (4), 529–539.
Du, Yi, Bradley R. Buchsbaum, Cheryl L. Grady, & Claude Alain
(2014) Noise differentially impacts phoneme representations in the auditory and speech motor systems. Proceedings of the National Academy of Sciences, 111 (19), 7126–7131. .
Emmorey, Karen
(2002) Language, cognition, and the brain: Insights from sign language research. Mahwah, NJ: Lawrence Erlbaum.
Emmorey, Karen, Jennifer A. Petrich, & Tamar H. Gollan
(2012) Bilingual processing of ASL–English code-blends: The consequences of accessing two lexical representations simultaneously. Journal of Memory and Language, 67 (1), 199–210.
Galantucci, Bruno, Carol A. Fowler, & Michael T. Turvey
(2006) The motor theory of speech perception reviewed. Psychonomic Bulletin & Review, 13 (3), 361–377.
Hickok, Greg
(2010) The role of mirror neurons in speech perception and action word semantics. Language and Cognitive Processes, 25 (6), 749–776.
Iacoboni, Marco
(2008) The role of premotor cortex in speech perception: Evidence from fMRI and rTMS. Journal of Physiology – Paris, 102 (1), 31–34.
Liberman, Alvin M., Franklin S. Cooper, Donald P. Shankweiler, & Michael Studdert-Kennedy
(1967) Perception of the speech code. Psychological Review, 74 (6), 431–461.
Liberman, Alvin M. & Ignatius G. Mattingly
(1985) The motor theory of speech perception revised. Cognition, 21 (1), 1–36.
MacSweeney, Mairéad, Bencie Woll, Ruth Campbell, Philip K. McGuire, Anthony S. David, Steven C.R. Williams, John Suckling, Gemma A. Calvert, & Michael J. Brammer
(2002) Neural systems underlying British Sign Language and audio‐visual English processing in native users. Brain, 125 (7), 1583–1593.
Neville, Helen J., Daphne Bavelier, David Corina, Josef Rauschecker, Avi Karni, Anil Lalwani, Allen Braun, Vince Clark, Peter Jezzard, & Robert Turner
(1998) Cerebral organization for language in deaf and hearing subjects: Biological constraints and effects of experience. Proceedings of the National Academy of Sciences, 95 (3), 922–929.
Poeppel, David, William J. Idsardi, & Virginie van Wassenhove
(2008) Speech perception at the interface of neurobiology and linguistics. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 363 (1493), 1071–1086.
Pulvermüller, Friedemann, Martina Huss, Ferath Kherif, Fermin Moscoso del Prado Martin, Olaf Hauk, & Yury Shtyrov
(2006) Motor cortex maps articulatory features of speech sounds. Proceedings of the National Academy of Sciences of the United States of America, 103 (20), 7865–7870.
Rauschecker, Josef P
(2011) An expanded role for the dorsal auditory pathway in sensorimotor control and integration. Hearing Research, 271 (1), 16–25.
Schwartz, Jean-Luc, Anahita Basirat, Lucie Ménard, & Marc Sato
(2012) The Perception-for-Action-Control Theory (PACT): A perceptuo-motor theory of speech perception. Journal of Neurolinguistics, 25 (5), 336–354.
Skipper, Jeremy I., Susan Goldin-Meadow, Howard Nusbaum, & Steven Small
(2007) Speech associated gestures, Broca’s area and the human mirror system. Brain and Language, 101 (3), 260–277.
Thompson, Robin & Gabriella Vigliocco
(2013) The relationship between sign production and sign comprehension: What the hands reveal. Presentation at the
Conference Theoretical Issues in Sign Language Research
2013.
Tremblay, Pascale & Steven L. Small
(2011) On the context-dependent nature of the contribution of the ventral premotor cortex to speech perception. NeuroImage, 57 (4), 1561–1571.
Wang, Yue, Joan A. Sereno, Allard Jongman, & Joy Hirsch
(2003) fMRI evidence for cortical modification during learning of mandarin lexical tone. Journal of Cognitive Neuroscience, 15 (7), 1019–1027.
Willems, Roel M. & Peter Hagoort
(2007) Neural evidence for the interplay between language, gesture, and action: A review. Brain and Language, 101 (3), 278–289.
Willems, Roel M., Peter Hagoort, & Daniel Casasanto
(2010) Body-specific representations of action verbs: Neural evidence from right-and left-handers. Psychological Science, 21 (1), 67–74.
Wilson, Stephen M., Ayse P. Saygin, Martin I. Sereno, & Marco Iacoboni
(2004) Listening to speech activates motor areas involved in speech production. Nature Neuroscience, 7 (7), 701–702.
Wilson, Stephen M. & Marco Iacoboni
(2006) Neural responses to non-native phonemes varying in producibility: Evidence for the sensorimotor nature of speech perception. NeuroImage, 33 (1), 316–325.
Wolpert, Daniel, Kenji Doya, & Mitsuo Kawato
(2003) A unifying computational framework for motor control and social interaction. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 358 (1431), 593–602.
2020. Language experience in LSF development: Behavioral evidence from a sentence repetition task. PLOS ONE 15:11 ► pp. e0236729 ff.
Brozdowski, Chris & Karen Emmorey
2020. Shadowing in the manual modality. Acta Psychologica 208 ► pp. 103092 ff.
Clarke, Jean S., Nicholas Llewellyn, Joep Cornelissen & Rowena Viney
2021. Gesture Analysis and Organizational Research: The Development and Application of a Protocol for Naturalistic Settings. Organizational Research Methods 24:1 ► pp. 140 ff.
Gawne, Lauren, Chelsea Krajcik, Helene N. Andreassen, Andrea L. Berez-Kroeker & Barbara F. Kelly
2018. Sensorimotor characteristics of sign translations modulate EEG when deaf signers read English. Brain and Language 187 ► pp. 9 ff.
This list is based on CrossRef data as of 20 may 2023. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.