Cover not available
Part of
Visually Situated Language Comprehension
Edited by Pia Knoeferle, Pirita Pyykkönen-Klauck and Matthew W. Crocker
[Advances in Consciousness Research 93] 2016
► pp. 83–126

The role of syntax in sentence and referential processing

| School of Psychology, University of Dundee
| Department of Linguistics, University of Alberta

How language comprehenders process the syntactic structure of sentences and, to a somewhat lesser extent, how sentence structure affects referential processing have been important questions in language comprehension research. Results from studies using the visual-world eye-tracking method have yielded important insights regarding these issues. In these studies, participants listen to sentences with varying structure (often involving ambiguity) while an eye tracker monitors their eye fixations to objects or pictures of words in the sentence. Because listeners rapidly fixate the objects/pictures in the sentence (Cooper, 1974; Allopenna, Magnuson, & Tanenhaus, 1998) and even fixate objects/pictures that are likely to be mentioned next (Altmann & Kamide, 1999), fixations to the objects/pictures can be used to inform us about how language comprehenders process sentence structure and how it affects referential processing. This chapter reviews visual-world studies that have done this.

Published online: 10 March 2016
DOI logo
https://doi.org/10.1075/aicr.93.04gom
References
Allopenna, P.D., Magnuson, J.S., & Tanenhaus, M.K
(1998) Tracking the time course of spoken word recognition using eye movements: Evidence for continuous mapping models. Journal of Memory and Language, 38, 419-439. DOI logoGoogle Scholar
Altmann, G., & Steedman, M
(1988) Interaction with context during human sentence processing. Cognition, 30, 191-238. DOI logoGoogle Scholar
Altmann, G.T.M., & Kamide, Y
(1999) Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition, 73, 247-264. DOI logoGoogle Scholar
Arai, M., Van Gompel, R.P.G., & Scheepers, C
(2007) Priming ditransitive structures in comprehension. Cognitive Psychology, 54, 218-250. DOI logoGoogle Scholar
Arnold, J.E., Eisenband, J.G., Brown-Schmidt, S., & Trueswell, J.C
(2000) The rapid use of gender information: Evidence of the time course of pronoun resolution from eyetracking. Cognition, 76, B13-B26. DOI logoGoogle Scholar
Arnold, J.E., Brown-Schmidt, S., Trueswell, J., & Fagnano, M
(2005) Children's use of gender and order of mention during pronoun comprehension. In J.C. Trueswell & M.K. Tanenhaus (Eds.), Processing world-situated language: Bridging the language-as-product and language-as-action traditions. Boston: MIT Press.Google Scholar
Arnold, J.E., Brown-Schmidt, S., & Trueswell, J
(2007) Children's use of gender and order-of-mention during pronoun comprehension. Language and Cognitive Processes, 22, 527-565. DOI logoGoogle Scholar
Bock, J.K
(1986) Syntactic persistence in language production. Cognitive Psychology, 18, 355-387. DOI logoGoogle Scholar
Bock, K., & Loebell, H
(1990) Framing sentences. Cognition, 35, 1-39. DOI logoGoogle Scholar
Boland, J.E
(2005) Visual arguments. Cognition, 95, 237-274. DOI logoGoogle Scholar
Bouma, G., & Hopp, H
(2007)  Coreference preferences for personal pronouns in German . Paper presented at the Conference on Intersentential Pronominal Reference in Child and Adult Language.
Branigan, H.P., Pickering, M.J., & McLean, J.F
(2005) Priming prepositional-phrase attachment during comprehension. Journal of Experimental Psychology-Learning Memory and Cognition, 31, 468-481. DOI logoGoogle Scholar
Britt, M.A
(1994) The interaction of referential ambiguity and argument structure in the parsing of prepositional phrases. Journal of Memory and Language, 33, 251-283. DOI logoGoogle Scholar
Brown-Schmidt, S., Byron, D.K., & Tanenhaus, M.K
(2005) Beyond salience: Interpretation of personal and demonstrative pronouns. Journal of Memory and Language, 53, 292-313. DOI logoGoogle Scholar
Carminati, M.N., Van Gompel, R.P.G., Scheepers, C., & Arai, M
(2008) Syntactic priming in comprehension: The role of argument order and animacy. Journal of Experimental Psychology-Learning Memory and Cognition, 34, 1098-1110. DOI logoGoogle Scholar
Carminati, M.N., & Van Gompel, R.P.G
(2010)  Structural priming is not short lived . Unpublished manuscript.Google Scholar
Carreiras, M., Gernsbacher, M.A., & Villa, V
(1995) The advantage of first mention in Spanish. Psychonomic Bulletin and Review, 2, 124-129. DOI logoGoogle Scholar
Chambers, C.G., Tanenhaus, M.K., Eberhard, K.M., Filip, H., & Carlson, G.N
(2002) Circumscribing referential domains during real-time language comprehension. Journal of Memory and Language, 47, 30-49. DOI logoGoogle Scholar
Chambers, C.G., Tanenhaus, M.K., & Magnuson, J.S
(2004) Actions and affordances in syntactic ambiguity resolution. Journal of Experimental Psychology-Learning Memory and Cognition, 30, 687-696. DOI logoGoogle Scholar
Choi, Y., & Trueswell, J.C
(2010) Children's (in)ability to recover from garden paths in a verb-final language: Evidence for developing control in sentence processing. Journal of Experimental Child Psychology, 106, 41-61. DOI logoGoogle Scholar
Chomsky, N
(1986) Barriers. Cambridge, MA: MIT Press.Google Scholar
Christianson, K., Hollingworth, A., Halliwell, J.F., & Ferreira, F
(2001) Thematic roles assigned along the garden path linger. Cognitive Psychology, 42, 368-407. DOI logoGoogle Scholar
Clackson, K., Felser, C., & Clahsen, H
(2011) Children's processing of reflexives and pronouns in English: Evidence from eye-movements during listening. Journal of Memory and Language, 65, 128-144. DOI logoGoogle Scholar
Cooper, R.M
(1974) The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology, 6, 84-107. DOI logoGoogle Scholar
Cozijn, R., Commandeur, E., Vonk, W., & Noordman, L.G.M
(2011) The time course of the use of implicit causality information in the processing of pronouns: A visual world paradigm study. Journal of Memory and Language, 64, 381-403. DOI logoGoogle Scholar
Crain, S., & Steedman, M
(1985) On not being led up the garden path: The use of context by the psychological syntax processor. In D.R. Dowty, L. Karttunen, & A.M. Zwicky (Eds.), Natural language parsing: Psychological, computational and theoretical perspectives (pp. 320-358). Cambridge, England: CUP. DOI logoGoogle Scholar
Crawley, R.A., Stevenson, R.J., & Kleinman, D
(1990) The use of heuristic strategies in the interpretation of pronouns. Journal of Psycholinguistic Research, 19, 245-264. DOI logoGoogle Scholar
Dowty, D.R
(1991) Thematic proto-roles and argument selection. Language, 67, 547-619. DOI logoGoogle Scholar
Ellert, M
(2010) Ambiguous pronoun resolution in L1 and L2 German and Dutch. Wageningen: Ponsen & Looijen.Google Scholar
Ellert, M., Roberts, L., & Järvikivi, J
(2011) Verarbeitung und Disambiguierung pronominaler Referenz in der Fremdsprache Deutsch: Eine psycholinguistische Studie. In A. Krafft & C. Spiegel (Eds.), Sprachliche Förderung und Weiterbildung – Transdisziplinär (pp. 51-68). Berlin: Peter Lang.Google Scholar
Ferreira, F., & Clifton, C
(1986) The independence of syntactic processing. Journal of Memory and Language, 25, 348-368. DOI logoGoogle Scholar
Ferreira, F
(2003) The misinterpretation of noncanonical sentences. Cognitive Psychology, 47, 164-203. DOI logoGoogle Scholar
Frazier, L
(1979)  On comprehending sentences: Syntactic parsing strategies . Unpublished Ph.D. Dissertation. Indiana University Linguistics Club, University of Connecticut.
Frazier, L., & Rayner, K
(1982) Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences. Cognitive Psychology, 14, 178-210. DOI logoGoogle Scholar
Frederiksen, J.R
(1981) Understanding anaphora: Rules used by readers in assigning pronominal reference. Discourse processes, 4, 323-347. DOI logoGoogle Scholar
Garnham, A., Traxler, M., Oakhill, J., & Gernsbacher, M.A
(1996) The locus of implicit causality effects in comprehension. Journal of Memory and Language, 35, 517-543. DOI logoGoogle Scholar
Garnham, A
(2001) Mental models and the interpretation of anaphora. Hove: Psychology Press.Google Scholar
Gernsbacher, M.A., & Hargreaves, D.J
(1988) Accessing sentence participants: The advantage of first mention. Journal of Memory and Language, 27, 699-717. DOI logoGoogle Scholar
Gernsbacher, M.A., Hargreaves, D.J., & Beeman, M
(1989) Building and accessing clausal representations: The advantage of first mention versus the advantage of clause recency. Journal of Memory and Language, 28, 735-755. DOI logoGoogle Scholar
Gernsbacher, M.A
(1989) Mechanisms that improve referential access. Cognition, 32, 99-156. DOI logoGoogle Scholar
Gordon, P.C., Grosz, B.J., & Gilliom, L.A
(1993) Pronouns, names, and the centering of attention. Cognitive Science, 17, 311-347. DOI logoGoogle Scholar
Hartshorne, J.K., Nappa, R., & Snedeker, J
(2015) Development of the first-mention bias. Journal of Child Language, 42, 423-446. DOI logoGoogle Scholar
Hurewitz, F., Brown-Schmidt, S., Thorpe, K., Gleitman, L.R., & Trueswell, J.C
(2000) One frog, two frog, red frog, blue frog: Factors affecting children's syntactic choices in production and comprehension. Journal of Psycholinguistic Research, 29, 597-626. DOI logoGoogle Scholar
Järvikivi, J., Pyykkönen-Klauck, P., Schimke, S., Colonna, S., & Hemforth, B
(2014) Information structure cues for 4-year-olds and adults: Tracking eye movements to visually presented anaphoric referents. Language, Cognition and Neuroscience, 29, 877-892. DOI logoGoogle Scholar
Järvikivi, J., Van Gompel, R.P.G., Hyönä, J., & Bertram, R
(2005) Ambiguous pronoun resolution - Contrasting the first-mention and subject-preference accounts. Psychological Science, 16, 260-264. DOI logoGoogle Scholar
Järvikivi, J., Van Gompel, R., & Hyönä, J
(2015)  The interplay of implicit causality, structural heuristics, and anaphor type in ambiguous pronoun resolution . Unpublished manuscript.Google Scholar
Kaiser, E
(2011) Focusing on pronouns: Consequences of subjecthood, pronominalization and contrastive focus. Language and Cognitive Processes, 26, 1625-1666 DOI logoGoogle Scholar
Kaiser, E., & Trueswell, J.C
(2008) Interpreting pronouns and demonstratives in Finnish: Evidence for a form-specific approach to reference resolution. Language and Cognitive Processes, 23, 709-748. DOI logoGoogle Scholar
Kaiser, E., Runner, J.T., Sussman, R.S., & Tanenhaus, M.K
(2009) Structural and semantic constraints on the resolution of pronouns and reflexives. Cognition, 112, 55-80. DOI logoGoogle Scholar
Kako, E
(2006) Thematic role properties of subjects and objects. Cognition, 101, 1-42. DOI logoGoogle Scholar
Kamide, Y., Scheepers, C., & Altmann, G.T.M
(2003) Integration of syntactic and semantic information in predictive processing: Cross-linguistic evidence from German and English. Journal of Psycholinguistic Research, 32, 37-55. DOI logoGoogle Scholar
Kamide, Y., Altmann, G.T.M., & Haywood, S.L
(2003) The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye movements. Journal of Memory and Language, 49, 133-156. DOI logoGoogle Scholar
Kidd, E., & Bavin, E.L
(2005) Lexical and referential cues to sentence interpretation: An investigation of children's interpretations of ambiguous sentences. Journal of Child Language, 32, 855-876. DOI logoGoogle Scholar
Kidd, E., Stewart, A.J., & Serratrice, L
(2011) Children do not overcome lexical biases where adults do: The role of the referential scene in garden-path recovery. Journal of Child Language, 38, 222-234. DOI logoGoogle Scholar
Knoeferle, P., Crocker, M.W., Scheepers, C., & Pickering, M.J
(2005) The influence of the immediate visual context on incremental thematic role-assignment: Evidence from eye-movements in depicted events. Cognition, 95, 95-127. DOI logoGoogle Scholar
Knoeferle, P., & Crocker, M.W
(2007) The influence of recent scene events on spoken comprehension: Evidence from eye movements. Journal of Memory and Language, 57, 519-543. DOI logoGoogle Scholar
Koornneef, A.W., & Van Berkum, J.J.A
(2006) On the use of verb-based implicit causality in sentence comprehension: Evidence from self-paced reading and eye tracking. Journal of Memory and Language, 54, 445-465. DOI logoGoogle Scholar
Ledoux, K., Traxler, M.J., & Swaab, T.Y
(2007) Syntactic priming in comprehension: Evidence from event-related potentials. Psychological Science, 18, 135-143. DOI logoGoogle Scholar
MacDonald, M.C., Pearlmutter, N.J., & Seidenberg, M.S
(1994) The lexical nature of syntactic ambiguity resolution. Psychological Review, 101, 676-703. DOI logoGoogle Scholar
McDonald, J.L., & MacWhinney, B
(1995) The time course of anaphor resolution: Effects of implicit causality and gender. Journal of Memory and Language, 34, 543-566. DOI logoGoogle Scholar
McRae, K., Spivey-Knowlton, M.J., & Tanenhaus, M.K
(1998) Modeling the influence of thematic fit (and other constraints) in on-line sentence comprehension. Journal of Memory and Language, 38, 283-312. DOI logoGoogle Scholar
Murray, W.S., & Liversedge, S.P
(1994) Referential context effects on syntactic processing. In C. Clifton, L. Frazier, & K. Rayner (Eds.), Perspectives on sentence processing (pp. 359-388). Hillsdale, NJ, US: Lawrence Erlbaum Associates, Inc.Google Scholar
Novick, J.M., Trueswell, J.C., & Thompson-Schill, S.L
(2005) Cognitive control and parsing: Reexamining the role of Broca's area in sentence comprehension. Cognitive Affective & Behavioral Neuroscience, 5, 263-281. DOI logoGoogle Scholar
Novick, J.M., Thompson-Schill, S.L., & Trueswell, J.C
(2008) Putting lexical constraints in context into the visual-world paradigm. Cognition, 107, 850-903. DOI logoGoogle Scholar
Pickering, M.J., & Branigan, H.P
(1998) The representation of verbs: Evidence from syntactic priming in language production. Journal of Memory and Language, 39, 633-651. DOI logoGoogle Scholar
Pickering, M.J., & Ferreira, V.S
(2008) Structural priming: A critical review. Psychological Bulletin, 134, 427-459. DOI logoGoogle Scholar
Pyykkönen, P., & Järvikivi, J
(2010) Activation and persistence of implicit causality information in spoken language comprehension. Experimental Psychology, 57(1), 5-16. DOI logoGoogle Scholar
Pyykkönen, P., Matthews, D., & Järvikivi, J
(2010) Three-year-olds are sensitive to semantic prominence during online language comprehension: A visual world study of pronoun resolution. Language and Cognitive Processes, 25, 115-129. DOI logoGoogle Scholar
Rayner, K., Carlson, M., & Frazier, L
(1983) The interaction of syntax and semantics during sentence processing: Eye movements in the analysis of semantically biased sentences. Journal of Verbal Learning and Verbal Behavior, 22, 358-374. DOI logoGoogle Scholar
Reinhart, T
(1983) Anaphora and semantic interpretation. London: Croom Helm.Google Scholar
Rose, R.L
(2005)  The relative contribution of syntactic and semantic prominence to the salience of discourse entities . Unpublished PhD thesis, Northwestern University.
Runner, J.T., Sussman, R.S., & Tanenhaus, M.K
(2003) Assignment of reference to reflexives and pronouns in picture noun phrases: Evidence from eye movements. Cognition, 89, B1-B13. DOI logoGoogle Scholar
(2006) Processing reflexives and pronouns in picture noun phrases. Cognitive Science, 30, 193-241. DOI logoGoogle Scholar
Scheepers, C., & Crocker, M.W
(2004) Constituent order priming from listening to comprehension: A visual-world study. In M. Carreiras & C. Clifton (Eds.), The on-line study of sentence comprehension: Eyetracking, ERP, and beyond (pp. 167-185). New York: Psychology Press.Google Scholar
Sedivy, J.C., Tanenhaus, M.K., Chambers, C.G., & Carlson, G.N
(1999) Achieving incremental semantic interpretation through contextual representation. Cognition, 71, 109-147. DOI logoGoogle Scholar
Sedivy, J.C
(2003) Pragmatic versus form-based accounts of referential contrast: Evidence for effects of informativity expectations. Journal of Psycholinguistic Research, 32, 3-23. DOI logoGoogle Scholar
Sekerina, I.A., Stromswold, K., & Hestvik, A
(2004) How do adults and children process referentially ambiguous pronouns? Journal of Child Language, 31(1), 123-152. DOI logoGoogle Scholar
Smyth, R
(1994) Grammatical determinants of ambiguous pronoun resolution. Journal of Psycholinguistic Research, 23, 197-229. DOI logoGoogle Scholar
Snedeker, J., & Trueswell, J
(2003) Using prosody to avoid ambiguity: Effects of speaker awareness and referential context. Journal of Memory and Language, 48, 103-130. DOI logoGoogle Scholar
Snedeker, J., & Trueswell, J.C
(2004) The developing constraints on parsing decisions: The role of lexical-biases and referential scenes in child and adult sentence processing. Cognitive Psychology, 49, 238-299. DOI logoGoogle Scholar
Snedeker, J., & Yuan, S
(2008) Effects of prosodic and lexical constraints on parsing in young children (and adults). Journal of Memory and Language, 58, 574-608. DOI logoGoogle Scholar
Song, H.J., & Fisher, C
(2005) Who's "she"? Discourse prominence influences preschoolers' comprehension of pronouns. Journal of Memory and Language, 52(1), 29-57. DOI logoGoogle Scholar
Spivey, M.J., Tanenhaus, M.K., Eberhard, K.M., & Sedivy, J.C
(2002) Eye movements and spoken language comprehension: Effects of visual context on syntactic ambiguity resolution. Cognitive Psychology, 45, 447-481. DOI logoGoogle Scholar
Stewart, A.J., Pickering, M.J., & Sanford, A.J
(2000) The time course of the influence of implicit causality information: Focusing versus integration accounts. Journal of Memory and Language, 42, 423-443. DOI logoGoogle Scholar
Sturt, P
(2013) Referential processing in sentences. In R.P.G. van Gompel (Ed.), Sentence processing. Hove: Psychology Press.Google Scholar
Tanenhaus, M.K., Spivey Knowlton, M.J., Eberhard, K.M., & Sedivy, J.C
(1995) Integration of visual and linguistic information in spoken language comprehension. Science, 268, 1632-1634. DOI logoGoogle Scholar
Thothathiri, M., & Snedeker, J
(2008) Give and take: Syntactic priming during spoken language comprehension. Cognition, 108, 51-68. DOI logoGoogle Scholar
(2008) Syntactic priming during language comprehension in three- and four-year-old children. Journal of Memory and Language, 58, 188-213. DOI logoGoogle Scholar
Tooley, K.M., Traxler, M.J., & Swaab, T.Y
(2009) Electrophysiological and behavioral evidence of syntactic priming in sentence comprehension. Journal of Experimental Psychology-Learning Memory and Cognition, 35, 19-45. DOI logoGoogle Scholar
Townsend, D., & Bever, T.G
(2001) Sentence comprehension: The integration of habits and rules. Cambridge MA: MIT Press.Google Scholar
Traxler, M.J., & Tooley, K.M
(2008) Priming in sentence comprehension: Strategic or syntactic? Language and Cognitive Processes, 23, 609-645. DOI logoGoogle Scholar
Trueswell, J.C., Tanenhaus, M.K., & Kello, C
(1993) Verb-specific constraints in sentence processing: Separating effects of lexical preference from garden-paths. Journal of Experimental Psychology Learning, Memory, and Cognition, 19, 528-553. DOI logoGoogle Scholar
Trueswell, J.C., Tanenhaus, M.K., & Garnsey, S.M
(1994) Semantic influences on parsing: Use of thematic role information in syntactic ambiguity resolution. Journal of Memory and Language, 33, 285-318. DOI logoGoogle Scholar
Trueswell, J.C., Sekerina, I., Hill, N.M., & Logrip, M.L
(1999) The kindergarten-path effect: Studying on-line sentence processing in young children. Cognition, 73, 89-134. DOI logoGoogle Scholar
Van Berkum, J.J.A., Brown, C.M., & Hagoort, P
(1999) Early referential context effects in sentence processing: Evidence from event-related brain potentials. Journal of Memory and Language, 41, 147-182. DOI logoGoogle Scholar
Van Gompel, R.P.G., Pickering, M.J., Pearson, J., & Jacob, G
(2006) The activation of inappropriate analyses in garden-path sentences: Evidence from structural priming. Journal of Memory and Language, 55(3), 335-362. DOI logoGoogle Scholar
Vilkuna, M
1989 Free word order in Finnish: Its syntax and discourse functions. Helsinki: Suomalaisen Kirjallisuuden Seura.Google Scholar
Weber, A., Grice, M., & Crocker, M.W
(2006) The role of prosody in the interpretation of structural ambiguities: As study of anticipatory eye movements. Cognition, 99, B63-B72. DOI logoGoogle Scholar
Weighall, A.R
(2008) The kindergarten path effect revisited: Children's use of context in processing structural ambiguities. Journal of Experimental Child Psychology, 99, 75-95. DOI logoGoogle Scholar
Cited by

Cited by 2 other publications

Cooper-Cunningham, Rebecca, Monique Charest, Vincent Porretta & Juhani Järvikivi
2020. When Couches Have Eyes: The Effect of Visual Context on Children's Reference Processing. Frontiers in Communication 5 DOI logo
Järvikivi, Juhani, Sarah Schimke & Pirita Pyykkönen-Klauck
2019. Understanding Indirect Reference in a Visual Context. Discourse Processes 56:2 ► pp. 117 ff. DOI logo

This list is based on CrossRef data as of 12 april 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.