Cover not available
Part of
Visually Situated Language Comprehension
Edited by Pia Knoeferle, Pirita Pyykkönen-Klauck and Matthew W. Crocker
[Advances in Consciousness Research 93] 2016
► pp. 205–226

The role of affordances in visually situated language comprehension

Affordances are potentiations for bodily action that are routinely evaluated in the course of perception. For example, the physical features of bricks, lamps, and pillows provide salient cues about the actions a perceiver could likely perform with those objects. In visually situated contexts, affordances can provide a potentially useful source of information for aspects of language comprehension. This chapter begins by reviewing various perspectives on affordances as well as issues regarding their computation. Of particular relevance is how the information provided by affordances differs from linguistically- or conceptually-encoded links between objects and actions, such as selectional restrictions or semantic associations. The chapter then describes various ways in which affordances influence visually situated language comprehension, using examples from different levels of linguistic processing. The remainder of the chapter considers whether language comprehension reflects the influence of “genuine” affordances or instead a system in which information about the idiosyncratic features of perceptible objects is combined with (and often controlled by) linguistic and cognitive constraints.

Published online: 10 March 2016
DOI logo
https://doi.org/10.1075/aicr.93.08cha
References
Altmann, G.T.M., & Kamide, Y
(1999) Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition, 73, 247-264. DOI logoGoogle Scholar
(2009) Discourse mediation of the mapping between language and the visual world: Eye movements and mental representation. Cognition, 111, 55-71. DOI logoGoogle Scholar
Ballmer, T
(1981) Context change and its consequences for a theory of natural language. In H. Parret, M. Sbisà, & J. Verschueren (Eds.), Studies in language companion series: Vol. 7. Possibilities and limitations of pragmatics (pp. 17-55). Amsterdam: John Benjamins. DOI logoGoogle Scholar
Chambers, C.G., & Cooke, H
(2009) Lexical competition during second-language listening: Sentence context, but not proficiency, constrains interference from the native lexicon. Journal of Experimental Psychology: Learning, Memory & Cognition, 35, 1029-1040. DOI logoGoogle Scholar
Chambers, C.G., & San Juan, V
(2008) Perception and presupposition in real-time language comprehension: Insights from anticipatory processing. Cognition, 108, 26-50. DOI logoGoogle Scholar
Chambers, C.G., Tanenhaus, M.K., Eberhard, K.M., Filip, H., & Carlson, G.N
(2002) Circumscribing referential domains during real-time language comprehension. Journal of Memory and Language, 47, 30-49. DOI logoGoogle Scholar
Chambers, C.G., Tanenhaus, M.K., & Magnuson, J.S
(2004) Actions and affordances in syntactic ambiguity resolution. Journal of Experimental Psychology: Learning, Memory and Cognition, 30, 687-696. DOI logoGoogle Scholar
Collins, S.J., Graham, S.A., & Chambers, C.G
(2012) Preschoolers’ sensitivity to speaker action constraints to refer referential intent. Journal of Experimental Child Psychology, 112, 389-402. DOI logoGoogle Scholar
Crain, S., & Steedman, M
(1985) On not being led up the garden path: The use of context by the psychological parser. In D. Dowty, L. Karttunen, & A. Zwicky (Eds.), Natural language parsing: Psychological, computational, and theoretical perspectives (pp. 320-358). Cambridge, UK: Cambridge University Press. DOI logoGoogle Scholar
Dahan, D., & Tanenhaus, M.K
(2004) Continuous mapping form sound to meaning in spoken-language comprehension: Immediate effects of verb-based thematic constraints. Journal of Experimental Psychology: Learning, Memory and Cognition, 30, 498-513. DOI logoGoogle Scholar
Ellis, R., & Tucker, M
(2000) Micro-affordance: The potentiation of components of action by seen objects. British Journal of Psychology, 91, 451-471. DOI logoGoogle Scholar
Garnham, A., & Oakhill, J.V
(1996) The mental models theory of language comprehension. In B.K. Britton & A.C. Graesser (Eds.), Models of understanding text (pp. 313-339). Hillsdale, NJ: Erlbaum.Google Scholar
Gibson, J.J
(1977) The theory of affordances. In R. Shaw & J. Bransford (Eds.), Perceiving, acting, and knowing: Toward an ecological psychology (pp. 67-82). Hillsdale, NJ: Erlbaum.Google Scholar
(1979) The ecological approach to visual perception. New York: Houghton Mifflin.Google Scholar
Glenberg, A.M., Becker, R., Klötzer, S., Kolano, L., Müller, S., & Rinck, M
(2009) Episodic affordances contribute to language comprehension. Language and Cognition, 1, 113-135. DOI logoGoogle Scholar
Glenberg, A.M., & Robertson, D.A
(1999) Indexical understanding of instructions. Discourse Processes, 28, 1-26. DOI logoGoogle Scholar
(2000) Symbol grounding and meaning: A comparison of high-dimensional and embodied theories of meaning. Journal of Memory and Language, 43, 379-401. DOI logoGoogle Scholar
Greeno, J.G
(1994) Gibson's affordances. Psychological Review, 101, 336-342. DOI logoGoogle Scholar
Hanna, J.E. & Tanenhaus, M.K
(2004) Pragmatic effects on reference resolution in a collaborative task: Evidence from eye movements. Cognitive Science, 28, 105-115. DOI logoGoogle Scholar
Humphreys, G
(2001) Objects, affordances, action! The Psychologist, 14, 408-412.Google Scholar
Johnson-Laird, P.N
(1983) Mental models: Towards a cognitive science of language, inference and consciousness. Cambridge, UK: Cambridge University Press.Google Scholar
Jones, K.S
(2003) What is an affordance? Ecological Psychology, 15, 107-114. DOI logoGoogle Scholar
Kako, E., & Trueswell, J.C
(2000) Verb meanings, object affordances, and the incremental restriction of reference. Proceedings of the 22nd Annual Conference of the Cognitive Science Society (pp. 256-261). Hillsdale, NJ: Erlbaum.
Kamp, H., & Reyle, U
(1993) From discourse to logic. Dordrecht, NL: Kluwer. DOI logoGoogle Scholar
Kaschak, M.P., & Glenberg, A.M
(2000) Constructing meaning: The role of affordances and grammatical constructions in sentence comprehension. Journal of Memory and Language, 43, 508-529. DOI logoGoogle Scholar
Knoeferle, P., & Crocker, M.W
(2007) The influence of recent scene events on spoken comprehension: Evidence from eye movements. Journal of Memory and Language, 57, 519-543. DOI logoGoogle Scholar
Kraljic, T., Samuel, A.G., & Brennan, S.E
(2008) First impressions and last resorts: How listeners adjust to speaker variability. Psychological Science, 19, 332-338. DOI logoGoogle Scholar
Magnuson, J.S., Dixon, J., Tanenhaus, M.K., & Aslin, R.N
(2007) The dynamics of lexical competition during spoken word recognition. Cognitive Science, 31, 133-156. DOI logoGoogle Scholar
Magnuson, J.S., Tanenhaus, M.K., Aslin, R.N., & Dahan, D
(2003) The time course of spoken word recognition and learning: Studies with artificial lexicons. Journal of Experimental Psychology: General, 132, 202-227. DOI logoGoogle Scholar
Myung, J.-J., Blumstein, S.E., & Sedivy, J.C
(2006) Playing on the typewriter, typing on the piano: Manipulation knowledge of objects. Cognition, 98, 223-243. DOI logoGoogle Scholar
Revill, K.P., Tanenhaus, M.K., & Aslin, R.N
(2008) Context and spoken word recognition in a novel lexicon. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 1207-1223. DOI logoGoogle Scholar
Riddoch, M.J., & Humphreys, G.W
(1987) Visual object processing in a case of optic aphasia: A case of semantic access agnosia. Cognitive Neuropsychology, 4, 131-185. DOI logoGoogle Scholar
Riddoch, M.J., Humphreys, G.W., & Price, C.J
(1989) Routes to action: Evidence from apraxia. Cognitive Neuropsychology, 6, 437-454. DOI logoGoogle Scholar
Sedivy, J.C., Tanenhaus, M.K., Chambers, C.G., & Carlson, G.N
(1999) Achieving incremental interpretation through contextual representation. Cognition, 71, 109-147. DOI logoGoogle Scholar
Shaw, R., & Turvey, M.T
(1981) Coalitions as models for ecosystems: A realist perspective on perceptual organization. In M. Kubovy & J. Pomerantz (Eds.), Perceptual organization (pp. 343-415). Hillsdale, NJ: Erlbaum.Google Scholar
Spivey, M. & Richardson, D
(2009) Language embedded in the environment. In P. Robbins & M. Aydede (Eds.), The Cambridge handbook of situated cognition (pp. 382-400). Cambridge, UK: Cambridge University Press.Google Scholar
van Gelder, T., & Port, R
(Eds.) (1995) Mind as motion: Explorations in the dynamics of cognition. Cambridge, MA: MIT Press.Google Scholar
van Leeuwen, L., Smitsman, A., & van Leeuwen, C
(1994) Affordances, perceptual complexity, and the development of tool use. Journal of Experimental Psychology: Human Perception and Performance, 20, 174-191. DOI logoGoogle Scholar
Vingerhoets, G., Vandamme, K., & Vercammen, A
(2009) Conceptual and physical object qualities contribute differently to motor affordances. Brain and Cognition, 69, 481-489. DOI logoGoogle Scholar
Wolter, L., Skovbroten Gorman, K., & Tanenhaus, M.K
(2011) Scalar reference, contrast and discourse: Separating effects of linguistic discourse from availability of the referent. Journal of Memory and Language, 65, 299-317. DOI logoGoogle Scholar
Ye, L., Cardwell, W., & Mark, L
(2009) Perceiving multiple affordances for objects. Ecological Psychology, 21, 185-217. DOI logoGoogle Scholar
Yee, E., Huffstetler, S., & Thompson-Schill, S.L
(2011) Function follows form: Activation of shape and function features during object identification. Journal of Experimental Psychology: General, 140, 348-363. DOI logoGoogle Scholar
Zwaan, R.A., & Kaschak, M.P
(2009) Language in the brain, body, and world. In P. Robbins & M. Aydede (Eds.), The Cambridge handbook of situated cognition (pp. 368-381). Cambridge, UK: Cambridge University Press.Google Scholar
Zwaan, R.A., & Radvansky, G.A
(1998) Situation models in language comprehension and memory. Psychological Bulletin, 123, 162-185. DOI logoGoogle Scholar
Cited by

Cited by 1 other publications

Wan, Yingjia, Yipu Wei, Baorui Xu, Liqi Zhu & Michael K. Tanenhaus
2023. Musical coordination affects children's perspective‐taking, but musical synchrony does not. Developmental Science 26:5 DOI logo

This list is based on CrossRef data as of 7 september 2023. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.