The role of affordances in visually situated language comprehension
Affordances are potentiations for bodily action that are routinely evaluated in the course of perception. For example, the physical features of bricks, lamps, and pillows provide salient cues about the actions a perceiver could likely perform with those objects. In visually situated contexts, affordances can provide a potentially useful source of information for aspects of language comprehension. This chapter begins by reviewing various perspectives on affordances as well as issues regarding their computation. Of particular relevance is how the information provided by affordances differs from linguistically- or conceptually-encoded links between objects and actions, such as selectional restrictions or semantic associations. The chapter then describes various ways in which affordances influence visually situated language comprehension, using examples from different levels of linguistic processing. The remainder of the chapter considers whether language comprehension reflects the influence of “genuine” affordances or instead a system in which information about the idiosyncratic features of perceptible objects is combined with (and often controlled by) linguistic and cognitive constraints.
References
Altmann, G.T.M., & Kamide, Y
(
1999)
Incremental interpretation at verbs: Restricting the domain of subsequent reference.
Cognition, 73, 247-264.


Altmann, G.T.M., & Kamide, Y
(
2009)
Discourse mediation of the mapping between language and the visual world: Eye movements and mental representation.
Cognition, 111, 55-71.


Chambers, C.G., & Cooke, H
(
2009)
Lexical competition during second-language listening: Sentence context, but not proficiency, constrains interference from the native lexicon.
Journal of Experimental Psychology: Learning, Memory & Cognition, 35, 1029-1040.


Chambers, C.G., & San Juan, V
(
2008)
Perception and presupposition in real-time language comprehension: Insights from anticipatory processing.
Cognition, 108, 26-50.


Chambers, C.G., Tanenhaus, M.K., Eberhard, K.M., Filip, H., & Carlson, G.N
(
2002)
Circumscribing referential domains during real-time language comprehension.
Journal of Memory and Language, 47, 30-49.


Chambers, C.G., Tanenhaus, M.K., & Magnuson, J.S
(
2004)
Actions and affordances in syntactic ambiguity resolution.
Journal of Experimental Psychology: Learning, Memory and Cognition, 30, 687-696.


Collins, S.J., Graham, S.A., & Chambers, C.G
(
2012)
Preschoolers’ sensitivity to speaker action constraints to refer referential intent.
Journal of Experimental Child Psychology, 112, 389-402.


Crain, S., & Steedman, M
(
1985)
On not being led up the garden path: The use of context by the psychological parser. In
D. Dowty,
L. Karttunen, &
A. Zwicky (Eds.),
Natural language parsing: Psychological, computational, and theoretical perspectives (pp. 320-358). Cambridge, UK: Cambridge University Press.


Dahan, D., & Tanenhaus, M.K
(
2004)
Continuous mapping form sound to meaning in spoken-language comprehension: Immediate effects of verb-based thematic constraints.
Journal of Experimental Psychology: Learning, Memory and Cognition, 30, 498-513.


Ellis, R., & Tucker, M
(
2000)
Micro-affordance: The potentiation of components of action by seen objects.
British Journal of Psychology, 91, 451-471.


Garnham, A., & Oakhill, J.V
(
1996)
The mental models theory of language comprehension. In
B.K. Britton &
A.C. Graesser (Eds.),
Models of understanding text (pp. 313-339). Hillsdale, NJ: Erlbaum.

Gibson, J.J
(
1977)
The theory of affordances. In
R. Shaw &
J. Bransford (Eds.),
Perceiving, acting, and knowing: Toward an ecological psychology (pp. 67-82). Hillsdale, NJ: Erlbaum.

Gibson, J.J
(
1979)
The ecological approach to visual perception. New York: Houghton Mifflin.

Glenberg, A.M., Becker, R., Klötzer, S., Kolano, L., Müller, S., & Rinck, M
(
2009)
Episodic affordances contribute to language comprehension.
Language and Cognition, 1, 113-135.


Glenberg, A.M., & Robertson, D.A
(
1999)
Indexical understanding of instructions.
Discourse Processes, 28, 1-26.


Glenberg, A.M., & Robertson, D.A
(
2000)
Symbol grounding and meaning: A comparison of high-dimensional and embodied theories of meaning.
Journal of Memory and Language, 43, 379-401.


Greeno, J.G
(
1994)
Gibson's affordances.
Psychological Review, 101, 336-342.


Hanna, J.E. & Tanenhaus, M.K
(
2004)
Pragmatic effects on reference resolution in a collaborative task: Evidence from eye movements.
Cognitive Science, 28, 105-115.


Humphreys, G
(
2001)
Objects, affordances, action! The Psychologist, 14, 408-412.

Johnson-Laird, P.N
(
1983)
Mental models: Towards a cognitive science of language, inference and consciousness. Cambridge, UK: Cambridge University Press.

Jones, K.S
(
2003)
What is an affordance? Ecological Psychology, 15, 107-114.


Kako, E., & Trueswell, J.C
(
2000)
Verb meanings, object affordances, and the incremental restriction of reference.
Proceedings of the 22nd Annual Conference of the Cognitive Science Society
(pp. 256-261). Hillsdale, NJ: Erlbaum.
Kamp, H., & Reyle, U
(
1993)
From discourse to logic. Dordrecht, NL: Kluwer.


Kaschak, M.P., & Glenberg, A.M
(
2000)
Constructing meaning: The role of affordances and grammatical constructions in sentence comprehension.
Journal of Memory and Language, 43, 508-529.


Knoeferle, P., & Crocker, M.W
(
2007)
The influence of recent scene events on spoken comprehension: Evidence from eye movements.
Journal of Memory and Language, 57, 519-543.


Kraljic, T., Samuel, A.G., & Brennan, S.E
(
2008)
First impressions and last resorts: How listeners adjust to speaker variability.
Psychological Science, 19, 332-338.


Magnuson, J.S., Dixon, J., Tanenhaus, M.K., & Aslin, R.N
(
2007)
The dynamics of lexical competition during spoken word recognition.
Cognitive Science, 31, 133-156.


Magnuson, J.S., Tanenhaus, M.K., Aslin, R.N., & Dahan, D
(
2003)
The time course of spoken word recognition and learning: Studies with artificial lexicons.
Journal of Experimental Psychology: General, 132, 202-227.


Myung, J.-J., Blumstein, S.E., & Sedivy, J.C
(
2006)
Playing on the typewriter, typing on the piano: Manipulation knowledge of objects.
Cognition, 98, 223-243.


Revill, K.P., Tanenhaus, M.K., & Aslin, R.N
(
2008)
Context and spoken word recognition in a novel lexicon.
Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 1207-1223.


Riddoch, M.J., & Humphreys, G.W
(
1987)
Visual object processing in a case of optic aphasia: A case of semantic access agnosia.
Cognitive Neuropsychology, 4, 131-185.


Riddoch, M.J., Humphreys, G.W., & Price, C.J
(
1989)
Routes to action: Evidence from apraxia.
Cognitive Neuropsychology, 6, 437-454.


Sedivy, J.C., Tanenhaus, M.K., Chambers, C.G., & Carlson, G.N
(
1999)
Achieving incremental interpretation through contextual representation.
Cognition, 71, 109-147.


Shaw, R., & Turvey, M.T
(
1981)
Coalitions as models for ecosystems: A realist perspective on perceptual organization. In
M. Kubovy &
J. Pomerantz (Eds.),
Perceptual organization (pp. 343-415). Hillsdale, NJ: Erlbaum.

Spivey, M. & Richardson, D
(
2009)
Language embedded in the environment. In
P. Robbins &
M. Aydede (Eds.),
The Cambridge handbook of situated cognition (pp. 382-400). Cambridge, UK: Cambridge University Press.

van Gelder, T., & Port, R
(Eds.) (
1995)
Mind as motion: Explorations in the dynamics of cognition. Cambridge, MA: MIT Press.

van Leeuwen, L., Smitsman, A., & van Leeuwen, C
(
1994)
Affordances, perceptual complexity, and the development of tool use.
Journal of Experimental Psychology: Human Perception and Performance, 20, 174-191.


Vingerhoets, G., Vandamme, K., & Vercammen, A
(
2009)
Conceptual and physical object qualities contribute differently to motor affordances.
Brain and Cognition, 69, 481-489.


Wolter, L., Skovbroten Gorman, K., & Tanenhaus, M.K
(
2011)
Scalar reference, contrast and discourse: Separating effects of linguistic discourse from availability of the referent.
Journal of Memory and Language, 65, 299-317.


Ye, L., Cardwell, W., & Mark, L
(
2009)
Perceiving multiple affordances for objects.
Ecological Psychology, 21, 185-217.


Yee, E., Huffstetler, S., & Thompson-Schill, S.L
(
2011)
Function follows form: Activation of shape and function features during object identification.
Journal of Experimental Psychology: General, 140, 348-363.


Zwaan, R.A., & Kaschak, M.P
(
2009)
Language in the brain, body, and world. In
P. Robbins &
M. Aydede (Eds.),
The Cambridge handbook of situated cognition (pp. 368-381). Cambridge, UK: Cambridge University Press.

Zwaan, R.A., & Radvansky, G.A
(
1998)
Situation models in language comprehension and memory.
Psychological Bulletin, 123, 162-185.


Cited by
Cited by 1 other publications
Wan, Yingjia, Yipu Wei, Baorui Xu, Liqi Zhu & Michael K. Tanenhaus
2023.
Musical coordination affects children's perspective‐taking, but musical synchrony does not.
Developmental Science 26:5

This list is based on CrossRef data as of 7 september 2023. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.