The role of affordances in visually situated language comprehension
Affordances are potentiations for bodily action that are routinely evaluated in the course of perception. For example, the physical features of bricks, lamps, and pillows provide salient cues about the actions a perceiver could likely perform with those objects. In visually situated contexts, affordances can provide a potentially useful source of information for aspects of language comprehension. This chapter begins by reviewing various perspectives on affordances as well as issues regarding their computation. Of particular relevance is how the information provided by affordances differs from linguistically- or conceptually-encoded links between objects and actions, such as selectional restrictions or semantic associations. The chapter then describes various ways in which affordances influence visually situated language comprehension, using examples from different levels of linguistic processing. The remainder of the chapter considers whether language comprehension reflects the influence of “genuine” affordances or instead a system in which information about the idiosyncratic features of perceptible objects is combined with (and often controlled by) linguistic and cognitive constraints.
References (44)
Altmann, G.T.M., & Kamide, Y
(
1999)
Incremental interpretation at verbs: Restricting the domain of subsequent reference.
Cognition, 73, 247-264.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Altmann, G.T.M., & Kamide, Y
(
2009)
Discourse mediation of the mapping between language and the visual world: Eye movements and mental representation.
Cognition, 111, 55-71.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chambers, C.G., & Cooke, H
(
2009)
Lexical competition during second-language listening: Sentence context, but not proficiency, constrains interference from the native lexicon.
Journal of Experimental Psychology: Learning, Memory & Cognition, 35, 1029-1040.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chambers, C.G., & San Juan, V
(
2008)
Perception and presupposition in real-time language comprehension: Insights from anticipatory processing.
Cognition, 108, 26-50.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chambers, C.G., Tanenhaus, M.K., Eberhard, K.M., Filip, H., & Carlson, G.N
(
2002)
Circumscribing referential domains during real-time language comprehension.
Journal of Memory and Language, 47, 30-49.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chambers, C.G., Tanenhaus, M.K., & Magnuson, J.S
(
2004)
Actions and affordances in syntactic ambiguity resolution.
Journal of Experimental Psychology: Learning, Memory and Cognition, 30, 687-696.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Collins, S.J., Graham, S.A., & Chambers, C.G
(
2012)
Preschoolers’ sensitivity to speaker action constraints to refer referential intent.
Journal of Experimental Child Psychology, 112, 389-402.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Crain, S., & Steedman, M
(
1985)
On not being led up the garden path: The use of context by the psychological parser. In
D. Dowty,
L. Karttunen, &
A. Zwicky (Eds.),
Natural language parsing: Psychological, computational, and theoretical perspectives (pp. 320-358). Cambridge, UK: Cambridge University Press.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Dahan, D., & Tanenhaus, M.K
(
2004)
Continuous mapping form sound to meaning in spoken-language comprehension: Immediate effects of verb-based thematic constraints.
Journal of Experimental Psychology: Learning, Memory and Cognition, 30, 498-513.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Ellis, R., & Tucker, M
(
2000)
Micro-affordance: The potentiation of components of action by seen objects.
British Journal of Psychology, 91, 451-471.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Garnham, A., & Oakhill, J.V
(
1996)
The mental models theory of language comprehension. In
B.K. Britton &
A.C. Graesser (Eds.),
Models of understanding text (pp. 313-339). Hillsdale, NJ: Erlbaum.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Gibson, J.J
(
1977)
The theory of affordances. In
R. Shaw &
J. Bransford (Eds.),
Perceiving, acting, and knowing: Toward an ecological psychology (pp. 67-82). Hillsdale, NJ: Erlbaum.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Gibson, J.J
(
1979)
The ecological approach to visual perception. New York: Houghton Mifflin.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Glenberg, A.M., Becker, R., Klötzer, S., Kolano, L., Müller, S., & Rinck, M
(
2009)
Episodic affordances contribute to language comprehension.
Language and Cognition, 1, 113-135.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Glenberg, A.M., & Robertson, D.A
(
1999)
Indexical understanding of instructions.
Discourse Processes, 28, 1-26.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Glenberg, A.M., & Robertson, D.A
(
2000)
Symbol grounding and meaning: A comparison of high-dimensional and embodied theories of meaning.
Journal of Memory and Language, 43, 379-401.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Greeno, J.G
(
1994)
Gibson's affordances.
Psychological Review, 101, 336-342.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Hanna, J.E. & Tanenhaus, M.K
(
2004)
Pragmatic effects on reference resolution in a collaborative task: Evidence from eye movements.
Cognitive Science, 28, 105-115.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Humphreys, G
(
2001)
Objects, affordances, action! The Psychologist, 14, 408-412.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Johnson-Laird, P.N
(
1983)
Mental models: Towards a cognitive science of language, inference and consciousness. Cambridge, UK: Cambridge University Press.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Jones, K.S
(
2003)
What is an affordance? Ecological Psychology, 15, 107-114.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kako, E., & Trueswell, J.C
(
2000)
Verb meanings, object affordances, and the incremental restriction of reference.
Proceedings of the 22nd Annual Conference of the Cognitive Science Society
(pp. 256-261). Hillsdale, NJ: Erlbaum.
Kamp, H., & Reyle, U
(
1993)
From discourse to logic. Dordrecht, NL: Kluwer.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kaschak, M.P., & Glenberg, A.M
(
2000)
Constructing meaning: The role of affordances and grammatical constructions in sentence comprehension.
Journal of Memory and Language, 43, 508-529.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Knoeferle, P., & Crocker, M.W
(
2007)
The influence of recent scene events on spoken comprehension: Evidence from eye movements.
Journal of Memory and Language, 57, 519-543.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kraljic, T., Samuel, A.G., & Brennan, S.E
(
2008)
First impressions and last resorts: How listeners adjust to speaker variability.
Psychological Science, 19, 332-338.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Magnuson, J.S., Dixon, J., Tanenhaus, M.K., & Aslin, R.N
(
2007)
The dynamics of lexical competition during spoken word recognition.
Cognitive Science, 31, 133-156.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Magnuson, J.S., Tanenhaus, M.K., Aslin, R.N., & Dahan, D
(
2003)
The time course of spoken word recognition and learning: Studies with artificial lexicons.
Journal of Experimental Psychology: General, 132, 202-227.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Myung, J.-J., Blumstein, S.E., & Sedivy, J.C
(
2006)
Playing on the typewriter, typing on the piano: Manipulation knowledge of objects.
Cognition, 98, 223-243.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Revill, K.P., Tanenhaus, M.K., & Aslin, R.N
(
2008)
Context and spoken word recognition in a novel lexicon.
Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 1207-1223.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Riddoch, M.J., & Humphreys, G.W
(
1987)
Visual object processing in a case of optic aphasia: A case of semantic access agnosia.
Cognitive Neuropsychology, 4, 131-185.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Riddoch, M.J., Humphreys, G.W., & Price, C.J
(
1989)
Routes to action: Evidence from apraxia.
Cognitive Neuropsychology, 6, 437-454.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Sedivy, J.C., Tanenhaus, M.K., Chambers, C.G., & Carlson, G.N
(
1999)
Achieving incremental interpretation through contextual representation.
Cognition, 71, 109-147.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Shaw, R., & Turvey, M.T
(
1981)
Coalitions as models for ecosystems: A realist perspective on perceptual organization. In
M. Kubovy &
J. Pomerantz (Eds.),
Perceptual organization (pp. 343-415). Hillsdale, NJ: Erlbaum.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Spivey, M. & Richardson, D
(
2009)
Language embedded in the environment. In
P. Robbins &
M. Aydede (Eds.),
The Cambridge handbook of situated cognition (pp. 382-400). Cambridge, UK: Cambridge University Press.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
van Gelder, T., & Port, R
(Eds.) (
1995)
Mind as motion: Explorations in the dynamics of cognition. Cambridge, MA: MIT Press.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
van Leeuwen, L., Smitsman, A., & van Leeuwen, C
(
1994)
Affordances, perceptual complexity, and the development of tool use.
Journal of Experimental Psychology: Human Perception and Performance, 20, 174-191.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Vingerhoets, G., Vandamme, K., & Vercammen, A
(
2009)
Conceptual and physical object qualities contribute differently to motor affordances.
Brain and Cognition, 69, 481-489.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Wolter, L., Skovbroten Gorman, K., & Tanenhaus, M.K
(
2011)
Scalar reference, contrast and discourse: Separating effects of linguistic discourse from availability of the referent.
Journal of Memory and Language, 65, 299-317.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Ye, L., Cardwell, W., & Mark, L
(
2009)
Perceiving multiple affordances for objects.
Ecological Psychology, 21, 185-217.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Yee, E., Huffstetler, S., & Thompson-Schill, S.L
(
2011)
Function follows form: Activation of shape and function features during object identification.
Journal of Experimental Psychology: General, 140, 348-363.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Zwaan, R.A., & Kaschak, M.P
(
2009)
Language in the brain, body, and world. In
P. Robbins &
M. Aydede (Eds.),
The Cambridge handbook of situated cognition (pp. 368-381). Cambridge, UK: Cambridge University Press.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Zwaan, R.A., & Radvansky, G.A
(
1998)
Situation models in language comprehension and memory.
Psychological Bulletin, 123, 162-185.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Cited by (1)
Cited by 1 other publications
Wan, Yingjia, Yipu Wei, Baorui Xu, Liqi Zhu & Michael K. Tanenhaus
2023.
Musical coordination affects children's perspective‐taking, but musical synchrony does not.
Developmental Science 26:5
![DOI logo](//benjamins.com/logos/doi-logo.svg)
This list is based on CrossRef data as of 14 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.