Article published in:Visually Situated Language Comprehension
Edited by Pia Knoeferle, Pirita Pyykkönen-Klauck and Matthew W. Crocker
[Advances in Consciousness Research 93] 2016
► pp. 205–226
The role of affordances in visually situated language comprehension
Affordances are potentiations for bodily action that are routinely evaluated in the course of perception. For example, the physical features of bricks, lamps, and pillows provide salient cues about the actions a perceiver could likely perform with those objects. In visually situated contexts, affordances can provide a potentially useful source of information for aspects of language comprehension. This chapter begins by reviewing various perspectives on affordances as well as issues regarding their computation. Of particular relevance is how the information provided by affordances differs from linguistically- or conceptually-encoded links between objects and actions, such as selectional restrictions or semantic associations. The chapter then describes various ways in which affordances influence visually situated language comprehension, using examples from different levels of linguistic processing. The remainder of the chapter considers whether language comprehension reflects the influence of “genuine” affordances or instead a system in which information about the idiosyncratic features of perceptible objects is combined with (and often controlled by) linguistic and cognitive constraints.
Published online: 10 March 2016
Altmann, G.T.M., & Kamide, Y.
Chambers, C.G., & Cooke, H.
Chambers, C.G., & San Juan, V.
Chambers, C.G., Tanenhaus, M.K., Eberhard, K.M., Filip, H., & Carlson, G.N.
Chambers, C.G., Tanenhaus, M.K., & Magnuson, J.S.
Collins, S.J., Graham, S.A., & Chambers, C.G.
Crain, S., & Steedman, M.
Dahan, D., & Tanenhaus, M.K.
Ellis, R., & Tucker, M.
Garnham, A., & Oakhill, J.V.
(1996) The mental models theory of language comprehension. In B.K. Britton & A.C. Graesser (Eds.), Models of understanding text (pp. 313-339). Hillsdale, NJ: Erlbaum.
(1977) The theory of affordances. In R. Shaw & J. Bransford (Eds.), Perceiving, acting, and knowing: Toward an ecological psychology (pp. 67-82). Hillsdale, NJ: Erlbaum.
(1979) The ecological approach to visual perception. New York: Houghton Mifflin.
Glenberg, A.M., Becker, R., Klötzer, S., Kolano, L., Müller, S., & Rinck, M.
Glenberg, A.M., & Robertson, D.A.
Hanna, J.E. & Tanenhaus, M.K.
(2001) Objects, affordances, action! The Psychologist, 14, 408-412.
(1983) Mental models: Towards a cognitive science of language, inference and consciousness. Cambridge, UK: Cambridge University Press.
Kako, E., & Trueswell, J.C.
(2000) Verb meanings, object affordances, and the incremental restriction of reference. Proceedings of the 22nd Annual Conference of the Cognitive Science Society (pp. 256-261). Hillsdale, NJ: Erlbaum.
Kaschak, M.P., & Glenberg, A.M.
Knoeferle, P., & Crocker, M.W.
Kraljic, T., Samuel, A.G., & Brennan, S.E.
Magnuson, J.S., Dixon, J., Tanenhaus, M.K., & Aslin, R.N.
Magnuson, J.S., Tanenhaus, M.K., Aslin, R.N., & Dahan, D.
Myung, J.-J., Blumstein, S.E., & Sedivy, J.C.
Revill, K.P., Tanenhaus, M.K., & Aslin, R.N.
Riddoch, M.J., & Humphreys, G.W.
Riddoch, M.J., Humphreys, G.W., & Price, C.J.
Sedivy, J.C., Tanenhaus, M.K., Chambers, C.G., & Carlson, G.N.
Shaw, R., & Turvey, M.T.
(1981) Coalitions as models for ecosystems: A realist perspective on perceptual organization. In M. Kubovy & J. Pomerantz (Eds.), Perceptual organization (pp. 343-415). Hillsdale, NJ: Erlbaum.
Spivey, M. & Richardson, D.
(2009) Language embedded in the environment. In P. Robbins & M. Aydede (Eds.), The Cambridge handbook of situated cognition (pp. 382-400). Cambridge, UK: Cambridge University Press.
van Gelder, T., & Port, R.
(Eds.) (1995) Mind as motion: Explorations in the dynamics of cognition. Cambridge, MA: MIT Press.
van Leeuwen, L., Smitsman, A., & van Leeuwen, C.
Vingerhoets, G., Vandamme, K., & Vercammen, A.
Wolter, L., Skovbroten Gorman, K., & Tanenhaus, M.K.
Ye, L., Cardwell, W., & Mark, L.
Yee, E., Huffstetler, S., & Thompson-Schill, S.L.
Zwaan, R.A., & Kaschak, M.P.
(2009) Language in the brain, body, and world. In P. Robbins & M. Aydede (Eds.), The Cambridge handbook of situated cognition (pp. 368-381). Cambridge, UK: Cambridge University Press.