Chapter 5
Is the acoustic modality relevant for abstract concepts?
A study with the Extrinsic Simon task
An emerging class of theories of knowledge assumes that the representation and processing of concepts is achieved by reactivating multiple aspects of experience. Abstract concepts such as freedom and justice constitute a challenge for these theories because they have no clearly identifiable referent that we can experience. The Words As social Tools theory (WAT) posits that while both concrete and abstract concepts activate sensorimotor networks, the linguistic network is activated more by abstract than by concrete concepts given that the mode of acquisition of abstract concepts relies more on language. In this chapter we extend this argument and report results from an experiment with the Extrinsic Simon task suggesting that when we process abstract words we re-enact the experience of their acquisition and/or explain to ourselves their meaning.
Article outline
- 1.Introduction
- 1.1Previous findings in line with the WAT theory
- 1.2Empirical investigations of WAT predictions
- 2.The experiment: Overview
- 3.Method
- 3.1Materials
- 3.2Participants
- 3.3Procedure
- 4.Results
- 5.General discussion and conclusions
-
References
-
Appendix
References (84)
References
Acheson, D. J., & Hagoort, P. 2013. Stimulating the brain’s language network: syntactic ambiguity resolution after TMS to the inferior frontal gyrus and middle temporal gyrus. Journal of Cognitive Neuroscience 25(10), 1664–1677.
Anderson, M. L. 2010. Neural reuse: A fundamental organizational principle of the brain. Behavioral and brain sciences 33(04), 245–266.
Anderson, M. L. 2016. Précis of after phrenology: neural reuse and the interactive brain. Behavioral and Brain Sciences 39, e120.
Andrews, M., Frank, S., & Vigliocco, G. 2014. Reconciling embodied and distributional accounts of meaning in language. Topics in cognitive science 6(3), 359–370.
Asendorpf, J. B., Banse, R., & Mücke, D. 2002. Double dissociation between implicit and explicit personality self-concept: The case of shy behavior. Journal of Personality and Social Psychology 83, 380–393.
Barsalou, L. W. 1999. Perceptual symbols systems. Behavioral and Brain Sciences 22, 577–660.
Barsalou, L. W. 2008. Grounded cognition. Annu. Rev. Psychol. 59, 617–645.
Barsalou, L. W. 2016. On staying grounded and avoiding Quixotic dead ends. Psychonomic Bulletin and Review 23, 1122–1142.
Barsalou, L. W., Santos, A., Simmons, K. W., & Wilson, C. D. 2008. Language and simulations in conceptual processing. In M. De Vega, A. M. Glenberg, and A. C. Graesser (Eds.), Symbols, embodiment and meaning (245–283). Oxford: Oxford University Press.
Binder, J. R., Desai, R. H., Graves, W. W., & Conant, L. L. 2009. Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. Cerebral Cortex 19(12), 2767–2796.
Binkofski, F., Buccino, G., Posse, S., Seitz, R. J., Rizzolatti, G., & Freund, H. J. 1999. A frontoparietal circuit for object manipulation in man: evidence from an fMRI-study. European journal of neuroscience. 11(9), 3276–3286.
Binney, R. J., Parker, G. J. M., & Lambon Ralph, M. A. 2012. Convergent connectivity and graded specialization in the rostral human temporal lobe as revealed by diffusion-weighted imaging probabilistic tractography. Journal of Cognitive Neuroscience 24(10), 1998–2014.
Bookheimer, S. 2002. Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. Annual review of neuroscience 25(1), 151–188.
Bolognesi, M., & Steen, G. (Eds.), 2018. Abstract Concepts: Structure, Processing and Modeling. Topics in Cognitive Science 10(3).
Borghi, A. M. 2013. Embodied cognition and word acquisition: The challenge of abstract words. In: C. Müller, A. Cienki, E. Fricke, S. H. Ladewig, D. McNeill and J. Bressem (Eds.), Body-Language-Communication: An International Handbook on Multimodality in Human Interaction. Handbooks of Linguistics and Communication Science (HSK) 38/2 Berlin, Boston: De Gruyter: Mouton.
Borghi, A. M., Barca, L., Binkofski, F., Tummolini, L. 2018. Varieties of abstract concepts: development, use, and representation in the brain. Philosophical Transactions of the Royal Society of London. Series B, biological sciences 373(1752).
Borghi, A. M., & Binkofski, F. 2014. Words as social tools: An embodied view on abstract concepts. Berlin and New York: Springer.
Borghi, A. M., Binkofski, F., Castelfranchi, C., Cimatti, F., Scorolli, C., Tummolini, L. 2017. The challenge of abstract concepts. Psychological Bulletin 143(3), 263.
Borghi, A. M., & Cimatti, F. 2009. Words as tools and the problem of abstract words meanings. In N. Taatgen and H. van Rijn (Eds.). Proceedings of the 31st Annual Conference of the Cognitive Science Society (2304–2309). Amsterdam: Cognitive Science Society.
Borghi, A. M., Flumini, A., Cimatti, F., Marocco, D. & Scorolli, C. 2011. Manipulating objects and telling words: A study on concrete and abstract words acquisition. Frontiers in Psychology 2(15).
Borghi, A. M., & Setti, A. 2017. Abstract Concepts and Aging: An Embodied and Grounded Perspective. Frontiers in Psychology 8.
Borghi, A. M. & Zarcone, E. 2016. Grounding abstractness: Abstract concepts and the activation of the mouth. Frontiers in Psychology 7(1498).
Bosco, F. M., Parola, A., Valentini, M. C., & Morese, R. 2017. Neural correlates underlying the comprehension of deceitful and ironic communicative intentions. Cortex 94, 73–86.
Bransford, J. D., & McCarrell, N. S. 1974. A sketch of a cognitive approach to comprehension: Some thoughts about understanding what it means to comprehend. In W. Weimer & D. Palermo (Eds.), Cognition and the symbolic processes. Hillsdale, N.J.: Erlbaum.
Brunel, F. F., Tietje, B. C., & Greenwald, A. G. 2004. Is the Implicit Association Test a valid and valuable measure of implicit consumer social cognition? Journal of Consumer Psychology 14(4), 385–404.
Buccino, G., Binkofski, F., Fink, G. R., Fadiga, L., Fogassi, L., Gallese, V., & Freund, H. J. 2001. Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. European journal of neuroscience 13(2), 400–404.
De Houwer, J. 2006. What are implicit measures and why are we using them? In R. W. Wiers & A. W. Stacy (Eds.), The handbook of implicit cognition and addiction (11–28). Thousand Oaks, CA: SAGE.
De Houwer, J. 2003. The extrinsic affective Simon task. Experimental Psychology 50(2), 77–85.
Della Rosa, P. A., Catricalà, E., Vigliocco, G., & Cappa, S. F. 2010. Beyond the abstract-concrete dichotomy: Mode of acquisition, concreteness, imageability, familiarity, age of acquisition, context availability, and abstractness norms for a set of 417 Italian words. Behavior research methods 42(4), 1042–1048.
Dove, G. 2009. Beyond Perceptual symbols: a call for representational pluralism. Cognition 110, 412–431.
Dove, G. 2011. On the need for embodied and disembodied cognition. Frontiers in Psychology 1, 242.
Dove, G. 2014. Thinking in words: language as an embodied medium of thought. Topics in cognitive science 6(3), 371–389.
Dreyer, F. R., Frey, D., Arana, S., Saldern, S. V., Picht, T., Vajkoczy, P., & Pulvermüller, F. 2015. Is the motor system necessary for processing action and abstract emotion words? Evidence from focal brain lesions. Frontiers in psychology 6, 1661.
Farias, A. R., Garrido, M. & Semin, G. R. 2013. Converging modalities ground abstract categories: The case of politics. PLoS One 8 (4), e60971.
Fazio, R. H., & Olson, M. A. 2003. Implicit measures in social cognition research: Their meaning and use. Annual Review of Psychology 54, 297–327.
Ferstl, E. C., Neumann, J., Bogler, C., & Von Cramon, D. Y. 2008. The extended language network: A meta-analysis of neuroimaging studies on text comprehension. Human Brain Mapping 29(5), 581–593.
Fiebach, C. J., Friederici, A. D. 2004. Processing concrete words: fMRI evidence against a specific right-hemisphere involvement. Neuropsychologia 42, 62–70.
Fiebach, C. J., Ricker, B., Friederici, A. D., Jacobs, A. M. 2007. Inhibition and facilitation in visual word recognition: prefrontal contribution to the orthographic neighborhood size effect. Neuroimage 36, 901–911.
Gallese, V. 2008. Mirror neurons and the social nature of language: The neural exploitation hypothesis. Social neuroscience 3(3–4), 317–333.
Ghio, M., Vaghi, M. M. S., & Tettamanti, M. 2013. Fine-grained semantic categorization across the abstract and concrete domains. PloS one 8(6), e67090.
Glenberg, A. M., & Gallese, V. 2012. Action-based language: A theory of language acquisition, comprehension, and production. Cortex 48(7), 905–922.
Gould, S. J. 1991. Exaptation: A crucial tool for an evolutionary psychology. Journal of Social Issues 47, 43–65.
Grade, S., Badets, A., & Pesenti, M. 2016. Influence of finger and mouth action observation on random number generation: an instance of embodied cognition for abstract concepts. Psychological Research, 1–11.
Granito, C., Scorolli, C., & Borghi, A. M. 2015. Naming a Lego World. The Role of Language in the Acquisition of Abstract Concepts. PloS one 10(1), e0114615.
Hoffman, P., Binney, R. J., Lambon Ralph, M. A. 2015. Differing contributions of inferior prefrontal and anterior temporal cortex to concrete and abstract conceptual knowledge. Cortex 63, 250–266.
Kieras, D. 1978. Beyond pictures and words: Alternative information-processing models for imagery effects in verbal memory. Psychological Bulletin 55, 532–554.
Kousta, S. T., Vigliocco, G., Vinson, D. P., Andrews, M., & Del Campo, E. 2011. The representation of abstract words: why emotion matters. Journal of Experimental Psychology 140(1), 14–34.
Krom, R. S. H. 1990. Wenselijke woordenschat en feitelijke frequenties: De nieuwe streeflijst Woordenschat getrancheerd naar verwervingsleeftijd en voorzien van frequentiegegevens. [Advisable vocabulary and actual frequencies: New target list of words classified according to age of acquisition, with frequency data added]. Arnhem, The Netherlands: Cito.
Landauer, T. K., & Dumais, S. T. 1997. A solution to Plato’s problem: The latent semantic analysis theory of the acquisition, induction, and representation of knowledge. Psychological Review 104 (2), 211–240.
Lebois, L. A., Wilson-Mendenhall, C. D., & Barsalou, L. W. 2015. Are automatic conceptual cores the gold standard of semantic processing? The context-dependence of spatial meaning in grounded congruency effects. Cognitive Science 39(8), 1764–1801.
Lieberman, P. 2009. Human language and our reptilian brain: The subcortical bases of speech, syntax, and thought. Harvard University Press.
Loftus, G. R., & Masson, M. E. 1994. Using confidence intervals in within-subject designs. Psychonomic Bulletin & Review 1 (4), 476–490.
Lund, K., & Burgess, C. 1996. Producing high-dimensional semantic spaces from lexical co-occurrence. Behavior Research Methods, Instruments and Computers 28 (2), 203–208.
Lynott, D., & Connell, L. 2009. Modality exclusivity norms for 423 object properties. Behavior Research Methods 41(2), 558–564.
Moffat, M., Siakaluk, P. D., Sidhu, D. M., & Pexman, P. M. 2015. Situated conceptualization and semantic processing: effects of emotional experience and context availability in semantic categorization and naming tasks. Psychonomic bulletin and review 22(2), 408–419.
Moseley, R., Carota, F., Hauk, O., Mohr, B., & Pulvermüller, F. 2011. A role for the motor system in binding abstract emotional meaning. Cerebral Cortex 22(7), 1634–1647.
Newcombe, P. I., Campbell, C., Siakaluk, P. D., & Pexman, P. M. 2012. Effects of emotional and sensorimotor knowledge in semantic processing of concrete and abstract nouns. Frontiers in human neuroscience 6, 275.
Noppeney, U., & Price, C. J. 2004. Retrieval of abstract semantics. Neuroimage 22(1), 164–170.
Paivio, A. 1971. Imagery and verbal processes. New York: Holt, Rinehart and Winston.
Paivio, A. 1986. Mental representations: A dual coding approach. Oxford, UK: Oxford University Press.
Paivio, A. 2007. Mind and its evolution: A dual coding theoretical approach. Mahwah, NJ: Erlbaum.
Papagno, A., Fogliata, E., Catricalà, C., & Miniussi, C. 2009. The lexical processing of abstract and concrete nouns. Brain Research 1263, 78–86.
Petrides, M. 1994. Frontal lobes and working memory: evidence from investigations of the effects of cortical excisions in nonhuman primates. In F. Boller, J. Grafman (Eds.), Handbook of Neuropsychology (959–981). Amsterdam: Elsevier.
Price, C. J. 2010. The anatomy of language: a review of 100 fMRI studies published in 2009. Annals of the New York Academy of Sciences 1191(1), 62–88.
Prinz, J. J. 2002. Furnishing the Mind: Concepts and their Perceptual Basis. Cambridge, MA: MIT Press.
Prinz, J. J. 2012. Beyond human nature. How culture and experience shape our lives. London; New York, NY: Penguin; Norton
Pulvermüller, F., & Fadiga, L. 2010. Active perception: sensorimotor circuits as a cortical basis for language. Nature Reviews Neuroscience 11(5), 351–360.
Recchia, G., & Jones, M. 2012. The semantic richness of abstract concepts. Frontiers in human neuroscience 6, 315.
Roxbury, T., McMahon, K., Coulthard, A., & Copland, D. A. 2015. An fMRI Study of Concreteness Effects during Spoken Word Recognition in Aging. Preservation or Attenuation? Frontiers in aging neuroscience, 7.
Sakreida, K., Scorolli, C., Menz, M. M., Heim, S., Borghi, A. M., & Binkofski, F. 2013. Are abstract action words embodied? An fMRI investigation at the interface between language and motor cognition. Frontiers in human neuroscience 7, 25.
Scerrati, E. 2017. From amodal to grounded to hybrid accounts of knowledge: New evidence from the investigation of the modality-switch effect. Unpublished doctoral dissertation, University of Bologna, Bologna, Italy.
Scerrati, E., Baroni, G., Borghi, A. M., Galatolo, R., Lugli, L., & Nicoletti, R. 2015. The modality-switch effect: visually and aurally presented prime sentences activate our senses. Frontiers in psychology, 6.
Scerrati, E., Lugli, L., Nicoletti, R., & Borghi, A. M. 2017. The Multilevel Modality-Switch Effect: What Happens When We See the Bees Buzzing and Hear the Diamonds Glistening. Psychonomic bulletin and review 24(3), 798–803.
Schwanenflugel, P. J. 1991. Why are abstract concepts hard to understand? In P. J. Schwanenflugel (Ed.), The psychology of word meanings (223–250). Hillsdale, NJ: Erlbaum.
Schwanenflugel, P. J., Harnishfeger, K. K., & Stowe, R. W. 1988. Context availability and lexical decisions for abstract and concrete words. Journal of Memory and Language 27, 499–520.
Schwanenflugel, P. J., & Shoben, E. J. 1983. Differential context effects in the comprehension of abstract and concrete verbal materials. Journal of Experimental Psychology: Learning, Memory, and Cognition 9, 82–102.
Siakaluk, P. D., Knol, N., & Pexman, P. M. 2014. Effects of emotional experience for abstract words in the Stroop task. Cognitive science 38(8), 1698–1717.
Topolinski, S., & Strack, F. 2009. The architecture of intuition: Fluency and affect determine intuitive judgments of semantic and visual coherence and judgments of grammaticality in artificial grammar learning. Journal of Experimental Psychology: General 138(1), 39.
Van Loon–Vervoorn, W. A., 1985. Voorstelbaarheidswaarden van Nederlandse woorden: 4600 substantieven, 1000 verba en 500 adjectieven. [Imagery values of Dutch words: 4600 nouns, 1000 verbs, and 500 adjectives]. Lisse, The Netherlands: Swets and Zeitlinger.
Vigliocco, G., Kousta, S. T., Della Rosa, P. A., Vinson, D. P., Tettamanti, M., Devlin, J. T., and Cappa, S. F. 2014. The neural representation of abstract words: the role of emotion. Cerebral Cortex 24(7), 1767–1777.
Visser, M., Jefferies, E., Embleton, K. V., & Lambon Ralph, M. A. 2012. Both the middle temporal gyrus and the ventral anterior temporal area are crucial for multimodal semantic processing: distortion-corrected fMRI evidence for a double gradient of information convergence in the temporal lobe. Journal of Cognitive Neuroscience 24(8), 1766–1778.
Wang, J., Conder, J. A., Blitzer, D. N., & Shinkareva, S. V. 2010. Neural representation of abstract and concrete concepts: A meta- analysis of neuroimaging studies. Human brain mapping 31(10), 1459–1468.
Wauters, L. N., Tellings, A., & van Bon, W. H. J. 2008. Mode of acquisition as a factor in deaf children’s reading comprehension. Journal of Deaf Studies and Deaf Education 13, 175–192.
Wauters, L. N., Tellings, A. E., Van Bon, W. H., & Van Haaften, A. W. 2003. Mode of acquisition of word meanings: The viability of a theoretical construct. Applied Psycholinguistics 24(03), 385–406.
Cited by (1)
Cited by one other publication
Wołoszyn, Kinga, Mateusz Hohol, Michał Kuniecki & Piotr Winkielman
2022.
Restricting movements of lower face leaves recognition of emotional vocalizations intact but introduces a valence positivity bias.
Scientific Reports 12:1
This list is based on CrossRef data as of 27 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.