Events with a motor action component (e.g., handling an object) tend to evoke gestures from the point of view of a character (character viewpoint, or CVPT) while events with a path component (moving through space) tend to evoke gestures from the point of view of an observer (observer viewpoint, or OVPT). Events that combine both components (e.g., rowing a boat across a lake) seem to evoke both types of gesture, but it is unclear why narrators use one or the other. We carry out two manipulations to explore whether gestural viewpoint can be manipulated. Participants read a series of stories and retold them in two conditions. In the image condition, story sentences were presented with images from either the actor’s perspective (actor version) or the observer’s perspective (observer version). In the linguistic condition, the same sentences were presented in either the second person (you…) or the third person point of view (h/she…). The second person led participants to use the first person (I) in retelling. Gestures produced during retelling were coded as CVPT or OVPT. Participants produced significantly more CVPT gestures after seeing images from the point of view of an actor, but the linguistic manipulation did not affect viewpoint in gesture. Neither manipulation affected overall gesture rate, or co-occurring speech. We relate these findings to frameworks in which motor action and mental imagery are linked to viewpoint in gesture.
Brunyé, Tad T., Tali Ditman, Caroline R. Mahoney, Jason S. Augustyn, & Holly A. Taylor
(2009) When you and I share perspectives. Psychological Science, 201, 27–32.
Crasborn, Onno & Han Sloetjes
(2008) Enhanced ELAN functionality for sign language corpora. In Onno Crasborn, Thomas Hanke, Eleni Efthimiou, Inge Zwitserlood, & Ernst-Daniel Thoutenhoofd (Eds.), Construction and exploitation of sign language corpora: 3rd workshop on the representation and processing of sign languages (pp. 39–43). Paris: ELRA.
Davis, Joshua Ian, Adam Benforado, Ellen Esrock, Alasdair Turner, Ruth C. Dalton, Leon van Noorden, & Marc Leman
(2012) Four applications of embodied cognition. Topics in Cognitive Science, 41, 786–793.
(2010) Language, gesture, action! A test of the Gesture as Simulated Action framework. Journal of Memory & Language, 631, 245–257.
Kaschak, Michael P. & Arthur M. Glenberg
(2000) Constructing meaning: The role of affordances and grammatical constructions in sentence comprehension. Journal of Memory & Language, 431, 508–529.
(2005) Mental images and the brain. Cognitive Neuropsychology, 221, 333–347.
Kushch, Olga, Carmen Pérez Vidal, Marianne Gullberg, & Pilar Prieto
(2016) Does viewpoint matter for word recall in second language acquisition? Paper presented at the International Society for Gesture Studies, Paris, 18–22 July.
(1993) English verb classes and alternations. Chicago: University of Chicago Press.
Landis, J. Richard & Gary G. Koch
(1977) The measurement of observer agreement for categorical data. Biometrics, 331, 159–174.
Markman, Arthur & Eric Dietrich
(2000) Extending the classical view of representation. Trends in Cognitive Sciences, 41, 470–471.
(1992) Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
Özyürek, Aslı & Pamela Perniss
(2011) Event representation in sign language: A crosslinguistic perspective. Event representation in language: Encoding events at the language-cognition interface. In Jürgen Bohnemeyer & Eric Pederson (Eds.), Event representation in language and cognition (pp. 84–107). Cambridge: Cambridge University Press.
(2010a) The hands are part of the package: Gesture, common ground, and information packaging. In Sally Rice & John Newman (Eds.), Empirical and experimental methods in cognitive/functional research (pp. 285–302). Stanford: CSLI Publications.
(2010b) Viewpoint in speech-gesture integration: Linguistic structure, discourse structure, and event structure. Language and Cognitive Processes, 251, 650–668.
(2012) Interactions between discourse status and viewpoint in co-speech gesture. In Barbara Dancygier & Eve Sweetser (Eds.), Viewpoint in language: A multimodal perspective (pp. 97–112). Cambridge: Cambridge University Press.
Parrill, Fey, Jennifer Bullen, & Huston Hoburg
(2010) Effects of input modality on speech-gesture integration. Journal of Pragmatics, 421, 3130–3137.
(2007) Achieving spatial coherence in German Sign Language narratives: The use of classifiers and perspective. Lingua, 1171, 1315–1338.
(1999) Words in the brain’s language. Behavioral and Brain Sciences, 221, 253–279, discussion 280–336.
Ruby, Perrine & Jean Decety
(2001) Effect of subjective perspective taking during simulation of action: A PET investigation of agency. Nature Neuroscience, 41, 546–550.
(2016) Maintaining multiple viewpoints with gaze. In Barbara Dancygier, Wei-lun Lu, & Arie Verhagen (Eds.), Viewpoint and the fabric of meaning: Form and use of viewpoint tools across languages and modalities (pp. 237–258). Berlin: de Gruyter.
Vogeley, Kai & Gereon R. Fink
(2003) Neural correlates of the first-person perspective. Trends in Cognitive Sciences, 71, 38–42.
Vogeley, Kai, Mark May, Afra Ritzl, Peter Falkai, Karl Zilles, & Gereon R. Fink
(2004) Neural correlates of first-person perspective as one constituent of human self-consciousness. Journal of Cognitive Neuroscience, 161, 817–827.
Yaxley, Richard H. & Rolf A. Zwaan
(2007) Simulating visibility during language comprehension. Cognition, 1051, 229–236.
Zwaan, Rolf A., Robert A. Stanfield, & Richard H. Yaxley
(2002) Language comprehenders mentally represent the shapes of objects. Psychological Science, 1361, 168–171.
Cited by 4 other publications
Chan, Dana Michelle & Spencer Kelly
2021. Construing events first-hand: Gesture viewpoints interact with speech to shape the attribution and memory of agency. Memory & Cognition 49:5 ► pp. 884 ff.
Hostetter, Autumn B. & Martha W. Alibali
2019. Gesture as simulated action: Revisiting the framework. Psychonomic Bulletin & Review 26:3 ► pp. 721 ff.
This list is based on CrossRef data as of 23 september 2023. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.