Cover not available
Article published In:
Interaction Studies
Vol. 18:2 (2017) ► pp.234–253

The awareness of joint attention

A study using gaze contingent avatars

| Université Pierre et Marie Curie |
| Université Pierre et Marie Curie |
| Laboratoire d’Informatique pour la Mécanique et les Sciences de l’Ingénieur |
| Université Pierre et Marie Curie |

This study investigates a specific aspect of joint attention, that is, the emergence of the sense that one is leading the attentional focus of others. Thirty participants were placed in front of two avatars and had to pay attention to objects that were also attended to by the avatars. Unbeknownst to the participant, the avatars’ gaze orientations were alternately controlled by the participant’s eyes. Eye-tracking data were collected and participants were enquired about their experience to account for their sense of agency. Only five participants noticed that the avatars were following their gaze. The 25 participants who remained unaware that they controlled the avatars nevertheless modified their gazing behavior with an increase in direct gaze toward one of the avatars. This outcome highlights a dissociation between an implicit feeling that a change occurred and the explicit awareness of being the cause of this change.

Keywords: social interactions, agency, gaze following, eye-tracking, gaze-contingent display, avatar
Article outline
  • 1.Introduction
  • 2.Method
    • 2.1Participants
    • 2.2Material
    • 2.3Procedure
  • 2.4Results
  • 3.Discussion
  • 4.Conclusion
  • Acknowledgements
  • References
Published online: 8 December 2017
DOI logo
https://doi.org/10.1075/is.18.2.05gry
References
Adolphs, R.
(2003) Cognitive neuroscience of human social behaviour. Nature Reviews Neuroscience, 4(3), 165‑178. DOI logoGoogle Scholar
Blakemore, S. J., Wolpert, D. M., & Frith, C. D.
(2002) Abnormalities in the awareness of action. Trends in Cognitive Sciences, 6(6), 237‑242. DOI logoGoogle Scholar
Charman, T.
(2003) Why is joint attention a pivotal skill in autism? Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 358(1430), 315‑324. DOI logoGoogle Scholar
Courgeon, M., & Clavel, C.
(2013) MARC: A framework that features emotion models for facial animation during human–computer interaction. Journal on Multimodal User Interfaces, 7(4), 311‑319. DOI logoGoogle Scholar
Courgeon, M., Rautureau, G., Martin, J.-C., & Grynszpan, O.
(2014) Joint attention simulation using eye-tracking and virtual humans. IEEE Transactions on Affective Computing, 5(3), 238‑250. DOI logoGoogle Scholar
David, N., Newen, A., & Vogeley, K.
(2008) The « sense of agency » and its underlying cognitive and neural mechanisms. Consciousness and Cognition, 17(2), 523‑534. DOI logoGoogle Scholar
Dratsch, T., Schwartz, C., Yanev, K., Schilbach, L., Vogeley, K., & Bente, G.
(2013) Getting a grip on social gaze: control over others’ gaze helps gaze detection in high-functioning autism. Journal of Autism and Developmental Disorders, 43(2), 286‑300. DOI logoGoogle Scholar
Driver, J.
(1999) Gaze perception triggers reflexive visuospatial orienting. Visual Cognition, 6(5), 509‑540. DOI logoGoogle Scholar
Duranton, C., & Gaunet, F.
(2016) Behavioural synchronization from an ethological perspective: Overview of its adaptive value. Adaptive Behavior, 10597123166449661. DOI logoGoogle Scholar
Emery, N. J.
(2000) The eyes have it: The neuroethology, function and evolution of social gaze. Neuroscience and Biobehavioral Reviews, 24(6), 581‑604. DOI logoGoogle Scholar
Friesen, C. K., & Kingstone, A.
(1998) The eyes have it! Reflexive orienting is triggered by nonpredictive gaze. Psychonomic Bulletin & Review, 5(3), 490‑495. DOI logoGoogle Scholar
Frischen, A., Bayliss, A. P., & Tipper, S. P.
(2007) Gaze cueing of attention: Visual attention, social cognition, and individual differences. Psychological Bulletin, 133(4), 694‑724. DOI logoGoogle Scholar
Grynszpan, O., Simonin, J., Martin, J.-C., & Nadel, J.
(2012) Investigating social gaze as an action-perception online performance. Frontiers in Human Neuroscience, 61, 94. DOI logoGoogle Scholar
Haggard, P., & Chambon, V.
(2012) Sense of agency. Current Biology, 22(10), R390‑R392. DOI logoGoogle Scholar
Horowitz, T. S., Wolfe, J. M., Alvarez, G. A., Cohen, M. A., & Kuzmova, Y. I.
(2009) The speed of free will. Quarterly Journal of Experimental Psychology (2006), 62(11), 2262‑2288. DOI logoGoogle Scholar
Hove, M. J., & Risen, J. L.
(2009) It’s all in the timing: Interpersonal synchrony increases affiliation. Social Cognition, 27(6), 949‑960. DOI logoGoogle Scholar
Jeannerod, M.
(2003) The mechanism of self-recognition in humans. Behavioural Brain Research, 142(1‑2), 1‑15. DOI logoGoogle Scholar
Kajopoulos, J., Wong, A. H. Y., Yuen, A. W. C., Dung, T. A., Kee, T. Y., & Wykowska, A.
(2015) Robot-Assisted Training of Joint Attention Skills in Children Diagnosed with Autism. In A. Tapus, E. André, J.-C. Martin, F. Ferland, & M. Ammi (Éd.), Social Robotics (pp. 296‑305). Springer International Publishing. DOI logoGoogle Scholar
Kim, K., & Mundy, P.
(2012) Joint attention, social-cognition, and recognition memory in adults. Frontiers in Human Neuroscience, 61. DOI logoGoogle Scholar
Langton, S. R. H., & Bruce, V.
(1999) Reflexive visual orienting in response to the social attention of others. Visual Cognition, 6(5), 541‑567. DOI logoGoogle Scholar
Mundy, P., & Newell, L.
(2007) Attention, Joint Attention, and Social Cognition. Current Directions in Psychological Science (Wiley-Blackwell), 16(5), 269‑274. DOI logoGoogle Scholar
Oberwelland, E., Schilbach, L., Barisic, I., Krall, S. C., Vogeley, K., Fink, G. R., Herpertz-Dahlmann, B., Konrad, K., & Schulte-Rüther, M.
(2016) Look into my eyes: Investigating joint attention using interactive eye-tracking and fMRI in a developmental sample. NeuroImage, 1301, 248–260. DOI logoGoogle Scholar
Pfeiffer, U. J., Schilbach, L., Jording, M., Timmermans, B., Bente, G., & Vogeley, K.
(2012) Eyes on the mind: Investigating the influence of gaze dynamics on the perception of others in real-time social interaction. Frontiers in Psychology, 31, 537. DOI logoGoogle Scholar
Pfeiffer, U. J., Timmermans, B., Bente, G., Vogeley, K., & Schilbach, L.
(2011) A non-verbal Turing test: differentiating mind from machine in gaze-based social interaction. PloS One, 6(11), e27591. DOI logoGoogle Scholar
Posner, M. I.
(1980) Orienting of attention. The Quarterly Journal of Experimental Psychology, 32(1), 3‑25. DOI logoGoogle Scholar
Raven, J. C., & Court, J. H.
(1986) Raven’s progressive matrices and Raven’s coloured matrices. London: HK Lewis.Google Scholar
Richardson, D. C., & Dale, R.
(2005) Looking to understand: The coupling between speakers’ and listeners’ eye movements and its relationship to discourse comprehension. Cognitive Science, 29(6), 1045‑1060. DOI logoGoogle Scholar
Richardson, M. J., Marsh, K. L., Isenhower, R. W., Goodman, J. R. L., & Schmidt, R. C.
(2007) Rocking together: Dynamics of intentional and unintentional interpersonal coordination. Human Movement Science, 26(6), 867‑891. DOI logoGoogle Scholar
Scaife, M., & Bruner, J. S.
(1975) The capacity for joint visual attention in the infant. Nature, 253(5489), 265‑266. DOI logoGoogle Scholar
Schilbach, L., Wilms, M., Eickhoff, S. B., Romanzetti, S., Tepest, R., Bente, G., Shah, N. J., Fink, G. R., & Vogeley, K.
(2010) Minds made for sharing: Initiating joint attention recruits reward-related neurocircuitry. Journal of Cognitive Neuroscience, 22(12), 2702‑2715. DOI logoGoogle Scholar
Schmidt, R. C., & O’Brien, B.
(1997) Evaluating the dynamics of unintended interpersonal coordination. Ecological Psychology, 9(3), 189‑206. DOI logoGoogle Scholar
Sebanz, N., Bekkering, H., & Knoblich, G.
(2006) Joint action: Bodies and minds moving together. Trends in Cognitive Sciences, 10(2), 70‑76. DOI logoGoogle Scholar
Sperduti, M., Delaveau, P., Fossati, P., & Nadel, J.
(2011) Different brain structures related to self- and external-agency attribution: a brief review and meta-analysis. Brain Structure and Function, 216(2), 151‑157. DOI logoGoogle Scholar
Synofzik, M., Vosgerau, G., & Newen, A.
(2008) Beyond the comparator model: A multifactorial two-step account of agency. Consciousness and Cognition, 17(1), 219‑239. DOI logoGoogle Scholar
Warren, Z. E., Zheng, Z., Swanson, A. R., Bekele, E., Zhang, L., Crittendon, J. A., Weitlauf, A. F., & Sarkar, N.
(2013) Can Robotic Interaction Improve Joint Attention Skills? Journal of autism and developmental disorders, 1–9.Google Scholar
Wegner, D. M.
(2003) The mind’s best trick: how we experience conscious will. Trends in Cognitive Sciences, 7(2), 65‑69. DOI logoGoogle Scholar
Wilms, M., Schilbach, L., Pfeiffer, U., Bente, G., Fink, G. R., & Vogeley, K.
(2010) It’s in your eyes—using gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience. Social cognitive and affective neuroscience, 5(1), 98. DOI logoGoogle Scholar
Wykowska, A., Kajopoulos, J., Ramirez-Amaro, K., & Cheng, G.
(2015) Autistic traits and sensitivity to human-like features of robot behavior. Interaction Studies, 16(2), 219‑248. DOI logoGoogle Scholar
Zaki, J., & Ochsner, K.
(2009) The need for a cognitive neuroscience of naturalistic social cognition. Annals of the New York Academy of Sciences, 11671, 16‑30. DOI logoGoogle Scholar
Cited by

Cited by 2 other publications

Grynszpan, Ouriel, Julie Bouteiller, Séverine Grynszpan, Florence Le Barillier, Jean-Claude Martin & Jacqueline Nadel
2019. Altered sense of gaze leading in autism. Research in Autism Spectrum Disorders 67 ► pp. 101441 ff. DOI logo
Recht, Samuel & Ouriel Grynszpan
2019. The sense of social agency in gaze leading. Journal on Multimodal User Interfaces 13:1 ► pp. 19 ff. DOI logo

This list is based on CrossRef data as of 15 april 2022. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.