Social gaze training for Autism Spectrum Disorder using eye-tracking and virtual humans
Background: Individuals with Autism Spectrum Disorder (ASD) have pronounced difficulties in attending
to relevant visual information during social interactions. Method: We designed and evaluated the feasibility of a
novel method to train this ability, by exposing participants to virtual human characters displayed on a screen which was entirely
blurred, except for a gaze-contingent viewing window that followed participants’ eyes direction. The goal was to incite
participants to direct their gaze towards the facial expressions of the virtual characters. Twenty-one adolescents with ASD who
attended ordinary school were randomized to either an experimental group, who was trained during a month and a half, or to a
control group. Social communicative abilities were assessed during pre, post and follow-up tests. Results: After
training, the experimental group showed significantly more interest in facial expressions on a test which involved understanding a
dialogue. Significant differences were not found for the other tests used. Conclusions: This outcome suggests that
the training method fostered participants’ awareness of the relevance of facial expressions.
Article outline
- 1.Introduction
- 2.Method
- 2.1Participants
- 2.2Design
- 2.3Material
- 2.3.1Experimental training material
- 2.3.2Control training material
- 2.3.3Measuring instruments
- 2.4Procedure
- 3.Results
- 4.Discussion
- 5.Conclusion
-
References
References (50)
American Psychiatric Association
(
2013)
Diagnostic and Statistical Manual of Mental Disorders (DSM-5®). American Psychiatric Pub.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Baron-Cohen, S.
(
1997)
Mindblindness : An Essay on Autism and Theory of Mind. MIT Press.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Barzy, M., Black, J., Williams, D., & Ferguson, H. J.
(
2019)
Autistic adults anticipate and integrate meaning based on the speaker’s voice : Evidence from eye-tracking and event-related potentials.
Journal of Experimental Psychology. General.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Berggren, S., Fletcher-Watson, S., Milenkovic, N., Marschik, P. B., Bölte, S., & Jonsson, U.
(
2018)
Emotion recognition training in autism spectrum disorder : A systematic review of challenges related to generalizability.
Developmental neurorehabilitation,
21
(3), 141–154.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Bolte, S., Hubl, D., Feineis-Matthews, S., Prvulovic, D., Dierks, T., & Poustka, F.
(
2006)
Facial affect recognition training in autism : Can we animate the fusiform gyrus? Behavioral Neuroscience,
120
(1), 211–216.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Brooks, B. L., Sherman, E. M. S., & Strauss, E.
(
2009)
NEPSY-II : A Developmental Neuropsychological Assessment, Second Edition.
Child Neuropsychology,
16
(1), 80–101.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Brown, S. M., & Bebko, J. M.
(
2012)
Generalization, overselectivity, and discrimination in the autism phenotype : A review.
Research in Autism Spectrum Disorders,
6
(2), 733–740.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Caruana, N., Stieglitz Ham, H., Brock, J., Woolgar, A., Kloth, N., Palermo, R., & McArthur, G.
(
2018)
Joint attention difficulties in autistic adults : An interactive eye-tracking study.
Autism,
22
(4), 502–512.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chawarska, K., Macari, S., & Shic, F.
(
2012)
Context modulates attention to social scenes in toddlers with autism.
Journal of Child Psychology and Psychiatry,
53
(8), 903–913.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chawarska, K., Macari, S., & Shic, F.
(
2013)
Decreased spontaneous attention to social scenes in 6-month-old infants later diagnosed with autism spectrum disorders.
Biological Psychiatry,
74
(3), 195–203.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chita-Tegmark, M.
(
2016)
Attention Allocation in ASD : A Review and Meta-analysis of Eye-Tracking Studies.
Review Journal of Autism and Developmental Disorders, 1–15.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Evers, K., Belle, G. V., Steyaert, J., Noens, I., & Wagemans, J.
(
2018)
Gaze-Contingent Display Changes as New Window on Analytical and Holistic Face Perception in Children With Autism Spectrum Disorder.
Child Development,
89
(2), 430–445.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Faja, S., Webb, S. J., Jones, E., Merkle, K., Kamara, D., Bavaro, J., Aylward, E., & Dawson, G.
(
2012)
The effects of face expertise training on the behavioral performance and brain activity of adults with high functioning autism spectrum disorders.
Journal of Autism and Developmental Disorders,
42
(2), 278–293.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Falck-Ytter, T., Hofsten, C. von, Gillberg, C., & Fernell, E.
(
2013)
Visualization and Analysis of Eye Movement Data from Children with Typical and Atypical Development.
Journal of Autism and Developmental Disorders,
43
(10), 2249–2258.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Fletcher-Watson, S., Petrou, A., Scott-Barrett, J., Dicks, P., Graham, C., O’Hare, A., Pain, H., & McConachie, H.
(
2016)
A trial of an iPadTM intervention targeting social communication skills in children with autism.
Autism,
20
(7), 771–782.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Frazier, T. W., Strauss, M., Klingemier, E. W., Zetzer, E. E., Hardan, A. Y., Eng, C., & Youngstrom, E. A.
(
2017)
A Meta-Analysis of Gaze Differences to Social and Nonsocial Information Between Individuals With and Without Autism.
Journal of the American Academy of Child & Adolescent Psychiatry,
56
(7), 546–555.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Freeth, M., & Bugembe, P.
(
2019)
Social partner gaze direction and conversational phase; factors affecting social attention during face-to-face conversations in autistic adults? Autism: The International Journal of Research and Practice,
23
(2), 503–513.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Golan, O., Ashwin, E., Granader, Y., McClintock, S., Day, K., Leggett, V., & Baron-Cohen, S.
(
2010)
Enhancing emotion recognition in children with autism spectrum conditions : An intervention using animated vehicles with real emotional faces.
Journal of Autism and Developmental Disorders,
40
(3), 269–279.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Golan, O., & Baron-Cohen, S.
(
2006)
Systemizing empathy : Teaching adults with Asperger syndrome or high-functioning autism to recognize complex emotions using interactive multimedia.
Development and psychopathology,
18
(02), 591–617.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Grossard, C., Grynspan, O., Serret, S., Jouen, A.-L., Bailly, K., & Cohen, D.
(
2017)
Serious games to teach social interactions and emotions to individuals with autism spectrum disorders (ASD).
Computers & Education,
113
1, 195–211.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Grynszpan, O., Bouteiller, J., Grynszpan, S., Le Barillier, F., Martin, J.-C., & Nadel, J.
(
2019)
Altered sense of gaze leading in autism.
Research in Autism Spectrum Disorders,
67
1, 101441.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Grynszpan, O., Martin, J., & Nadel, J.
Grynszpan, O., Martin, J., & Nadel, J.
(
2008)
Multimedia interfaces for users with high functioning autism : An empirical investigation.
International Journal of Human-Computer Studies,
66
(8), 628–639.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Grynszpan, O., Nadel, J., Martin, J.-C., Simonin, J., Bailleul, P., Wang, Y., Gepner, D., Le Barillier, F., & Constant, J.
(
2012)
Self-monitoring of gaze in high functioning autism.
Journal of autism and developmental disorders,
42
(8), 1642–1650.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Grynszpan, O., Weiss, P. L. (Tamar), Perez-Diaz, F., & Gal, E.
(
2014)
Innovative technology-based interventions for autism spectrum disorders : A meta-analysis.
Autism,
18
(4), 346–361.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Guillon, Q., Hadjikhani, N., Baduel, S., & Rogé, B.
(
2014)
Visual social attention in autism spectrum disorder : Insights from eye tracking studies.
Neuroscience and Biobehavioral Reviews,
42
1, 279–297.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Happé, F. G.
(
1993)
Communicative competence and theory of mind in autism : A test of relevance theory.
Cognition,
48
(2), 101–119.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Hochhauser, M., & Grynszpan, O.
(
2017)
Methods Investigating How Individuals with Autism Spectrum Disorder Spontaneously Attend to Social Events.
Review Journal of Autism and Developmental Disorders,
4
(1), 82–93.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Hopkins, I. M., Gower, M. W., Perez, T. A., Smith, D. S., Amthor, F. R., Wimsatt, F. C., & Biasini, F. J.
(
2011)
Avatar assistant : Improving social skills in students with an ASD through a computer-based intervention.
Journal of autism and developmental disorders,
41
(11), 1543–1555.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Jolliffe, T., & Baron-Cohen, S.
(
1999)
A test of central coherence theory : Linguistic processing in high-functioning adults with autism or Asperger syndrome: is local coherence impaired? Cognition,
71
(2), 149–185.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Jones, W., Carr, K., & Klin, A.
(
2008)
Absence of preferential looking to the eyes of approaching adults predicts level of social disability in 2-year-old toddlers with autism spectrum disorder.
Archives of General Psychiatry,
65
(8), 946–954.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Keemink, J. R., Keshavarzi-Pour, M. J., & Kelly, D. J.
(
2019)
Infants’ responses to interactive gaze-contingent faces in a novel and naturalistic eye-tracking paradigm.
Developmental Psychology,
55
(7), 1362–1371.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Klin, A., Jones, W., Schultz, R., Volkmar, F., & Cohen, D.
(
2002)
Defining and quantifying the social phenotype in autism.
The American Journal of Psychiatry,
159
(6), 895–908.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kuhn, G., Kourkoulou, A., & Leekam, S. R.
(
2010)
How Magic Changes Our Expectations About Autism.
Psychological Science, 21(10), 1487–1493.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Little, G. E., Bonnar, L., Kelly, S. W., Lohan, K. S., & Rajendran, G.
(
2016)
Gaze contingent joint attention with an avatar in children with and without ASD.
2016 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), 15–20.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. C., Pickles, A., & Rutter, M.
(
2000)
The Autism Diagnostic Observation Schedule – Generic : A Standard Measure of Social and Communication Deficits Associated with the Spectrum of Autism.
Journal of Autism and Developmental Disorders,
30
(3), 205–223.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Mei, C., Zahed, B. T., Mason, L., & Ouarles, J.
(
2018)
Towards Joint Attention Training for Children with ASD – a VR Game Approach and Eye Gaze Exploration.
2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 289–296.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Nakano, T., Tanaka, K., Endo, Y., Yamane, Y., Yamamoto, T., Nakano, Y., Ohta, H., Kato, N., & Kitazawa, S.
(
2010)
Atypical gaze patterns in children and adults with autism spectrum disorders dissociated from developmental changes in gaze behaviour.
Proceedings. Biological Sciences / The Royal Society,
277
(1696), 2935–2943.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Papagiannopoulou, E. A., Chitty, K. M., Hermens, D. F., Hickie, I. B., & Lagopoulos, J.
(
2014)
A systematic review and meta-analysis of eye-tracking studies in children with autism spectrum disorders.
Social Neuroscience,
9
(6), 610–632.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Pennington, R. C.
(
2010)
Computer-Assisted Instruction for Teaching Academic Skills to Students With Autism Spectrum Disorders : A Review of Literature.
Focus on Autism and Other Developmental Disabilities,
25
(4), 239.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Ramdoss, S., Lang, R., Mulloy, A., Franco, J., O’Reilly, M., Didden, R., & Lancioni, G.
(
2011)
Use of computer-based interventions to teach communication skills to children with autism spectrum disorders : A systematic review.
Journal of Behavioral Education,
20
(1), 55–76.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Sasson, N. J., Pinkham, A. E., Weittenhiller, L. P., Faso, D. J., & Simpson, C.
(
2016)
Context Effects on Facial Affect Recognition in Schizophrenia and Autism : Behavioral and Eye-Tracking Evidence.
Schizophrenia Bulletin,
42
(3), 675–683.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Shic, F., Wang, Q., Macari, S. L., & Chawarska, K.
(
2020)
The role of limited salience of speech in selective attention to faces in toddlers with autism spectrum disorders.
Journal of Child Psychology and Psychiatry,
61
(4), 459–469.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Tanaka, J. W., Wolf, J. M., Klaiman, C., Koenig, K., Cockburn, J., Herlihy, L., Brown, C., Stahl, S., Kaiser, M. D., & Schultz, R. T.
(
2010)
Using computerized games to teach face recognition skills to children with autism spectrum disorder : The Let’s Face It! program.
Journal of Child Psychology and Psychiatry, and Allied Disciplines,
51
(8), 944–952.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Trepagnier, C. Y., Sebrechts, M. M., Finkelmeyer, A., Stewart, W., Woodford, J., & Coleman, M.
(
2006)
Simulating social interaction to address deficits of autistic spectrum disorder in children.
Cyberpsychology & Behavior: The Impact of the Internet, Multimedia and Virtual Reality on Behavior and Society,
9
(2), 213–217.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
von Hofsten, C., Uhlig, H., Adell, M., & Kochukhova, O.
(
2009)
How children with autism look at events.
Research in Autism Spectrum Disorders,
3
(2), 556–569.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Voss, C., Schwartz, J., Daniels, J., Kline, A., Haber, N., Washington, P., Tariq, Q., Robinson, T. N., Desai, M., Phillips, J. M., Feinstein, C., Winograd, T., & Wall, D. P.
(
2019)
Effect of Wearable Digital Intervention for Improving Socialization in Children With Autism Spectrum Disorder : A Randomized Clinical Trial.
JAMA Pediatrics,
173
(5), 446–454.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Wang, Q., Wall, C. A., Barney, E. C., Bradshaw, J. L., Macari, S. L., Chawarska, K., & Shic, F.
(
2020)
Promoting social attention in 3-year-olds with ASD through gaze-contingent eye tracking.
Autism Research,
13
(1), 61–73.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Warren, Z. E., Zheng, Z., Swanson, A. R., Bekele, E., Zhang, L., Crittendon, J. A., Weitlauf, A. F., & Sarkar, N.
(
2015)
Can Robotic Interaction Improve Joint Attention Skills? Journal of Autism and Developmental Disorders,
45
(11), 3726–3734.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Wechsler, D.
(
2003)
Wechsler intelligence scale for children–Fourth Edition (WISC-IV).
San Antonio, TX: The Psychological Corporation.
[URL]
Cited by (3)
Cited by 3 other publications
Guo, Yangyang, Hongye Liu, Yaojin Sun & Yongjun Ren
2024.
Virtual human pose estimation in a fire education system for children with autism spectrum disorders.
Multimedia Systems 30:2
![DOI logo](//benjamins.com/logos/doi-logo.svg)
Grynszpan, O.
2023.
Entraînement cognitif dans l’autisme. In
Remédiation Cognitive,
► pp. 401 ff.
![DOI logo](//benjamins.com/logos/doi-logo.svg)
Gómez León, M.ª Isabel
2023.
Desarrollo de la comprensión emocional. ¿Qué tipo de tecnología para qué alumno con trastorno del espectro autista? Revisión sistemática.
Siglo Cero 54:4
► pp. 65 ff.
![DOI logo](//benjamins.com/logos/doi-logo.svg)
This list is based on CrossRef data as of 4 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.