Social gaze training for Autism Spectrum Disorder using eye-tracking and virtual humans
Background: Individuals with Autism Spectrum Disorder (ASD) have pronounced difficulties in attending
to relevant visual information during social interactions. Method: We designed and evaluated the feasibility of a
novel method to train this ability, by exposing participants to virtual human characters displayed on a screen which was entirely
blurred, except for a gaze-contingent viewing window that followed participants’ eyes direction. The goal was to incite
participants to direct their gaze towards the facial expressions of the virtual characters. Twenty-one adolescents with ASD who
attended ordinary school were randomized to either an experimental group, who was trained during a month and a half, or to a
control group. Social communicative abilities were assessed during pre, post and follow-up tests. Results: After
training, the experimental group showed significantly more interest in facial expressions on a test which involved understanding a
dialogue. Significant differences were not found for the other tests used. Conclusions: This outcome suggests that
the training method fostered participants’ awareness of the relevance of facial expressions.
Article outline
- 1.Introduction
- 2.Method
- 2.1Participants
- 2.2Design
- 2.3Material
- 2.3.1Experimental training material
- 2.3.2Control training material
- 2.3.3Measuring instruments
- 2.4Procedure
- 3.Results
- 4.Discussion
- 5.Conclusion
-
References
References (50)
References
American Psychiatric Association. (2013). Diagnostic and Statistical Manual of Mental Disorders (DSM-5®). American Psychiatric Pub. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Baron-Cohen, S. (1997). Mindblindness : An Essay on Autism and Theory of Mind. MIT Press.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Barzy, M., Black, J., Williams, D., & Ferguson, H. J. (2019). Autistic adults anticipate and integrate meaning based on the speaker’s voice : Evidence from eye-tracking and event-related potentials. Journal of Experimental Psychology. General. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Berggren, S., Fletcher-Watson, S., Milenkovic, N., Marschik, P. B., Bölte, S., & Jonsson, U. (2018). Emotion recognition training in autism spectrum disorder : A systematic review of challenges related to generalizability. Developmental neurorehabilitation,
21
(3), 141–154. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Bolte, S., Hubl, D., Feineis-Matthews, S., Prvulovic, D., Dierks, T., & Poustka, F. (2006). Facial affect recognition training in autism : Can we animate the fusiform gyrus? Behavioral Neuroscience,
120
(1), 211–216. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Brooks, B. L., Sherman, E. M. S., & Strauss, E. (2009). NEPSY-II : A Developmental Neuropsychological Assessment, Second Edition. Child Neuropsychology,
16
(1), 80–101. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Brown, S. M., & Bebko, J. M. (2012). Generalization, overselectivity, and discrimination in the autism phenotype : A review. Research in Autism Spectrum Disorders,
6
(2), 733–740. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Caruana, N., Stieglitz Ham, H., Brock, J., Woolgar, A., Kloth, N., Palermo, R., & McArthur, G. (2018). Joint attention difficulties in autistic adults : An interactive eye-tracking study. Autism,
22
(4), 502–512. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chawarska, K., Macari, S., & Shic, F. (2012). Context modulates attention to social scenes in toddlers with autism. Journal of Child Psychology and Psychiatry,
53
(8), 903–913. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chawarska, K., Macari, S., & Shic, F. (2013). Decreased spontaneous attention to social scenes in 6-month-old infants later diagnosed with autism spectrum disorders. Biological Psychiatry,
74
(3), 195–203. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chita-Tegmark, M. (2016). Attention Allocation in ASD : A Review and Meta-analysis of Eye-Tracking Studies. Review Journal of Autism and Developmental Disorders, 1–15. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Evers, K., Belle, G. V., Steyaert, J., Noens, I., & Wagemans, J. (2018). Gaze-Contingent Display Changes as New Window on Analytical and Holistic Face Perception in Children With Autism Spectrum Disorder. Child Development,
89
(2), 430–445. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Faja, S., Webb, S. J., Jones, E., Merkle, K., Kamara, D., Bavaro, J., Aylward, E., & Dawson, G. (2012). The effects of face expertise training on the behavioral performance and brain activity of adults with high functioning autism spectrum disorders. Journal of Autism and Developmental Disorders,
42
(2), 278–293. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Falck-Ytter, T., Hofsten, C. von, Gillberg, C., & Fernell, E. (2013). Visualization and Analysis of Eye Movement Data from Children with Typical and Atypical Development. Journal of Autism and Developmental Disorders,
43
(10), 2249–2258. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Fletcher-Watson, S., Petrou, A., Scott-Barrett, J., Dicks, P., Graham, C., O’Hare, A., Pain, H., & McConachie, H. (2016). A trial of an iPadTM intervention targeting social communication skills in children with autism. Autism,
20
(7), 771–782. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Frazier, T. W., Strauss, M., Klingemier, E. W., Zetzer, E. E., Hardan, A. Y., Eng, C., & Youngstrom, E. A. (2017). A Meta-Analysis of Gaze Differences to Social and Nonsocial Information Between Individuals With and Without Autism. Journal of the American Academy of Child & Adolescent Psychiatry,
56
(7), 546–555. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Freeth, M., & Bugembe, P. (2019). Social partner gaze direction and conversational phase; factors affecting social attention during face-to-face conversations in autistic adults? Autism: The International Journal of Research and Practice,
23
(2), 503–513. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Golan, O., Ashwin, E., Granader, Y., McClintock, S., Day, K., Leggett, V., & Baron-Cohen, S. (2010). Enhancing emotion recognition in children with autism spectrum conditions : An intervention using animated vehicles with real emotional faces. Journal of Autism and Developmental Disorders,
40
(3), 269–279. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Golan, O., & Baron-Cohen, S. (2006). Systemizing empathy : Teaching adults with Asperger syndrome or high-functioning autism to recognize complex emotions using interactive multimedia. Development and psychopathology,
18
(02), 591–617. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Grossard, C., Grynspan, O., Serret, S., Jouen, A.-L., Bailly, K., & Cohen, D. (2017). Serious games to teach social interactions and emotions to individuals with autism spectrum disorders (ASD). Computers & Education,
113
1, 195–211. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Grynszpan, O., Bouteiller, J., Grynszpan, S., Le Barillier, F., Martin, J.-C., & Nadel, J. (2019). Altered sense of gaze leading in autism. Research in Autism Spectrum Disorders,
67
1, 101441. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Grynszpan, O., Martin, J., & Nadel, J. (2008). Multimedia interfaces for users with high functioning autism : An empirical investigation. International Journal of Human-Computer Studies,
66
(8), 628–639. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Grynszpan, O., Nadel, J., Martin, J.-C., Simonin, J., Bailleul, P., Wang, Y., Gepner, D., Le Barillier, F., & Constant, J. (2012). Self-monitoring of gaze in high functioning autism. Journal of autism and developmental disorders,
42
(8), 1642–1650. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Grynszpan, O., Weiss, P. L. (Tamar), Perez-Diaz, F., & Gal, E. (2014). Innovative technology-based interventions for autism spectrum disorders : A meta-analysis. Autism,
18
(4), 346–361. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Guillon, Q., Hadjikhani, N., Baduel, S., & Rogé, B. (2014). Visual social attention in autism spectrum disorder : Insights from eye tracking studies. Neuroscience and Biobehavioral Reviews,
42
1, 279–297. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Happé, F. G. (1993). Communicative competence and theory of mind in autism : A test of relevance theory. Cognition,
48
(2), 101–119. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Hochhauser, M., & Grynszpan, O. (2017). Methods Investigating How Individuals with Autism Spectrum Disorder Spontaneously Attend to Social Events. Review Journal of Autism and Developmental Disorders,
4
(1), 82–93. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Hopkins, I. M., Gower, M. W., Perez, T. A., Smith, D. S., Amthor, F. R., Wimsatt, F. C., & Biasini, F. J. (2011). Avatar assistant : Improving social skills in students with an ASD through a computer-based intervention. Journal of autism and developmental disorders,
41
(11), 1543–1555. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Jolliffe, T., & Baron-Cohen, S. (1999). A test of central coherence theory : Linguistic processing in high-functioning adults with autism or Asperger syndrome: is local coherence impaired? Cognition,
71
(2), 149–185. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Jones, W., Carr, K., & Klin, A. (2008). Absence of preferential looking to the eyes of approaching adults predicts level of social disability in 2-year-old toddlers with autism spectrum disorder. Archives of General Psychiatry,
65
(8), 946–954. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Keemink, J. R., Keshavarzi-Pour, M. J., & Kelly, D. J. (2019). Infants’ responses to interactive gaze-contingent faces in a novel and naturalistic eye-tracking paradigm. Developmental Psychology,
55
(7), 1362–1371. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Klin, A., Jones, W., Schultz, R., Volkmar, F., & Cohen, D. (2002). Defining and quantifying the social phenotype in autism. The American Journal of Psychiatry,
159
(6), 895–908. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kuhn, G., Kourkoulou, A., & Leekam, S. R. (2010). How Magic Changes Our Expectations About Autism. Psychological Science, 21(10), 1487–1493. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Little, G. E., Bonnar, L., Kelly, S. W., Lohan, K. S., & Rajendran, G. (2016). Gaze contingent joint attention with an avatar in children with and without ASD. 2016 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), 15–20. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. C., Pickles, A., & Rutter, M. (2000). The Autism Diagnostic Observation Schedule – Generic : A Standard Measure of Social and Communication Deficits Associated with the Spectrum of Autism. Journal of Autism and Developmental Disorders,
30
(3), 205–223. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Mei, C., Zahed, B. T., Mason, L., & Ouarles, J. (2018). Towards Joint Attention Training for Children with ASD – a VR Game Approach and Eye Gaze Exploration. 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 289–296. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Nakano, T., Tanaka, K., Endo, Y., Yamane, Y., Yamamoto, T., Nakano, Y., Ohta, H., Kato, N., & Kitazawa, S. (2010). Atypical gaze patterns in children and adults with autism spectrum disorders dissociated from developmental changes in gaze behaviour. Proceedings. Biological Sciences / The Royal Society,
277
(1696), 2935–2943. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Papagiannopoulou, E. A., Chitty, K. M., Hermens, D. F., Hickie, I. B., & Lagopoulos, J. (2014). A systematic review and meta-analysis of eye-tracking studies in children with autism spectrum disorders. Social Neuroscience,
9
(6), 610–632. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Pennington, R. C. (2010). Computer-Assisted Instruction for Teaching Academic Skills to Students With Autism Spectrum Disorders : A Review of Literature. Focus on Autism and Other Developmental Disabilities,
25
(4), 239. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Ramdoss, S., Lang, R., Mulloy, A., Franco, J., O’Reilly, M., Didden, R., & Lancioni, G. (2011). Use of computer-based interventions to teach communication skills to children with autism spectrum disorders : A systematic review. Journal of Behavioral Education,
20
(1), 55–76. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Sasson, N. J., Pinkham, A. E., Weittenhiller, L. P., Faso, D. J., & Simpson, C. (2016). Context Effects on Facial Affect Recognition in Schizophrenia and Autism : Behavioral and Eye-Tracking Evidence. Schizophrenia Bulletin,
42
(3), 675–683. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Shic, F., Wang, Q., Macari, S. L., & Chawarska, K. (2020). The role of limited salience of speech in selective attention to faces in toddlers with autism spectrum disorders. Journal of Child Psychology and Psychiatry,
61
(4), 459–469. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Tanaka, J. W., Wolf, J. M., Klaiman, C., Koenig, K., Cockburn, J., Herlihy, L., Brown, C., Stahl, S., Kaiser, M. D., & Schultz, R. T. (2010). Using computerized games to teach face recognition skills to children with autism spectrum disorder : The Let’s Face It! program. Journal of Child Psychology and Psychiatry, and Allied Disciplines,
51
(8), 944–952. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Trepagnier, C. Y., Sebrechts, M. M., Finkelmeyer, A., Stewart, W., Woodford, J., & Coleman, M. (2006). Simulating social interaction to address deficits of autistic spectrum disorder in children. Cyberpsychology & Behavior: The Impact of the Internet, Multimedia and Virtual Reality on Behavior and Society,
9
(2), 213–217. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
von Hofsten, C., Uhlig, H., Adell, M., & Kochukhova, O. (2009). How children with autism look at events. Research in Autism Spectrum Disorders,
3
(2), 556–569. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Voss, C., Schwartz, J., Daniels, J., Kline, A., Haber, N., Washington, P., Tariq, Q., Robinson, T. N., Desai, M., Phillips, J. M., Feinstein, C., Winograd, T., & Wall, D. P. (2019). Effect of Wearable Digital Intervention for Improving Socialization in Children With Autism Spectrum Disorder : A Randomized Clinical Trial. JAMA Pediatrics,
173
(5), 446–454. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Wang, Q., Wall, C. A., Barney, E. C., Bradshaw, J. L., Macari, S. L., Chawarska, K., & Shic, F. (2020). Promoting social attention in 3-year-olds with ASD through gaze-contingent eye tracking. Autism Research,
13
(1), 61–73. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Warren, Z. E., Zheng, Z., Swanson, A. R., Bekele, E., Zhang, L., Crittendon, J. A., Weitlauf, A. F., & Sarkar, N. (2015). Can Robotic Interaction Improve Joint Attention Skills? Journal of Autism and Developmental Disorders,
45
(11), 3726–3734. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Wechsler, D. (2003). Wechsler intelligence scale for children–Fourth Edition (WISC-IV). San Antonio, TX: The Psychological Corporation. [URL]
Cited by (3)
Cited by three other publications
Guo, Yangyang, Hongye Liu, Yaojin Sun & Yongjun Ren
2024.
Virtual human pose estimation in a fire education system for children with autism spectrum disorders.
Multimedia Systems 30:2
![DOI logo](//benjamins.com/logos/doi-logo.svg)
Grynszpan, O.
2023.
Entraînement cognitif dans l’autisme. In
Remédiation Cognitive,
► pp. 401 ff.
![DOI logo](//benjamins.com/logos/doi-logo.svg)
Gómez León, M.ª Isabel
2023.
Desarrollo de la comprensión emocional. ¿Qué tipo de tecnología para qué alumno con trastorno del espectro autista? Revisión sistemática.
Siglo Cero 54:4
► pp. 65 ff.
![DOI logo](//benjamins.com/logos/doi-logo.svg)
This list is based on CrossRef data as of 4 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.