Communicating attention
Gaze position transfer in cooperative problem solving
Boris M. Velichkovsky | University of Bielefeld and Dresden University of Technology
The results of two experiments, in which participants solved constructive tasks of the puzzle type, are reported. The tasks were solved by two partners who shared the same visual environment hut whose knowledge of the situation and ability to change it to reach a solution were different. One of the partners — the "expert" — knew the solution in detail but had no means of acting on this information. The second partner — the "novice " — could act to achieve the goal, but knew very little about the solution. The partners were free to communicate verbally. In one third of the trials of the first experiment, in addition to verbal communication, the eye fixations of the expert were projected onto the working space of the novice. In another condition the expert could use a mouse to show the novice relevant parts of the task configuration. Both methods of facilitating the 'joint attention' state of the partners improved their performance. The nature of the dialogues as well as the parameters of the eye movements changed. In the second experiment the direction of the gaze-position data transfer was reversed, from the novice to the expert. This also led to a significant increase in the efficiency of the distributed problem solving.
Published online: 01 January 1995
https://doi.org/10.1075/pc.3.2.02vel
https://doi.org/10.1075/pc.3.2.02vel
Cited by
Cited by 85 other publications
Afkari, Hoorieh, Roman Bednarik, Susanne Mäkelä & Shahram Eivazi
2016. Mechanisms for maintaining situation awareness in the micro-neurosurgical operating room.
International Journal of Human-Computer Studies 95 ► pp. 1 ff. 
Akkil, Deepak & Poika Isokoski
2018. Comparison of Gaze and Mouse Pointers for Video-based Collaborative Physical Task.
Interacting with Computers 30:6 ► pp. 524 ff.
Akkil, Deepak, Biju Thankachan & Poika Isokoski
2018.
In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications,
► pp. 1 ff.
Bailenson, Jeremy N., Andrew C. Beall, Jack Loomis, Jim Blascovich & Matthew Turk
2004. Transformed Social Interaction: Decoupling Representation from Behavior and Form in Collaborative Virtual Environments.
Presence: Teleoperators and Virtual Environments 13:4 ► pp. 428 ff.
Ball, Linden J. & Damien Litchfield
2013.
In Cognition Beyond the Brain,
► pp. 223 ff.
Ball, Linden J. & Damien Litchfield
2017.
In Cognition Beyond the Brain,
► pp. 115 ff.
Bangerter, Adrian
2004. Using Pointing and Describing to Achieve Joint Focus of Attention in Dialogue.
Psychological Science 15:6 ► pp. 415 ff.
Barattelli, S., L. Sichelschmidt & G. Rickheit
1998.
In IECON '98. Proceedings of the 24th Annual Conference of the IEEE Industrial Electronics Society (Cat. No.98CH36200),
► pp. 2000 ff.
Bard, E.G., A.H. Anderson, Y. Chen, H.B.M. Nicholson, C. Havard & S. Dalzel-Job
2007. Let’s you do that: Sharing the cognitive burdens of dialogue.
Journal of Memory and Language 57:4 ► pp. 616 ff.
Billinghurst, Mark, Kunal Gupta, Masai Katsutoshi, Youngho Lee, Gun Lee, Kai Kunze & Maki Sugimoto
2016.
In Collaboration Meets Interactive Spaces,
► pp. 177 ff.
Brennan, Susan E., Xin Chen, Christopher A. Dickinson, Mark B. Neider & Gregory J. Zelinsky
2008. Coordinating cognition: The costs and benefits of shared gaze during collaborative search.
Cognition 106:3 ► pp. 1465 ff.
Brunyé, Tad T., Trafton Drew, Donald L. Weaver & Joann G. Elmore
2019. A review of eye tracking for understanding and improving diagnostic interpretation.
Cognitive Research: Principles and Implications 4:1
Carletta, Jean, Robin L. Hill, Craig Nicol, Tim Taylor, Jan Peter de Ruiter & Ellen Gurman Bard
2010. Eyetracking for two-person tasks with manipulation of a virtual world.
Behavior Research Methods 42:1 ► pp. 254 ff.
Cole, Geoff G., Paul A. Skarratt & Gustav Kuhn
2016. Real Person Interaction in Visual Attention Research.
European Psychologist 21:2 ► pp. 141 ff.
Dubynin, Ignat, Artem Yashin & Boris M. Velichkovsky
2021.
In Advances in Cognitive Research, Artificial Intelligence and Neuroinformatics [Advances in Intelligent Systems and Computing, 1358],
► pp. 720 ff.
Dzaack, Jeronimo, Bo Höge & Matthias Rötting
2010.
In Advances in Human Factors, Ergonomics, and Safety in Manufacturing and Service Industries [Advances in Human Factors and Ergonomics Series, ],
► pp. 180 ff.
Emhardt, Selina N., Ellen M. Kok, Halszka Jarodzka, Saskia Brand‐Gruwel, Christian Drumm & Tamara Gog
2020. How Experts Adapt Their Gaze Behavior When Modeling a Task to Novices.
Cognitive Science 44:9
Eryilmaz, Evren, Terry Ryan, Mary Poplin & Justin Mary
2012.
In 2012 45th Hawaii International Conference on System Sciences,
► pp. 108 ff.
Fedorova, A. A., S. L. Shishkin, Y. O. Nuzhdin & B. M. Velichkovsky
2015.
In 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER),
► pp. 751 ff.
Fullwood, Chris & Gwyneth Doherty-Sneddon
2006. Effect of gazing at the camera during a video link on recall.
Applied Ergonomics 37:2 ► pp. 167 ff.
Gallagher-Mitchell, Thomas, Victoria Simms & Damien Litchfield
2018. Learning from where ‘eye’ remotely look or point: Impact on number line estimation error in adults.
Quarterly Journal of Experimental Psychology 71:7 ► pp. 1526 ff.
Gegenfurtner, Andreas, Erno Lehtinen, Halszka Jarodzka & Roger Säljö
2017. Effects of eye movement modeling examples on adaptive expertise in medical image diagnosis.
Computers & Education 113 ► pp. 212 ff.
Gog, Tamara van, Liesbeth Kester, Fleurie Nievelstein, Bas Giesbers & Fred Paas
2009. Uncovering cognitive processes: Different techniques that can contribute to cognitive load research and instruction.
Computers in Human Behavior 25:2 ► pp. 325 ff.
Groen, Martin & Jan Noyes
2010. Solving problems: How can guidance concerning task-relevancy be provided?.
Computers in Human Behavior 26:6 ► pp. 1318 ff.
Hampton, Andrew, Valerie L. Shalin, Eric Robinson, Brian Simpson, Victor Finomore, Jeffery Cowgill, Thomas Moore, Terry Rapoch & Robert Gilkey
2012. The Impact of Spatialized Communications on Team Navigation.
Proceedings of the Human Factors and Ergonomics Society Annual Meeting 56:1 ► pp. 463 ff.
Hausfeld, J., K. von Hesler & S. Goldlücke
2021. Strategic gaze: an interactive eye-tracking study.
Experimental Economics 24:1 ► pp. 177 ff.
Ho, Hong-Fa, Cheng-I Lu, Jon-Chao Hong & Chi-Ruei Tsai
2015.
In 2015 International Conference of Educational Innovation through Technology (EITT),
► pp. 194 ff.
Höge, Bo, Ulrike Schmuntzsch & Matthias Rötting
2012.
In Integrierte Industrielle Sach- und Dienstleistungen,
► pp. 217 ff.
Isachenko, Andrey V., Darisy G. Zhao, Eugeny V. Melnichuk, Ignat A. Dubynin, Boris M. Velichkovsky & Sergei L. Shishkin
2018.
In 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC),
► pp. 3518 ff.
Jarodzka, Halszka, Irene Skuballa & Hans Gruber
2021. Eye-Tracking in Educational Practice: Investigating Visual Perception Underlying Teaching and Learning in the Classroom.
Educational Psychology Review 33:1 ► pp. 1 ff.
Jarodzka, Halszka, Tamara van Gog, Michael Dorr, Katharina Scheiter & Peter Gerjets
2013. Learning to see: Guiding students' attention via a Model's eye movements fosters learning.
Learning and Instruction 25 ► pp. 62 ff.
Jiazhi Ou, Lui Min Oh, S.R. Fussell, T. Blum & Jie Yang
2008. Predicting Visual Focus of Attention From Intention in Remote Collaborative Tasks.
IEEE Transactions on Multimedia 10:6 ► pp. 1034 ff.
Kohler, Petra, Sebastian Pannasch & Boris M. Velichkovsky
2009.
In Future Interaction Design II,
► pp. 31 ff.
Le, Khanh-Duy, Tanh Quang Tran, Karol Chlasta, Krzysztof Krejtz, Morten Fjeld & Andreas Kunz
2021.
In Designing Interactive Systems Conference 2021,
► pp. 283 ff.
Lefrançois, Olivier, Nadine Matton & Mickaël Causse
2021. Improving Airline Pilots’ Visual Scanning and Manual Flight Performance through Training on Skilled Eye Gaze Strategies.
Safety 7:4 ► pp. 70 ff.
Li, Yuan, Feiyu Lu, Wallace S Lages & Doug Bowman
2019.
In Symposium on Spatial User Interaction,
► pp. 1 ff.
Lindgren, Robb
2012. Generating a learning stance through perspective-taking in a virtual environment.
Computers in Human Behavior 28:4 ► pp. 1130 ff.
Litchfield, Damien & Linden J. Ball
2011. Rapid communication: Using another's gaze as an explicit aid to insight problem solving.
Quarterly Journal of Experimental Psychology 64:4 ► pp. 649 ff.
Marschner, Linda, Sebastian Pannasch, Johannes Schulz & Sven-Thomas Graupner
2015. Social communication with virtual agents: The effects of body and gaze direction on attention and emotional responding in human observers.
International Journal of Psychophysiology 97:2 ► pp. 85 ff.
Mikhailenko, Maria, Nadezhda Maksimenko & Mikhail Kurushkin
2022. Eye-Tracking in Immersive Virtual Reality for Education: A Review of the Current Progress and Applications.
Frontiers in Education 7
Mojzisch, Andreas, Leonhard Schilbach, Jens R. Helmert, Sebastian Pannasch, Boris M. Velichkovsky & Kai Vogeley
2006. The effects of self-involvement on attention, arousal, and facial expression during social interaction with virtual others: A psychophysiological study.
Social Neuroscience 1:3-4 ► pp. 184 ff.
Monk, Andrew F. & Caroline Gale
2002. A Look Is Worth a Thousand Words: Full Gaze Awareness in Video-Mediated Conversation.
Discourse Processes 33:3 ► pp. 257 ff.
Müller, Romy, Jens R. Helmert, Sebastian Pannasch & Boris M. Velichkovsky
2013. Gaze transfer in remote cooperation: Is it always helpful to see what your partner is attending to?.
Quarterly Journal of Experimental Psychology 66:7 ► pp. 1302 ff.
Müller, Romy, Jens R. Helmert & Sebastian Pannasch
2014. Limitations of gaze transfer: Without visual context, eye movements do not to help to coordinate joint action, whereas mouse movements do.
Acta Psychologica 152 ► pp. 19 ff.
Neider, Mark B., Xin Chen, Christopher A. Dickinson, Susan E. Brennan & Gregory J. Zelinsky
2010. Coordinating spatial referencing using shared gaze.
Psychonomic Bulletin & Review 17:5 ► pp. 718 ff.
Niehorster, Diederick C., Tim Cornelissen, Kenneth Holmqvist & Ignace Hooge
2019. Searching with and against each other: Spatiotemporal coordination of visual search behavior in collaborative and competitive settings.
Attention, Perception, & Psychophysics 81:3 ► pp. 666 ff.
Ohno, Takehiko
2005.
In CHI '05 Extended Abstracts on Human Factors in Computing Systems,
► pp. 1709 ff.
Pannasch, Sebastian, Jens R. Helmert, Romy Müller & Boris M. Velichkovsky
2012.
In Cognitive Behavioural Systems [Lecture Notes in Computer Science, 7403],
► pp. 19 ff.
Pannasch, Sebastian & Boris M. Velichkovsky
2009. Distractor effect and saccade amplitudes: Further evidence on different modes of processing in free exploration of visual images.
Visual Cognition 17:6-7 ► pp. 1109 ff.
Peysakhovich, Vsevolod, Olivier Lefrançois, Frédéric Dehais & Mickaël Causse
2018. The Neuroergonomics of Aircraft Cockpits: The Four Stages of Eye-Tracking Integration to Enhance Flight Safety.
Safety 4:1 ► pp. 8 ff.
Pomplun, M., E. Carbone, L. Sichelschmidt, B.M. Velichkovskv & H. Ritter
2005.
In Fourth IEEE Conference on Cognitive Informatics, 2005. (ICCI 2005).,
► pp. 183 ff.
Pomplun, Marc, Hannes Rieser, Helge Ritter & Boris M. Velichkovsky
1997.
In Strukturen und Prozesse intelligenter Systeme,
► pp. 65 ff.
Pomplun, Marc, Helge Ritter & Boris Velichkovsky
1996. Disambiguating Complex Visual Information: Towards Communication of Personal Views of a Scene.
Perception 25:8 ► pp. 931 ff.
Pomplun, Marc, Lorenz Sichelschmidt, Karin Wagner, Thomas Clermont, Gert Rickheit & Helge Ritter
2001. Comparative visual search: a difference that makes a difference.
Cognitive Science 25:1 ► pp. 3 ff.
Qvarfordt, Pernilla, David Beymer & Shumin Zhai
2005.
In Human-Computer Interaction - INTERACT 2005 [Lecture Notes in Computer Science, 3585],
► pp. 767 ff.
Qvarfordt, Pernilla & Shumin Zhai
2005.
In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems,
► pp. 221 ff.
Roads, Brett, Michael C. Mozer, Thomas A. Busey & Rouwen Canal-Bruland
2016. Using Highlighting to Train Attentional Expertise.
PLOS ONE 11:1 ► pp. e0146266 ff.
Sadasivan, Sajay, Joel S. Greenstein, Anand K. Gramopadhye & Andrew T. Duchowski
2005.
In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems,
► pp. 141 ff.
Schlösser, Christian
2018.
In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications,
► pp. 1 ff.
Schlösser, Christian, Benedikt Schröder, Linda Cedli & Andrea Kienle
2018.
In Proceedings of the Workshop on Communication by Gaze Interaction,
► pp. 1 ff.
Schrammel, Franziska, Sebastian Pannasch, Sven-Thomas Graupner, Andreas Mojzisch & Boris M. Velichkovsky
2009. Virtual friend or threat? The effects of facial expression and gaze interaction on psychophysiological responses and emotional experience.
Psychophysiology 46:5 ► pp. 922 ff.
Scurr, Joanna C., Jenny Page & Heather Lunt
2014. A methodological framework for capturing relative eyetracking coordinate data to determine gaze patterns and fixations from two or more observers.
Behavior Research Methods 46:4 ► pp. 922 ff.
Sindhwani, Shyamli, Gregory Minissale, Gerald Weber, Christof Lutteroth, Anthony Lambert, Neal Curtis & Elizabeth Broadbent
2020. A Multidisciplinary Study of Eye Tracking Technology for Visual Intelligence.
Education Sciences 10:8 ► pp. 195 ff.
Skantze, Gabriel
2021. Turn-taking in Conversational Systems and Human-Robot Interaction: A Review.
Computer Speech & Language 67 ► pp. 101178 ff.
Skantze, Gabriel, Anna Hjalmarsson & Catharine Oertel
2014. Turn-taking, feedback and joint attention in situated human–robot interaction.
Speech Communication 65 ► pp. 50 ff.
Skantze, Gabriel, Martin Johansson & Jonas Beskow
2015.
In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction,
► pp. 67 ff.
Tapie, J., P. Terrier, L. Perron & J.-M. Cellier
2006. Should remote collaborators be represented by avatars? A matter of common ground for collective medical decision-making.
AI & SOCIETY 20:3 ► pp. 331 ff.
Tenenberg, Josh, Wolff-Michael Roth & David Socha
2016. From I-Awareness to We-Awareness in CSCW.
Computer Supported Cooperative Work (CSCW) 25:4-5 ► pp. 235 ff.
Toet, Alexander
2006. Gaze directed displays as an enabling technology for attention aware systems.
Computers in Human Behavior 22:4 ► pp. 615 ff.
van Gog, Tamara & Halszka Jarodzka
2013.
In International Handbook of Metacognition and Learning Technologies [Springer International Handbooks of Education, 28],
► pp. 143 ff.
van Gog, Tamara, Halszka Jarodzka, Katharina Scheiter, Peter Gerjets & Fred Paas
2008.
In Beyond Knowledge: The Legacy of Competence,
► pp. 189 ff.
van Gog, Tamara, Halszka Jarodzka, Katharina Scheiter, Peter Gerjets & Fred Paas
2009. Attention guidance during example study via the model’s eye movements.
Computers in Human Behavior 25:3 ► pp. 785 ff.
van Gog, Tamara & Katharina Scheiter
2010. Eye tracking as a tool to study and enhance multimedia learning.
Learning and Instruction 20:2 ► pp. 95 ff.
Velichkovsky, Boris, Marc Pomplun & Johannes Rieser
1996.
In Visual Attention and Cognition [Advances in Psychology, 116],
► pp. 125 ff.
Velichkovsky, Boris M.
2002. Heterarchy of cognition: The depths and the highs of a framework for memory research.
Memory 10:5-6 ► pp. 405 ff.
Velichkovsky, Boris M.
2021.
In Advances in Cognitive Research, Artificial Intelligence and Neuroinformatics [Advances in Intelligent Systems and Computing, 1358],
► pp. 17 ff.
Velichkovsky, Boris M., Artemiy Kotov, Nikita Arinkin, Liudmila Zaidelman, Anna Zinina & Kirill Kivva
2021. From Social Gaze to Indirect Speech Constructions: How to Induce the Impression That Your Companion Robot Is a Conscious Creature.
Applied Sciences 11:21 ► pp. 10255 ff.
Velichkovsky, Boris M., Andreas Sprenger & Marc Pomplun
1997.
In Software-Ergonomie ’97 [Berichte des German Chapter of the ACM, 49],
► pp. 317 ff.
Wade, Mark, Chris Moore, Janet Wilde Astington, Kristen Frampton & Jennifer M. Jenkins
2015. Cumulative contextual risk, maternal responsivity, and social cognition at 18 months.
Development and Psychopathology 27:1 ► pp. 189 ff.
Wang, Haofei & Bertram E. Shi
2019.
In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications,
► pp. 1 ff.
Wang, Haofei & Bertram E. Shi
2019.
In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications - ETRA '19,
► pp. 1 ff.
Wu, Daw-An, Shinsuke Shimojo, Stephanie W. Wang & Colin F. Camerer
2012. Shared Visual Attention Reduces Hindsight Bias.
Psychological Science 23:12 ► pp. 1524 ff.
Yang, Guang-Zhong, Laura Dempere-Marco, Xiao-Peng Hu & Anthony Rowe
2002. Visual search: psychophysical models and practical applications.
Image and Vision Computing 20:4 ► pp. 291 ff.
Zhao, Darisy G., Nikita D. Karikov, Eugeny V. Melnichuk, Boris M. Velichkovsky & Sergei L. Shishkin
2020. Voice as a Mouse Click: Usability and Effectiveness of Simplified Hands-Free Gaze-Voice Selection.
Applied Sciences 10:24 ► pp. 8791 ff.
Величковский, Б.М.
2020.
In Актуальные проблемы психологии труда, инженерной психологии и эргономики,
► pp. 15 ff.
This list is based on CrossRef data as of 17 april 2022. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.