In this paper, we investigate how the interactions of a robot with its environment can be used to create concepts that are typically represented by verbs in language. Towards this end, we utilize the notion of affordances to argue that verbs typically refer to the generation of a specific type of effect rather than a specific type of action. Then, we show how a robot can form these concepts through interactions with the environment and how humans can use these concepts to ease their communication with the robots. We demonstrate that iCub, a humanoid robot, can use the concepts, which it has developed, to to understand what a human performs, perform multi-step planning for reaching a goal state as well as to specify a goal to the robot using symbolic descriptions.
Akgun, B., Dag, N., Bilal, T., Atil, I., & Sahin, E. (
2009). Unsupervised learning of affordance relations on a humanoid robot. 24th International Symposium on Computer and Information Sciences (ISCIS), 254–259.
Akgun, B., Tunaoglu, D., & Sahin, E. (
2010). Action recognition through an action generation mechanism. International Conference on Epigenetic Robotics.
Alissandrakis, A., Nehaniv, C., & Dautenhahn, K. (
2003). Syn-chrony and perception in robotic imitation across embodiments. In
Computational intelligence in robotics and automation, 2003. proceedings. 2003. ieee international symposium on
(Vol. 21, pp. 923–930).
Ashby, F.G., & Maddox, W.T. (
1993). Relations between prototype, exemplar, and decision bound models of categorization. Journal of Mathematical Psychology, 37(3), 372–400.
Barsalou, L. (
1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22(4), 577–660..
2009). Interactive object recognition using pro-prioceptive feedback.
IROS Workshop: Semantic Perception for Mobile Manipulation
.
Borghi, A.M. (
2007). Object concepts and embodiment: Why sensorimotor and cognitive processes cannot be separated. La nuova Critica, 15(4), 447–472.
Borghi, A.M. (
2012). Action language comprehension, affordances and goals. InY. Coello & A. Bartolo(Eds.), Language and action in cognitive neuroscience. contemporary topics in cognitive neuroscience series (pp. 125–143). Psychology Press.
Borghi, A.M., & Riggio, L. (
2009). Sentence comprehension and simulation of object temporary, canonical and stable affordances. Brain Research, 12531, 117–128.
Bruner, J., Goodnow, J., & Austin, G. (
1986). A study of thinking. Transaction Publishers.
Cangelosi, A. (
2001). Evolution of communication and language using signals, symbols, and words. IEEE Transactions on Evolutionary Computation, 5(2), 93–101.
Cangelosi, A. (
2010). Grounding language in action and perception: From cognitive agents to humanoid robots. Physics of Life Reviews, 7(2), 139–151.
2006). Language acquisition and symbol grounding transfer with neural networks and cognitive robots. International Joint Conference on Neural Networks (IJCNN), 1576–1582.
Cangelosi, A., Metta, G., Sagerer, G., Nolfi, S., Nehaniv, C., Fischer, K., & Zeschel, A. (
2010). Integration of action and language knowledge: A roadmap for developmental robotics. IEEE Transactions on Autonomous Mental Development, 2(3), 167–195.
Cangelosi, A., & Parisi, D. (
2004). The processing of verbs and nouns in neural networks: Insights from synthetic brain imaging. Brain and Language, 89(2), 401–408.
Cangelosi, A., & Riga, T. (
2006). An embodied model for sensorimotor grounding and grounding transfer: Experiments with epigenetic robots. Cognitive Science, 30(4), 673–689.
Christiansen, M., & Kirby, S. (
2003). Language evolution: Consensus and controversies. Trends in Cognitive Sciences, 7(7), 300–307.
Cohen, P., Morrison, C., & Cannon, E. (
2005). Maps for verbs: The relation between interaction dynamics and verb use. Proceedings of the 9th International Conference on Artificial Intelligence (ijcai).
Elsner, B. (
2007). Infants’ imitation of goaldirected actions: The role of movements and action effects. Acta Psychologica, 124(1), 44–59.
Fischer, M., & Zwaan, R. (
2008). Embodied language: A review of the role of the motor system in language comprehension. The Quarterly Journal of Experimental Psychology, 61(6), 825–850.
Gabora, L., Rosch, E., & Aerts, D. (
2008). Toward an ecological theory of concepts. Ecological Psychology, 20(1), 84–116.
Gallese, V., & Lakoff, G. (
2005). The brain’s concepts: The role of the sensory-motor system in conceptual knowledge. Cognitive Neuropsychology, 22(3), 455–479.
Gärdenfors, P. (
2004). Conceptual spaces: The geometry of thought. The MIT Press.
Gibson, J.J. (
1986). The ecologial approach to visual perception. Lawrence Erlbaum Associates.
Glenberg, A., & Kaschak, M. (
2002). Grounding language in action. Psychonomic Bulletin and Review, 9(3), 558.
Glenberg, A., & Robertson, D. (
2000). Symbol grounding and meaning: A comparison of high-dimensional and embodied theories of meaning. Journal of Memory and Language, 43(3), 379–401.
Glenberg, A., Sato, M., Cattaneo, L., Riggio, L., Palumbo, D., & Buccino, G. (
2008). Processing abstract language modulates motor system activity. The Quarterly Journal of Experimental Psychology, 61(6), 905–919.
Hamilton, A., Grafton, S., &
Hamilton, A. (2007). The motor hierarchy: from kinematics to goals and intentions. InP. Haggard, Y. Rossetti, & M. Kawato(Eds.), Sensorimotor foundations of higher cognition, attention and performance (pp. 381–408). Oxford University Press.
Harnad, S. (
1990). The symbol grounding problem. Physica, D(42), 335–346.
Hashimoto, T., & Masumi, A. (
2007). Learning and transition of symbols: Towards a dynamical model of a symbolic individual. InC.N.C. Lyon & A. Cangelos(Eds.), Emergence of communication and language (pp. 223–236). Springer.
Hommel, B., Musseler, J., Aschersleben, G., & Prinz, W. (
2001). The theory of event coding (tec): A framework for perception and action planning. Behavioral and Brain Sciences, 24(05), 849–878.
Jebara, T. (
2004). Machine learning: Discriminative and generative (Vol. 7551). Springer..
Johansen, M., & Kruschke, J. (
2005). Category representation for classification and feature inference. Learning Memory, 31(6), 1433–1458.
Kozima, H., Nakagawa, C., & Yano, H. (
2002). Emergence of imitation mediated by objects. Lund University Cognitive Studies, 59–61.
Krunic, V., Salvi, G., Bernardino, A., Montesano, L., & Santos-Victor, J. (
2009). Affordance based word-to-meaning association. IEEE Int. Conference on Robotics and Automation (ICRA), 4138–4143.
Kruschke, J. (
2005). Category learning. In:K. Lamberts, & R.L. Goldstone(Eds.), The handbook of cognition, 183–201..
Leopold, D., O’Toole, A., Vetter, T., & Blanz, V. (
2007). Emergence of communication and language. Springer-VerlagNew York Inc.
Mahalanobis, P. (
1936). On the generalized distance in statistics. In
Proceedings of the National Institute of Sciences of India
(Vol. 21, pp. 49–55).
Marocco, D., Cangelosi, A., Fischer, K., & Belpaeme, T. (
2010). Grounding action words in the sensorimotor interaction with the world: Experiments with a simulated iCub humanoid robot. Frontiers in Neurorobotics, 4(7), 1–15.
Metta, G., & Fitzpatrick, P. (
2003). Better vision through manipulation. Adaptive Behavior, 11(2), 109–128.
Metta, G., Sandini, G., Vernon, D., Natale, L., & Nori, F. (
2008). The iCub humanoid robot: An open platform for research in embodied cognition. In
Proceedings ofthe 8th workshop on performance metrics for intelligent systems
(pp. 50–56).
Minda, J., & Smith, J. (
2001). Prototypes in category learning: The effects of category size, category structure, and stimulus com-plexity. Journal of Experimental Psychology: Learning, Memory, and Cognition, 27(3), 775–799.
Montesano, L., Lopes, M., Bernardino, A., & Santos-Victor, J. (
2008). Learning object affordances: From sensory-motor co-ordination to imitation. IEEE Transactions on Robotics, 24(1), 15–26.
Montesano, L., Lopes, M., Melo, F., Bernardino, A., & Santos-Victor, J. (
2009). A computational model of object affordances. Advances in Cognitive Systems.
Nehaniv, C.L., Lyon, C., & Cangelosi, A. (
2007). Current work and open problems: A road-map for research into the emergence of communication and language. InC.L.N.C. Lyon, & A. Cangelosi(Eds.), Emergence of communication and language (pp. 1–27). Springer.
2002). Mixture models of categorization. Journal of Mathematical Psychology, 46(2), 178–210.
Rouder, J., & Ratcliff, R. (
2006). Comparing exemplar-and rule-based theories of categorization. Current Directions in Psychological Science, 15(1), 9–13.
Rudolph, M., Muhlig, M., Gienger, M., & Bohme, H.-J. (
2010). Learning the consequences of actions: Representing effects as feature changes.
Int. Symposium on Learning and Adaptive Behavior in Robotic Systems
.
Rusu, R.B., & Cousins, S. (
2011). 3d is here: Point cloud library (pcl). Library, 26(2), 1–4.
Sahin, E., Cakmak, M., Dogar, M., Ugur, E., & Ucoluk, G. (
2007). To afford or not to afford: A new formalization of affordances toward affordance-based robot control. Adaptive Behavior, 15(4), 447–472.
Steels, L. (
2003). Evolving grounded communication for robots. Trends in Cognitive Science, 7(7), 308–312.
Steels, L. (
2007). The recruitment theory of language origins. InC.L.N.C. Lyon, & A. Cangelosi(Eds.), Emergence of communication and language (pp. 129–150). Springer.
Ug̃ur, E., Sahin, E., & Oztop, E. (
2009). Affordance learning from range data for multi-step planning.
9th International Conference on Epigenetic Robotics (Epirob)
, 1461, 177–184.
Uğur, E., & Şahin, E. (
2010). Traversability: A case study for learning and perceiving affordances in robots. Adaptive Behavior, 18(3–4), 258–284.
Umilta, M., Intskirveli, I., Grammont, F., Rochat, M., Caruana, F., Jezzini, A., & Rizzolatti, G. (
2008). When pliers become fingers in the monkey motor system. Proceedings of the National Academy of Sciences, 105(6), 2209.
Umilta, M., Kohler, E., Gallese, V., Fogassi, L., Fadiga, L., Keysers, C., & Rizzolatti, G. (
2001). I know what you are doing: A neurophysiological study. Neuron, 31(1), 155–165.
Verguts, T., Ameel, E., & Storms, G. (
2004). Measures of similarity in models of categorization. Memory and Cognition, 32(3), 379.
Want, S.C., & Harris, P.L. (
2002). How do children ape? Applying concepts from the study of non-human primates to the developmental study of imitation in children. Developmental Science, 5(1), 1–13.
Zwaan, R., & Taylor, L. (
2006). Seeing, acting, understanding: Motor resonance in language comprehension. Journal of Experimental Psychology-General, 135(1), 1–11.
Cited by
Cited by 20 other publications
Bozcan, İlker & Sinan Kalkan
2019. COSMO: Contextualized scene modeling with Boltzmann Machines. Robotics and Autonomous Systems 113 ► pp. 132 ff.
Celikkanat, Hande, Guner Orhan & Sinan Kalkan
2015. A Probabilistic Concept Web on a Humanoid Robot. IEEE Transactions on Autonomous Mental Development 7:2 ► pp. 92 ff.
Celikkanat, Hande, Guner Orhan, Nicolas Pugeault, Frank Guerin, Erol Sahin & Sinan Kalkan
2014. 4th International Conference on Development and Learning and on Epigenetic Robotics, ► pp. 201 ff.
Celikkanat, Hande, Guner Orhan, Nicolas Pugeault, Frank Guerin, Erol Sahin & Sinan Kalkan
2016. Learning Context on a Humanoid Robot using Incremental Latent Dirichlet Allocation. IEEE Transactions on Cognitive and Developmental Systems 8:1 ► pp. 42 ff.
Celikkanat, Hande, Erol Sahin & Sinan Kalkan
2015. 2015 International Conference on Advanced Robotics (ICAR), ► pp. 259 ff.
Gardenfors, Peter
2020. An Epigenetic Approach to Semantic Categories. IEEE Transactions on Cognitive and Developmental Systems 12:2 ► pp. 139 ff.
Gärdenfors, Peter
2019. Using Event Representations to Generate Robot Semantics. ACM Transactions on Human-Robot Interaction 8:4 ► pp. 1 ff.
Gärdenfors, Peter
2020. Primary Cognitive Categories Are Determined by Their Invariances. Frontiers in Psychology 11
Gharaee, Zahra, Peter Gardenfors & Magnus Johnsson
2016. 2016 12th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), ► pp. 538 ff.
Gharaee, Zahra, Peter Gärdenfors & Magnus Johnsson
2017. Online recognition of actions involving objects. Biologically Inspired Cognitive Architectures 22 ► pp. 10 ff.
Gharaee, Zahra, Peter Gärdenfors & Magnus Johnsson
2017. First and second order dynamics in a hierarchical SOM system for action recognition. Applied Soft Computing 59 ► pp. 574 ff.
2016. Affordance Research in Developmental Robotics: A Survey. IEEE Transactions on Cognitive and Developmental Systems 8:4 ► pp. 237 ff.
Olier, Juan Sebastian, Emilia Barakova, Carlo Regazzoni & Matthias Rauterberg
2017. Re-framing the characteristics of concepts and their relation to learning and cognition in artificial agents. Cognitive Systems Research 44 ► pp. 50 ff.
Pandey, Amit Kumar & Rodolphe Gelin
2015. 2015 International Conference on Advanced Robotics (ICAR), ► pp. 642 ff.
Petit, Maxime, Grégoire Pointeau & Peter Ford Dominey
2016. 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO), ► pp. 88 ff.
Zhong, Junpei, Tetsuya Ogata, Angelo Cangelosi & Chenguang Yang
2019. Disentanglement in conceptual space during sensorimotor interaction. Cognitive Computation and Systems 1:4 ► pp. 103 ff.
This list is based on CrossRef data as of 31 march 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.