Peter Ford Dominey |
Univ Lyon, Université Lyon 1, Inserm, Stem Cell and Brain Research Institute U1208, Bron, France
In robotics research with language-based interaction, simplifications are made, such that a given event can be described in a unique manner, where there is a direct mapping between event representations and sentences that can describe these events. However, common experience tells us that the same physical event can be described in multiple ways, depending on the perspective of the speaker. The current research develops methods for representing events from multiple perspectives, and for choosing the perspective that will be used for generating a linguistic construal, based on attentional processes in the system. The multiple perspectives are based on the principle that events can be considered in terms of the force driving the event, and the result obtained from the event, based on the theory of Gärdenfors. In addition, within these perspectives a further refinement can be made with respect to the agent, object, and recipient perspectives. We develop a system for generating appropriate construals of meaning, and demonstrate how this can be used in a realistic dialogic interaction between a behaving robot and a human interlocutor.
1.1The problem of focus in sentence production
1.2Different construals of event meanings
2.Coding of meaning
2.1A model of events
2.2From construals to sentences
2.3Determining the focus of the speaker
3.Central components of the computational system
3.1Sentence comprehension model
3.2Sentence production model
3.3PAOR representation of meaning
3.4Force-result event construal
3.5Ontic processes in mental model formation
4.Method of implementation
4.1Spoken language platform
5.Demonstrations of construal and sentence generation
5.1Conceptualization and construal of spatial configurations
2005aDevelopmental stages of perception and language acquisition in a perceptually grounded robot. Cognitive Systems Research 61: 243–59
2001A model of learning syntactic comprehension for natural and artificial grammars In Basic mechanisms of language and language disorders., ed. E Witruk, AD Friederici, T Lachmann, pp. 61–77. Dordrecht: Kluwer Academic Publishers
. 25th Annual Meeting of the Cognitive Science Society, Boston 2003.
2013Recurrent temporal networks and language acquisition-from corticostriatal neurophysiology to reservoir computing. Frontiers in psychology 41: 1–14
Dominey PF, Boucher JD.
2005bLearning to talk about events from narrated video in a construction grammar framework. Artificial Intelligence 1671: 31–61
Dominey PF, Hoen MBlanc JM, Lelekov-Boissard T.
2003Neurological basis of language and sequential cognition: evidence from simulation, aphasia, and ERP studies. Brain Lang 861: 207–25
Dominey PF, Hoen M, Inui T.
2006A neurolinguistic model of grammatical construction processing. J Cogn Neurosci 181: 2088–107
Dominey PF, Inui T.
2009Cortico-striatal function in sentence comprehension: insights from neurophysiology and modeling. Cortex 451: 1012–8
Dominey PF, Inui T, Hoen M.
2009Neural network processing of natural language: II. Towards a unified model of corticostriatal function in learning sentence comprehension and non-linguistic sequencing. Brain & Language 1091: 80–92
Dominey PF, Ramus F.
2000Neural network processing of natural language: I. Sensitivity to serial, temporal and abstract structure of language in the infant. Language and Cognitive Processes 151: 40
Doshi F, Roy N.
2008Spoken language interaction with model uncertainty: an adaptive human–robot interaction system. Connection Science 201: 299–318
1991Thematic proto-roles and argument selection. language: 547–619
1987Thought from language: the linguistic constructino of cognitive representations In Making sense: the child's construction of the world, ed. J Bruner, pp. 131–46. London: Methuen & Co.
2014The geometry of meaning: Semantics based on conceptual spaces. MIT Press.
Gärdenfors P, Warglien M
2012Using conceptual spaces to model actions and events. Journal of Semantics: ffs007
2001Syntax: an introduction. John Benjamins Publishing.
Gorniak P, Roy D.
2004Grounded semantic composition for visual scenes. J. Artificial Intelligence Res. 211: 429–70.
Hassin RR, Aarts H, Ferguson MJ.
2005Automatic goal inferences. Journal of Experimental Social Psychology 411: 129–40
Hinaut X, Dominey PF.
2013Real-time parallel processing of grammatical structure in the fronto-striatal system: a recurrent network simulation study using reservoir computing. PLoS One 81: 1–18
Hinaut X, Petit M, Pointeau G, Dominey PF.
2014Exploring the acquisition and production of grammatical constructions through human-robot interaction with echo state networks. Front Neurorobot 81
2002Foundations of language: Brain, meaning, grammar, evolution. Oxford University Press.
Kollar T, Tellex S, Roy D, Roy N.
2010 Proceeding of the 5th ACM/IEEE International Conference on Human-robot Interaction - HRI ’10. Osaka, Japan.
Lakoff G, Narayanan S.
2010AAAI Fall Symposium: Computational Models of Narrative.
2013Cooperative Human Robot Interaction Systems: IV. Communication of Shared Plans with Naïve Humans using Gaze and Speech. Presented at IEEE/RSJ International Conference on Intelligent Robots and Systems, Tokyo
Lallée S, Madden C, Hoen M, Dominey P.
2010Linking language with embodied teleological representations of action for humanoid cognition. Frontiers in Neurobotics
1987Foundations of cognitive grammar: Theoretical prerequisites. Stanford university press.
2008Cognitive grammar: A basic introduction. Oxford University Press.
Lauria S, Bugmann G, Kyriacou T, Klein E.
2002Mobile robot programming using natural language. Robotics and Autonomous Systems 381: 171–81
Levin B, Hovav MR.
2005Argument realization. Cambridge University Press.
Li P, Macwhinney B.
2013Competition Model. The Encyclopedia of Applied Linguistics
Maguire MJ, Hirsh-Pasek K, Golinkoff RM, Imai M, Haryu E., et al.
2010A developmental shift from similar to language-specific strategies in verb acquisition: a comparison of English, Spanish, and Japanese. Cognition 1141: 299–319
Metta G, Fitzpatrick P, Natale L.
2006YARP: yet another robot platform. International Journal on Advanced Robotics Systems 31: 43–48
2008Toward a Theory of Goal Detection in Social Interaction Effects of Contextual Ambiguity and Tactical Functionality on Goal Inferences and Inference Certainty. Communication Research 351: 109–48
Peelen MV, Romagno D, Caramazza A.
2012Independent representations of verbs and actions in left lateral temporal cortex. Journal of cognitive neuroscience 241: 2096–107
Pointeau G, Petit M, Dominey PF.
2014Successive Developmental Levels of Autobiographical Memory for Learning Through Social Interaction. Autonomous Mental Development, IEEE Transactions on
Regier T, Zheng M.
2007Attention to Endpoints: A Cross‐Linguistic Constraint on Spatial Meaning. Cognitive Science 311: 705–19
1999The syntactic representation of linguistic events. Glot International 41: 3–11
2002Learning visually grounded words and syntax for a scene description task. Computer Speech and Language 161: 353–85
Semin GR, Fiedler K.
1988The cognitive functions of linguistic categories in describing persons: Social cognition and language. Journal of Personality and Social Psychology 541: 558
1988Force dynamics in language and cognition. Cognitive Science 121: 49–100
Tomasello M, Carpenter M, Call J, Behne T, Moll H.
2005Understanding and sharing intentions: The origins of cultural cognition. Behavioral and Brain Sciences 281: 675–91
Warglien M, Gärdenfors P, Westera M.
2012Event structure, conceptual spaces and the semantics of verbs. Theoretical Linguistics 381: 159–93
Yu C, Smith LB.
2012Embodied attention and word learning by toddlers. Cognition 1251: 244–62
Zacks JM, Tversky B.
2001Event structure in perception and conception. Psychological bulletin 1271: 3
Zwaan RA, Madden CJ, Whitten SN.
2000The presence of an event in the narrated situation affects its availability to the comprehender. Mem Cognit 281: 1022–8
Dominey, Peter Ford, Victor Paleologue, Amit Kumar Pandey & Jocelyne Ventre-Dominey
2017. 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), ► pp. 127 ff.
2020. An Epigenetic Approach to Semantic Categories. IEEE Transactions on Cognitive and Developmental Systems 12:2 ► pp. 139 ff.
2019. Using Event Representations to Generate Robot Semantics. ACM Transactions on Human-Robot Interaction 8:4 ► pp. 1 ff.
2020. Primary Cognitive Categories Are Determined by Their Invariances. Frontiers in Psychology 11
Gharaee, Zahra, Peter Gärdenfors & Magnus Johnsson
2017. Online recognition of actions involving objects. Biologically Inspired Cognitive Architectures 22 ► pp. 10 ff.
Gharaee, Zahra, Peter Gärdenfors & Magnus Johnsson
2017. First and second order dynamics in a hierarchical SOM system for action recognition. Applied Soft Computing 59 ► pp. 574 ff.
Mealier, Anne-Laure, Gregoire Pointeau, Solène Mirliaz, Kenji Ogawa, Mark Finlayson & Peter F. Dominey
2017. Narrative Constructions for the Organization of Self Experience: Proof of Concept via Embodied Robotics. Frontiers in Psychology 8
Moulin-Frier, Clement, Tobias Fischer, Maxime Petit, Gregoire Pointeau, Jordi-Ysard Puigbo, Ugo Pattacini, Sock Ching Low, Daniel Camilleri, Phuong Nguyen, Matej Hoffmann, Hyung Jin Chang, Martina Zambelli, Anne-Laure Mealier, Andreas Damianou, Giorgio Metta, Tony J. Prescott, Yiannis Demiris, Peter Ford Dominey & Paul F. M. J. Verschure
2018. DAC-h3: A Proactive Robot Cognitive Architecture to Acquire and Express Knowledge About the World and the Self. IEEE Transactions on Cognitive and Developmental Systems 10:4 ► pp. 1005 ff.
Pointeau, Gregoire & Peter Ford Dominey
2017. The Role of Autobiographical Memory in the Development of a Robot Self. Frontiers in Neurorobotics 11
Pointeau, Gregoire, Solène Mirliaz, Anne-Laure Mealier & Peter Ford Dominey
2021. Learning to Use Narrative Function Words for the Organization and Communication of Experience. Frontiers in Psychology 12
This list is based on CrossRef data as of 27 november 2023. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.