Article published In:
Robots in the Wild: Exploring human-robot interaction in naturalistic environmentsEdited by Kerstin Dautenhahn
[Interaction Studies 10:3] 2009
► pp. 392–426
Edited by Kerstin Dautenhahn
[Interaction Studies 10:3] 2009
► pp. 392–426
RoboCup@Home
Scientific Competition and Benchmarking for Domestic Service Robots
Thomas Wisspeintner | Department of Mathematics and Computer Science, Freie Universität Berlin, Germany
Being part of the RoboCup initiative, the RoboCup@Home league targets the development and deployment of autonomous service and assistive robot technology being essential for future personal domestic applications. The domain of domestic service and assistive robotics implicates a wide range of possible problems. The primary reasons for this include the large amount of uncertainty in the dynamic and non-standardized environments of the real world, and the related human interaction. Furthermore, the application orientation requires a large effort towards high level integration combined with a demand for general robustness of the systems. This article details the need for interdisciplinary community effort to iteratively identify related problems, to define benchmarks, to test and, finally, to solve the problems. The concepts and the implementation of the RoboCup@Home initiative as a combination of scientific exchange and competition is presented as an effi cient method to accelerate and focus technological and scientific progress in the domain of domestic service robots. Finally, the progress in terms of performance increase in the benchmarks and technological advancements is evaluated and discussed. Keywords: Domestic Service Robotics, Application, Uncertainty, Benchmark, Competition, Human–Robot Interaction, RoboCup@Home
Cited by
Cited by 81 other publications
Alvarez-Aparicio, Claudia, Angel M. Guerrero-Higueras, Francisco J. Rodriguez-Lera, M. Carmen Calvo Olivera, Vicente Matellan Olivera, Jonatan Gines Clavero & Francisco Martin Rico
2019. 2019 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), ► pp. 1 ff. 
Aly, Amir, Sascha Griffiths & Francesca Stramandinoli
2017. Metrics and benchmarks in human-robot interaction: Recent advances in cognitive robotics. Cognitive Systems Research 43 ► pp. 313 ff.
Amigoni, Francesco, Emanuele Bastianelli, Jakob Berghofer, Andrea Bonarini, Giulio Fontana, Nico Hochgeschwender, Luca Iocchi, Gerhard Kraetzschmar, Pedro Lima, Matteo Matteucci, Pedro Miraldo, Daniele Nardi & Viola Schiaffonati
2015. Competitions for Benchmarking: Task and Functionality Scoring Complete Performance Assessment. IEEE Robotics & Automation Magazine 22:3 ► pp. 53 ff.
Armênio, Gustavo Fardo, João Alberto Fabro, Renzo De Rosa Tognella, Felipe Pierre Conter, Marlon Vaz De Oliveira & Everson De Souza Silva
2023. 2023 Latin American Robotics Symposium (LARS), 2023 Brazilian Symposium on Robotics (SBR), and 2023 Workshop on Robotics in Education (WRE), ► pp. 478 ff.
Breuer, Thomas, Geovanny R. Giorgana Macedo, Ronny Hartanto, Nico Hochgeschwender, Dirk Holz, Frederik Hegger, Zha Jin, Christian Müller, Jan Paulus, Michael Reckhaus, José Antonio Álvarez Ruiz, Paul G. Plöger & Gerhard K. Kraetzschmar
2012. Johnny: An Autonomous Service Robot for Domestic Environments. Journal of Intelligent & Robotic Systems 66:1-2 ► pp. 245 ff.
Brinckhaus, Eric, Guillermo Trinidad Barnech, Mathias Etcheverry & Federico Andrade
2021. 2021 Latin American Robotics Symposium (LARS), 2021 Brazilian Symposium on Robotics (SBR), and 2021 Workshop on Robotics in Education (WRE), ► pp. 25 ff.
Chen, Yingfeng, Feng Wu, Ningyang Wang, Keke Tang, Min Cheng & Xiaoping Chen
2015. KeJia-LC: A Low-Cost Mobile Robot Platform — Champion of Demo Challenge on Benchmarking Service Robots at RoboCup 2015. In RoboCup 2015: Robot World Cup XIX [Lecture Notes in Computer Science, 9513], ► pp. 60 ff.
Cheng, Min, Xiaoping Chen, Keke Tang, Feng Wu, Andras Kupcsik, Luca Iocchi, Yingfeng Chen & David Hsu
2015. Synthetical Benchmarking of Service Robots: A First Effort on Domestic Mobile Platforms. In RoboCup 2015: Robot World Cup XIX [Lecture Notes in Computer Science, 9513], ► pp. 377 ff.
Cho, Mi-Young & Young-Sook Jeong
2017. 2017 19th International Conference on Advanced Communication Technology (ICACT), ► pp. 847 ff.
Contreras, Luis & Hiroyuki Okada
2021. Personal and Domestic Robotics. In Encyclopedia of Robotics, ► pp. 1 ff.
Contreras, Luis, Jesus Savage, Stephany Ortuno-Chanelo, Marco Negrete, Arata Sakamaki & Hiroyuki Okada
2023. Fail It till You Make It: Error Expectation in Complex-Plan Execution for Service Robots. In Interactive Collaborative Robotics [Lecture Notes in Computer Science, 14214], ► pp. 36 ff.
Corominas-Murtra, Andreu, Jordi Pages & Sammy Pfeiffer
2015. 2015 European Conference on Mobile Robots (ECMR), ► pp. 1 ff.
Correa, Mauricio, Gabriel Hermosilla, Rodrigo Verschae & Javier Ruiz-del-Solar
2012. Human Detection and Identification by Robots Using Thermal and Visual Information in Domestic Environments. Journal of Intelligent & Robotic Systems 66:1-2 ► pp. 223 ff.
De Pellegrin, Emanuele, Ronnie Smith, Scott MacLeod, Mauro Dragone & Ronald P. A. Petrick
2023. Towards Multimodal Sensing and Interaction for Assistive Autonomous Robots. In Towards Autonomous Robotic Systems [Lecture Notes in Computer Science, 14136], ► pp. 162 ff.
Eksiri, Akkharaphong & Tetsuya Kimura
2015. Restaurant Service Robots Development in Thailand and Their Real Environment Evaluation. Journal of Robotics and Mechatronics 27:1 ► pp. 91 ff.
Elara, Mohan Rajesh, Nicolas Rojas, Ricardo Sosa & John Kaisner
2013. 2013 6th IEEE Conference on Robotics, Automation and Mechatronics (RAM), ► pp. 73 ff.
Eppe, Manfred, Sean Trott & Jerome Feldman
2016. 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), ► pp. 731 ff.
Ermacora, Gabriele, Daniele Sartori, Manfredi Rovasenda, Ling Pei & Wenxian Yu
2020. 2020 IEEE International Conference on Mechatronics and Automation (ICMA), ► pp. 1803 ff.
Ferrein, Alexander, Stefan Schiffer, Tracy Booysen & Riaan Stopforth
2016. Why it is harder to run RoboCup in South Africa. International Journal of Advanced Robotic Systems 13:5 ► pp. 172988141666278 ff.
Flores, Jorge Garcia, Iván Meza, Émilie Colin, Claire Gardent, Aldo Gangemi, Luis A. Pineda, David Pinto, Vivek Kumar Singh, Aline Villavicencio, Philipp Mayr-Schlegel & Efstathios Stamatatos
2018. Robot experience stories: First person generation of robotic task narratives in SitLog1. Journal of Intelligent & Fuzzy Systems 34:5 ► pp. 3291 ff.
Garcia Ricardez, Gustavo Alfonso, Jun Takamatsu & Tsukasa Ogasawara
2019. Key Technologies for Collaborative Robots in Front-end Retail Automation. Journal of the Robotics Society of Japan 37:10 ► pp. 934 ff.
Huamán Quispe, Ana, Heni Ben Amor & Henrik I. Christensen
2018. A Taxonomy of Benchmark Tasks for Robot Manipulation. In Robotics Research [Springer Proceedings in Advanced Robotics, 2], ► pp. 405 ff.
Hughes, Josie, Kieran Gilday, Luca Scimeca, Soham Garg & Fumiya Iida
2020. Flexible, adaptive industrial assembly: driving innovation through competition. Intelligent Service Robotics 13:1 ► pp. 169 ff.
Iocchi, Luca, Dirk Holz, Javier Ruiz-del-Solar, Komei Sugiura & Tijn van der Zant
2015. RoboCup
Home: Analysis and results of evolving competitions for domestic and service robots. Artificial Intelligence 229 ► pp. 258 ff.
Home: Analysis and results of evolving competitions for domestic and service robots. Artificial Intelligence 229 ► pp. 258 ff. Iocchi, Luca, Javier Ruiz-del-Solar & Tijn van der Zant
2012. Domestic Service Robots in the Real World. Journal of Intelligent & Robotic Systems 66:1-2 ► pp. 183 ff.
Iocchi, Luca, Javier Ruiz-del-Solar & Tijn van der Zant
2014. Advances in Domestic Service Robots in the Real World. Journal of Intelligent & Robotic Systems 76:1 ► pp. 3 ff.
Iovino, Matteo, Julian Förster, Pietro Falco, Jen Jen Chung, Roland Siegwart & Christian Smith
2023. 2023 IEEE International Conference on Robotics and Automation (ICRA), ► pp. 5807 ff.
Ishida, Yutaro, Takashi Morie & Hakaru Tamukoh
2018. 2018 IEEE International Symposium on Circuits and Systems (ISCAS), ► pp. 1 ff.
Ishida, Yutaro, Takashi Morie & Hakaru Tamukoh
2020. A hardware intelligent processing accelerator for domestic service robots. Advanced Robotics 34:14 ► pp. 947 ff.
Ishida, Yutaro & Hakaru Tamukoh
2020. Semi-Automatic Dataset Generation for Object Detection and Recognition and its Evaluation on Domestic Service Robots. Journal of Robotics and Mechatronics 32:1 ► pp. 245 ff.
Ji, Jianmin, Zhiqiang Sui, Guoqiang Jin, Jiongkun Xie & Xiaoping Chen
2013. Simulation Competitions on Domestic Robots. In RoboCup 2012: Robot Soccer World Cup XVI [Lecture Notes in Computer Science, 7500], ► pp. 166 ff.
Keleştemur, Tarik, Naoki Yokoyama, Joanne Truong, Anas Abou Allaban & Taşkin Padir
2019. Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments, ► pp. 264 ff.
Khandelwal, Piyush, Shiqi Zhang, Jivko Sinapov, Matteo Leonetti, Jesse Thomason, Fangkai Yang, Ilaria Gori, Maxwell Svetlik, Priyanka Khante, Vladimir Lifschitz, J. K. Aggarwal, Raymond Mooney & Peter Stone
2017. BWIBots: A platform for bridging the gap between AI and human–robot interaction research. The International Journal of Robotics Research 36:5-7 ► pp. 635 ff.
Kikkeri, Harsha, Gershon Parent, Mihai Jalobeanu & Stan Birchfield
2014. 2014 IEEE International Conference on Robotics and Automation (ICRA), ► pp. 4100 ff.
Kramer, Ivanna, Raphael Memmesheimer & Dietrich Paulus
2021. 2021 IEEE International Conference on Omni-Layer Intelligent Systems (COINS), ► pp. 1 ff.
Lee, Beom-Jin, Jinyoung Choi, Christina Baek & Byoung-Tak Zhang
2018. 2018 IEEE International Conference on Robotics and Automation (ICRA), ► pp. 7189 ff.
Leitner, Jurgen, Adam W. Tow, Niko Sunderhauf, Jake E. Dean, Joseph W. Durham, Matthew Cooper, Markus Eich, Christopher Lehnert, Ruben Mangels, Christopher McCool, Peter T. Kujala, Lachlan Nicholson, Trung Pham, James Sergeant, Liao Wu, Fangyi Zhang, Ben Upcroft & Peter Corke
2017. 2017 IEEE International Conference on Robotics and Automation (ICRA), ► pp. 4705 ff.
Lingelbach, Michael, Chengshu Li, Minjune Hwang, Andrey Kurenkov, Alan Lou, Roberto Martín-Martín, Ruohan Zhang, Li Fei-Fei & Jiajun Wu
2023. 2023 IEEE International Conference on Robotics and Automation (ICRA), ► pp. 886 ff.
Ma, Anji, Guoyi Chi, Serena Ivaldi & Lipeng Chen
2024. Learning high-level robotic manipulation actions with visual predictive model. Complex & Intelligent Systems 10:1 ► pp. 811 ff.
Matamoros, Mauricio, Karin Harbusch & Dietrich Paulus
2019. From Commands to Goal-Based Dialogs: A Roadmap to Achieve Natural Language Interaction in RoboCupHome. In RoboCup 2018: Robot World Cup XXII [Lecture Notes in Computer Science, 11374], ► pp. 217 ff.
Home. In RoboCup 2018: Robot World Cup XXII [Lecture Notes in Computer Science, 11374], ► pp. 217 ff. MATAMOROS, Mauricio, Viktor SEIB & Dietrich PAULUS
2019. 2019 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), ► pp. 1 ff.
Memmesheimer, Raphael, Ivanna Kramer, Viktor Seib & Dietrich Paulus
2019. 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), ► pp. 5243 ff.
Memmesheimer, Raphael, Ivanna Mykhalchyshyna & Dietrich Paulus
2018. 2018 International Conference on Intelligent Systems (IS), ► pp. 813 ff.
Meza, Ivan, Caleb Rascon, Gibran Fuentes & Luis A. Pineda
2016. On Indexicality, Direction of Arrival of Sound Sources, and Human-Robot Interaction. Journal of Robotics 2016 ► pp. 1 ff.
Minato, Takashi, Ryuichiro Higashinaka, Kurima Sakai, Tomo Funayama, Hiromitsu Nishizaki & Takayuki Nagai
2023. Design of a competition specifically for spoken dialogue with a humanoid robot. Advanced Robotics 37:21 ► pp. 1349 ff.
Mohan, Rajesh Elara, Ning Tan, Katrine Tjoelsen & Ricardo Sosa
2015. Designing the robot inclusive space challenge. Digital Communications and Networks 1:4 ► pp. 267 ff.
Murtagh, Andrew, Patrick Lynch & Conor McGinn
2020. 2020 Fourth IEEE International Conference on Robotic Computing (IRC), ► pp. 248 ff.
Müller, Daniel, Niklas Yann Wettengel & Dietrich Paulus
2022. homerUniKoblenz: Winning Team of the RoboCup Virtual Home Open Platform League 2021. In RoboCup 2021: Robot World Cup XXIV [Lecture Notes in Computer Science, 13132], ► pp. 283 ff.
UniKoblenz: Winning Team of the RoboCup Virtual Home Open Platform League 2021. In RoboCup 2021: Robot World Cup XXIV [Lecture Notes in Computer Science, 13132], ► pp. 283 ff. Nardi, Daniele, Itsuki Noda, Fernando Ribeiro, Peter Stone, Oskar von Stryk & Manuela Veloso
2014. RoboCup Soccer Leagues. AI Magazine 35:3 ► pp. 77 ff.
Nardi, Daniele, Jonathan Roberts, Manuela Veloso & Luke Fletcher
2016. Robotics Competitions and Challenges. In Springer Handbook of Robotics [Springer Handbooks, ], ► pp. 1759 ff.
Neumann, Nils, Sebastian Meyer zu Borgsen, Phillip Lucking & Sven Wachsmuth
2018. 2018 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), ► pp. 243 ff.
Niemueller, Tim, Sebastian Reuter, Alexander Ferrein, Sabina Jeschke & Gerhard Lakemeyer
2015. Evaluation of the RoboCup Logistics League and Derived Criteria for Future Competitions. In RoboCup 2015: Robot World Cup XIX [Lecture Notes in Computer Science, 9513], ► pp. 31 ff.
Niemueller, Tim, Sebastian Reuter, Alexander Ferrein, Sabina Jeschke & Gerhard Lakemeyer
2016. Evaluation of the RoboCup Logistics League and Derived Criteria for Future Competitions. In Automation, Communication and Cybernetics in Science and Engineering 2015/2016, ► pp. 591 ff.
Oistad, Benjamin C., Catherine E. Sembroski, Kathryn A. Gates, Margaret M. Krupp, Marlena R. Fraune & Selma Šabanović
2016. Colleague or Tool? Interactivity Increases Positive Perceptions of and Willingness to Interact with a Robotic Co-worker. In Social Robotics [Lecture Notes in Computer Science, 9979], ► pp. 774 ff.
Peña, Federico, Manuel Eirea, Mercedes Marzoa Tanco & Federico Andrade
2023. 2023 Latin American Robotics Symposium (LARS), 2023 Brazilian Symposium on Robotics (SBR), and 2023 Workshop on Robotics in Education (WRE), ► pp. 1 ff.
Ramaswamy, Arunkumar, Bruno Monsuez & Adriana Tapus
2014. 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV), ► pp. 1911 ff.
Ramaswamy, Arunkumar, Bruno Monsuez & Adriana Tapus
2020. Formal Specification of Robotic Architectures for Experimental Robotics. In Metrics of Sensory Motor Coordination and Integration in Robots and Animals [Cognitive Systems Monographs, 36], ► pp. 15 ff.
Rennie, Colin, Rahul Shome, Kostas E. Bekris & Alberto F. De Souza
2016. A Dataset for Improved RGBD-Based Object Detection and Pose Estimation for Warehouse Pick-and-Place. IEEE Robotics and Automation Letters 1:2 ► pp. 1179 ff.
Rodriguez, Igor, Aitzol Astigarraga, Elena Lazkano, José María Martínez-Otzeta & Inigo Mendialdua
2018. Robots on stage: A cognitive framework for socially interacting robots. Biologically Inspired Cognitive Architectures 25 ► pp. 17 ff.
Sanfilippo, Filippo, Lars Ivar Hatledal, Kristin Ytterstad Pettersen & Houxiang Zhang
2018. A Benchmarking Framework for Control Methods of Maritime Cranes Based on the Functional Mockup Interface. IEEE Journal of Oceanic Engineering 43:2 ► pp. 468 ff.
Sasabuchi, Kazuhiro, Hiroaki Yaguchi, Kotaro Nagahama, Shintaro Hori, Hiroto Mizohana & Masayuki Inaba
2018. The Seednoid Robot Platform: Designing a Multipurpose Compact Robot From Continuous Evaluation and Lessons From Competitions. IEEE Robotics and Automation Letters 3:4 ► pp. 3983 ff.
Schiffer, Stefan
2016. Integrating Qualitative Reasoning and Human-Robot Interaction in Domestic Service Robotics. KI - Künstliche Intelligenz 30:3-4 ► pp. 257 ff.
Schiffer, Stefan, Niklas Hoppe & Gerhard Lakemeyer
2013. Natural Language Interpretation for an Interactive Service Robot in Domestic Domains. In Agents and Artificial Intelligence [Communications in Computer and Information Science, 358], ► pp. 39 ff.
Schwarz, Max & Sven Behnke
2019. Semantic RGB-D Perception for Cognitive Service Robots. In RGB-D Image Analysis and Processing [Advances in Computer Vision and Pattern Recognition, ], ► pp. 285 ff.
Shuai, Wei & Xiao-ping Chen
2019. KeJia: towards an autonomous service robot with tolerance of unexpected environmental changes. Frontiers of Information Technology & Electronic Engineering 20:3 ► pp. 307 ff.
Stuckler, J. & S. Behnke
2012. 2012 IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO), ► pp. 1 ff.
Stuckler, Jorg, Dirk Holz & Sven Behnke
2012. RoboCupHome: Demonstrating Everyday Manipulation Skills in RoboCupHome. IEEE Robotics & Automation Magazine 19:2 ► pp. 34 ff.
Home: Demonstrating Everyday Manipulation Skills in RoboCupHome. IEEE Robotics & Automation Magazine 19:2 ► pp. 34 ff. Stückler, Jörg, David Droeschel, Kathrin Gräve, Dirk Holz, Jochen Kläß, Michael Schreiber, Ricarda Steffens & Sven Behnke
2012. Towards Robust Mobility, Flexible Object Manipulation, and Intuitive Multimodal Interaction for Domestic Service Robots. In RoboCup 2011: Robot Soccer World Cup XV [Lecture Notes in Computer Science, 7416], ► pp. 51 ff.
Stückler, Jörg, David Droeschel, Kathrin Gräve, Dirk Holz, Michael Schreiber, Angeliki Topalidou-Kyniazopoulou, Max Schwarz & Sven Behnke
2014. Increasing Flexibility of Mobile Manipulation and Intuitive Human-Robot Interaction in RoboCupHome. In RoboCup 2013: Robot World Cup XVII [Lecture Notes in Computer Science, 8371], ► pp. 135 ff.
Home. In RoboCup 2013: Robot World Cup XVII [Lecture Notes in Computer Science, 8371], ► pp. 135 ff. Stückler, Jörg, Max Schwarz & Sven Behnke
2016. Mobile Manipulation, Tool Use, and Intuitive Interaction for Cognitive Service Robot Cosero. Frontiers in Robotics and AI 3
Tan, Jeffrey Too Chuan, Tetsunari Inamura, Komei Sugiura, Takayuki Nagai & Hiroyuki Okada
2013. Human-Robot Interaction between Virtual and Real Worlds: Motivation from RoboCup Home. In Social Robotics [Lecture Notes in Computer Science, 8239], ► pp. 239 ff.
Home. In Social Robotics [Lecture Notes in Computer Science, 8239], ► pp. 239 ff. Tan, Jeffrey Too Chuan, Luca Iocchi, Amy Eguchi & Hiroyuki Okada
2019. 2019 IEEE AFRICON, ► pp. 1 ff.
Tan, Ning, Rajesh Mohan, Shaohui Foong, Masaki Yamakita, Masami Iwase, Shoshiro Hatakeyama, Norihiro Kamamichi, Libo Song, You Wang & Qiuguo Zhu
2016. IDC Robocon: A Transnational Teaming Competition for Project-Based Design Education in Undergraduate Robotics. Robotics 5:3 ► pp. 12 ff.
Tawiah, Thomas
2022. Machine Learning and Cognitive Robotics: Opportunities and Challenges. In Cognitive Robotics and Adaptive Behaviors,
Trivedi, Urvish, Dimitrios Menychtas, Redwan Alqasemi & Rajiv Dubey
2023. Biomimetic Approaches for Human Arm Motion Generation: Literature Review and Future Directions. Sensors 23:8 ► pp. 3912 ff.
van der Zant, Tijn
2012. Adaptivity on the Robot Brain Architecture Level Using Reinforcement Learning. In RoboCup 2011: Robot Soccer World Cup XV [Lecture Notes in Computer Science, 7416], ► pp. 528 ff.
Villamar Gómez, L. & J. Miura
2021. Ontology-based knowledge management with verbal interaction for command interpretation and execution by home service robots. Robotics and Autonomous Systems 140 ► pp. 103763 ff.
Yang, Boling, Patrick E. Lancaster, Siddhartha S. Srinivasa & Joshua R. Smith
2020. Benchmarking Robot Manipulation With the Rubik's Cube. IEEE Robotics and Automation Letters 5:2 ► pp. 2094 ff.
Zeylikman, Sofya, Sarah Widder, Alessandro Roncone, Olivier Mangin & Brian Scassellati
2018. 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), ► pp. 1845 ff.
Zug, Sebastian, Tim Niemueller, Nico Hochgeschwender, Kai Seidensticker, Martin Seidel, Tim Friedrich, Tobias Neumann, Ulrich Karras, Gerhard K. Kraetzschmar & Alexander Ferrein
2017. An Integration Challenge to Bridge the Gap Among Industry-Inspired RoboCup Leagues. In RoboCup 2016: Robot World Cup XX [Lecture Notes in Computer Science, 9776], ► pp. 157 ff.
Álvarez-Aparicio, Claudia, Ángel Manuel Guerrero-Higueras, Francisco Javier Rodríguez-Lera, Jonatan Ginés Clavero, Francisco Martín Rico & Vicente Matellán
2019. People Detection and Tracking Using LIDAR Sensors. Robotics 8:3 ► pp. 75 ff.
This list is based on CrossRef data as of 31 march 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.