English
Related papers

Related papers: Towards Generalist Robots: A Promising Paradigm vi…

200 papers

In order for a robot to be a generalist that can perform a wide range of jobs, it must be able to acquire a wide variety of skills quickly and efficiently in complex unstructured environments. High-capacity models such as deep neural…

Machine Learning · Computer Science 2017-09-15 Chelsea Finn , Tianhe Yu , Tianhao Zhang , Pieter Abbeel , Sergey Levine

Robotic systems are multi-dimensional entities, combining both hardware and software, that are heavily dependent on, and influenced by, interactions with the real world. They can be variously categorised as embedded, cyberphysical,…

Software Engineering · Computer Science 2018-09-05 Marie Farrell , Matt Luckcuck , Michael Fisher

In this paper, we present a planning system based on semantic reasoning for a general-purpose service robot, which is aimed at behaving more intelligently in domains that contain incomplete information, under-specified goals, and dynamic…

Robotics · Computer Science 2020-11-03 Guowei Cui , Wei Shuai , Xiaoping Chen

Scientific discovery is poised for rapid advancement through advanced robotics and artificial intelligence. Current scientific practices face substantial limitations as manual experimentation remains time-consuming and resource-intensive,…

Computation and Language · Computer Science 2025-04-04 Pengsong Zhang , Heng Zhang , Huazhe Xu , Renjun Xu , Zhenting Wang , Cong Wang , Animesh Garg , Zhibin Li , Arash Ajoudani , Xinyu Liu

Imitation learning is a popular paradigm to teach robots new tasks, but collecting robot demonstrations through teleoperation or kinesthetic teaching is tedious and time-consuming. In contrast, directly demonstrating a task using our human…

Robotics · Computer Science 2026-02-16 Nick Heppert , Minh Quang Nguyen , Abhinav Valada

Generating simulations to train intelligent agents in game-playing and robotics from natural language input, from user input or task documentation, remains an open-ended challenge. Existing approaches focus on parts of this challenge, such…

Artificial Intelligence · Computer Science 2024-11-12 Fan-Yun Sun , S. I. Harini , Angela Yi , Yihan Zhou , Alex Zook , Jonathan Tremblay , Logan Cross , Jiajun Wu , Nick Haber

We present initial ideas for a programming paradigm based on simulation that is targeted towards applications of artificial intelligence (AI). The approach aims at integrating techniques from different areas of AI and is based on the idea…

Artificial Intelligence · Computer Science 2015-05-21 Jörg Pührer

This discussion paper aims to support the argument process for the need to develop a comprehensive science of resilient robotic autonomy. Resilience and its key characteristics relating to robustness, redundancy, and resourcefulness are…

Robotics · Computer Science 2020-04-07 Kostas Alexis

Encouraged by the remarkable achievements of language and vision foundation models, developing generalist robotic agents through imitation learning, using large demonstration datasets, has become a prominent area of interest in robot…

Robotics · Computer Science 2024-04-12 Tongzhou Mu , Yijie Guo , Jie Xu , Ankit Goyal , Hao Su , Dieter Fox , Animesh Garg

Endowed with higher levels of autonomy, robots are required to perform increasingly complex manipulation tasks. Learning from demonstration is arising as a promising paradigm for transferring skills to robots. It allows to implicitly learn…

Robotics · Computer Science 2023-02-24 Miguel Arduengo , Adrià Colomé , Joan Lobo-Prat , Luis Sentis , Carme Torras

This paper investigates the task of the open-ended interactive robotic manipulation on table-top scenarios. While recent Large Language Models (LLMs) enhance robots' comprehension of user instructions, their lack of visual grounding…

Robotics · Computer Science 2024-08-16 Tianyu Wang , Haitao Lin , Junqiu Yu , Yanwei Fu

User simulation is an emerging interdisciplinary topic with multiple critical applications in the era of Generative AI. It involves creating an intelligent agent that mimics the actions of a human user interacting with an AI system,…

Artificial Intelligence · Computer Science 2026-04-22 Krisztian Balog , ChengXiang Zhai

The General AI Challenge is an initiative to encourage the wider artificial intelligence community to focus on important problems in building intelligent machines with more general scope than is currently possible. The challenge comprises…

Artificial Intelligence · Computer Science 2017-08-18 Jan Feyereisl , Matej Nikl , Martin Poliak , Martin Stransky , Michal Vlasak

This dissertation considers Open-world Robot Manipulation, a manipulation problem where a robot must generalize or quickly adapt to new objects, scenes, or tasks for which it has not been pre-programmed or pre-trained. This dissertation…

Robotics · Computer Science 2025-05-12 Yifeng Zhu

This paper reviews various Evolutionary Approaches applied to the domain of Evolutionary Robotics with the intention of resolving difficult problems in the areas of robotic design and control. Evolutionary Robotics is a fast-growing field…

Robotics · Computer Science 2022-10-24 Hari Mohan Pandey

Imitation learning and world models have shown significant promise in advancing generalizable robotic learning, with robotic grasping remaining a critical challenge for achieving precise manipulation. Existing methods often rely heavily on…

Robotics · Computer Science 2025-02-06 Yiqi Huang , Travis Davies , Jiahuan Yan , Xiang Chen , Yu Tian , Luhui Hu

Machine learning has long since become a keystone technology, accelerating science and applications in a broad range of domains. Consequently, the notion of applying learning methods to a particular problem set has become an established and…

The objective of this work is to augment the basic abilities of a robot by learning to use new sensorimotor primitives to enable the solution of complex long-horizon problems. Solving long-horizon problems in complex domains requires…

Robotics · Computer Science 2018-08-14 Zi Wang , Caelan Reed Garrett , Leslie Pack Kaelbling , Tomás Lozano-Pérez

Robotic simulation today remains challenging to scale up due to the human efforts required to create diverse simulation tasks and scenes. Simulation-trained policies also face scalability issues as many sim-to-real methods focus on a single…

Robotics · Computer Science 2024-10-07 Pu Hua , Minghuan Liu , Annabella Macaluso , Yunfeng Lin , Weinan Zhang , Huazhe Xu , Lirui Wang

Building a humanlike integrative artificial cognitive system, that is, an artificial general intelligence (AGI), is the holy grail of the artificial intelligence (AI) field. Furthermore, a computational model that enables an artificial…