English
Related papers

Related papers: Guiding Skill Discovery with Foundation Models

200 papers

Reward learning enables robots to learn adaptable behaviors from human input. Traditional methods model the reward as a linear function of hand-crafted features, but that requires specifying all the relevant features a priori, which is…

Robotics · Computer Science 2022-01-19 Andreea Bobu , Marius Wiggert , Claire Tomlin , Anca D. Dragan

Unsupervised skill discovery in Reinforcement Learning aims to mimic humans' ability to autonomously discover diverse behaviors. However, existing methods are often unconstrained, making it difficult to find useful skills, especially in…

Machine Learning · Computer Science 2025-01-30 Maxence Hussonnois , Thommen George Karimpanal , Santu Rana

Humans are capable of learning a new behavior by observing others perform the skill. Robots can also implement this by imitation learning. Furthermore, if with external guidance, humans will master the new behavior more efficiently. So how…

Robotics · Computer Science 2019-09-17 Boyi Liu , Lujia Wang , Ming Liu , Cheng-Zhong Xu

Assistive robots can potentially improve the quality of life and personal independence of elderly people by supporting everyday life activities. To guarantee a safe and intuitive interaction between human and robot, human intentions need to…

Robotics · Computer Science 2019-07-05 Susanne Trick , Dorothea Koert , Jan Peters , Constantin Rothkopf

This study presents a grasping method for objects with uneven mass distribution by leveraging diffusion models to localize the center of gravity (CoG) on unknown objects. In robotic grasping, CoG deviation often leads to postural…

Robotics · Computer Science 2025-07-28 Kang Xiangli , Yage He , Xianwu Gong , Zehan Liu , Yuru Bai

Robots learn reward functions from user demonstrations, but these rewards often fail to generalize to new environments. This failure occurs because learned rewards latch onto spurious correlations in training data rather than the underlying…

Robotics · Computer Science 2026-03-25 Fin Amin , Nathaniel Dennler , Andreea Bobu

Observing a human demonstrator manipulate objects provides a rich, scalable and inexpensive source of data for learning robotic policies. However, transferring skills from human videos to a robotic manipulator poses several challenges, not…

Robotics · Computer Science 2023-03-08 Minttu Alakuijala , Gabriel Dulac-Arnold , Julien Mairal , Jean Ponce , Cordelia Schmid

Well-designed dense reward functions in robot manipulation not only indicate whether a task is completed but also encode progress along the way. Generally, designing dense rewards is challenging and usually requires access to privileged…

Robotics · Computer Science 2026-03-19 Pierre Krack , Tobias Jülg , Wolfram Burgard , Florian Walter

Learning skills that interact with objects is of major importance for robotic manipulation. These skills can indeed serve as an efficient prior for solving various manipulation tasks. We propose a novel Skill Learning approach that…

Robotics · Computer Science 2024-10-08 Paul Jansonnie , Bingbing Wu , Julien Perez , Jan Peters

When a robot learns from human examples, most approaches assume that the human partner provides examples of optimal behavior. However, there are applications in which the robot learns from non-expert humans. We argue that the robot should…

Robotics · Computer Science 2020-11-10 Pamela Carreno-Medrano , Stephen L. Smith , Dana Kulic

Recent progress on vision-language foundation models have brought significant advancement to building general-purpose robots. By using the pre-trained models to encode the scene and instructions as inputs for decision making, the…

Machine Learning · Computer Science 2023-03-22 Yuying Ge , Annabella Macaluso , Li Erran Li , Ping Luo , Xiaolong Wang

Humans are capable of learning a new behavior by observing others to perform the skill. Similarly, robots can also implement this by imitation learning. Furthermore, if with external guidance, humans can master the new behavior more…

Robotics · Computer Science 2019-12-30 Boyi Liu , Lujia Wang , Ming Liu , Cheng-Zhong Xu

This paper develops a hierarchical learning and optimization framework that can learn and achieve well-coordinated multi-skill locomotion. The learned multi-skill policy can switch between skills automatically and naturally in tracking…

Humans possess an extraordinary ability to create and utilize tools, allowing them to overcome physical limitations and explore new frontiers. With the advent of foundation models, AI systems have the potential to be equally adept in tool…

Multi-task imitation learning (MTIL) has shown significant potential in robotic manipulation by enabling agents to perform various tasks using a single policy. This simplifies the policy deployment and enhances the agent's adaptability…

Robotics · Computer Science 2025-03-27 Litao Liu , Wentao Wang , Yifan Han , Zhuoli Xie , Pengfei Yi , Junyan Li , Yi Qin , Wenzhao Lian

When a person is not satisfied with how a robot performs a task, they can intervene to correct it. Reward learning methods enable the robot to adapt its reward function online based on such human input, but they rely on handcrafted…

Robotics · Computer Science 2021-01-13 Andreea Bobu , Marius Wiggert , Claire Tomlin , Anca D. Dragan

Multi-legged robots offer enhanced stability in complex terrains, yet autonomously learning natural and robust motions in such environments remains challenging. Drawing inspiration from animals' progressive learning patterns, from simple to…

Robotics · Computer Science 2024-01-24 Yinghui Li , Jinze Wu , Xin Liu , Weizhong Guo , Yufei Xue

Solving a reinforcement learning problem typically involves correctly prespecifying the reward signal from which the algorithm learns. Here, we approach the problem of reward signal design by using an evolutionary approach to perform a…

Multiagent Systems · Computer Science 2021-05-19 Rafal Muszynski , Katja Hofmann , Jun Wang

Robots assist humans in various activities, from daily living public service (e.g., airports and restaurants), and to collaborative manufacturing. However, it is risky to assume that the knowledge and strategies robots learned from one…

Robotics · Computer Science 2023-06-08 Jie Zhu , Mengsha Hu , Xueyao Liang , Amy Zhang , Ruoming Jin , Rui Liu

The correct specification of reward models is a well-known challenge in reinforcement learning. Hand-crafted reward functions often lead to inefficient or suboptimal policies and may not be aligned with user values. Reinforcement learning…

Artificial Intelligence · Computer Science 2024-10-24 Muhan Lin , Shuyang Shi , Yue Guo , Behdad Chalaki , Vaishnav Tadiparthi , Ehsan Moradi Pari , Simon Stepputtis , Joseph Campbell , Katia Sycara