English
Related papers

Related papers: Adversarial Skill Chaining for Long-Horizon Robot …

200 papers

Generalizable object manipulation skills are critical for intelligent and multi-functional robots to work in real-world complex scenes. Despite the recent progress in reinforcement learning, it is still very challenging to learn a…

Robotics · Computer Science 2022-09-14 Hao Shen , Weikang Wan , He Wang

Legged robots often use separate control policiesthat are highly engineered for traversing difficult terrain suchas stairs, gaps, and steps, where switching between policies isonly possible when the robot is in a region that is commonto…

Robotics · Computer Science 2021-09-30 Brendan Tidd , Nicolas Hudson , Akansel Cosgun , Jurgen Leitner

In order to be effective general purpose machines in real world environments, robots not only will need to adapt their existing manipulation skills to new circumstances, they will need to acquire entirely new skills on-the-fly. A great…

Machine Learning · Computer Science 2021-10-22 K. R. Zentner , Ryan Julian , Ujjwal Puri , Yulun Zhang , Gaurav S. Sukhatme

The ability to effectively reuse prior knowledge is a key requirement when building general and flexible Reinforcement Learning (RL) agents. Skill reuse is one of the most common approaches, but current methods have considerable…

Deep Reinforcement Learning (Deep RL) has been receiving increasingly more attention thanks to its encouraging performance on a variety of control tasks. Yet, conventional regularization techniques in training neural networks (e.g., $L_2$…

Machine Learning · Computer Science 2021-11-30 Zhuang Liu , Xuanlin Li , Bingyi Kang , Trevor Darrell

We propose a novel parameterized skill-learning algorithm that aims to learn transferable parameterized skills and synthesize them into a new action space that supports efficient learning in long-horizon tasks. We propose to leverage…

Machine Learning · Computer Science 2023-07-20 Haotian Fu , Shangqun Yu , Saket Tiwari , Michael Littman , George Konidaris

Zero-shot execution of unseen robotic tasks is important to allowing robots to perform a wide variety of tasks in human environments, but collecting the amounts of data necessary to train end-to-end policies in the real-world is often…

Robotics · Computer Science 2021-07-15 Shohin Mukherjee , Chris Paxton , Arsalan Mousavian , Adam Fishman , Maxim Likhachev , Dieter Fox

Problems which require both long-horizon planning and continuous control capabilities pose significant challenges to existing reinforcement learning agents. In this paper we introduce a novel hierarchical reinforcement learning agent which…

Machine Learning · Computer Science 2023-07-25 Jan Achterhold , Markus Krimmel , Joerg Stueckler

Deep reinforcement learning has achieved many impressive results in recent years. However, tasks with sparse rewards or long horizons continue to pose significant challenges. To tackle these important problems, we propose a general…

Artificial Intelligence · Computer Science 2017-04-12 Carlos Florensa , Yan Duan , Pieter Abbeel

Multi-task learning is a very challenging problem in reinforcement learning. While training multiple tasks jointly allow the policies to share parameters across different tasks, the optimization problem becomes non-trivial: It remains…

Machine Learning · Computer Science 2020-12-08 Ruihan Yang , Huazhe Xu , Yi Wu , Xiaolong Wang

High-reliability long-horizon robotic manipulation has traditionally relied on large-scale data and compute to understand complex real-world dynamics. However, we identify that the primary bottleneck to real-world robustness is not resource…

In this work, we address the problem of solving complex collaborative robotic tasks subject to multiple varying parameters. Our approach combines simultaneous policy blending with system identification to create generalized policies that…

Robotics · Computer Science 2022-05-23 Luke Bhan , Marcos Quinones-Grueiro , Gautam Biswas

Legged locomotion is a challenging task for learning algorithms, especially when the task requires a diverse set of primitive behaviors. To solve these problems, we introduce a hierarchical framework to automatically decompose complex…

Machine Learning · Computer Science 2019-05-23 Deepali Jain , Atil Iscen , Ken Caluwaerts

Developing robotic systems capable of robustly executing long-horizon manipulation tasks with human-level dexterity is challenging, as such tasks require both physical dexterity and seamless sequencing of manipulation skills while robustly…

Robotics · Computer Science 2025-08-26 Weikang Wan , Jiawei Fu , Xiaodi Yuan , Yifeng Zhu , Hao Su

Recent advances in robot skill learning have unlocked the potential to construct task-agnostic skill libraries, facilitating the seamless sequencing of multiple simple manipulation primitives (aka. skills) to tackle significantly more…

Robotics · Computer Science 2024-07-18 Teng Xue , Amirreza Razmjoo , Suhan Shetty , Sylvain Calinon

We study building multi-task agents in open-world environments. Without human demonstrations, learning to accomplish long-horizon tasks in a large open-world environment with reinforcement learning (RL) is extremely inefficient. To tackle…

Machine Learning · Computer Science 2023-12-05 Haoqi Yuan , Chi Zhang , Hongcheng Wang , Feiyang Xie , Penglin Cai , Hao Dong , Zongqing Lu

Manipulating deformable objects, such as fabric, is a long standing problem in robotics, with state estimation and control posing a significant challenge for traditional methods. In this paper, we show that it is possible to learn fabric…

Robotics · Computer Science 2020-10-08 Robert Lee , Daniel Ward , Akansel Cosgun , Vibhavari Dasagi , Peter Corke , Jurgen Leitner

Generalist robot policies, trained on large and diverse datasets, have demonstrated the ability to generalize across a wide spectrum of behaviors, enabling a single policy to act in varied real-world environments. However, they still fall…

Robotics · Computer Science 2026-03-03 Yajat Yadav , Zhiyuan Zhou , Andrew Wagenmaker , Karl Pertsch , Sergey Levine

Accurately predicting the dynamics of robotic systems is crucial for model-based control and reinforcement learning. The most common way to estimate dynamics is by fitting a one-step ahead prediction model and using it to recursively…

Machine Learning · Computer Science 2021-09-02 Nathan O. Lambert , Albert Wilcox , Howard Zhang , Kristofer S. J. Pister , Roberto Calandra

Humanoid robots are expected to operate reliably over long horizons while executing versatile whole-body skills. Yet Reinforcement Learning (RL) motion policies typically lose stability under prolonged operation, sensor/actuator noise, and…

Robotics · Computer Science 2025-11-14 Yang Zhang , Zhanxiang Cao , Buqing Nie , Haoyang Li , Zhong Jiangwei , Qiao Sun , Xiaoyi Hu , Xiaokang Yang , Yue Gao