English
Related papers

Related papers: Learning to Ball: Composing Policies for Long-Hori…

200 papers

In recent years, the robotics community has made substantial progress in robotic manipulation using deep reinforcement learning (RL). Effectively learning of long-horizon tasks remains a challenging topic. Typical RL-based methods…

Robotics · Computer Science 2021-05-13 Zhihao Li , Zhenglong Sun , Jionglong SU , Jiaming Zhang

Mastering complex sequential tasks continues to pose a significant challenge in robotics. While there has been progress in learning long-horizon manipulation tasks, most existing approaches lack rigorous mathematical guarantees for ensuring…

Robotics · Computer Science 2024-10-08 Alexandre St-Aubin , Amin Abyaneh , Hsiu-Chin Lin

Long-horizon contact-rich tasks are challenging to learn with reinforcement learning, due to ineffective exploration of high-dimensional state spaces with sparse rewards. The learning process often gets stuck in local optimum and demands…

Robotics · Computer Science 2025-02-24 Xiaofeng Mao , Yucheng Xu , Zhaole Sun , Elle Miller , Daniel Layeghi , Michael Mistry

Recently, quadrupedal locomotion has achieved significant success, but their manipulation capabilities, particularly in handling large objects, remain limited, restricting their usefulness in demanding real-world applications such as search…

Robotics · Computer Science 2025-04-01 Yuming Feng , Chuye Hong , Yaru Niu , Shiqi Liu , Yuxiang Yang , Wenhao Yu , Tingnan Zhang , Jie Tan , Ding Zhao

Advancing the dynamic loco-manipulation capabilities of quadruped robots in complex terrains is crucial for performing diverse tasks. Specifically, dynamic ball manipulation in rugged environments presents two key challenges. The first is…

Robotics · Computer Science 2025-04-22 Dongjie Zhu , Zhuo Yang , Tianhang Wu , Luzhou Ge , Xuesong Li , Qi Liu , Xiang Li

Complex object manipulation tasks often span over long sequences of operations. Task planning over long-time horizons is a challenging and open problem in robotics, and its complexity grows exponentially with an increasing number of…

Robotics · Computer Science 2020-10-27 Sören Pirk , Karol Hausman , Alexander Toshev , Mohi Khansari

Skill chaining is a promising approach for synthesizing complex behaviors by sequentially combining previously learned skills. Yet, a naive composition of skills fails when a policy encounters a starting state never seen during its…

Machine Learning · Computer Science 2021-11-16 Youngwoon Lee , Joseph J. Lim , Anima Anandkumar , Yuke Zhu

Policy learning focuses on devising strategies for agents in embodied artificial intelligence systems to perform optimal actions based on their perceived states. One of the key challenges in policy learning involves handling complex,…

Robotics · Computer Science 2025-07-08 Hao Huang , Shuaihang Yuan , Geeta Chandra Raju Bethala , Congcong Wen , Anthony Tzes , Yi Fang

We present relay policy learning, a method for imitation and reinforcement learning that can solve multi-stage, long-horizon robotic tasks. This general and universally-applicable, two-phase approach consists of an imitation learning stage…

Machine Learning · Computer Science 2019-10-29 Abhishek Gupta , Vikash Kumar , Corey Lynch , Sergey Levine , Karol Hausman

Robotic manipulation policies often degrade over extended horizons, yet existing benchmarks provide limited insight into why such failures occur. Most prior benchmarks are either simulation-based or report aggregate success, making it…

Robotics · Computer Science 2026-04-21 Xueyao Chen , Jingkai Jia , Tong Yang , Yibo Fu , Wei Li , Wenqiang Zhang

This paper presents a hierarchical framework for Deep Reinforcement Learning that acquires motor skills for a variety of push recovery and balancing behaviors, i.e., ankle, hip, foot tilting, and stepping strategies. The policy is trained…

Robotics · Computer Science 2020-02-11 Chuanyu Yang , Kai Yuan , Wolfgang Merkt , Taku Komura , Sethu Vijayakumar , Zhibin Li

Learning policies for complex tasks that require multiple different skills is a major challenge in reinforcement learning (RL). It is also a requirement for its deployment in real-world scenarios. This paper proposes a novel framework for…

Artificial Intelligence · Computer Science 2017-12-21 Tianmin Shu , Caiming Xiong , Richard Socher

Despite recent advances in control, reinforcement learning, and imitation learning, developing a unified framework that can achieve agile, precise, and robust whole-body behaviors, particularly in long-horizon tasks, remains challenging.…

Robotics · Computer Science 2026-04-02 Donghoon Baek , Sang-Hun Kim , Sehoon Ha

Many real-world manipulation tasks consist of a series of subtasks that are significantly different from one another. Such long-horizon, complex tasks highlight the potential of dexterous hands, which possess adaptability and versatility,…

Robotics · Computer Science 2023-10-17 Yuanpei Chen , Chen Wang , Li Fei-Fei , C. Karen Liu

In this study, we propose a multitask reinforcement learning algorithm for foundational policy acquisition to generate novel motor skills. \textcolor{\hcolor}{Learning the rich representation of the multitask policy is a challenge in…

Robotics · Computer Science 2025-03-04 Satoshi Yamamori , Jun Morimoto

We study the problem of modeling spatiotemporal trajectories over long time horizons using expert demonstrations. For instance, in sports, agents often choose action sequences with long-term goals in mind, such as achieving a certain…

Machine Learning · Computer Science 2017-06-23 Stephan Zheng , Yisong Yue , Patrick Lucey

Deep Reinforcement Learning (DRL) enables robots to perform some intelligent tasks end-to-end. However, there are still many challenges for long-horizon sparse-reward robotic manipulator tasks. On the one hand, a sparse-reward setting…

Robotics · Computer Science 2021-12-07 Guangming Wang , Minjian Xin , Wenhua Wu , Zhe Liu , Hesheng Wang

While deep reinforcement learning methods have shown impressive results in robot learning, their sample inefficiency makes the learning of complex, long-horizon behaviors with real robot systems infeasible. To mitigate this issue,…

Machine Learning · Computer Science 2022-04-26 Taewook Nam , Shao-Hua Sun , Karl Pertsch , Sung Ju Hwang , Joseph J Lim

Everyday tasks of long-horizon and comprising a sequence of multiple implicit subtasks still impose a major challenge in offline robot control. While a number of prior methods aimed to address this setting with variants of imitation and…

Robotics · Computer Science 2022-09-20 Erick Rosete-Beas , Oier Mees , Gabriel Kalweit , Joschka Boedecker , Wolfram Burgard

Humans decompose novel complex tasks into simpler ones to exploit previously learned skills. Analogously, hierarchical reinforcement learning seeks to leverage lower-level policies for simple tasks to solve complex ones. However, because…

Machine Learning · Computer Science 2022-03-15 Ju-Seung Byun , Andrew Perrault
‹ Prev 1 2 3 10 Next ›