English
Related papers

Related papers: Enabling Option Learning in Sparse Rewards with Hi…

200 papers

Deep reinforcement learning agents are often misaligned, as they over-exploit early reward signals. Recently, several symbolic approaches have addressed these challenges by encoding sparse objectives along with aligned plans. However,…

Artificial Intelligence · Computer Science 2026-03-09 Zihan Ye , Phil Chau , Raban Emunds , Jannis Blüml , Cedric Derstroff , Quentin Delfosse , Oleg Arenz , Kristian Kersting

This project combines recent advances in experience replay techniques, namely, Combined Experience Replay (CER), Prioritized Experience Replay (PER), and Hindsight Experience Replay (HER). We show the results of combinations of these…

Machine Learning · Computer Science 2018-05-16 Tracy Wan , Neil Xu

We introduce Hindsight Off-policy Options (HO2), a data-efficient option learning algorithm. Given any trajectory, HO2 infers likely option choices and backpropagates through the dynamic programming inference procedure to robustly train all…

Most meta reinforcement learning (meta-RL) methods learn to adapt to new tasks by directly optimizing the parameters of policies over primitive action space. Such algorithms work well in tasks with relatively slight difference. However,…

Machine Learning · Computer Science 2020-03-05 Haotian Fu , Hongyao Tang , Jianye Hao , Wulong Liu , Chen Chen

Recent work in hierarchical reinforcement learning has shown success in scaling to billions of timesteps when learning over a set of predefined option reward functions. We show that, instead of using a single reward function per option, the…

Artificial Intelligence · Computer Science 2026-04-28 Michael Tryfan Matthews , Anssi Kanervisto , Jakob Foerster , Pierluca D'Oro , Scott Fujimoto , Mikael Henaff

Deep reinforcement learning has obtained significant breakthroughs in recent years. Most methods in deep-RL achieve good results via the maximization of the reward signal provided by the environment, typically in the form of discounted…

Machine Learning · Computer Science 2018-09-10 Yubin Deng , Ke Yu , Dahua Lin , Xiaoou Tang , Chen Change Loy

In this paper, we consider cooperative multi-agent reinforcement learning (MARL) with sparse reward. To tackle this problem, we propose a novel method named MASER: MARL with subgoals generated from experience replay buffer. Under the…

Machine Learning · Computer Science 2022-06-23 Jeewon Jeon , Woojun Kim , Whiyoung Jung , Youngchul Sung

Meta-Reinforcement Learning (Meta-RL) enables fast adaptation to new testing tasks. Despite recent advancements, it is still challenging to learn performant policies across multiple complex and high-dimensional tasks. To address this, we…

Machine Learning · Computer Science 2024-12-17 Minjae Cho , Chuangchuang Sun

During recent years, deep reinforcement learning (DRL) has made successful incursions into complex decision-making applications such as robotics, autonomous driving or video games. Off-policy algorithms tend to be more sample-efficient than…

Machine Learning · Computer Science 2021-12-06 Jesus Bujalance Martin , Raphael Chekroun , Fabien Moutarde

Reward design is a fundamental, yet challenging aspect of reinforcement learning (RL). Researchers typically utilize feedback signals from the environment to handcraft a reward function, but this process is not always effective due to the…

Machine Learning · Computer Science 2024-06-11 Alexander Bukharin , Yixiao Li , Pengcheng He , Tuo Zhao

Long-horizon manipulation tasks such as stacking represent a longstanding challenge in the field of robotic manipulation, particularly when using reinforcement learning (RL) methods which often struggle to learn the correct sequence of…

Robotics · Computer Science 2024-07-01 Jing Zhang , Emmanuel Dean , Karinne Ramirez-Amaro

Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume…

Machine Learning · Computer Science 2019-08-27 Konrad Zolna , Negar Rostamzadeh , Yoshua Bengio , Sungjin Ahn , Pedro O. Pinheiro

The necessity for cooperation among intelligent machines has popularised cooperative multi-agent reinforcement learning (MARL) in the artificial intelligence (AI) research community. However, many research endeavors have been focused on…

Multiagent Systems · Computer Science 2022-08-04 Jakub Grudzien Kuba , Xidong Feng , Shiyao Ding , Hao Dong , Jun Wang , Yaodong Yang

Many real-world applications can be formulated as multi-agent cooperation problems, such as network packet routing and coordination of autonomous vehicles. The emergence of deep reinforcement learning (DRL) provides a promising approach for…

Multiagent Systems · Computer Science 2022-06-28 Zhixuan Liang , Jiannong Cao , Shan Jiang , Divya Saxena , Huafeng Xu

Long-horizon goal-conditioned tasks pose fundamental challenges for reinforcement learning (RL), particularly when goals are distant and rewards are sparse. While hierarchical and graph-based methods offer partial solutions, their reliance…

Machine Learning · Computer Science 2026-05-21 Jaebak Hwang , Sanghyeon Lee , Jeongmo Kim , Seungyul Han

Meta reinforcement learning (meta-RL) aims to learn a policy solving a set of training tasks simultaneously and quickly adapting to new tasks. It requires massive amounts of data drawn from training tasks to infer the common structure…

Machine Learning · Computer Science 2022-07-21 Yijie Guo , Qiucheng Wu , Honglak Lee

Multiple quadrotor unmanned aerial vehicle (UAV) systems have garnered widespread research interest and fostered tremendous interesting applications, especially in multi-constrained pursuit-evasion games (MC-PEG). The Cooperative Evasion…

Artificial Intelligence · Computer Science 2025-06-24 Xiang Yuming , Li Sizhao , Li Rongpeng , Zhao Zhifeng , Zhang Honggang

Designing optimal reward functions has been desired but extremely difficult in reinforcement learning (RL). When it comes to modern complex tasks, sophisticated reward functions are widely used to simplify policy learning yet even a tiny…

Machine Learning · Computer Science 2021-09-07 Ning Wei , Jiahua Liang , Di Xie , Shiliang Pu

Multi-objective reinforcement learning (MORL) aims to find a set of high-performing and diverse policies that address trade-offs between multiple conflicting objectives. However, in practice, decision makers (DMs) often deploy only one or a…

Neural and Evolutionary Computing · Computer Science 2024-01-05 Ke Li , Han Guo

This study presents a comparative analysis between single-objective and multi-objective reinforcement learning methods for training a robot to navigate effectively to an end goal while efficiently avoiding obstacles. Traditional…

Robotics · Computer Science 2023-12-15 Vicki Young , Jumman Hossain , Nirmalya Roy