中文
相关论文

相关论文: Unbiased Methods for Multi-Goal Reinforcement Lear…

200 篇论文

In spite of the success of existing meta reinforcement learning methods, they still have difficulty in learning a meta policy effectively for RL problems with sparse reward. In this respect, we develop a novel meta reinforcement learning…

机器学习 · 计算机科学 2021-06-08 Yun Hua , Xiangfeng Wang , Bo Jin , Wenhao Li , Junchi Yan , Xiaofeng He , Hongyuan Zha

Hindsight experience replay (HER) is well-known to accelerate goal-based reinforcement learning (RL). While HER is generally applied to off-policy RL algorithms, we previously showed that HER can also accelerate on-policy algorithms, such…

机器学习 · 计算机科学 2024-11-01 Douglas C. Crowder , Matthew L. Trappett , Darrien M. McKenzie , Frances S. Chance

Hindsight experience replay (HER) is a goal relabelling technique typically used with off-policy deep reinforcement learning algorithms to solve goal-oriented tasks; it is well suited to robotic manipulation tasks that deliver only sparse…

机器学习 · 计算机科学 2021-11-10 Tianhong Dai , Hengyan Liu , Kai Arulkumaran , Guangyu Ren , Anil Anthony Bharath

Hindsight Experience Replay (HER) is a technique used in reinforcement learning (RL) that has proven to be very efficient for training off-policy RL-based agents to solve goal-based robotic manipulation tasks using sparse rewards. Even…

Sparse rewards present a difficult problem in reinforcement learning and may be inevitable in certain domains with complex dynamics such as real-world robotics. Hindsight Experience Replay (HER) is a recent replay memory development that…

机器学习 · 计算机科学 2020-08-31 Trevor A. McInroe

Hierarchical Reinforcement Learning (HRL) exploits temporally extended actions, or options, to make decisions from a higher-dimensional perspective to alleviate the sparse reward problem, one of the most challenging problems in…

机器学习 · 计算机科学 2019-05-15 Libo Xing

Successfully navigating a complex environment to obtain a desired outcome is a difficult task, that up to recently was believed to be capable only by humans. This perception has been broken down over time, especially with the introduction…

机器学习 · 计算机科学 2019-11-12 Joshua Hare

This paper proposes a method for prioritizing the replay experience referred to as Hindsight Goal Ranking (HGR) in overcoming the limitation of Hindsight Experience Replay (HER) that generates hindsight goals based on uniform sampling. HGR…

机器学习 · 计算机科学 2021-10-29 Tung M. Luu , Chang D. Yoo

Sparse rewards pose a significant challenge to achieving high sample efficiency in goal-conditioned reinforcement learning (RL). Specifically, in sequential manipulation tasks, the agent receives failure rewards until it successfully…

机器人学 · 计算机科学 2024-06-24 Yuming Huang , Bin Ren , Ziming Xu , Lianghong Wu

Goal-conditioned reinforcement learning (GCRL) with sparse rewards remains a fundamental challenge in reinforcement learning. While hindsight experience replay (HER) has shown promise by relabeling collected trajectories with achieved…

机器学习 · 计算机科学 2025-08-11 Xing Lei , Wenyan Yang , Kaiqiang Ke , Shentao Yang , Xuetao Zhang , Joni Pajarinen , Donglin Wang

The problem of sparse rewards is one of the hardest challenges in contemporary reinforcement learning. Hierarchical reinforcement learning (HRL) tackles this problem by using a set of temporally-extended actions, or options, each of which…

机器学习 · 计算机科学 2020-01-14 Nat Dilokthanakul , Christos Kaplanis , Nick Pawlowski , Murray Shanahan

Reinforcement Learning(RL) with sparse rewards is a major challenge. We propose \emph{Hindsight Trust Region Policy Optimization}(HTRPO), a new RL algorithm that extends the highly successful TRPO algorithm with \emph{hindsight} to tackle…

机器学习 · 计算机科学 2021-05-18 Hanbo Zhang , Site Bai , Xuguang Lan , David Hsu , Nanning Zheng

In Multi-Goal Reinforcement Learning, an agent learns to achieve multiple goals with a goal-conditioned policy. During learning, the agent first collects the trajectories into a replay buffer, and later these trajectories are selected…

机器学习 · 计算机科学 2020-05-26 Rui Zhao , Xudong Sun , Volker Tresp

Hindsight Experience Replay (HER) is widely regarded as the state-of-the-art algorithm for achieving sample-efficient multi-goal reinforcement learning (RL) in robotic manipulation tasks with binary rewards. HER facilitates learning from…

机器人学 · 计算机科学 2025-04-16 Fikrican Özgür , René Zurbrügg , Suryansh Kumar

Hindsight experience replay (HER) accelerates off-policy reinforcement learning algorithms for environments that emit sparse rewards by modifying the goal of the episode post-hoc to be some state achieved during the episode. Because…

机器学习 · 计算机科学 2024-10-31 Douglas C. Crowder , Darrien M. McKenzie , Matthew L. Trappett , Frances S. Chance

Learning with sparse rewards remains a significant challenge in reinforcement learning (RL), especially when the aim is to train a policy capable of achieving multiple different goals. To date, the most successful approaches for dealing…

机器学习 · 计算机科学 2020-06-02 Henry Charlesworth , Giovanni Montana

A reinforcement learning agent that needs to pursue different goals across episodes requires a goal-conditional policy. In addition to their potential to generalize desirable behavior to unseen goals, such policies may also enable…

机器学习 · 计算机科学 2019-02-21 Paulo Rauber , Avinash Ummadisingu , Filipe Mutz , Juergen Schmidhuber

Reinforcement learning (RL) can align language models with non-differentiable reward signals, such as human preferences. However, a major challenge arises from the sparsity of these reward signals - typically, there is only a single reward…

计算与语言 · 计算机科学 2024-02-20 Meng Cao , Lei Shu , Lei Yu , Yun Zhu , Nevan Wichers , Yinxiao Liu , Lei Meng

Reinforcement Learning (RL) has shown promise for aligning Large Language Models (LLMs) to follow instructions with various constraints. Despite the encouraging results, RL improvement inevitably relies on sampling successful, high-quality…

人工智能 · 计算机科学 2025-12-30 Kongcheng Zhang , Qi Yao , Shunyu Liu , Wenjian Zhang , Min Cen , Yang Zhou , Wenkai Fang , Yiru Zhao , Baisheng Lai , Mingli Song

Dealing with environments with sparse rewards has always been crucial for systems developed to operate in autonomous open-ended learning settings. Intrinsic Motivations could be an effective way to help Deep Reinforcement Learning…

机器学习 · 计算机科学 2025-04-07 Gianluca Maselli , Vieri Giuliano Santucci