English
Related papers

Related papers: Learning and reusing primitive behaviours to impro…

200 papers

Reinforcement Learning (RL) algorithms typically require millions of environment interactions to learn successful policies in sparse reward settings. Hindsight Experience Replay (HER) was introduced as a technique to increase sample…

Artificial Intelligence · Computer Science 2019-10-31 Himanshu Sahni , Toby Buckley , Pieter Abbeel , Ilya Kuzovkin

Learning optimal policies from sparse feedback is a known challenge in reinforcement learning. Hindsight Experience Replay (HER) is a multi-goal reinforcement learning algorithm that comes to solve such tasks. The algorithm treats every…

Machine Learning · Computer Science 2020-01-14 Binyamin Manela

Hindsight experience replay (HER) is well-known to accelerate goal-based reinforcement learning (RL). While HER is generally applied to off-policy RL algorithms, we previously showed that HER can also accelerate on-policy algorithms, such…

Machine Learning · Computer Science 2024-11-01 Douglas C. Crowder , Matthew L. Trappett , Darrien M. McKenzie , Frances S. Chance

Hindsight Experience Replay (HER) is a multi-goal reinforcement learning algorithm for sparse reward functions. The algorithm treats every failure as a success for an alternative (virtual) goal that has been achieved in the episode. Virtual…

Machine Learning · Computer Science 2021-03-09 Binyamin Manela , Armin Biess

Hindsight Experience Replay (HER) is widely regarded as the state-of-the-art algorithm for achieving sample-efficient multi-goal reinforcement learning (RL) in robotic manipulation tasks with binary rewards. HER facilitates learning from…

Robotics · Computer Science 2025-04-16 Fikrican Özgür , René Zurbrügg , Suryansh Kumar

Hindsight Experience Replay (HER) is one of the efficient algorithm to solve Reinforcement Learning tasks related to sparse rewarded environments.But due to its reduced sample efficiency and slower convergence HER fails to perform…

Machine Learning · Computer Science 2020-10-14 Dhuruva Priyan G M , Abhik Singla , Shalabh Bhatnagar

Experience replay is an important technique for addressing sample-inefficiency in deep reinforcement learning (RL), but faces difficulty in learning from binary and sparse rewards due to disproportionately few successful experiences in the…

Machine Learning · Computer Science 2018-09-10 Sameera Lanka , Tianfu Wu

Exploration with sparse rewards remains a challenging research problem in reinforcement learning (RL). Especially for sequential object manipulation tasks, the RL agent always receives negative rewards until completing all sub-tasks, which…

Robotics · Computer Science 2022-11-04 Yongle Luo , Yuxin Wang , Kun Dong , Qiang Zhang , Erkang Cheng , Zhiyong Sun , Bo Song

Goal-oriented reinforcement learning has recently been a practical framework for robotic manipulation tasks, in which an agent is required to reach a certain goal defined by a function on the state space. However, the sparsity of such…

Machine Learning · Computer Science 2019-12-19 Zhizhou Ren , Kefan Dong , Yuan Zhou , Qiang Liu , Jian Peng

Reinforcement Learning (RL) has shown promise for aligning Large Language Models (LLMs) to follow instructions with various constraints. Despite the encouraging results, RL improvement inevitably relies on sampling successful, high-quality…

Artificial Intelligence · Computer Science 2025-12-30 Kongcheng Zhang , Qi Yao , Shunyu Liu , Wenjian Zhang , Min Cen , Yang Zhou , Wenkai Fang , Yiru Zhao , Baisheng Lai , Mingli Song

Efficient learning in the environment with sparse rewards is one of the most important challenges in Deep Reinforcement Learning (DRL). In continuous DRL environments such as robotic arms control, Hindsight Experience Replay (HER) has been…

Artificial Intelligence · Computer Science 2020-02-07 Qiwei He , Liansheng Zhuang , Houqiang Li

Sparse rewards pose a significant challenge to achieving high sample efficiency in goal-conditioned reinforcement learning (RL). Specifically, in sequential manipulation tasks, the agent receives failure rewards until it successfully…

Robotics · Computer Science 2024-06-24 Yuming Huang , Bin Ren , Ziming Xu , Lianghong Wu

Hindsight experience replay (HER) accelerates off-policy reinforcement learning algorithms for environments that emit sparse rewards by modifying the goal of the episode post-hoc to be some state achieved during the episode. Because…

Machine Learning · Computer Science 2024-10-31 Douglas C. Crowder , Darrien M. McKenzie , Matthew L. Trappett , Frances S. Chance

Dealing with sparse rewards is a long-standing challenge in reinforcement learning (RL). Hindsight Experience Replay (HER) addresses this problem by reusing failed trajectories for one goal as successful trajectories for another. This…

Machine Learning · Computer Science 2022-07-05 Liam Schramm , Yunfu Deng , Edgar Granados , Abdeslam Boularias

Deep learning has achieved remarkable successes in solving challenging reinforcement learning (RL) problems when dense reward function is provided. However, in sparse reward environment it still often suffers from the need to carefully…

Machine Learning · Computer Science 2019-02-19 Hao Liu , Alexander Trott , Richard Socher , Caiming Xiong

In Hindsight Experience Replay (HER), a reinforcement learning agent is trained by treating whatever it has achieved as virtual goals. However, in previous work, the experience was replayed at random, without considering which episode might…

Machine Learning · Computer Science 2020-05-26 Rui Zhao , Volker Tresp

Multi-goal robot manipulation tasks with sparse rewards are difficult for reinforcement learning (RL) algorithms due to the inefficiency in collecting successful experiences. Recent algorithms such as Hindsight Experience Replay (HER)…

Robotics · Computer Science 2024-02-26 Erdi Sayar , Zhenshan Bing , Carlo D'Eramo , Ozgur S. Oguz , Alois Knoll

Hindsight experience replay (HER) is a goal relabelling technique typically used with off-policy deep reinforcement learning algorithms to solve goal-oriented tasks; it is well suited to robotic manipulation tasks that deliver only sparse…

Machine Learning · Computer Science 2021-11-10 Tianhong Dai , Hengyan Liu , Kai Arulkumaran , Guangyu Ren , Anil Anthony Bharath

Exploration in environments with sparse feedback remains a challenging research problem in reinforcement learning (RL). When the RL agent explores the environment randomly, it results in low exploration efficiency, especially in robotic…

Robotics · Computer Science 2020-11-19 Boyao Li , Tao Lu , Jiayi Li , Ning Lu , Yinghao Cai , Shuo Wang

Sparse reward problems are one of the biggest challenges in Reinforcement Learning. Goal-directed tasks are one such sparse reward problems where a reward signal is received only when the goal is reached. One promising way to train an agent…

Machine Learning · Computer Science 2018-11-06 Ameet Deshpande , Srikanth Sarma , Ashutosh Jha , Balaraman Ravindran
‹ Prev 1 2 3 10 Next ›