English
Related papers

Related papers: Deep Reinforcement Learning for Complex Manipulati…

200 papers

Hindsight Experience Replay (HER) is a multi-goal reinforcement learning algorithm for sparse reward functions. The algorithm treats every failure as a success for an alternative (virtual) goal that has been achieved in the episode. Virtual…

Machine Learning · Computer Science 2021-03-09 Binyamin Manela , Armin Biess

Hindsight experience replay (HER) is a goal relabelling technique typically used with off-policy deep reinforcement learning algorithms to solve goal-oriented tasks; it is well suited to robotic manipulation tasks that deliver only sparse…

Machine Learning · Computer Science 2021-11-10 Tianhong Dai , Hengyan Liu , Kai Arulkumaran , Guangyu Ren , Anil Anthony Bharath

Efficient learning in the environment with sparse rewards is one of the most important challenges in Deep Reinforcement Learning (DRL). In continuous DRL environments such as robotic arms control, Hindsight Experience Replay (HER) has been…

Artificial Intelligence · Computer Science 2020-02-07 Qiwei He , Liansheng Zhuang , Houqiang Li

Learning complex tasks from scratch is challenging and often impossible for humans as well as for artificial agents. A curriculum can be used instead, which decomposes a complex task (target task) into a sequence of source tasks (the…

Machine Learning · Computer Science 2020-08-24 Binyamin Manela , Armin Biess

Hindsight Experience Replay (HER) is a technique used in reinforcement learning (RL) that has proven to be very efficient for training off-policy RL-based agents to solve goal-based robotic manipulation tasks using sparse rewards. Even…

Hindsight Experience Replay (HER) is one of the efficient algorithm to solve Reinforcement Learning tasks related to sparse rewarded environments.But due to its reduced sample efficiency and slower convergence HER fails to perform…

Machine Learning · Computer Science 2020-10-14 Dhuruva Priyan G M , Abhik Singla , Shalabh Bhatnagar

Goal-oriented reinforcement learning has recently been a practical framework for robotic manipulation tasks, in which an agent is required to reach a certain goal defined by a function on the state space. However, the sparsity of such…

Machine Learning · Computer Science 2019-12-19 Zhizhou Ren , Kefan Dong , Yuan Zhou , Qiang Liu , Jian Peng

Reinforcement Learning (RL) algorithms typically require millions of environment interactions to learn successful policies in sparse reward settings. Hindsight Experience Replay (HER) was introduced as a technique to increase sample…

Artificial Intelligence · Computer Science 2019-10-31 Himanshu Sahni , Toby Buckley , Pieter Abbeel , Ilya Kuzovkin

In multi-goal reinforcement learning (RL) settings, the reward for each goal is sparse, and located in a small neighborhood of the goal. In large dimension, the probability of reaching a reward vanishes and the agent receives little…

Machine Learning · Computer Science 2021-06-17 Léonard Blier , Yann Ollivier

Deep learning has achieved remarkable successes in solving challenging reinforcement learning (RL) problems when dense reward function is provided. However, in sparse reward environment it still often suffers from the need to carefully…

Machine Learning · Computer Science 2019-02-19 Hao Liu , Alexander Trott , Richard Socher , Caiming Xiong

Dealing with sparse rewards is a long-standing challenge in reinforcement learning (RL). Hindsight Experience Replay (HER) addresses this problem by reusing failed trajectories for one goal as successful trajectories for another. This…

Machine Learning · Computer Science 2022-07-05 Liam Schramm , Yunfu Deng , Edgar Granados , Abdeslam Boularias

Hindsight experience replay (HER) is well-known to accelerate goal-based reinforcement learning (RL). While HER is generally applied to off-policy RL algorithms, we previously showed that HER can also accelerate on-policy algorithms, such…

Machine Learning · Computer Science 2024-11-01 Douglas C. Crowder , Matthew L. Trappett , Darrien M. McKenzie , Frances S. Chance

Experience replay is an important technique for addressing sample-inefficiency in deep reinforcement learning (RL), but faces difficulty in learning from binary and sparse rewards due to disproportionately few successful experiences in the…

Machine Learning · Computer Science 2018-09-10 Sameera Lanka , Tianfu Wu

Solving multi-goal reinforcement learning (RL) problems with sparse rewards is generally challenging. Existing approaches have utilized goal relabeling on collected experiences to alleviate issues raised from sparse rewards. However, these…

Machine Learning · Computer Science 2021-11-30 Rui Yang , Meng Fang , Lei Han , Yali Du , Feng Luo , Xiu Li

Exploration with sparse rewards remains a challenging research problem in reinforcement learning (RL). Especially for sequential object manipulation tasks, the RL agent always receives negative rewards until completing all sub-tasks, which…

Robotics · Computer Science 2022-11-04 Yongle Luo , Yuxin Wang , Kun Dong , Qiang Zhang , Erkang Cheng , Zhiyong Sun , Bo Song

Sparse reward problems are one of the biggest challenges in Reinforcement Learning. Goal-directed tasks are one such sparse reward problems where a reward signal is received only when the goal is reached. One promising way to train an agent…

Machine Learning · Computer Science 2018-11-06 Ameet Deshpande , Srikanth Sarma , Ashutosh Jha , Balaraman Ravindran

Sparse reward is one of the most challenging problems in reinforcement learning (RL). Hindsight Experience Replay (HER) attempts to address this issue by converting a failed experience to a successful one by relabeling the goals. Despite…

Machine Learning · Computer Science 2019-02-13 Harris Chan , Yuhuai Wu , Jamie Kiros , Sanja Fidler , Jimmy Ba

Hindsight experience replay (HER) accelerates off-policy reinforcement learning algorithms for environments that emit sparse rewards by modifying the goal of the episode post-hoc to be some state achieved during the episode. Because…

Machine Learning · Computer Science 2024-10-31 Douglas C. Crowder , Darrien M. McKenzie , Matthew L. Trappett , Frances S. Chance

Multi-goal reinforcement learning is widely applied in planning and robot manipulation. Two main challenges in multi-goal reinforcement learning are sparse rewards and sample inefficiency. Hindsight Experience Replay (HER) aims to tackle…

Machine Learning · Computer Science 2022-09-27 Rui Yang , Jiafei Lyu , Yu Yang , Jiangpeng Yan , Feng Luo , Dijun Luo , Lanqing Li , Xiu Li

Sparse rewards pose a significant challenge to achieving high sample efficiency in goal-conditioned reinforcement learning (RL). Specifically, in sequential manipulation tasks, the agent receives failure rewards until it successfully…

Robotics · Computer Science 2024-06-24 Yuming Huang , Bin Ren , Ziming Xu , Lianghong Wu
‹ Prev 1 2 3 10 Next ›