中文
相关论文

相关论文: ARCHER: Aggressive Rewards to Counter bias in Hind…

200 篇论文

Hindsight experience replay (HER) is well-known to accelerate goal-based reinforcement learning (RL). While HER is generally applied to off-policy RL algorithms, we previously showed that HER can also accelerate on-policy algorithms, such…

机器学习 · 计算机科学 2024-11-01 Douglas C. Crowder , Matthew L. Trappett , Darrien M. McKenzie , Frances S. Chance

Hindsight Experience Replay (HER) is widely regarded as the state-of-the-art algorithm for achieving sample-efficient multi-goal reinforcement learning (RL) in robotic manipulation tasks with binary rewards. HER facilitates learning from…

机器人学 · 计算机科学 2025-04-16 Fikrican Özgür , René Zurbrügg , Suryansh Kumar

Hierarchical Reinforcement Learning (HRL) frameworks like Option-Critic (OC) and Multi-updates Option Critic (MOC) have introduced significant advancements in learning reusable options. However, these methods underperform in multi-goal…

In reinforcement learning (RL), experience replay-based sampling techniques play a crucial role in promoting convergence by eliminating spurious correlations. However, widely used methods such as uniform experience replay (UER) and…

机器学习 · 计算机科学 2023-02-07 Ramnath Kumar , Dheeraj Nagaraj

This paper presents CONTHER, a novel reinforcement learning algorithm designed to efficiently and rapidly train robotic agents for goal-oriented manipulation tasks and obstacle avoidance. The algorithm uses a modified replay buffer inspired…

机器人学 · 计算机科学 2025-03-21 Maria Makarova , Qian Liu , Dzmitry Tsetserukou

Reinforcement Learning (RL) algorithms typically require millions of environment interactions to learn successful policies in sparse reward settings. Hindsight Experience Replay (HER) was introduced as a technique to increase sample…

人工智能 · 计算机科学 2019-10-31 Himanshu Sahni , Toby Buckley , Pieter Abbeel , Ilya Kuzovkin

This project combines recent advances in experience replay techniques, namely, Combined Experience Replay (CER), Prioritized Experience Replay (PER), and Hindsight Experience Replay (HER). We show the results of combinations of these…

机器学习 · 计算机科学 2018-05-16 Tracy Wan , Neil Xu

In reinforcement learning, Reverse Experience Replay (RER) is a recently proposed algorithm that attains better sample complexity than the classic experience replay method. RER requires the learning algorithm to update the parameters…

机器学习 · 计算机科学 2024-09-02 Nan Jiang , Jinzhao Li , Yexiang Xue

This paper proposes a method for prioritizing the replay experience referred to as Hindsight Goal Ranking (HGR) in overcoming the limitation of Hindsight Experience Replay (HER) that generates hindsight goals based on uniform sampling. HGR…

机器学习 · 计算机科学 2021-10-29 Tung M. Luu , Chang D. Yoo

Natural language instruction following is paramount to enable collaboration between artificial agents and human beings. Natural language-conditioned reinforcement learning (RL) agents have shown how natural languages' properties, such as…

计算与语言 · 计算机科学 2023-12-19 Kevin Denamganaï , Daniel Hernandez , Ozan Vardal , Sondess Missaoui , James Alfred Walker

In this work, we introduce PIPER: Primitive-Informed Preference-based Hierarchical reinforcement learning via Hindsight Relabeling, a novel approach that leverages preference-based learning to learn a reward model, and subsequently uses…

机器学习 · 计算机科学 2024-06-18 Utsav Singh , Wesley A. Suttle , Brian M. Sadler , Vinay P. Namboodiri , Amrit Singh Bedi

Hindsight experience replay (HER) accelerates off-policy reinforcement learning algorithms for environments that emit sparse rewards by modifying the goal of the episode post-hoc to be some state achieved during the episode. Because…

机器学习 · 计算机科学 2024-10-31 Douglas C. Crowder , Darrien M. McKenzie , Matthew L. Trappett , Frances S. Chance

Multi-goal robot manipulation tasks with sparse rewards are difficult for reinforcement learning (RL) algorithms due to the inefficiency in collecting successful experiences. Recent algorithms such as Hindsight Experience Replay (HER)…

机器人学 · 计算机科学 2024-02-26 Erdi Sayar , Zhenshan Bing , Carlo D'Eramo , Ozgur S. Oguz , Alois Knoll

Goal-oriented reinforcement learning has recently been a practical framework for robotic manipulation tasks, in which an agent is required to reach a certain goal defined by a function on the state space. However, the sparsity of such…

机器学习 · 计算机科学 2019-12-19 Zhizhou Ren , Kefan Dong , Yuan Zhou , Qiang Liu , Jian Peng

AlphaZero-like Monte Carlo Tree Search systems, originally introduced for two-player games, dynamically balance exploration and exploitation using neural network guidance. This combination makes them also suitable for classical search…

机器学习 · 计算机科学 2025-11-06 Alexandros Vazaios , Jannis Brugger , Cedric Derstroff , Kristian Kersting , Mira Mezini

Sparse rewards present a difficult problem in reinforcement learning and may be inevitable in certain domains with complex dynamics such as real-world robotics. Hindsight Experience Replay (HER) is a recent replay memory development that…

机器学习 · 计算机科学 2020-08-31 Trevor A. McInroe

This paper introduces ACS2HER, a novel integration of the Anticipatory Classifier System (ACS2) with the Hindsight Experience Replay (HER) mechanism. While ACS2 is highly effective at building cognitive maps through latent learning, its…

机器学习 · 计算机科学 2026-01-15 Olgierd Unold , Stanisław Franczyk

This paper describes an improvement in Deep Q-learning called Reverse Experience Replay (also RER) that solves the problem of sparse rewards and helps to deal with reward maximizing tasks by sampling transitions successively in reverse…

机器学习 · 计算机科学 2019-10-24 Egor Rotinov

Learning complex tasks from scratch is challenging and often impossible for humans as well as for artificial agents. A curriculum can be used instead, which decomposes a complex task (target task) into a sequence of source tasks (the…

机器学习 · 计算机科学 2020-08-24 Binyamin Manela , Armin Biess

Reinforcement Learning algorithms aim to learn optimal control strategies through iterative interactions with an environment. A critical element in this process is the experience replay buffer, which stores past experiences, allowing the…

机器学习 · 计算机科学 2025-01-31 Hoda Yamani , Yuning Xing , Lee Violet C. Ong , Bruce A. MacDonald , Henry Williams