English
Related papers

Related papers: Advances in Experience Replay

200 papers

In this paper, we propose SACHER (soft actor-critic (SAC) with hindsight experience replay (HER)), which constitutes a class of deep reinforcement learning (DRL) algorithms. SAC is known as an off-policy model-free DRL algorithm based on…

Systems and Control · Electrical Eng. & Systems 2021-06-08 Myoung Hoon Lee , Jun Moon

In Multi-Goal Reinforcement Learning, an agent learns to achieve multiple goals with a goal-conditioned policy. During learning, the agent first collects the trajectories into a replay buffer, and later these trajectories are selected…

Machine Learning · Computer Science 2020-05-26 Rui Zhao , Xudong Sun , Volker Tresp

We propose a graphical model framework for goal-conditioned RL, with an EM algorithm that operates on the lower bound of the RL objective. The E-step provides a natural interpretation of how 'learning in hindsight' techniques, such as HER,…

Machine Learning · Computer Science 2021-03-01 Yunhao Tang , Alp Kucukelbir

We propose a distributed architecture for deep reinforcement learning at scale, that enables agents to learn effectively from orders of magnitude more data than previously possible. The algorithm decouples acting from learning: the actors…

Machine Learning · Computer Science 2018-03-05 Dan Horgan , John Quan , David Budden , Gabriel Barth-Maron , Matteo Hessel , Hado van Hasselt , David Silver

Reinforcement learning algorithms such as hindsight experience replay (HER) and hindsight goal generation (HGG) have been able to solve challenging robotic manipulation tasks in multi-goal settings with sparse rewards. HER achieves its…

Robotics · Computer Science 2020-07-28 Zhenshan Bing , Matthias Brucker , Fabrice O. Morin , Kai Huang , Alois Knoll

Replay strategies are Continual Learning techniques which mitigate catastrophic forgetting by keeping a buffer of patterns from previous experiences, which are interleaved with new data during training. The amount of patterns stored in the…

Machine Learning · Computer Science 2021-06-23 Andrea Rosasco , Antonio Carta , Andrea Cossu , Vincenzo Lomonaco , Davide Bacciu

Experience replay enables off-policy reinforcement learning (RL) agents to utilize past experiences to maximize the cumulative reward. Prioritized experience replay that weighs experiences by the magnitude of their temporal-difference error…

Machine Learning · Computer Science 2021-02-08 Ang A. Li , Zongqing Lu , Chenglin Miao

Training agents via off-policy deep reinforcement learning (RL) requires a large memory, named replay memory, that stores past experiences used for learning. These experiences are sampled, uniformly or non-uniformly, to create the batches…

Machine Learning · Computer Science 2022-12-27 Bumgeun Park , Taeyoung Kim , Woohyeon Moon , Luiz Felipe Vecchietti , Dongsoo Har

Deep neural networks suffer from the catastrophic forgetting problem in the field of continual learning (CL). To address this challenge, we propose MGSER-SAM, a novel memory replay-based algorithm specifically engineered to enhance the…

Machine Learning · Computer Science 2024-05-16 Xingyu Li , Bo Tang

In continual learning, a model learns incrementally over time while minimizing interference between old and new tasks. One of the most widely used approaches in continual learning is referred to as replay. Replay methods support interleaved…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Truman Hickok , Dhireesha Kudithipudi

Recent works have advanced feedback-based learning systems, whereby a foundation model is able to intake incoming feedback (e.g., a user) to self-improve, creating a self-loop system of training. However, existing works are limited in…

Machine Learning · Computer Science 2026-05-11 Seohyun Lee , Wenzhi Fang , Dong-Jun Han , Seyyedali Hosseinalipour , Christopher G. Brinton

Continual learning (CL) aims to develop techniques by which a single model adapts to an increasing number of tasks encountered sequentially, thereby potentially leveraging learnings across tasks in a resource-efficient manner. A major…

Machine Learning · Computer Science 2022-04-18 Rishabh Tiwari , Krishnateja Killamsetty , Rishabh Iyer , Pradeep Shenoy

Deep reinforcement learning has emerged as a powerful tool for a variety of learning tasks, however deep nets typically exhibit forgetting when learning multiple tasks in sequence. To mitigate forgetting, we propose an experience replay…

Artificial Intelligence · Computer Science 2018-03-01 David Isele , Akansel Cosgun

Efficient exploration has presented a long-standing challenge in reinforcement learning, especially when rewards are sparse. A developmental system can overcome this difficulty by learning from both demonstrations and self-exploration.…

Machine Learning · Computer Science 2021-02-19 Siqing Hou , Dongqi Han , Jun Tani

Deep Reinforcement Learning has enabled the control of increasingly complex and high-dimensional problems. However, the need of vast amounts of data before reasonable performance is attained prevents its widespread application. We employ…

Machine Learning · Computer Science 2020-04-08 Jan Scholten , Daan Wout , Carlos Celemin , Jens Kober

This paper deals with robotic lever control using Explainable Deep Reinforcement Learning. First, we train a policy by using the Deep Deterministic Policy Gradient algorithm and the Hindsight Experience Replay technique, where the goal is…

Robotics · Computer Science 2021-10-08 Sindre Benjamin Remman , Anastasios M. Lekkas

In online continual learning, a neural network incrementally learns from a non-i.i.d. data stream. Nearly all online continual learning methods employ experience replay to simultaneously prevent catastrophic forgetting and underfitting on…

Machine Learning · Computer Science 2024-07-22 Jason Yoo , Yunpeng Liu , Frank Wood , Geoff Pleiss

Learning new tasks accumulatively without forgetting remains a critical challenge in continual learning. Generative experience replay addresses this challenge by synthesizing pseudo-data points for past learned tasks and later replaying…

Machine Learning · Computer Science 2023-10-09 Zizhao Hu , Mohammad Rostami

ViZDoom is a robust, first-person shooter reinforcement learning environment, characterized by a significant degree of latent state information. In this paper, double-Q learning and prioritized experience replay methods are tested under a…

Artificial Intelligence · Computer Science 2018-01-04 Christopher Schulze , Marcus Schulze

Replay is the reactivation of one or more neural patterns, which are similar to the activation patterns experienced during past waking experiences. Replay was first observed in biological neural networks during sleep, and it is now thought…

Neurons and Cognition · Quantitative Biology 2021-06-01 Tyler L. Hayes , Giri P. Krishnan , Maxim Bazhenov , Hava T. Siegelmann , Terrence J. Sejnowski , Christopher Kanan