English
Related papers

Related papers: Reliability-Adjusted Prioritized Experience Replay

200 papers

A central component of training in Reinforcement Learning (RL) is Experience: the data used for training. The mechanisms used to generate and consume this data have an important effect on the performance of RL algorithms. In this paper, we…

Machine Learning · Computer Science 2021-02-10 Albin Cassirer , Gabriel Barth-Maron , Eugene Brevdo , Sabela Ramos , Toby Boyd , Thibault Sottiaux , Manuel Kroiss

Back-stepping experience replay (BER) is a reinforcement learning technique that can accelerate learning efficiency in reversible environments. BER trains an agent with generated back-stepping transitions of collected experiences and normal…

Machine Learning · Computer Science 2024-12-23 Guwen Lyu , Masahiro Sato

We present the extension of the Remember and Forget for Experience Replay (ReF-ER) algorithm to Multi-Agent Reinforcement Learning (MARL). ReF-ER was shown to outperform state of the art algorithms for continuous control in problems ranging…

Machine Learning · Computer Science 2022-09-05 Pascal Weber , Daniel Wälchli , Mustafa Zeqiri , Petros Koumoutsakos

Our work is a simple extension of the paper "Exploration by Random Network Distillation". More in detail, we show how to efficiently combine Intrinsic Rewards with Experience Replay in order to achieve more efficient and robust exploration…

Machine Learning · Computer Science 2019-12-03 Francesco Sovrano

Experience replay plays a crucial role in improving the sample efficiency of deep reinforcement learning agents. Recent advances in experience replay propose using Mixup (Zhang et al., 2018) to further improve sample efficiency via…

Machine Learning · Computer Science 2022-05-20 Ryan Sander , Wilko Schwarting , Tim Seyde , Igor Gilitschenski , Sertac Karaman , Daniela Rus

We propose Ephemeral Value Adjusments (EVA): a means of allowing deep reinforcement learning agents to rapidly adapt to experience in their replay buffer. EVA shifts the value predicted by a neural network with an estimate of the value…

Machine Learning · Computer Science 2018-10-19 Steven Hansen , Pablo Sprechmann , Alexander Pritzel , André Barreto , Charles Blundell

In the online continual learning paradigm, agents must learn from a changing distribution while respecting memory and compute constraints. Experience Replay (ER), where a small subset of past data is stored and replayed alongside new data,…

Machine Learning · Computer Science 2022-04-26 Lucas Caccia , Rahaf Aljundi , Nader Asadi , Tinne Tuytelaars , Joelle Pineau , Eugene Belilovsky

Experience replay (ER) improves the data efficiency of off-policy reinforcement learning (RL) algorithms by allowing an agent to store and reuse its past experiences in a replay buffer. While many techniques have been proposed to enhance ER…

Machine Learning · Computer Science 2021-04-06 Yunshu Du , Garrett Warnell , Assefaw Gebremedhin , Peter Stone , Matthew E. Taylor

In reinforcement learning, experience replay stores past samples for further reuse. Prioritized sampling is a promising technique to better utilize these samples. Previous criteria of prioritization include TD error, recentness and…

Machine Learning · Computer Science 2021-11-10 Xu-Hui Liu , Zhenghai Xue , Jing-Cheng Pang , Shengyi Jiang , Feng Xu , Yang Yu

The capability of continuously learning new skills via a sequence of pre-collected offline datasets is desired for an agent. However, consecutively learning a sequence of offline tasks likely leads to the catastrophic forgetting issue under…

Machine Learning · Computer Science 2024-04-23 Sibo Gai , Donglin Wang , Li He

In the online continual learning paradigm, agents must learn from a changing distribution while respecting memory and compute constraints. Experience Replay (ER), where a small subset of past data is stored and replayed alongside new data,…

Machine Learning · Computer Science 2022-05-03 Lucas Caccia , Rahaf Aljundi , Nader Asadi , Tinne Tuytelaars , Joelle Pineau , Eugene Belilovsky

In this paper, a novel training paradigm inspired by quantum computation is proposed for deep reinforcement learning (DRL) with experience replay. In contrast to traditional experience replay mechanism in DRL, the proposed deep…

Machine Learning · Computer Science 2021-01-07 Qing Wei , Hailan Ma , Chunlin Chen , Daoyi Dong

Recent advances in Large Language Models (LLMs) and Vision-Language Models (VLMs) have enabled powerful semantic and multimodal reasoning capabilities, creating new opportunities to enhance sample efficiency, high-level planning, and…

Machine Learning · Computer Science 2026-02-03 Elad Sharony , Tom Jurgenson , Orr Krupnik , Dotan Di Castro , Shie Mannor

Even though reinforcement-learning-based algorithms achieved superhuman performance in many domains, the field of robotics poses significant challenges as the state and action spaces are continuous, and the reward function is predominantly…

Agents must be able to adapt quickly as an environment changes. We find that existing model-based reinforcement learning agents are unable to do this well, in part because of how they use past experiences to train their world model. Here,…

Machine Learning · Computer Science 2023-06-29 Isaac Kauvar , Chris Doyle , Linqi Zhou , Nick Haber

This paper describes an improvement in Deep Q-learning called Reverse Experience Replay (also RER) that solves the problem of sparse rewards and helps to deal with reward maximizing tasks by sampling transitions successively in reverse…

Machine Learning · Computer Science 2019-10-24 Egor Rotinov

In goal-conditioned offline reinforcement learning, an agent learns from previously collected data to go to an arbitrary goal. Since the offline data only contains a finite number of trajectories, a main challenge is how to generate more…

Machine Learning · Computer Science 2023-03-07 Wenyan Yang , Joni Pajarinen , Dinging Cai , Joni Kämäräinen

Transformers achieve state-of-the-art performance for natural language processing tasks by pre-training on large-scale text corpora. They are extremely compute-intensive and have very high sample complexity. Memory replay is a mechanism…

Machine Learning · Computer Science 2022-05-23 Rui Liu , Barzan Mozafari

Experience replay is a foundational technique in reinforcement learning that enhances learning stability by storing past experiences in a replay buffer and reusing them during training. Despite its practical success, its theoretical…

Machine Learning · Statistics 2025-11-14 Jiale Han , Xiaowu Dai , Yuhua Zhu

Experience replay is a key technique behind many recent advances in deep reinforcement learning. Allowing the agent to learn from earlier memories can speed up learning and break undesirable temporal correlations. Despite its wide-spread…

Artificial Intelligence · Computer Science 2017-10-19 Ruishan Liu , James Zou