English
Related papers

Related papers: CUER: Corrected Uniform Experience Replay for Off-…

200 papers

Continual learning is the process of training machine learning models on a sequence of tasks where data distributions change over time. A well-known obstacle in this setting is catastrophic forgetting, a phenomenon in which a model…

Machine Learning · Computer Science 2025-02-18 Andrii Krutsylo

We investigate the combination of actor-critic reinforcement learning algorithms with uniform large-scale experience replay and propose solutions for two challenges: (a) efficient actor-critic learning with experience replay (b) stability…

Machine Learning · Computer Science 2019-11-19 Simon Schmitt , Matteo Hessel , Karen Simonyan

In Continual Learning, a Neural Network is trained on a stream of data whose distribution shifts over time. Under these assumptions, it is especially challenging to improve on classes appearing later in the stream while remaining accurate…

Machine Learning · Computer Science 2020-10-13 Pietro Buzzega , Matteo Boschini , Angelo Porrello , Simone Calderara

We present a novel technique called Dynamic Experience Replay (DER) that allows Reinforcement Learning (RL) algorithms to use experience replay samples not only from human demonstrations but also successful transitions generated by RL…

Artificial Intelligence · Computer Science 2020-10-19 Jieliang Luo , Hui Li

This paper describes an improvement in Deep Q-learning called Reverse Experience Replay (also RER) that solves the problem of sparse rewards and helps to deal with reward maximizing tasks by sampling transitions successively in reverse…

Machine Learning · Computer Science 2019-10-24 Egor Rotinov

In reinforcement learning, experience replay stores past samples for further reuse. Prioritized sampling is a promising technique to better utilize these samples. Previous criteria of prioritization include TD error, recentness and…

Machine Learning · Computer Science 2021-11-10 Xu-Hui Liu , Zhenghai Xue , Jing-Cheng Pang , Shengyi Jiang , Feng Xu , Yang Yu

Experience replay is a foundational technique in reinforcement learning that enhances learning stability by storing past experiences in a replay buffer and reusing them during training. Despite its practical success, its theoretical…

Machine Learning · Statistics 2025-11-14 Jiale Han , Xiaowu Dai , Yuhua Zhu

Experience replay is a key technique behind many recent advances in deep reinforcement learning. Allowing the agent to learn from earlier memories can speed up learning and break undesirable temporal correlations. Despite its wide-spread…

Artificial Intelligence · Computer Science 2017-10-19 Ruishan Liu , James Zou

Compared to on-policy counterparts, off-policy model-free deep reinforcement learning can improve data efficiency by repeatedly using the previously gathered data. However, off-policy learning becomes challenging when the discrepancy…

Machine Learning · Computer Science 2023-09-27 Baturay Saglam , Dogan C. Cicek , Furkan B. Mutlu , Suleyman S. Kozat

Model-based reinforcement learning uses models to plan, where the predictions and policies of an agent can be improved by using more computation without additional data from the environment, thereby improving sample efficiency. However,…

Machine Learning · Computer Science 2023-02-22 Animesh Kumar Paul , Videh Raj Nema

Experience replay is an important technique for addressing sample-inefficiency in deep reinforcement learning (RL), but faces difficulty in learning from binary and sparse rewards due to disproportionately few successful experiences in the…

Machine Learning · Computer Science 2018-09-10 Sameera Lanka , Tianfu Wu

We investigate the effect of using human demonstration data in the replay buffer for Deep Reinforcement Learning. We use a policy gradient method with a modified experience replay buffer where a human demonstration experience is sampled…

Artificial Intelligence · Computer Science 2021-07-15 Dylan Klein , Akansel Cosgun

Continual learning is a promising machine learning paradigm to learn new tasks while retaining previously learned knowledge over streaming training data. Till now, rehearsal-based methods, keeping a small part of data from old tasks as a…

Machine Learning · Computer Science 2023-08-04 Quanziang Wang , Renzhen Wang , Yuexiang Li , Dong Wei , Kai Ma , Yefeng Zheng , Deyu Meng

By reusing data throughout training, off-policy deep reinforcement learning algorithms offer improved sample efficiency relative to on-policy approaches. For continuous action spaces, the most popular methods for off-policy learning include…

Machine Learning · Computer Science 2023-12-01 Jared Markowitz , Jesse Silverberg , Gary Collins

Experience replay, the reuse of past data to improve sample efficiency, is ubiquitous in reinforcement learning. Though a variety of smart sampling schemes have been introduced to improve performance, uniform sampling by far remains the…

Machine Learning · Computer Science 2024-10-22 Parham Mohammad Panahi , Andrew Patterson , Martha White , Adam White

This project combines recent advances in experience replay techniques, namely, Combined Experience Replay (CER), Prioritized Experience Replay (PER), and Hindsight Experience Replay (HER). We show the results of combinations of these…

Machine Learning · Computer Science 2018-05-16 Tracy Wan , Neil Xu

Modern off-policy reinforcement learning algorithms often rely on simple uniform replay sampling and it remains unclear when and why non-uniform replay improves over this strong baseline. Across diverse RL settings, we show that the…

Machine Learning · Computer Science 2026-05-19 Michal Korniak , Mikołaj Czarnecki , Yarden As , Piotr Miłoś , Pieter Abbeel , Michal Nauman

While on-policy algorithms are known for their stability, they often demand a substantial number of samples. In contrast, off-policy algorithms, which leverage past experiences, are considered sample-efficient but tend to exhibit…

Machine Learning · Computer Science 2023-09-28 Jianfei Ma

We present the extension of the Remember and Forget for Experience Replay (ReF-ER) algorithm to Multi-Agent Reinforcement Learning (MARL). ReF-ER was shown to outperform state of the art algorithms for continuous control in problems ranging…

Machine Learning · Computer Science 2022-09-05 Pascal Weber , Daniel Wälchli , Mustafa Zeqiri , Petros Koumoutsakos

During recent years, deep reinforcement learning (DRL) has made successful incursions into complex decision-making applications such as robotics, autonomous driving or video games. Off-policy algorithms tend to be more sample-efficient than…

Machine Learning · Computer Science 2021-12-06 Jesus Bujalance Martin , Raphael Chekroun , Fabien Moutarde