English
Related papers

Related papers: Virtual Replay Cache

200 papers

Much of recent Deep Reinforcement Learning success is owed to the neural architecture's potential to learn and use effective internal representations of the world. While many current algorithms access a simulator to train with a large…

Artificial Intelligence · Computer Science 2022-02-03 Amir Ardalan Kalantari , Mohammad Amini , Sarath Chandar , Doina Precup

For reinforcement learning on complex stochastic systems where many factors dynamically impact the output trajectories, it is desirable to effectively leverage the information from historical samples collected in previous iterations to…

Machine Learning · Statistics 2022-09-13 Hua Zheng , Wei Xie , M. Ben Feng

This paper introduces a novel method for learning how to play the most difficult Atari 2600 games from the Arcade Learning Environment using deep reinforcement learning. The proposed method, human checkpoint replay, consists in using…

Artificial Intelligence · Computer Science 2016-07-19 Ionel-Alexandru Hosu , Traian Rebedea

Recent advances in off-policy deep reinforcement learning (RL) have led to impressive success in complex tasks from visual observations. Experience replay improves sample-efficiency by reusing experiences from the past, and convolutional…

Machine Learning · Computer Science 2021-10-29 Lili Chen , Kimin Lee , Aravind Srinivas , Pieter Abbeel

Deep Reinforcement Learning has yielded proficient controllers for complex tasks. However, these controllers have limited memory and rely on being able to perceive the complete game screen at each decision point. To address these…

Machine Learning · Computer Science 2017-01-13 Matthew Hausknecht , Peter Stone

Training deep neural networks at the edge on light computational devices, embedded systems and robotic platforms is nowadays very challenging. Continual learning techniques, where complex models are incrementally trained on small batches of…

Machine Learning · Computer Science 2020-03-05 Lorenzo Pellegrini , Gabriele Graffieti , Vincenzo Lomonaco , Davide Maltoni

Recently, reinforcement learning models have achieved great success, completing complex tasks such as mastering Go and other games with higher scores than human players. Many of these models collect considerable data on the tasks and…

Machine Learning · Computer Science 2019-07-19 Hanten Chang , Katsuya Futagami

Most deep reinforcement learning (RL) algorithms distill experience into parametric behavior policies or value functions via gradient updates. While effective, this approach has several disadvantages: (1) it is computationally expensive,…

Perceptive deep reinforcement learning (DRL) has lead to many recent breakthroughs for complex AI systems leveraging image-based input data. Applications of these results range from super-human level video game agents to dexterous,…

Robotics · Computer Science 2023-10-04 Lev Grossman , Brian Plancher

Experience replay enables online reinforcement learning agents to store and reuse the previous experiences of interacting with the environment. In the original method, the experiences are sampled and replayed uniformly at random. A prior…

Machine Learning · Computer Science 2021-12-13 Fanchen Bu , Dong Eui Chang

Reinforcement Learning (RL) is one of the most dynamic research areas in Game AI and AI as a whole, and a wide variety of games are used as its prominent test problems. However, it is subject to the replicability crisis that currently…

Machine Learning · Computer Science 2022-03-03 Matthias Müller-Brockhausen , Aske Plaat , Mike Preuss

In reinforcement learning, Reverse Experience Replay (RER) is a recently proposed algorithm that attains better sample complexity than the classic experience replay method. RER requires the learning algorithm to update the parameters…

Machine Learning · Computer Science 2024-09-02 Nan Jiang , Jinzhao Li , Yexiang Xue

In value-based deep reinforcement learning with replay memories, the batch size parameter specifies how many transitions to sample for each gradient update. Although critical to the learning process, this value is typically not adjusted…

Machine Learning · Computer Science 2023-10-09 Johan Obando-Ceron , Marc G. Bellemare , Pablo Samuel Castro

High Performance Computing (HPC) systems are used across a wide range of disciplines for both large and complex computations. HPC systems often receive many thousands of computational tasks at a time, colloquially referred to as jobs. These…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-16 Elliot Kolker-Hicks , Di Zhang , Dong Dai

Retrieval-Augmented Generation (RAG) systems enhance the performance of large language models (LLMs) by incorporating supplementary retrieved documents, enabling more accurate and context-aware responses. However, integrating these external…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-25 Wenfeng Wang , Xiaofeng Hou , Peng Tang , Hengyi Zhou , Jing Wang , Xinkai Wang , Chao Li , Minyi Guo

In this paper, a novel training paradigm inspired by quantum computation is proposed for deep reinforcement learning (DRL) with experience replay. In contrast to traditional experience replay mechanism in DRL, the proposed deep…

Machine Learning · Computer Science 2021-01-07 Qing Wei , Hailan Ma , Chunlin Chen , Daoyi Dong

Experience replay is widely used in deep reinforcement learning algorithms and allows agents to remember and learn from experiences from the past. In an effort to learn more efficiently, researchers proposed prioritized experience replay…

Machine Learning · Computer Science 2020-02-20 Marc Brittain , Josh Bertram , Xuxi Yang , Peng Wei

In modern GPU inference, cache efficiency remains a major bottleneck, and heuristic policies such as \textsc{LRU} can perform far worse than the offline optimum. Existing learning-based caching systems improve hit rates mainly through…

Data efficiency is a key challenge for deep reinforcement learning. We address this problem by using unlabeled data to pretrain an encoder which is then finetuned on a small amount of task-specific data. To encourage learning…

Continual learning seeks to enable deep learners to train on a series of tasks of unknown length without suffering from the catastrophic forgetting of previous tasks. One effective solution is replay, which involves storing few previous…

Machine Learning · Computer Science 2023-08-04 Daniel Brignac , Niels Lobo , Abhijit Mahalanobis