English
Related papers

Related papers: Exploration by Random Network Distillation

200 papers

Our work is a simple extension of the paper "Exploration by Random Network Distillation". More in detail, we show how to efficiently combine Intrinsic Rewards with Experience Replay in order to achieve more efficient and robust exploration…

Machine Learning · Computer Science 2019-12-03 Francesco Sovrano

Exploration remains a critical issue in deep reinforcement learning for an agent to attain high returns in unknown environments. Although the prevailing exploration Random Network Distillation (RND) algorithm has been demonstrated to be…

Machine Learning · Computer Science 2024-05-21 Kai Yang , Jian Tao , Jiafei Lyu , Xiu Li

Exploration remains a critical challenge in online reinforcement learning, as an agent must effectively explore unknown environments to achieve high returns. Currently, the main exploration algorithms are primarily count-based methods and…

Machine Learning · Computer Science 2025-05-19 Zhirui Fang , Kai Yang , Jian Tao , Jiafei Lyu , Lusong Li , Li Shen , Xiu Li

Research on exploration in reinforcement learning, as applied to Atari 2600 game-playing, has emphasized tackling difficult exploration problems such as Montezuma's Revenge (Bellemare et al., 2016). Recently, bonus-based exploration…

Machine Learning · Computer Science 2021-09-24 Adrien Ali Taïga , William Fedus , Marlos C. Machado , Aaron Courville , Marc G. Bellemare

Exploration is a key problem in reinforcement learning. Recently bonus-based methods have achieved considerable successes in environments where exploration is difficult such as Montezuma's Revenge, which assign additional bonuses (e.g.,…

Artificial Intelligence · Computer Science 2020-09-02 Yan Song , Yingfeng Chen , Yujing Hu , Changjie Fan

This paper provides an empirical evaluation of recently developed exploration algorithms within the Arcade Learning Environment (ALE). We study the use of different reward bonuses that incentives exploration in reinforcement learning. We do…

Machine Learning · Computer Science 2021-09-28 Adrien Ali Taïga , William Fedus , Marlos C. Machado , Aaron Courville , Marc G. Bellemare

Despite the success of Random Network Distillation (RND) in various domains, it was shown as not discriminative enough to be used as an uncertainty estimator for penalizing out-of-distribution actions in offline reinforcement learning. In…

Machine Learning · Computer Science 2023-05-18 Alexander Nikulin , Vladislav Kurenkov , Denis Tarasov , Sergey Kolesnikov

Sparse reward environments are known to be challenging for reinforcement learning agents. In such environments, efficient and scalable exploration is crucial. Exploration is a means by which an agent gains information about the environment.…

Machine Learning · Computer Science 2023-10-11 Jacob Chmura , Hasham Burhani , Xiao Qi Shi

We propose a new method for learning from a single demonstration to solve hard exploration tasks like the Atari game Montezuma's Revenge. Instead of imitating human demonstrations, as proposed in other recent works, our approach is to…

Machine Learning · Computer Science 2018-12-11 Tim Salimans , Richard Chen

In this study, we address the problem of efficient exploration in reinforcement learning. Most common exploration approaches depend on random action selection, however these approaches do not work well in environments with sparse or no…

Machine Learning · Computer Science 2022-06-30 Doğay Kamar , Nazım Kemal Üre , Gözde Ünal

Reinforcement learning can solve decision-making problems and train an agent to behave in an environment according to a predesigned reward function. However, such an approach becomes very problematic if the reward is too sparse and so the…

Artificial Intelligence · Computer Science 2024-06-12 Matej Pecháč , Michal Chovanec , Igor Farkaš

In distributional reinforcement learning (RL), the estimated distribution of value function models both the parametric and intrinsic uncertainties. We propose a novel and efficient exploration method for deep RL that has two components. The…

Machine Learning · Computer Science 2019-05-16 Borislav Mavrin , Shangtong Zhang , Hengshuai Yao , Linglong Kong , Kaiwen Wu , Yaoliang Yu

Achieving efficient and scalable exploration in complex domains poses a major challenge in reinforcement learning. While Bayesian and PAC-MDP approaches to the exploration problem offer strong formal guarantees, they are often impractical…

Artificial Intelligence · Computer Science 2015-11-23 Bradly C. Stadie , Sergey Levine , Pieter Abbeel

Multi-agent reinforcement learning has shown promise in learning cooperative behaviors in team-based environments. However, such methods often demand extensive training time. For instance, the state-of-the-art method TiZero takes 40 days to…

Machine Learning · Computer Science 2025-03-18 Amir Baghi , Jens Sjölund , Joakim Bergdahl , Linus Gisslén , Alessandro Sestini

Intrinsic motivation, inspired by the psychology of developmental learning in infants, stimulates exploration in agents without relying solely on sparse external rewards. Existing methods in reinforcement learning like Random Network…

Machine Learning · Computer Science 2024-10-03 Mohammadamin Davoodabadi , Negin Hashemi Dijujin , Mahdieh Soleymani Baghshah

Developing agents for complex and underspecified tasks, where no clear objective exists, remains challenging but offers many opportunities. This is especially true in video games, where simulated players (bots) need to play realistically,…

Machine Learning · Computer Science 2025-04-15 Emilien Biré , Anthony Kobanda , Ludovic Denoyer , Rémy Portelas

We introduce Random Latent Exploration (RLE), a simple yet effective exploration strategy in reinforcement learning (RL). On average, RLE outperforms noise-based methods, which perturb the agent's actions, and bonus-based exploration, which…

Machine Learning · Computer Science 2025-02-28 Srinath Mahankali , Zhang-Wei Hong , Ayush Sekhari , Alexander Rakhlin , Pulkit Agrawal

This paper introduces a novel method for learning how to play the most difficult Atari 2600 games from the Arcade Learning Environment using deep reinforcement learning. The proposed method, human checkpoint replay, consists in using…

Artificial Intelligence · Computer Science 2016-07-19 Ionel-Alexandru Hosu , Traian Rebedea

A grand challenge in reinforcement learning is intelligent exploration, especially when rewards are sparse or deceptive. Two Atari games serve as benchmarks for such hard-exploration domains: Montezuma's Revenge and Pitfall. On both games,…

Machine Learning · Computer Science 2021-03-02 Adrien Ecoffet , Joost Huizinga , Joel Lehman , Kenneth O. Stanley , Jeff Clune

Exploration is a difficult challenge in reinforcement learning and is of prime importance in sparse reward environments. However, many of the state of the art deep reinforcement learning algorithms, that rely on epsilon-greedy, fail on…

Machine Learning · Computer Science 2018-10-15 Navneet Madhu Kumar
‹ Prev 1 2 3 10 Next ›