English
Related papers

Related papers: Exploration by Random Network Distillation

200 papers

Bugs in popular distributed protocol implementations have been the source of many downtimes in popular internet services. We describe a randomized testing approach for distributed protocol implementations based on reinforcement learning.…

Software Engineering · Computer Science 2024-09-05 Andrea Borgarelli , Constantin Enea , Rupak Majumdar , Srinidhi Nagendra

Deep reinforcement learning methods traditionally struggle with tasks where environment rewards are particularly sparse. One successful method of guiding exploration in these domains is to imitate trajectories provided by a human…

Machine Learning · Computer Science 2018-12-03 Yusuf Aytar , Tobias Pfaff , David Budden , Tom Le Paine , Ziyu Wang , Nando de Freitas

Offline Reinforcement Learning (RL) aims to learn effective policies from a static dataset without requiring further agent-environment interactions. However, its practical adoption is often hindered by the need for explicit reward…

Machine Learning · Computer Science 2025-12-23 Gaurav Chaudhary , Laxmidhar Behera

With the flourishing development of intelligent warehousing systems, the technology of Automated Guided Vehicle (AGV) has experienced rapid growth. Within intelligent warehousing environments, AGV is required to safely and rapidly plan an…

Robotics · Computer Science 2024-04-22 Huilin Yin , Shengkai Su , Yinjia Lin , Pengju Zhen , Karin Festl , Daniel Watzenig

Designing appropriate reward functions for Reinforcement Learning (RL) approaches has been a significant problem, especially for complex environments such as Atari games. Utilizing natural language instructions to provide intermediate…

Robotics · Computer Science 2023-02-09 Ziyuan Cao , Reshma Anugundanahalli Ramachandra , Kelin Yu

We introduce an exploration bonus for deep reinforcement learning methods calculated using self-organising feature maps. Our method uses adaptive resonance theory (ART) providing online, unsupervised clustering to quantify the novelty of a…

Machine Learning · Computer Science 2023-02-09 Marius Lindegaard , Hjalmar Jacob Vinje , Odin Aleksander Severinsen

This paper reviews exploration techniques in deep reinforcement learning. Exploration techniques are of primary importance when solving sparse reward problems. In sparse reward problems, the reward is rare, which means that the agent will…

Machine Learning · Computer Science 2022-05-03 Pawel Ladosz , Lilian Weng , Minwoo Kim , Hyondong Oh

State-of-the-art reinforcement learning (RL) algorithms typically use random sampling (e.g., $\epsilon$-greedy) for exploration, but this method fails on hard exploration tasks like Montezuma's Revenge. To address the challenge of…

Machine Learning · Computer Science 2022-11-21 Eric Chen , Zhang-Wei Hong , Joni Pajarinen , Pulkit Agrawal

Efficient exploration in complex environments remains a major challenge for reinforcement learning. We propose bootstrapped DQN, a simple algorithm that explores in a computationally and statistically efficient manner through use of…

Machine Learning · Computer Science 2016-07-05 Ian Osband , Charles Blundell , Alexander Pritzel , Benjamin Van Roy

We introduce Random Reward Perturbation (RRP), a novel exploration strategy for reinforcement learning (RL). Our theoretical analyses demonstrate that adding zero-mean noise to environmental rewards effectively enhances policy diversity…

Machine Learning · Computer Science 2025-06-11 Haozhe Ma , Guoji Fu , Zhengding Luo , Jiele Wu , Tze-Yun Leong

Exploration in complex domains is a key challenge in reinforcement learning, especially for tasks with very sparse rewards. Recent successes in deep reinforcement learning have been achieved mostly using simple heuristic exploration…

Machine Learning · Computer Science 2017-03-07 Joshua Achiam , Shankar Sastry

Efficient exploration remains a challenging research problem in reinforcement learning, especially when an environment contains large state spaces, deceptive local optima, or sparse rewards. To tackle this problem, we present a…

Artificial Intelligence · Computer Science 2018-10-30 Zhang-Wei Hong , Tzu-Yun Shann , Shih-Yang Su , Yi-Hsiang Chang , Chun-Yi Lee

To solve complex real-world problems with reinforcement learning, we cannot rely on manually specified reward functions. Instead, we can have humans communicate an objective to the agent directly. In this work, we combine two approaches to…

Machine Learning · Computer Science 2018-11-16 Borja Ibarz , Jan Leike , Tobias Pohlen , Geoffrey Irving , Shane Legg , Dario Amodei

Reinforcement Learning (RL) algorithms have led to recent successes in solving complex games, such as Atari or Starcraft, and to a huge impact in real-world applications, such as cybersecurity or autonomous driving. In the side of the…

Machine Learning · Computer Science 2021-02-15 Rubén Majadas , Javier García , Fernando Fernández

Despite significant advances in the field of deep Reinforcement Learning (RL), today's algorithms still fail to learn human-level policies consistently over a set of diverse tasks such as Atari 2600 games. We identify three key challenges…

Recent reinforcement learning (RL) approaches have shown strong performance in complex domains such as Atari games, but are often highly sample inefficient. A common approach to reduce interaction time with the environment is to use reward…

Machine Learning · Computer Science 2019-06-03 Prasoon Goyal , Scott Niekum , Raymond J. Mooney

Exploration is critical for deep reinforcement learning in complex environments with high-dimensional observations and sparse rewards. To address this problem, recent approaches proposed to leverage intrinsic rewards to improve exploration,…

Machine Learning · Computer Science 2022-11-11 Mingqi Yuan , Bo Li , Xin Jin , Wenjun Zeng

We consider an agent's uncertainty about its environment and the problem of generalizing this uncertainty across observations. Specifically, we focus on the problem of exploration in non-tabular reinforcement learning. Drawing inspiration…

Artificial Intelligence · Computer Science 2018-07-11 Marc G. Bellemare , Sriram Srinivasan , Georg Ostrovski , Tom Schaul , David Saxton , Remi Munos

This paper investigates whether learning contingency-awareness and controllable aspects of an environment can lead to better exploration in reinforcement learning. To investigate this question, we consider an instantiation of this…

Machine Learning · Computer Science 2019-03-05 Jongwook Choi , Yijie Guo , Marcin Moczulski , Junhyuk Oh , Neal Wu , Mohammad Norouzi , Honglak Lee

In the last decade, deep learning has achieved great success in machine learning tasks where the input data is represented with different levels of abstractions. Driven by the recent research in reinforcement learning using deep neural…

Machine Learning · Computer Science 2022-05-18 Dejan Markovikj