English
Related papers

Related papers: Random Latent Exploration for Deep Reinforcement L…

200 papers

We introduce an exploration bonus for deep reinforcement learning methods that is easy to implement and adds minimal overhead to the computation performed. The bonus is the error of a neural network predicting features of the observations…

Machine Learning · Computer Science 2018-10-31 Yuri Burda , Harrison Edwards , Amos Storkey , Oleg Klimov

Reinforcement learning (RL) agents are particularly hard to train when rewards are sparse. One common solution is to use intrinsic rewards to encourage agents to explore their environment. However, recent intrinsic exploration methods often…

Machine Learning · Computer Science 2022-11-23 Jesse Mu , Victor Zhong , Roberta Raileanu , Minqi Jiang , Noah Goodman , Tim Rocktäschel , Edward Grefenstette

Reinforcement Learning (RL) has emerged as a powerful paradigm in Artificial Intelligence (AI), enabling agents to learn optimal behaviors through interactions with their environments. Drawing from the foundations of trial and error, RL…

Artificial Intelligence · Computer Science 2025-02-04 Majid Ghasemi , Amir Hossein Moosavi , Dariush Ebrahimi

In Reinforcement Learning (RL), artificial agents are trained to maximize numerical rewards by performing tasks. Exploration is essential in RL because agents must discover information before exploiting it. Two rewards encouraging efficient…

Machine Learning · Computer Science 2024-05-14 Theodore Jerome Tinker , Kenji Doya , Jun Tani

In Reinforcement Learning, agents learn policies by exploring and interacting with the environment. Due to the curse of dimensionality, learning policies that map high-dimensional sensory input to motor output is particularly challenging.…

Intelligent agents must pursue their goals in complex environments with partial information and often limited computational capacity. Reinforcement learning methods have achieved great success by creating agents that optimize engineered…

Machine Learning · Computer Science 2021-06-07 Alejandro Daniel Noel , Charel van Hoof , Beren Millidge

In distributional reinforcement learning (RL), the estimated distribution of value function models both the parametric and intrinsic uncertainties. We propose a novel and efficient exploration method for deep RL that has two components. The…

Machine Learning · Computer Science 2019-05-16 Borislav Mavrin , Shangtong Zhang , Hengshuai Yao , Linglong Kong , Kaiwen Wu , Yaoliang Yu

In this paper, we investigate preference-based reinforcement learning (PbRL), which enables reinforcement learning (RL) agents to learn from human feedback. This is particularly valuable when defining a fine-grain reward function is not…

Machine Learning · Computer Science 2025-11-11 Guojian Wang , Jianxiang Liu , Xinyuan Li , Faguo Wu , Xiao Zhang , Tianyuan Chen , Xuyang Chen

Deep reinforcement learning (DRL) is playing an increasingly important role in real-world applications. However, obtaining an optimally performing DRL agent for complex tasks, especially with sparse rewards, remains a significant challenge.…

Machine Learning · Computer Science 2024-06-07 Zelei Cheng , Xian Wu , Jiahao Yu , Sabrina Yang , Gang Wang , Xinyu Xing

How to best explore in domains with sparse, delayed, and deceptive rewards is an important open problem for reinforcement learning (RL). This paper considers one such domain, the recently-proposed multi-agent benchmark of Pommerman. This…

Machine Learning · Computer Science 2019-07-30 Chao Gao , Bilal Kartal , Pablo Hernandez-Leal , Matthew E. Taylor

Reward shaping allows reinforcement learning (RL) agents to accelerate learning by receiving additional reward signals. However, these signals can be difficult to design manually, especially for complex RL tasks. We propose a simple and…

Artificial Intelligence · Computer Science 2018-06-11 Niels Justesen , Sebastian Risi

Deep learning has achieved remarkable successes in solving challenging reinforcement learning (RL) problems when dense reward function is provided. However, in sparse reward environment it still often suffers from the need to carefully…

Machine Learning · Computer Science 2019-02-19 Hao Liu , Alexander Trott , Richard Socher , Caiming Xiong

Large Language Model (LLM) agents have demonstrated remarkable proficiency in learned tasks, yet they often struggle to adapt to non-stationary environments with feedback. While In-Context Learning and external memory offer some…

Artificial Intelligence · Computer Science 2026-03-05 Lu Yang , Zelai Xu , Minyang Xie , Jiaxuan Gao , Zhao Shok , Yu Wang , Yi Wu

Exploration in environments with sparse rewards remains a fundamental challenge in reinforcement learning (RL). Existing approaches such as curriculum learning and Go-Explore often rely on hand-crafted heuristics, while curiosity-driven…

Machine Learning · Computer Science 2026-02-03 Georgios Sotirchos , Zlatan Ajanović , Jens Kober

We propose a exploration mechanism of policy in Deep Reinforcement Learning, which is exploring more when agent needs, called Add Noise to Noise (AN2N). The core idea is: when the Deep Reinforcement Learning agent is in a state of poor…

Machine Learning · Computer Science 2021-09-29 Youtian Guo , Qi Gao

Effective and intelligent exploration has been an unresolved problem for reinforcement learning. Most contemporary reinforcement learning relies on simple heuristic strategies such as $\epsilon$-greedy exploration or adding Gaussian noise…

Machine Learning · Computer Science 2025-12-19 Muhammad Usama , Dong Eui Chang

Navigating and understanding complex and unknown environments autonomously demands more than just basic perception and movement from embodied agents. Truly effective exploration requires agents to possess higher-level cognitive abilities,…

Artificial Intelligence · Computer Science 2025-09-12 Abdel Hakim Drid , Vincenzo Suriani , Daniele Nardi , Abderrezzak Debilou

Exploration in environments with sparse rewards has been a persistent problem in reinforcement learning (RL). Many tasks are natural to specify with a sparse reward, and manually shaping a reward function can result in suboptimal…

Machine Learning · Computer Science 2018-02-27 Ashvin Nair , Bob McGrew , Marcin Andrychowicz , Wojciech Zaremba , Pieter Abbeel

Scalable and effective exploration remains a key challenge in reinforcement learning (RL). While there are methods with optimality guarantees in the setting of discrete state and action spaces, these methods cannot be applied in…

Machine Learning · Computer Science 2017-01-30 Rein Houthooft , Xi Chen , Yan Duan , John Schulman , Filip De Turck , Pieter Abbeel

Reinforcement Learning (RL) agents often struggle with inefficient exploration, particularly in environments with sparse rewards. Traditional exploration strategies can lead to slow learning and suboptimal performance because agents fail to…

Machine Learning · Computer Science 2026-03-31 Gaurav Chaudhary , Laxmidhar Behera , Washim Uddin Mondal