English
Related papers

Related papers: Beyond Surprise: Improving Exploration Through Sur…

200 papers

In Reinforcement Learning (RL), artificial agents are trained to maximize numerical rewards by performing tasks. Exploration is essential in RL because agents must discover information before exploiting it. Two rewards encouraging efficient…

Machine Learning · Computer Science 2024-05-14 Theodore Jerome Tinker , Kenji Doya , Jun Tani

Exploration is a crucial and distinctive aspect of reinforcement learning (RL) that remains a fundamental open problem. Several methods have been proposed to tackle this challenge. Commonly used methods inject random noise directly into the…

Machine Learning · Computer Science 2024-11-06 Sebastian Griesbach , Carlo D'Eramo

Curiosity-based reward schemes can present powerful exploration mechanisms which facilitate the discovery of solutions for complex, sparse or long-horizon tasks. However, as the agent learns to reach previously unexplored spaces and the…

An effective approach to exploration in reinforcement learning is to rely on an agent's uncertainty over the optimal policy, which can yield near-optimal exploration strategies in tabular settings. However, in non-tabular settings that…

Exploration is critical for deep reinforcement learning in complex environments with high-dimensional observations and sparse rewards. To address this problem, recent approaches proposed to leverage intrinsic rewards to improve exploration,…

Machine Learning · Computer Science 2022-11-11 Mingqi Yuan , Bo Li , Xin Jin , Wenjun Zeng

Efficient exploration in reinforcement learning is a challenging problem commonly addressed through intrinsic rewards. Recent prominent approaches are based on state novelty or variants of artificial curiosity. However, directly applying…

Machine Learning · Computer Science 2022-11-21 Aditya Ramesh , Louis Kirsch , Sjoerd van Steenkiste , Jürgen Schmidhuber

Realistic environments often provide agents with very limited feedback. When the environment is initially unknown, the feedback, in the beginning, can be completely absent, and the agents may first choose to devote all their effort on…

Machine Learning · Computer Science 2020-10-13 Pierre Ménard , Omar Darwiche Domingues , Anders Jonsson , Emilie Kaufmann , Edouard Leurent , Michal Valko

Many scenes in real life can be abstracted to the sparse reward visual scenes, where it is difficult for an agent to tackle the task under the condition of only accepting images and sparse rewards. We propose to decompose this problem into…

Artificial Intelligence · Computer Science 2022-05-20 Zheng Fang , Biao Zhao , Guizhong Liu

Exploration in sparse reward reinforcement learning remains an open challenge. Many state-of-the-art methods use intrinsic motivation to complement the sparse extrinsic reward signal, giving the agent more opportunities to receive feedback…

Machine Learning · Computer Science 2019-06-24 Jingwei Zhang , Niklas Wetzel , Nicolai Dorka , Joschka Boedecker , Wolfram Burgard

Reinforcement learning is a powerful learning paradigm that has spearheaded progress in numerous domains. Its core promise lies in learning through high-level goals without the need for granular labels. However, it still remains elusive in…

Large language models (LLMs) are probabilistic in nature and perform more reliably when augmented with external information. As complex queries often require multi-step reasoning over the retrieved information, with no clear or…

Information Retrieval · Computer Science 2026-04-10 Roxana Petcu , Evangelos Kanoulas , Maarten de Rijke

Exploration is a key problem in reinforcement learning. Recently bonus-based methods have achieved considerable successes in environments where exploration is difficult such as Montezuma's Revenge, which assign additional bonuses (e.g.,…

Artificial Intelligence · Computer Science 2020-09-02 Yan Song , Yingfeng Chen , Yujing Hu , Changjie Fan

Robots must know how to be gentle when they need to interact with fragile objects, or when the robot itself is prone to wear and tear. We propose an approach that enables deep reinforcement learning to train policies that are gentle, both…

Computer-aided design of molecules has the potential to disrupt the field of drug and material discovery. Machine learning, and deep learning, in particular, have been topics where the field has been developing at a rapid pace.…

Machine Learning · Computer Science 2022-08-08 Luca A. Thiede , Mario Krenn , AkshatKumar Nigam , Alan Aspuru-Guzik

This paper presents a novel form of policy gradient for model-free reinforcement learning (RL) with improved exploration properties. Current policy-based methods use entropy regularization to encourage undirected exploration of the reward…

Machine Learning · Computer Science 2017-03-17 Ofir Nachum , Mohammad Norouzi , Dale Schuurmans

Reward engineering and designing an incentive reward function are non-trivial tasks to train agents in complex environments. Furthermore, an inaccurate reward function may lead to a biased behaviour which is far from an efficient and…

Robotics · Computer Science 2021-05-04 Saeed Tafazzol , Erfan Fathi , Mahdi Rezaei , Ehsan Asali

Model-based reinforcement learning (MBRL) has gained much attention for its ability to learn complex behaviors in a sample-efficient way: planning actions by generating imaginary trajectories with predicted rewards. Despite its success, we…

Machine Learning · Computer Science 2024-02-20 Vint Lee , Pieter Abbeel , Youngwoon Lee

Exploration in high-dimensional, continuous spaces with sparse rewards is an open problem in reinforcement learning. Artificial curiosity algorithms address this by creating rewards that lead to exploration. Given a reinforcement learning…

Machine Learning · Computer Science 2023-11-08 Alexander Nedergaard , Matthew Cook

Reinforcement learning has been shown to be highly successful at many challenging tasks. However, success heavily relies on well-shaped rewards. Intrinsically motivated RL attempts to remove this constraint by defining an intrinsic reward…

Machine Learning · Computer Science 2021-03-16 Rui Zhao , Yang Gao , Pieter Abbeel , Volker Tresp , Wei Xu

The broader application of reinforcement learning (RL) is limited by challenges including data efficiency, generalization capability, and ability to learn in sparse-reward environments. Meta-learning has emerged as a promising approach to…

Machine Learning · Computer Science 2026-03-05 Octavio Pappalardo , Rodrigo Ramele , Juan Miguel Santos
‹ Prev 1 3 4 5 6 7 10 Next ›