中文
相关论文

相关论文: Improving Intrinsic Exploration by Creating Statio…

200 篇论文

What is a good exploration strategy for an agent that interacts with an environment in the absence of external rewards? Ideally, we would like to get a policy driving towards a uniform state-action visitation (highly exploring) in a minimum…

机器学习 · 计算机科学 2019-12-20 Mirco Mutti , Marcello Restelli

Sparse reward environments are known to be challenging for reinforcement learning agents. In such environments, efficient and scalable exploration is crucial. Exploration is a means by which an agent gains information about the environment.…

机器学习 · 计算机科学 2023-10-11 Jacob Chmura , Hasham Burhani , Xiao Qi Shi

Optimistic value estimates provide one mechanism for directed exploration in reinforcement learning (RL). The agent acts greedily with respect to an estimate of the value plus what can be seen as a value bonus. The value bonus can be…

机器学习 · 计算机科学 2026-02-16 Abdul Wahab , Raksha Kumaraswamy , Martha White

Maximum entropy reinforcement learning motivates agents to explore states and actions to maximize the entropy of some distribution, typically by providing additional intrinsic rewards proportional to that entropy function. In this paper, we…

机器学习 · 计算机科学 2026-03-20 Adrien Bolland , Gaspard Lambrechts , Damien Ernst

Exploration of indoor environments has recently experienced a significant interest, also thanks to the introduction of deep neural agents built in a hierarchical fashion and trained with Deep Reinforcement Learning (DRL) on simulated…

Autonomous exploration has many important applications. However, classic information gain-based or frontier-based exploration only relies on the robot current state to determine the immediate exploration goal, which lacks the capability of…

机器人学 · 计算机科学 2023-05-26 Yafei Hu , Junyi Geng , Chen Wang , John Keller , Sebastian Scherer

Reinforcement Learning has emerged as a strong alternative to solve optimization tasks efficiently. The use of these algorithms highly depends on the feedback signals provided by the environment in charge of informing about how good (or…

机器学习 · 计算机科学 2022-12-01 Alain Andres , Esther Villar-Rodriguez , Javier Del Ser

This paper introduces a novel method of adding intrinsic bonuses to task-oriented reward function in order to efficiently facilitate reinforcement learning search. While various bonuses have been designed to date, they are analogous to the…

机器学习 · 计算机科学 2023-07-04 Taisuke Kobayashi

Efficient exploration remains a challenging problem in reinforcement learning, especially for those tasks where rewards from environments are sparse. A commonly used approach for exploring such environments is to introduce some "intrinsic"…

机器学习 · 计算机科学 2020-07-16 Neale Ratzlaff , Qinxun Bai , Li Fuxin , Wei Xu

We introduce a new count-based optimistic exploration algorithm for Reinforcement Learning (RL) that is feasible in environments with high-dimensional state-action spaces. The success of RL algorithms in these domains depends crucially on…

人工智能 · 计算机科学 2017-06-27 Jarryd Martin , Suraj Narayanan Sasikumar , Tom Everitt , Marcus Hutter

Exploration in sparse reward reinforcement learning remains an open challenge. Many state-of-the-art methods use intrinsic motivation to complement the sparse extrinsic reward signal, giving the agent more opportunities to receive feedback…

机器学习 · 计算机科学 2019-06-24 Jingwei Zhang , Niklas Wetzel , Nicolai Dorka , Joschka Boedecker , Wolfram Burgard

Dealing with environments with sparse rewards has always been crucial for systems developed to operate in autonomous open-ended learning settings. Intrinsic Motivations could be an effective way to help Deep Reinforcement Learning…

机器学习 · 计算机科学 2025-04-07 Gianluca Maselli , Vieri Giuliano Santucci

We introduce an exploration bonus for deep reinforcement learning methods calculated using self-organising feature maps. Our method uses adaptive resonance theory (ART) providing online, unsupervised clustering to quantify the novelty of a…

机器学习 · 计算机科学 2023-02-09 Marius Lindegaard , Hjalmar Jacob Vinje , Odin Aleksander Severinsen

We introduce Random Latent Exploration (RLE), a simple yet effective exploration strategy in reinforcement learning (RL). On average, RLE outperforms noise-based methods, which perturb the agent's actions, and bonus-based exploration, which…

机器学习 · 计算机科学 2025-02-28 Srinath Mahankali , Zhang-Wei Hong , Ayush Sekhari , Alexander Rakhlin , Pulkit Agrawal

Designing effective reward functions remains a central challenge in reinforcement learning, especially in multi-objective environments. In this work, we propose Multi-Objective Reward Shaping with Exploration (MORSE), a general framework…

机器学习 · 计算机科学 2025-12-18 Yuqing Xie , Jiayu Chen , Wenhao Tang , Ya Zhang , Chao Yu , Yu Wang

Exploration is fundamental to reinforcement learning (RL), as it determines how effectively an agent discovers and exploits the underlying structure of its environment to achieve optimal performance. Existing exploration methods generally…

人工智能 · 计算机科学 2025-10-30 Likun Wang , Xiangteng Zhang , Yinuo Wang , Guojian Zhan , Wenxuan Wang , Haoyu Gao , Jingliang Duan , Shengbo Eben Li

Maintaining the long-term exploration capability of the agent remains one of the critical challenges in deep reinforcement learning. A representative solution is to leverage reward shaping to provide intrinsic rewards for the agent to…

机器学习 · 计算机科学 2021-09-21 Mingqi Yuan , Mon-on Pun , Dong Wang , Yi Chen , Haojun Li

Intelligent agents progress by continually refining their capabilities through actively exploring environments. Yet robot policies often lack sufficient exploration capability due to action mode collapse. Existing methods that encourage…

机器人学 · 计算机科学 2025-09-24 Yang Jin , Jun Lv , Han Xue , Wendi Chen , Chuan Wen , Cewu Lu

Exploration in complex domains is a key challenge in reinforcement learning, especially for tasks with very sparse rewards. Recent successes in deep reinforcement learning have been achieved mostly using simple heuristic exploration…

机器学习 · 计算机科学 2017-03-07 Joshua Achiam , Shankar Sastry

Exploration algorithms for reinforcement learning typically replace or augment the reward function with an additional ``intrinsic'' reward that trains the agent to seek previously unseen states of the environment. Here, we consider an…

机器学习 · 计算机科学 2025-09-30 Kevin McKee , Eric Alt , Andrew Grebenisan , Mick van Gelderen , Gary Miguel