中文
相关论文

相关论文: Improving Intrinsic Exploration by Creating Statio…

200 篇论文

This paper proposes \emph{Episodic and Lifelong Exploration via Maximum ENTropy} (ELEMENT), a novel, multiscale, intrinsically motivated reinforcement learning (RL) framework that is able to explore environments without using any extrinsic…

机器学习 · 计算机科学 2024-12-06 Hongming Li , Shujian Yu , Bin Liu , Jose C. Principe

In this paper, we propose SEA, a novel approach for active robot exploration through semantic map prediction and a reinforcement learning-based hierarchical exploration policy. Unlike existing learning-based methods that rely on one-step…

机器人学 · 计算机科学 2025-12-12 Hongyu Ding , Xinyue Liang , Yudong Fang , You Wu , Jieqi Shi , Jing Huo , Wenbin Li , Jing Wu , Yu-Kun Lai , Yang Gao

Model-based reinforcement learning algorithms are typically more sample efficient than their model-free counterparts, especially in sparse reward problems. Unfortunately, many interesting domains are too complex to specify the complete…

机器学习 · 计算机科学 2022-03-11 Andrew Chester , Michael Dann , Fabio Zambetta , John Thangarajah

Balancing exploration and exploitation is a fundamental part of reinforcement learning, yet most state-of-the-art algorithms use a naive exploration protocol like $\epsilon$-greedy. This contributes to the problem of high sample complexity,…

机器学习 · 计算机科学 2019-11-21 Tom Blau , Lionel Ott , Fabio Ramos

This paper reviews exploration techniques in deep reinforcement learning. Exploration techniques are of primary importance when solving sparse reward problems. In sparse reward problems, the reward is rare, which means that the agent will…

机器学习 · 计算机科学 2022-05-03 Pawel Ladosz , Lilian Weng , Minwoo Kim , Hyondong Oh

In the Reinforcement Learning (RL) framework, the learning is guided through a reward signal. This means that in situations of sparse rewards the agent has to focus on exploration, in order to discover which action, or set of actions leads…

机器学习 · 计算机科学 2022-03-03 Giuseppe Paolo

Offline reinforcement learning methods typically enforce strict constraints to ensure safety; yet this rigidity often prevents the discovery of optimal behaviors outside the immediate support of the behavior policy. To address this, we…

机器学习 · 计算机科学 2026-05-19 Yifei Chen , Shaoqin Zhu , Xiaoqiang Ji

One of the main challenges in reinforcement learning is solving tasks with sparse reward. We show that the difficulty of discovering a distant rewarding state in an MDP is bounded by the expected cover time of a random walk over the graph…

人工智能 · 计算机科学 2019-03-19 Yuu Jinnai , Jee Won Park , David Abel , George Konidaris

Effective exploration is crucial to discovering optimal strategies for multi-agent reinforcement learning (MARL) in complex coordination tasks. Existing methods mainly utilize intrinsic rewards to enable committed exploration or use…

机器学习 · 计算机科学 2024-03-04 Zeyang Liu , Lipeng Wan , Xinrui Yang , Zhuoran Chen , Xingyu Chen , Xuguang Lan

Reinforcement learning can solve decision-making problems and train an agent to behave in an environment according to a predesigned reward function. However, such an approach becomes very problematic if the reward is too sparse and so the…

人工智能 · 计算机科学 2024-06-12 Matej Pecháč , Michal Chovanec , Igor Farkaš

In multi-agent reinforcement learning (MARL), effective exploration is critical, especially in sparse reward environments. Although introducing global intrinsic rewards can foster exploration in such settings, it often complicates credit…

机器学习 · 计算机科学 2024-05-29 Xinran Li , Zifan Liu , Shibo Chen , Jun Zhang

All reinforcement learning algorithms must handle the trade-off between exploration and exploitation. Many state-of-the-art deep reinforcement learning methods use noise in the action selection, such as Gaussian noise in policy gradient…

机器学习 · 计算机科学 2018-04-05 Trevor Barron , Oliver Obst , Heni Ben Amor

Efficient exploration is a challenging topic in reinforcement learning, especially for sparse reward tasks. To deal with the reward sparsity, people commonly apply intrinsic rewards to motivate agents to explore the state space efficiently.…

机器学习 · 计算机科学 2023-08-29 Yao Fu , Run Peng , Honglak Lee

A central challenge in reinforcement learning is discovering effective policies for tasks where rewards are sparsely distributed. We postulate that in the absence of useful reward signals, an effective exploration strategy should seek out…

Mastering deep reinforcement learning (DRL) proves challenging in tasks featuring scant rewards. These limited rewards merely signify whether the task is partially or entirely accomplished, necessitating various exploration actions before…

机器学习 · 计算机科学 2024-04-11 Guojian Wang , Faguo Wu , Xiao Zhang

Sparse reward is one of the biggest challenges in reinforcement learning (RL). In this paper, we propose a novel method called Generative Exploration and Exploitation (GENE) to overcome sparse reward. GENE automatically generates start…

机器学习 · 计算机科学 2019-11-21 Jiechuan Jiang , Zongqing Lu

Exploration in environments with continuous control and sparse rewards remains a key challenge in reinforcement learning (RL). Recently, surprise has been used as an intrinsic reward that encourages systematic and efficient exploration. We…

机器学习 · 计算机科学 2019-11-01 Haitao Xu , Brendan McCane , Lech Szymanski

Learning in environments with sparse rewards remains a fundamental challenge in reinforcement learning. Artificial curiosity addresses this limitation through intrinsic rewards to guide exploration, however, the precise formulation of these…

机器学习 · 计算机科学 2026-04-20 Alexander Nedergaard , Pablo A. Morales

Positive affect has been linked to increased interest, curiosity and satisfaction in human learning. In reinforcement learning, extrinsic rewards are often sparse and difficult to define, intrinsically motivated learning can help address…

计算机视觉与模式识别 · 计算机科学 2021-04-06 Dean Zadok , Daniel McDuff , Ashish Kapoor

One effective approach for equipping artificial agents with sensorimotor skills is to use self-exploration. To do this efficiently is critical, as time and data collection are costly. In this study, we propose an exploration mechanism that…

机器人学 · 计算机科学 2021-02-18 Melisa Sener , Yukie Nagai , Erhan Oztop , Emre Ugur