中文
相关论文

相关论文: Never Explore Repeatedly in Multi-Agent Reinforcem…

200 篇论文

We consider an agent's uncertainty about its environment and the problem of generalizing this uncertainty across observations. Specifically, we focus on the problem of exploration in non-tabular reinforcement learning. Drawing inspiration…

人工智能 · 计算机科学 2018-07-11 Marc G. Bellemare , Sriram Srinivasan , Georg Ostrovski , Tom Schaul , David Saxton , Remi Munos

In the last few years, the research activity around reinforcement learning tasks formulated over environments with sparse rewards has been especially notable. Among the numerous approaches proposed to deal with these hard exploration…

机器学习 · 计算机科学 2022-11-22 Alain Andres , Esther Villar-Rodriguez , Javier Del Ser

In this paper we address the challenge of exploration in deep reinforcement learning for robotic manipulation tasks. In sparse goal settings, an agent does not receive any positive feedback until randomly achieving the goal, which becomes…

机器人学 · 计算机科学 2021-02-23 Nikola Vulin , Sammy Christen , Stefan Stevsic , Otmar Hilliges

The objective of a reinforcement learning agent is to behave so as to maximise the sum of a suitable scalar function of state: the reward. These rewards are typically given and immutable. In this paper, we instead consider the proposition…

人工智能 · 计算机科学 2020-08-25 Zeyu Zheng , Junhyuk Oh , Matteo Hessel , Zhongwen Xu , Manuel Kroiss , Hado van Hasselt , David Silver , Satinder Singh

High-dimensional observations and complex real-world dynamics present major challenges in reinforcement learning for both function approximation and exploration. We address both of these challenges with two complementary techniques: First,…

人工智能 · 计算机科学 2016-03-15 David Abel , Alekh Agarwal , Fernando Diaz , Akshay Krishnamurthy , Robert E. Schapire

Reinforcement Learning (RL) is known to be often unsuccessful in environments with sparse extrinsic rewards. A possible countermeasure is to endow RL agents with an intrinsic reward function, or 'intrinsic motivation', which rewards the…

人工智能 · 计算机科学 2021-07-16 Francesco Massari , Martin Biehl , Lisa Meeden , Ryota Kanai

Exploration is essential in reinforcement learning as an agent relies on trial and error to learn an optimal policy. However, when rewards are sparse, naive exploration strategies, like noise injection, are often insufficient. Intrinsic…

机器学习 · 计算机科学 2026-01-30 Minjae Cho , Huy Trong Tran

Extrinsic rewards can effectively guide reinforcement learning (RL) agents in specific tasks. However, extrinsic rewards frequently fall short in complex environments due to the significant human effort needed for their design and…

机器学习 · 计算机科学 2025-04-28 Mingqi Yuan , Roger Creus Castanyer , Bo Li , Xin Jin , Wenjun Zeng , Glen Berseth

Finding meaningful and accurate dense rewards is a fundamental task in the field of reinforcement learning (RL) that enables agents to explore environments more efficiently. In traditional RL settings, agents learn optimal policies through…

人工智能 · 计算机科学 2025-12-05 Shuyuan Zhang

Intrinsic motivation enables reinforcement learning (RL) agents to explore when rewards are very sparse, where traditional exploration heuristics such as Boltzmann or e-greedy would typically fail. However, intrinsic exploration is…

机器学习 · 计算机科学 2020-04-07 Philippe Morere , Fabio Ramos

One of the bottlenecks preventing Deep Reinforcement Learning algorithms (DRL) from real-world applications is how to explore the environment and collect informative transitions efficiently. The present paper describes bounded exploration,…

机器学习 · 计算机科学 2024-12-10 Ting Qiao , Henry Williams , David Valencia , Bruce MacDonald

Efficient exploration remains a challenging research problem in reinforcement learning, especially when an environment contains large state spaces, deceptive local optima, or sparse rewards. To tackle this problem, we present a…

人工智能 · 计算机科学 2018-10-30 Zhang-Wei Hong , Tzu-Yun Shann , Shih-Yang Su , Yi-Hsiang Chang , Chun-Yi Lee

Reinforcement learning has enabled agents to solve challenging tasks in unknown environments. However, manually crafting reward functions can be time consuming, expensive, and error prone to human error. Competing objectives have been…

机器学习 · 计算机科学 2021-02-11 Brendon Matusch , Jimmy Ba , Danijar Hafner

To achieve sample efficiency in reinforcement learning (RL), it necessitates efficiently exploring the underlying environment. Under the offline setting, addressing the exploration challenge lies in collecting an offline dataset with…

机器学习 · 计算机科学 2022-02-15 Shuang Qiu , Jieping Ye , Zhaoran Wang , Zhuoran Yang

Reinforcement learning algorithms rely on carefully engineering environment rewards that are extrinsic to the agent. However, annotating each environment with hand-designed, dense rewards is not scalable, motivating the need for developing…

机器学习 · 计算机科学 2018-08-14 Yuri Burda , Harri Edwards , Deepak Pathak , Amos Storkey , Trevor Darrell , Alexei A. Efros

Learning in environments with sparse rewards remains a fundamental challenge in reinforcement learning. Artificial curiosity addresses this limitation through intrinsic rewards to guide exploration, however, the precise formulation of these…

机器学习 · 计算机科学 2026-04-20 Alexander Nedergaard , Pablo A. Morales

Exploration of indoor environments has recently experienced a significant interest, also thanks to the introduction of deep neural agents built in a hierarchical fashion and trained with Deep Reinforcement Learning (DRL) on simulated…

Exploration is essential in reinforcement learning, particularly in environments where external rewards are sparse. Here we focus on exploration with intrinsic rewards, where the agent transiently augments the external rewards with…

机器学习 · 计算机科学 2024-01-26 Changmin Yu , Neil Burgess , Maneesh Sahani , Samuel J. Gershman

One obstacle to applying reinforcement learning algorithms to real-world problems is the lack of suitable reward functions. Designing such reward functions is difficult in part because the user only has an implicit understanding of the task…

机器学习 · 计算机科学 2018-11-20 Jan Leike , David Krueger , Tom Everitt , Miljan Martic , Vishal Maini , Shane Legg

We consider a setting for Inverse Reinforcement Learning (IRL) where the learner is extended with the ability to actively select multiple environments, observing an agent's behavior on each environment. We first demonstrate that if the…

人工智能 · 计算机科学 2016-01-26 Kareem Amin , Satinder Singh