中文
相关论文

相关论文: Task-agnostic Exploration in Reinforcement Learnin…

200 篇论文

In reinforcement learning, we typically refer to unsupervised pre-training when we aim to pre-train a policy without a priori access to the task specification, i.e. rewards, to be later employed for efficient learning of downstream tasks.…

机器学习 · 计算机科学 2025-10-21 Riccardo Zamboni , Mirco Mutti , Marcello Restelli

Designing a competent meta-reinforcement learning (meta-RL) algorithm in terms of data usage remains a central challenge to be tackled for its successful real-world applications. In this paper, we propose a sample-efficient meta-RL…

机器学习 · 计算机科学 2023-12-12 Jaeuk Shin , Giho Kim , Howon Lee , Joonho Han , Insoon Yang

Reinforcement Learning has emerged as a strong alternative to solve optimization tasks efficiently. The use of these algorithms highly depends on the feedback signals provided by the environment in charge of informing about how good (or…

机器学习 · 计算机科学 2022-12-01 Alain Andres , Esther Villar-Rodriguez , Javier Del Ser

We consider the problem of reinforcement learning under safety requirements, in which an agent is trained to complete a given task, typically formalized as the maximization of a reward signal over time, while concurrently avoiding…

Exploration is a fundamental challenge in reinforcement learning (RL). Many of the current exploration methods for deep RL use task-agnostic objectives, such as information gain or bonuses based on state visitation. However, many practical…

机器学习 · 计算机科学 2018-02-21 Abhishek Gupta , Russell Mendonca , YuXuan Liu , Pieter Abbeel , Sergey Levine

Reinforcement learning (RL) and Deep Reinforcement Learning (DRL), in particular, have the potential to disrupt and are already changing the way we interact with the world. One of the key indicators of their applicability is their ability…

机器学习 · 计算机科学 2024-08-20 Nikolai Rozanov

There has been growing progress on theoretical analyses for provably efficient learning in MDPs with linear function approximation, but much of the existing work has made strong assumptions to enable exploration by conventional exploration…

机器学习 · 计算机科学 2020-10-23 Andrea Zanette , Alessandro Lazaric , Mykel J. Kochenderfer , Emma Brunskill

We consider reinforcement learning (RL) in continuous time and study the problem of achieving the best trade-off between exploration of a black box environment and exploitation of current knowledge. We propose an entropy-regularized reward…

最优化与控制 · 数学 2019-02-14 Haoran Wang , Thaleia Zariphopoulou , Xunyu Zhou

Reinforcement Learning (RL) has demonstrated tremendous empirical success across numerous challenging domains. However, we lack a strong theoretical understanding of the statistical complexity of RL in environments with large state spaces,…

机器学习 · 计算机科学 2025-06-03 Gene Li

Exploration remains a key challenge in deep reinforcement learning (RL). Optimism in the face of uncertainty is a well-known heuristic with theoretical guarantees in the tabular setting, but how best to translate the principle to deep…

机器学习 · 计算机科学 2023-06-06 Brendan O'Donoghue

In reward-free reinforcement learning (RL), an agent explores the environment first without any reward information, in order to achieve certain learning goals afterwards for any given reward. In this paper we focus on reward-free RL under…

机器学习 · 计算机科学 2023-03-21 Yuan Cheng , Ruiquan Huang , Jing Yang , Yingbin Liang

Designing sample-efficient and computationally feasible reinforcement learning (RL) algorithms is particularly challenging in environments with large or infinite state and action spaces. In this paper, we advance this effort by presenting…

机器学习 · 计算机科学 2024-10-04 Zakaria Mhammedi

Reinforcement learning (RL) with sparse and deceptive rewards is challenging because non-zero rewards are rarely obtained. Hence, the gradient calculated by the agent can be stochastic and without valid information. Recent studies that…

机器学习 · 计算机科学 2024-02-08 Guojian Wang , Faguo Wu , Xiao Zhang , Jianxiang Liu

Incomplete knowledge of the environment leads an agent to make decisions under uncertainty. One of the major dilemmas in Reinforcement Learning (RL) where an autonomous agent has to balance two contrasting needs in making its decisions is:…

机器学习 · 统计学 2024-02-21 Valentina Zangirolami , Matteo Borrotti

A reinforcement learning agent tries to maximize its cumulative payoff by interacting in an unknown environment. It is important for the agent to explore suboptimal actions as well as to pick actions with highest known rewards. Yet, in…

机器学习 · 计算机科学 2019-01-23 Reazul Hasan Russel

Although parallelism has been extensively used in reinforcement learning (RL), the quantitative effects of parallel exploration are not well understood theoretically. We study the benefits of simple parallel exploration for reward-free RL…

机器学习 · 计算机科学 2023-03-03 Pedro Cisneros-Velarde , Boxiang Lyu , Sanmi Koyejo , Mladen Kolar

Deep reinforcement learning has been shown to solve challenging tasks where large amounts of training experience is available, usually obtained online while learning the task. Robotics is a significant potential application domain for many…

机器学习 · 计算机科学 2019-11-21 Vibhavari Dasagi , Robert Lee , Jake Bruce , Jürgen Leitner

Finding meaningful and accurate dense rewards is a fundamental task in the field of reinforcement learning (RL) that enables agents to explore environments more efficiently. In traditional RL settings, agents learn optimal policies through…

人工智能 · 计算机科学 2025-12-05 Shuyuan Zhang

In this paper, a unified framework for exploration in reinforcement learning (RL) is proposed based on an option-critic model. The proposed framework learns to integrate a set of diverse exploration strategies so that the agent can…

机器学习 · 计算机科学 2024-09-10 Woojun Kim , Jeonghye Kim , Youngchul Sung

A major challenge in reinforcement learning is exploration, when local dithering methods such as epsilon-greedy sampling are insufficient to solve a given task. Many recent methods have proposed to intrinsically motivate an agent to seek…

机器学习 · 计算机科学 2021-01-15 Riley Simmons-Edler , Ben Eisner , Daniel Yang , Anthony Bisulco , Eric Mitchell , Sebastian Seung , Daniel Lee