中文
相关论文

相关论文: Goal-conditioned Offline Planning from Curious Exp…

200 篇论文

Goal-Conditioned Reinforcement Learning (GCRL) provides a versatile framework for developing unified controllers capable of handling wide ranges of tasks, exploring environments, and adapting behaviors. However, its reliance on…

机器学习 · 计算机科学 2025-02-20 Charly Pecqueux-Guézénec , Stéphane Doncieux , Nicolas Perrin-Gilbert

While reinforcement learning algorithms provide automated acquisition of optimal policies, practical application of such methods requires a number of design decisions, such as manually designing reward functions that not only define the…

机器学习 · 计算机科学 2022-12-29 Tim G. J. Rudner , Vitchyr H. Pong , Rowan McAllister , Yarin Gal , Sergey Levine

Goal-conditioned reinforcement learning (RL) can solve tasks in a wide range of domains, including navigation and manipulation, but learning to reach distant goals remains a central challenge to the field. Learning to reach such goals is…

机器学习 · 计算机科学 2021-10-26 Tianjun Zhang , Benjamin Eysenbach , Ruslan Salakhutdinov , Sergey Levine , Joseph E. Gonzalez

Offline goal-conditioned reinforcement learning (GCRL) is a promising approach for pretraining generalist policies on large datasets of reward-free trajectories, akin to the self-supervised objectives used to train foundation models for…

机器学习 · 计算机科学 2026-01-05 John L. Zhou , Jonathan C. Kao

Offline goal-conditioned reinforcement learning (GCRL) aims at solving goal-reaching tasks with sparse rewards from an offline dataset. While prior work has demonstrated various approaches for agents to learn near-optimal policies, these…

机器人学 · 计算机科学 2024-03-05 Chenyang Cao , Zichen Yan , Renhao Lu , Junbo Tan , Xueqian Wang

This paper investigates exploration strategies of Deep Reinforcement Learning (DRL) methods to learn navigation policies for mobile robots. In particular, we augment the normal external reward for training DRL algorithms with intrinsic…

机器人学 · 计算机科学 2018-05-15 Oleksii Zhelo , Jingwei Zhang , Lei Tai , Ming Liu , Wolfram Burgard

The Exploration-Exploitation tradeoff arises in Reinforcement Learning when one cannot tell if a policy is optimal. Then, there is a constant need to explore new actions instead of exploiting past experience. In practice, it is common to…

机器学习 · 计算机科学 2019-09-10 Lior Shani , Yonathan Efroni , Shie Mannor

Intrinsically motivated goal exploration algorithms enable machines to discover repertoires of policies that produce a diversity of effects in complex environments. These exploration algorithms have been shown to allow real world robots to…

机器学习 · 计算机科学 2018-10-11 Alexandre Péré , Sébastien Forestier , Olivier Sigaud , Pierre-Yves Oudeyer

Offline Reinforcement Learning (RL) aims at learning an optimal control from a fixed dataset, without interactions with the system. An agent in this setting should avoid selecting actions whose consequences cannot be predicted from the…

A practical approach to robot reinforcement learning is to first collect a large batch of real or simulated robot interaction data, using some data collection policy, and then learn from this data to perform various tasks, using offline…

机器人学 · 计算机科学 2021-06-02 Shadi Endrawis , Gal Leibovich , Guy Jacob , Gal Novik , Aviv Tamar

Offline Reinforcement Learning (ORL) enablesus to separately study the two interlinked processes of reinforcement learning: collecting informative experience and inferring optimal behaviour. The second step has been widely studied in the…

Offline goal-conditioned reinforcement learning (GCRL) promises general-purpose skill learning in the form of reaching diverse goals from purely offline datasets. We propose $\textbf{Go}$al-conditioned $f$-$\textbf{A}$dvantage…

机器学习 · 计算机科学 2022-11-11 Yecheng Jason Ma , Jason Yan , Dinesh Jayaraman , Osbert Bastani

A default assumption in the design of reinforcement-learning algorithms is that a decision-making agent always explores to learn optimal behavior. In sufficiently complex environments that approach the vastness and scale of the real world,…

机器学习 · 计算机科学 2024-07-23 Dilip Arumugam , Saurabh Kumar , Ramki Gummadi , Benjamin Van Roy

Goal-conditioned policies are used in order to break down complex reinforcement learning (RL) problems by using subgoals, which can be defined either in state space or in a latent feature space. This can increase the efficiency of learning…

机器学习 · 计算机科学 2020-06-04 Srinivas Venkattaramanujam , Eric Crawford , Thang Doan , Doina Precup

Offline goal-conditioned reinforcement learning (GCRL) can be challenging due to overfitting to the given dataset. To generalize agents' skills outside the given dataset, we propose a goal-swapping procedure that generates additional…

机器学习 · 计算机科学 2023-02-20 Wenyan Yang , Huiling Wang , Dingding Cai , Joni Pajarinen , Joni-Kristen Kämäräinen

Goal-conditioned reinforcement learning (RL) concerns the problem of training an agent to maximize the probability of reaching target goal states. This paper presents an analysis of the goal-conditioned setting based on optimal control. In…

机器学习 · 计算机科学 2026-05-15 Nathan P. Lawrence , Ali Mesbah

Causal inference is crucial for humans to explore the world, which can be modeled to enable an agent to efficiently explore the environment in reinforcement learning. Existing research indicates that establishing the causality between…

机器学习 · 计算机科学 2025-08-14 Yan Yu , Yaodong Yang , Zhengbo Lu , Chengdong Ma , Wengang Zhou , Houqiang Li

Goal-conditioned reinforcement learning (GCRL) refers to learning general-purpose skills that aim to reach diverse goals. In particular, offline GCRL only requires purely pre-collected datasets to perform training tasks without additional…

机器学习 · 计算机科学 2023-10-13 Hanlin Zhu , Amy Zhang

We consider a class of reinforcement-learning systems in which the agent follows a behavior policy to explore a discrete state-action space to find an optimal policy while adhering to some restriction on its behavior. Such restriction may…

机器学习 · 计算机科学 2023-04-07 Peter C. Y. Chen

It has been a long-standing dream to design artificial agents that explore their environment efficiently via intrinsic motivation, similar to how children perform curious free play. Despite recent advances in intrinsically motivated…

机器学习 · 计算机科学 2022-11-29 Cansu Sancaktar , Sebastian Blaes , Georg Martius