中文
相关论文

相关论文: Learning Transferable Domain Priors for Safe Explo…

200 篇论文

In robotics, it is often not possible to learn useful policies using pure model-free reinforcement learning without significant reward shaping or curriculum learning. As a consequence, many researchers rely on expert demonstrations to guide…

机器人学 · 计算机科学 2021-04-20 Ondrej Biza , Dian Wang , Robert Platt , Jan-Willem van de Meent , Lawson L. S. Wong

In this paper, we present a new approach to Transfer Learning (TL) in Reinforcement Learning (RL) for cross-domain tasks. Many of the available techniques approach the transfer architecture as a method of speeding up the target task…

人工智能 · 计算机科学 2018-01-23 Girish Joshi , Girish Chowdhary

Random exploration is one of the main mechanisms through which reinforcement learning (RL) finds well-performing policies. However, it can lead to undesirable or catastrophic outcomes when learning online in safety-critical environments. In…

机器学习 · 计算机科学 2021-07-15 Djordje Grbic , Sebastian Risi

Learning a reward function from human preferences is challenging as it typically requires having a high-fidelity simulator or using expensive and potentially unsafe actual physical rollouts in the environment. However, in many tasks the…

机器学习 · 计算机科学 2023-01-05 Daniel Shin , Anca D. Dragan , Daniel S. Brown

We propose a probabilistic framework to directly insert prior knowledge in reinforcement learning (RL) algorithms by defining the behaviour policy as a Bayesian posterior distribution. Such a posterior combines task specific information…

机器学习 · 计算机科学 2018-10-02 Michalis K. Titsias , Sotirios Nikoloutsopoulos

Human ability at solving complex tasks is helped by priors on object and event semantics of their environment. This paper investigates the use of similar prior knowledge for transfer learning in Reinforcement Learning agents. In particular,…

机器学习 · 计算机科学 2019-06-18 Samy Badreddine , Michael Spranger

A crucial challenge in reinforcement learning is to reduce the number of interactions with the environment that an agent requires to master a given task. Transfer learning proposes to address this issue by re-using knowledge from previously…

机器学习 · 计算机科学 2023-04-28 Remo Sasso , Matthia Sabatelli , Marco A. Wiering

In this paper, we study the Tiered Reinforcement Learning setting, a parallel transfer learning framework, where the goal is to transfer knowledge from the low-tier (source) task to the high-tier (target) task to reduce the exploration risk…

机器学习 · 计算机科学 2024-06-14 Jiawei Huang , Niao He

Reinforcement learning (RL) algorithms typically start tabula rasa, without any prior knowledge of the environment, and without any prior skills. This however often leads to low sample efficiency, requiring a large amount of interaction…

机器学习 · 计算机科学 2020-07-13 Matthias Hutsebaut-Buysse , Kevin Mets , Steven Latré

Standard reinforcement learning (RL) optimizes policies for reward but imposes few constraints on how decisions evolve over time. As a result, policies may achieve high performance while exhibiting temporally incoherent behavior such as…

机器学习 · 计算机科学 2026-04-24 Sukesh Subaharan

In reinforcement learning, pre-trained low-level skills have the potential to greatly facilitate exploration. However, prior knowledge of the downstream task is required to strike the right balance between generality (fine-grained control)…

机器学习 · 计算机科学 2021-10-22 Jonas Gehring , Gabriel Synnaeve , Andreas Krause , Nicolas Usunier

Policy search reinforcement learning allows robots to acquire skills by themselves. However, the learning procedure is inherently unsafe as the robot has no a-priori way to predict the consequences of the exploratory actions it takes.…

机器人学 · 计算机科学 2018-10-09 Jens Lundell , Robert Krug , Erik Schaffernicht , Todor Stoyanov , Ville Kyrki

Several recent works have been dedicated to unsupervised reinforcement learning in a single environment, in which a policy is first pre-trained with unsupervised interactions, and then fine-tuned towards the optimal policy for several…

机器学习 · 计算机科学 2021-12-17 Mirco Mutti , Mattia Mancassola , Marcello Restelli

Efficient and robust policy transfer remains a key challenge for reinforcement learning to become viable for real-wold robotics. Policy transfer through warm initialization, imitation, or interacting over a large set of agents with…

机器学习 · 计算机科学 2021-05-12 Girish Joshi , Girish Chowdhary

In this paper, we consider a transfer reinforcement learning problem involving agents with different action spaces. Specifically, for any new unseen task, the goal is to use a successful demonstration of this task by an expert agent in its…

机器学习 · 计算机科学 2024-10-21 Kavinayan P. Sivakumar , Yan Zhang , Zachary Bell , Scott Nivison , Michael M. Zavlanos

Safe reinforcement learning is a promising path toward applying reinforcement learning algorithms to real-world problems, where suboptimal behaviors may lead to actual negative consequences. In this work, we focus on the setting where…

机器学习 · 计算机科学 2022-02-17 Garrett Thomas , Yuping Luo , Tengyu Ma

In lifelong learning, an agent learns throughout its entire life without resets, in a constantly changing environment, as we humans do. Consequently, lifelong learning comes with a plethora of research problems such as continual domain…

As we deploy reinforcement learning agents to solve increasingly challenging problems, methods that allow us to inject prior knowledge about the structure of the world and effective solution strategies becomes increasingly important. In…

Transfer learning (TL) is a promising way to improve the sample efficiency of reinforcement learning. However, how to efficiently transfer knowledge across tasks with different state-action spaces is investigated at an early stage. Most…

机器学习 · 计算机科学 2021-05-11 Yu Chen , Yingfeng Chen , Zhipeng Hu , Tianpei Yang , Changjie Fan , Yang Yu , Jianye Hao

Safety is an essential component for deploying reinforcement learning (RL) algorithms in real-world scenarios, and is critical during the learning process itself. A natural first approach toward safe RL is to manually specify constraints on…

机器学习 · 计算机科学 2020-10-29 Krishnan Srinivasan , Benjamin Eysenbach , Sehoon Ha , Jie Tan , Chelsea Finn