中文
相关论文

相关论文: Planning in Hierarchical Reinforcement Learning: G…

200 篇论文

Reinforcement learning policies are often represented by neural networks, but programmatic policies are preferred in some cases because they are more interpretable, amenable to formal verification, or generalize better. While efficient…

人工智能 · 计算机科学 2022-01-19 Rasmus Larsen , Mikkel Nørgaard Schmidt

We study the problem of representation learning in goal-conditioned hierarchical reinforcement learning. In such hierarchical structures, a higher-level controller solves tasks by iteratively communicating goals which a lower-level policy…

人工智能 · 计算机科学 2019-01-10 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

We present a principled and efficient planning algorithm for collaborative multiagent dynamical systems. All computation, during both the planning and the execution phases, is distributed among the agents; each agent only needs to model and…

人工智能 · 计算机科学 2013-01-07 Carlos E. Guestrin , Geoffrey Gordon

Reinforcement learning with sparse rewards is challenging because an agent can rarely obtain non-zero rewards and hence, gradient-based optimization of parameterized policies can be incremental and slow. Recent work demonstrated that using…

机器学习 · 计算机科学 2021-02-16 Yijie Guo , Jongwook Choi , Marcin Moczulski , Shengyu Feng , Samy Bengio , Mohammad Norouzi , Honglak Lee

Backtracking search algorithms are often used to solve the Constraint Satisfaction Problem (CSP). The efficiency of backtracking search depends greatly on the variable ordering heuristics. Currently, the most commonly used heuristics are…

人工智能 · 计算机科学 2021-12-28 Wen Song , Zhiguang Cao , Jie Zhang , Andrew Lim

This paper addresses the problem of optimal control of robotic sensing systems aimed at autonomous information gathering in scenarios such as environmental monitoring, search and rescue, and surveillance and reconnaissance. The information…

系统与控制 · 计算机科学 2016-01-28 Mikko Lauri , Nikolay Atanasov , George J. Pappas , Risto Ritala

Understanding a \textit{reinforcement learning} policy, which guides state-to-action mappings to maximize rewards, necessitates an accompanying explanation for human comprehension. In this paper, we introduce a set of \textit{linear…

人工智能 · 计算机科学 2025-05-01 Mikihisa Yuasa , Huy T. Tran , Ramavarapu S. Sreenivas

We consider the problem of steering a system with unknown, stochastic dynamics to satisfy a rich, temporally layered task given as a signal temporal logic formula. We represent the system as a Markov decision process in which the states are…

系统与控制 · 计算机科学 2015-10-23 Austin Jones , Derya Aksaray , Zhaodan Kong , Mac Schwager , Calin Belta

While reinforcement learning algorithms provide automated acquisition of optimal policies, practical application of such methods requires a number of design decisions, such as manually designing reward functions that not only define the…

机器学习 · 计算机科学 2022-12-29 Tim G. J. Rudner , Vitchyr H. Pong , Rowan McAllister , Yarin Gal , Sergey Levine

Policy gradient (PG) methods are successful approaches to deal with continuous reinforcement learning (RL) problems. They learn stochastic parametric (hyper)policies by either exploring in the space of actions or in the space of parameters.…

机器学习 · 计算机科学 2024-05-31 Alessandro Montenegro , Marco Mussi , Alberto Maria Metelli , Matteo Papini

Reinforcement Learning, a machine learning framework for training an autonomous agent based on rewards, has shown outstanding results in various domains. However, it is known that learning a good policy is difficult in a domain where…

机器学习 · 计算机科学 2019-06-27 Takahisa Imagawa , Takuya Hiraoka , Yoshimasa Tsuruoka

A reinforcement learning agent tries to maximize its cumulative payoff by interacting in an unknown environment. It is important for the agent to explore suboptimal actions as well as to pick actions with highest known rewards. Yet, in…

机器学习 · 计算机科学 2019-01-23 Reazul Hasan Russel

We study the offline data-driven sequential decision making problem in the framework of Markov decision process (MDP). In order to enhance the generalizability and adaptivity of the learned policy, we propose to evaluate each policy by a…

统计理论 · 数学 2021-11-11 Zhengling Qi , Peng Liao

We address the problem of reinforcement learning in which observations may exhibit an arbitrary form of stochastic dependence on past observations and actions, i.e. environments more general than (PO)MDPs. The task for an agent is to attain…

机器学习 · 计算机科学 2009-12-30 Daniil Ryabko , Marcus Hutter

Driving in dense traffic with human and autonomous drivers is a challenging task that requires high-level planning and reasoning. Human drivers can achieve this task comfortably, and there has been many efforts to model human driver…

机器学习 · 计算机科学 2024-10-28 Yigit Gurses , Kaan Buyukdemirci , Yildiray Yildiz

We address the problem of learning hierarchical deep neural network policies for reinforcement learning. In contrast to methods that explicitly restrict or cripple lower layers of a hierarchy to force them to use higher-level modulating…

机器学习 · 计算机科学 2018-09-05 Tuomas Haarnoja , Kristian Hartikainen , Pieter Abbeel , Sergey Levine

The subject of this paper is reinforcement learning. Policies are considered here that produce actions based on states and random elements autocorrelated in subsequent time instants. Consequently, an agent learns from experiments that are…

机器学习 · 计算机科学 2020-09-11 Marcin Szulc , Jakub Łyskawa , Paweł Wawrzyński

Policy optimization is a core component of reinforcement learning (RL), and most existing RL methods directly optimize parameters of a policy based on maximizing the expected total reward, or its surrogate. Though often achieving…

机器学习 · 计算机科学 2018-08-10 Ruiyi Zhang , Changyou Chen , Chunyuan Li , Lawrence Carin

It is well known that reinforcement learning can be cast as inference in an appropriate probabilistic model. However, this commonly involves introducing a distribution over agent trajectories with probabilities proportional to exponentiated…

人工智能 · 计算机科学 2021-10-07 David Tolpin , Tomer Dobkin

Reactive synthesis algorithms allow automatic construction of policies to control an environment modeled as a Markov Decision Process (MDP) that are optimal with respect to high-level temporal logic specifications. However, they assume that…

形式语言与自动机理论 · 计算机科学 2022-05-31 Rajeev Alur , Suguman Bansal , Osbert Bastani , Kishor Jothimurugan