English
Related papers

Related papers: Hierarchical Reinforcement Learning: Approximating…

200 papers

Reinforcement Learning algorithms are primarily focused on learning a policy that maximizes expected return. As a result, the learned policy can exploit one or few reward sources. However, in many natural situations, it is desirable to…

Machine Learning · Computer Science 2026-03-31 Sagalpreet Singh , Rishi Saket , Aravindan Raghuveer

Although in recent years reinforcement learning has become very popular the number of successful applications to different kinds of operations research problems is rather scarce. Reinforcement learning is based on the well-studied dynamic…

Machine Learning · Computer Science 2020-04-03 Manuel Schneckenreither

Local Policy Search is a popular reinforcement learning approach for handling large state spaces. Formally, it searches locally in a paramet erized policy space in order to maximize the associated value function averaged over some…

Machine Learning · Computer Science 2013-06-07 Bruno Scherrer , Matthieu Geist

Maximum entropy reinforcement learning integrates exploration into policy learning by providing additional intrinsic rewards proportional to the entropy of some distribution. In this paper, we propose a novel approach in which the intrinsic…

Machine Learning · Computer Science 2025-09-30 Adrien Bolland , Gaspard Lambrechts , Damien Ernst

To date, distributional reinforcement learning (distributional RL) methods have exclusively focused on the discounted setting, where an agent aims to optimize a discounted sum of rewards over time. In this work, we extend distributional RL…

Machine Learning · Computer Science 2026-01-14 Juan Sebastian Rojas , Chi-Guhn Lee

Explaining the behavior of reinforcement learning agents operating in sequential decision-making settings is challenging, as their behavior is affected by a dynamic environment and delayed rewards. Methods that help users understand the…

Machine Learning · Computer Science 2024-02-28 Yael Septon , Tobias Huber , Elisabeth André , Ofra Amir

Despite advances in hierarchical reinforcement learning, its applications to path planning in autonomous driving on highways are challenging. One reason is that conventional hierarchical reinforcement learning approaches are not amenable to…

Machine Learning · Computer Science 2021-11-11 Jaehyun Kim , Jaeseung Jeong

One of the key challenges in applying reinforcement learning to real-life problems is that the amount of train-and-error required to learn a good policy increases drastically as the task becomes complex. One potential solution to this…

Machine Learning · Computer Science 2018-06-29 Kazeto Yamamoto , Takashi Onishi , Yoshimasa Tsuruoka

Designing optimal reward functions has been desired but extremely difficult in reinforcement learning (RL). When it comes to modern complex tasks, sophisticated reward functions are widely used to simplify policy learning yet even a tiny…

Machine Learning · Computer Science 2021-09-07 Ning Wei , Jiahua Liang , Di Xie , Shiliang Pu

We address the problem of learning hierarchical deep neural network policies for reinforcement learning. In contrast to methods that explicitly restrict or cripple lower layers of a hierarchy to force them to use higher-level modulating…

Machine Learning · Computer Science 2018-09-05 Tuomas Haarnoja , Kristian Hartikainen , Pieter Abbeel , Sergey Levine

Reinforcement learning (RL) aims to estimate the action to take given a (time-varying) state, with the goal of maximizing a cumulative reward function. Predominantly, there are two families of algorithms to solve RL problems: value-based…

Machine Learning · Computer Science 2025-01-10 Sergio Rozada , Hoi-To Wai , Antonio G. Marques

We consider the joint design and control of discrete-time stochastic dynamical systems over a finite time horizon. We formulate the problem as a multi-step optimization problem under uncertainty seeking to identify a system design and a…

Machine Learning · Computer Science 2022-01-07 Adrien Bolland , Ioannis Boukas , Mathias Berger , Damien Ernst

The use of deep neural networks as function approximators has led to striking progress for reinforcement learning algorithms and applications. Yet the knowledge we have on decision boundary geometry and the loss landscape of neural policies…

Machine Learning · Computer Science 2021-12-17 Ezgi Korkmaz

Recently, deep reinforcement learning (DRL) frameworks have shown potential for solving NP-hard routing problems such as the traveling salesman problem (TSP) without problem-specific expert knowledge. Although DRL can be used to solve…

Machine Learning · Computer Science 2021-10-28 Minsu Kim , Jinkyoo Park , Joungho Kim

The endeavor of artificial intelligence (AI) is to design autonomous agents capable of achieving complex tasks. Namely, reinforcement learning (RL) proposes a theoretical background to learn optimal behaviors. In practice, RL algorithms…

Machine Learning · Computer Science 2022-09-27 Firas Jarboui , Ahmed Akakzia

Reinforcement learning (RL) is a central problem in artificial intelligence. This problem consists of defining artificial agents that can learn optimal behaviour by interacting with an environment -- where the optimal behaviour is defined…

The optimal objective is a fundamental aspect of reinforcement learning (RL), as it determines how policies are evaluated and optimized. While total return maximization is the ideal objective in RL, discounted return maximization is the…

Machine Learning · Computer Science 2025-03-19 Shuyu Yin , Fei Wen , Peilin Liu , Tao Luo

For robotic vehicles to navigate robustly and safely in unseen environments, it is crucial to decide the most suitable navigation policy. However, most existing deep reinforcement learning based navigation policies are trained with a…

Robotics · Computer Science 2023-10-31 Kyowoon Lee , Seongun Kim , Jaesik Choi

We study the problem of how to construct a set of policies that can be composed together to solve a collection of reinforcement learning tasks. Each task is a different reward function defined as a linear combination of known features. We…

Artificial Intelligence · Computer Science 2021-12-13 Tom Zahavy , Andre Barreto , Daniel J Mankowitz , Shaobo Hou , Brendan O'Donoghue , Iurii Kemaev , Satinder Singh

We study learning optimal policies from a logged dataset, i.e., offline RL, with function approximation. Despite the efforts devoted, existing algorithms with theoretic finite-sample guarantees typically assume exploratory data coverage or…

Machine Learning · Computer Science 2023-05-25 Chenjie Mao