English
Related papers

Related papers: Hierarchical Approaches for Reinforcement Learning…

200 papers

Hierarchical reinforcement learning has been a compelling approach for achieving goal directed behavior over long sequences of actions. However, it has been challenging to implement in realistic or open-ended environments. A main challenge…

Machine Learning · Computer Science 2023-09-22 Arun Ahuja , Kavya Kopparapu , Rob Fergus , Ishita Dasgupta

When Reinforcement Learning (RL) agents are deployed in practice, they might impact their environment and change its dynamics. We propose a new framework to model this phenomenon, where the current environment depends on the deployed policy…

Machine Learning · Computer Science 2024-06-03 Ben Rank , Stelios Triantafyllou , Debmalya Mandal , Goran Radanovic

Advances in reinforcement learning have led to its successful application in complex tasks with continuous state and action spaces. Despite these advances in practice, most theoretical work pertains to finite state and action spaces. We…

Machine Learning · Computer Science 2024-08-13 Saket Tiwari , Omer Gottesman , George Konidaris

Group Relative Policy Optimization (GRPO) has shown promise in discrete action spaces by eliminating value function dependencies through group-based advantage estimation. However, its application to continuous control remains unexplored,…

Robotics · Computer Science 2025-07-29 Rajat Khanda , Mohammad Baqar , Sambuddha Chakrabarti , Satyasaran Changdar

Distributional reinforcement learning (DRL) is a recent reinforcement learning framework whose success has been supported by various empirical studies. It relies on the key idea of replacing the expected return with the return distribution,…

Machine Learning · Computer Science 2020-01-09 Rahul Singh , Keuntaek Lee , Yongxin Chen

Autonomous vehicles are suited for continuous area patrolling problems. However, finding an optimal patrolling strategy can be challenging for many reasons. Firstly, patrolling environments are often complex and can include unknown…

Artificial Intelligence · Computer Science 2023-06-12 Chenhao Tong , Aaron Harwood , Maria A. Rodriguez , Richard O. Sinnott

Training intelligent agents through reinforcement learning is a notoriously unstable procedure. Massive parallelization on GPUs and distributed systems has been exploited to generate a large amount of training experiences and consequently…

Machine Learning · Computer Science 2019-02-08 Greg Heinrich , Iuri Frosio

Assigning resources in business processes execution is a repetitive task that can be effectively automated. However, different automation methods may give varying results that may not be optimal. Proper resource allocation is crucial as it…

Machine Learning · Computer Science 2021-04-02 Kamil Żbikowski , Michał Ostapowicz , Piotr Gawrysiak

A major goal of materials design is to find material structures with desired properties and in a second step to find a processing path to reach one of these structures. In this paper, we propose and investigate a deep reinforcement learning…

Machine Learning · Computer Science 2021-07-09 Johannes Dornheim , Lukas Morand , Samuel Zeitvogel , Tarek Iraki , Norbert Link , Dirk Helm

Deep reinforcement learning provides a promising approach for text-based games in studying natural language communication between humans and artificial agents. However, the generalization still remains a big challenge as the agents depend…

Computation and Language · Computer Science 2021-09-22 Yunqiu Xu , Meng Fang , Ling Chen , Yali Du , Chengqi Zhang

This paper addresses key challenges in task scheduling for multi-tenant distributed systems, including dynamic resource variation, heterogeneous tenant demands, and fairness assurance. An adaptive scheduling method based on reinforcement…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-13 Xiaopei Zhang , Xingang Wang , Xin Wang

Due to the sparse rewards and high degree of environment variation, reinforcement learning approaches such as Deep Deterministic Policy Gradient (DDPG) are plagued by issues of high variance when applied in complex real world environments.…

Robotics · Computer Science 2018-11-28 Linhai Xie , Yishu Miao , Sen Wang , Phil Blunsom , Zhihua Wang , Changhao Chen , Andrew Markham , Niki Trigoni

Bayesian approaches developed to solve the optimal design of sequential experiments are mathematically elegant but computationally challenging. Recently, techniques using amortization have been proposed to make these Bayesian approaches…

Machine Learning · Computer Science 2022-06-20 Tom Blau , Edwin V. Bonilla , Iadine Chades , Amir Dezfouli

Real-world tasks are often highly structured. Hierarchical reinforcement learning (HRL) has attracted research interest as an approach for leveraging the hierarchical structure of a given task in reinforcement learning (RL). However,…

Machine Learning · Computer Science 2019-03-08 Takayuki Osa , Voot Tangkaratt , Masashi Sugiyama

Model-based Bayesian reinforcement learning has generated significant interest in the AI community as it provides an elegant solution to the optimal exploration-exploitation tradeoff in classical reinforcement learning. Unfortunately, the…

Artificial Intelligence · Computer Science 2012-06-18 Stephane Ross , Joelle Pineau

Deep Reinforcement Learning (RL) algorithms can solve complex sequential decision tasks successfully. However, they have a major drawback of having poor sample efficiency which can often be tackled by knowledge reuse. In Multi-Agent…

Multiagent Systems · Computer Science 2019-05-30 Ercüment İlhan , Jeremy Gow , Diego Perez-Liebana

A challenge in multi-agent reinforcement learning is to be able to generalize over intractable state-action spaces. Inspired from Tesseract [Mahajan et al., 2021], this position paper investigates generalisation in state-action space over…

Machine Learning · Computer Science 2021-10-28 Pascal Van Der Vaart , Anuj Mahajan , Shimon Whiteson

The aim of multi-task reinforcement learning is two-fold: (1) efficiently learn by training against multiple tasks and (2) quickly adapt, using limited samples, to a variety of new tasks. In this work, the tasks correspond to reward…

Machine Learning · Computer Science 2019-11-05 Nicholas C. Landolfi , Garrett Thomas , Tengyu Ma

Deep reinforcement learning has shown remarkable success in the past few years. Highly complex sequential decision making problems from game playing and robotics have been solved with deep model-free methods. Unfortunately, the sample…

Machine Learning · Computer Science 2021-07-20 Aske Plaat , Walter Kosters , Mike Preuss

Existing studies on constrained reinforcement learning (RL) may obtain a well-performing policy in the training environment. However, when deployed in a real environment, it may easily violate constraints that were originally satisfied…

Machine Learning · Computer Science 2024-05-06 Zhongchang Sun , Sihong He , Fei Miao , Shaofeng Zou