English
Related papers

Related papers: D3HRL: A Distributed Hierarchical Reinforcement Le…

200 papers

This paper investigates the application of Deep Reinforcement Learning (DRL) to classical inventory management problems, with a focus on practical implementation considerations. We apply a DRL algorithm based on DirectBackprop to several…

Cloud computing has revolutionized the provisioning of computing resources, offering scalable, flexible, and on-demand services to meet the diverse requirements of modern applications. At the heart of efficient cloud operations are job…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Yan Gu , Zhaoze Liu , Shuhong Dai , Cong Liu , Ying Wang , Shen Wang , Georgios Theodoropoulos , Long Cheng

This paper presents a novel hierarchical deep reinforcement learning (DRL) based design for the voltage control of power grids. DRL agents are trained for fast, and adaptive selection of control actions such that the voltage recovery…

Systems and Control · Electrical Eng. & Systems 2021-02-02 Sayak Mukherjee , Renke Huang , Qiuhua Huang , Thanh Long Vu , Tianzhixi Yin

Goal-conditioned reinforcement learning (GCRL) with sparse rewards remains a fundamental challenge in reinforcement learning. While hindsight experience replay (HER) has shown promise by relabeling collected trajectories with achieved…

Machine Learning · Computer Science 2025-08-11 Xing Lei , Wenyan Yang , Kaiqiang Ke , Shentao Yang , Xuetao Zhang , Joni Pajarinen , Donglin Wang

Order picking is a pivotal operation in warehouses that directly impacts overall efficiency and profitability. This study addresses the dynamic order picking problem, a significant concern in modern warehouse management, where real-time…

Optimization and Control · Mathematics 2025-04-08 Sasan Mahmoudinazlou , Abhay Sobhanan , Hadi Charkhgard , Ali Eshragh , George Dunn

When Reinforcement Learning (RL) agents are deployed in practice, they might impact their environment and change its dynamics. We propose a new framework to model this phenomenon, where the current environment depends on the deployed policy…

Machine Learning · Computer Science 2024-06-03 Ben Rank , Stelios Triantafyllou , Debmalya Mandal , Goran Radanovic

Hierarchies of temporally decoupled policies present a promising approach for enabling structured exploration in complex long-term planning problems. To fully achieve this approach an end-to-end training paradigm is needed. However,…

Machine Learning · Computer Science 2021-11-19 Abdul Rahman Kreidieh , Glen Berseth , Brandon Trabucco , Samyak Parajuli , Sergey Levine , Alexandre M. Bayen

Deep reinforcement learning has made significant strides in various robotic tasks. However, employing deep reinforcement learning methods to tackle multi-stage tasks still a challenge. Reinforcement learning algorithms often encounter…

Robotics · Computer Science 2025-03-06 Jiechao Deng , Ning Tan

This paper introduces an algorithm for discovering implicit and delayed causal relations between events observed by a robot at arbitrary times, with the objective of improving data-efficiency and interpretability of model-based…

Machine Learning · Computer Science 2020-08-05 Junchi Liang , Abdeslam Boularias

Deep reinforcement learning (DRL) is one promising approach to teaching robots to perform complex tasks. Because methods that directly reuse the stored experience data cannot follow the change of the environment in robotic problems with a…

Robotics · Computer Science 2022-01-26 Taisuke Kobayashi

Deep reinforcement learning (DRL) algorithms require substantial samples and computational resources to achieve higher performance, which restricts their practical application and poses challenges for further development. Given the…

Machine Learning · Computer Science 2024-03-13 Yanxiao Zhao , Yangge Qian , Tianyi Wang , Jingyang Shan , Xiaolin Qin

Deep reinforcement learning (DRL) is a promising way to achieve human-like autonomous driving. However, the low sample efficiency and difficulty of designing reward functions for DRL would hinder its applications in practice. In light of…

Robotics · Computer Science 2021-10-29 Zhiyu Huang , Jingda Wu , Chen Lv

We present a constraint-based algorithm for learning causal structures from observational time-series data, in the presence of latent confounders. We assume a discrete-time, stationary structural vector autoregressive process, with both…

Artificial Intelligence · Computer Science 2023-06-02 Raanan Y. Rohekar , Shami Nisimov , Yaniv Gurwicz , Gal Novik

We provide a framework for accelerating reinforcement learning (RL) algorithms by heuristics constructed from domain knowledge or offline data. Tabula rasa RL algorithms require environment interactions or computation that scales with the…

Machine Learning · Computer Science 2021-11-23 Ching-An Cheng , Andrey Kolobov , Adith Swaminathan

The application of Deep Reinforcement Learning (DRL) to inventory management is an emerging field. However, traditional DRL algorithms, originally developed for diverse domains such as game-playing and robotics, may not be well-suited for…

Machine Learning · Computer Science 2025-06-04 Tarkan Temizöz , Christina Imdahl , Remco Dijkman , Douniel Lamghari-Idrissi , Willem van Jaarsveld

We study the problem of Distributionally Robust Constrained RL (DRC-RL), where the goal is to maximize the expected reward subject to environmental distribution shifts and constraints. This setting captures situations where training and…

Machine Learning · Computer Science 2024-06-25 Zhengfei Zhang , Kishan Panaganti , Laixi Shi , Yanan Sui , Adam Wierman , Yisong Yue

Despite numerous successes in Deep Reinforcement Learning (DRL), the learned policies are not interpretable. Moreover, since DRL does not exploit symbolic relational representations, it has difficulties in coping with structural changes in…

Artificial Intelligence · Computer Science 2023-07-17 Rishi Hazra , Luc De Raedt

A pervasive challenge in Reinforcement Learning (RL) is the "curse of dimensionality" which is the exponential growth in the state-action space when optimizing a high-dimensional target task. The framework of curriculum learning trains the…

Machine Learning · Computer Science 2025-03-24 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

Causal models bring many benefits to decision-making systems (or agents) by making them interpretable, sample-efficient, and robust to changes in the input distribution. However, spurious correlations can lead to wrong causal models and…

Machine Learning · Computer Science 2020-12-09 Sergei Volodin , Nevan Wichers , Jeremy Nixon

Hierarchical model-based reinforcement learning (HMBRL) aims to combine the benefits of better sample efficiency of model based reinforcement learning (MBRL) with the abstraction capability of hierarchical reinforcement learning (HRL) to…

Machine Learning · Computer Science 2024-06-04 Robin Schiewer , Anand Subramoney , Laurenz Wiskott