English
Related papers

Related papers: Scalable Hierarchical Reinforcement Learning for H…

200 papers

Reinforcement Learning (RL) algorithms can suffer from poor sample efficiency when rewards are delayed and sparse. We introduce a solution that enables agents to learn temporally extended actions at multiple levels of abstraction in a…

Machine Learning · Computer Science 2019-03-11 Andrew Levy , Robert Platt , Kate Saenko

In this paper, we propose a novel hierarchical framework for robot navigation in dynamic environments with heterogeneous constraints. Our approach leverages a graph neural network trained via reinforcement learning (RL) to efficiently…

Robotics · Computer Science 2025-07-24 Huajian Liu , Yixuan Feng , Wei Dong , Kunpeng Fan , Chao Wang , Yongzhuo Gao

The increasing complexity of modern applications demands wireless networks capable of real time adaptability and efficient resource management. The Open Radio Access Network (O-RAN) architecture, with its RAN Intelligent Controller (RIC)…

Artificial Intelligence · Computer Science 2025-12-17 Fatemeh Lotfi , Fatemeh Afghah

Hierarchical model-based reinforcement learning (HMBRL) aims to combine the benefits of better sample efficiency of model based reinforcement learning (MBRL) with the abstraction capability of hierarchical reinforcement learning (HRL) to…

Machine Learning · Computer Science 2024-06-04 Robin Schiewer , Anand Subramoney , Laurenz Wiskott

Recent advancements have significantly enhanced the performance of large language models (LLMs) in tackling complex reasoning tasks, achieving notable success in domains like mathematical and logical reasoning. However, these methods…

Artificial Intelligence · Computer Science 2025-05-30 Runquan Gui , Zhihai Wang , Jie Wang , Chi Ma , Huiling Zhen , Mingxuan Yuan , Jianye Hao , Defu Lian , Enhong Chen , Feng Wu

The authors present an overview of a hierarchical framework for coordinating task- and motion-level operations in multirobot systems. Their framework is based on the idea of using simple temporal networks to simultaneously reason about…

Artificial Intelligence · Computer Science 2018-04-03 Hang Ma , Wolfgang Hönig , Liron Cohen , Tansel Uras , Hong Xu , T. K. Satish Kumar , Nora Ayanian , Sven Koenig

The high-dimensional or sparse reward task of a reinforcement learning (RL) environment requires a superior potential controller such as hierarchical reinforcement learning (HRL) rather than an atomic RL because it absorbs the complexity of…

Machine Learning · Computer Science 2021-07-20 JaeYoon Kim , Junyu Xuan , Christy Liang , Farookh Hussain

Hierarchical Reinforcement Learning (HRL) exploits temporal abstraction to solve large Markov Decision Processes (MDP) and provide transferable subtask policies. In this paper, we introduce an off-policy HRL algorithm: Hierarchical Q-value…

Artificial Intelligence · Computer Science 2016-03-30 Tiancheng Zhao , Mohammad Gowayyed

Budget planning and maintenance optimization are crucial for infrastructure asset management, ensuring cost-effectiveness and sustainability. However, the complexity arising from combinatorial action spaces, diverse asset deterioration,…

Artificial Intelligence · Computer Science 2025-07-28 Amir Fard , Arnold X. -X. Yuan

Managing disruptions in railway traffic management is a major challenge. Rising traffic density and infrastructure limits increase complexity, making the Vehicle Routing and Scheduling Problem (VRSP) difficult to solve reliably and in real…

Artificial Intelligence · Computer Science 2026-05-12 Alberto Castagna , Stefan Zahlner , Adrian Egli , Christian Eichenberger , Daniel Boos , Manuel Meyer , Anton Fuxjager

Despite advances in hierarchical reinforcement learning, its applications to path planning in autonomous driving on highways are challenging. One reason is that conventional hierarchical reinforcement learning approaches are not amenable to…

Machine Learning · Computer Science 2021-11-11 Jaehyun Kim , Jaeseung Jeong

Hierarchical agents have the potential to solve sequential decision making tasks with greater sample efficiency than their non-hierarchical counterparts because hierarchical agents can break down tasks into sets of subtasks that only…

Artificial Intelligence · Computer Science 2019-09-05 Andrew Levy , George Konidaris , Robert Platt , Kate Saenko

Hierarchical reinforcement learning (HRL) is hypothesized to be able to leverage the inherent hierarchy in learning tasks where traditional reinforcement learning (RL) often fails. In this research, HRL is evaluated and contrasted with…

Artificial Intelligence · Computer Science 2025-08-20 Brendon Johnson , Alfredo Weitzenfeld

Hierarchical reinforcement learning (HRL) decomposes the policy into a manager and a worker, enabling long-horizon planning but introducing a performance gap on tasks requiring agility. We identify a root cause: in subgoal-based HRL, the…

Artificial Intelligence · Computer Science 2026-04-22 Shashank Sharma , Janina Hoffmann , Vinay Namboodiri

Past research into robotic planning with temporal logic specifications, notably Linear Temporal Logic (LTL), was largely based on a single formula for individual or groups of robots. But with increasing task complexity, LTL formulas…

Robotics · Computer Science 2024-05-27 Xusheng Luo , Shaojun Xu , Ruixuan Liu , Changliu Liu

Feature selection aims to preprocess the target dataset, find an optimal and most streamlined feature subset, and enhance the downstream machine learning task. Among filter, wrapper, and embedded-based approaches, the reinforcement learning…

Artificial Intelligence · Computer Science 2025-09-17 Weiliang Zhang , Xiaohan Huang , Yi Du , Ziyue Qiao , Qingqing Long , Zhen Meng , Yuanchun Zhou , Meng Xiao

We present a novel mission-planning strategy for heterogeneous multi-robot teams, taking into account the specific constraints and capabilities of each robot. Our approach employs hierarchical trees to systematically break down complex…

Robotics · Computer Science 2025-01-29 Piyush Gupta , David Isele , Enna Sachdeva , Pin-Hao Huang , Behzad Dariush , Kwonjoon Lee , Sangjae Bae

Task allocation in multi-human multi-robot (MH-MR) teams presents significant challenges due to the inherent heterogeneity of team members, the dynamics of task execution, and the information uncertainty of operational states. Existing…

Robotics · Computer Science 2025-03-12 Ziqin Yuan , Ruiqi Wang , Taehyeon Kim , Dezhong Zhao , Ike Obi , Byung-Cheol Min

Multi-task reinforcement learning (MTRL) aims to endow a single agent with the ability to perform well on multiple tasks. Recent works have focused on developing novel sophisticated architectures to improve performance, often resulting in…

Machine Learning · Computer Science 2025-03-13 Reginald McLean , Evangelos Chatzaroulas , Jordan Terry , Isaac Woungang , Nariman Farsad , Pablo Samuel Castro

Two common approaches to sequential decision-making are AI planning (AIP) and reinforcement learning (RL). Each has strengths and weaknesses. AIP is interpretable, easy to integrate with symbolic knowledge, and often efficient, but requires…

Artificial Intelligence · Computer Science 2022-09-30 Junkyu Lee , Michael Katz , Don Joven Agravante , Miao Liu , Geraud Nangue Tasse , Tim Klinger , Shirin Sohrabi