English
Related papers

Related papers: Subgoal-based Hierarchical Reinforcement Learning …

200 papers

Hierarchical reinforcement learning (HRL) decomposes the policy into a manager and a worker, enabling long-horizon planning but introducing a performance gap on tasks requiring agility. We identify a root cause: in subgoal-based HRL, the…

Artificial Intelligence · Computer Science 2026-04-22 Shashank Sharma , Janina Hoffmann , Vinay Namboodiri

Common approaches to Reinforcement Learning (RL) are seriously challenged by large-scale applications involving huge state spaces and sparse delayed reward feedback. Hierarchical Reinforcement Learning (HRL) methods attempt to address this…

Artificial Intelligence · Computer Science 2019-04-15 Jacob Rafati , David C. Noelle

Hierarchical reinforcement learning (HRL) provides a promising solution for complex tasks with sparse rewards of intelligent agents, which uses a hierarchical framework that divides tasks into subgoals and completes them sequentially.…

Artificial Intelligence · Computer Science 2024-11-28 Xinglin Zhou , Yifu Yuan , Shaofu Yang , Jianye Hao

Robotic systems are nowadays capable of solving complex navigation tasks. However, their capabilities are limited to the knowledge of the designer and consequently lack generalizability to initially unconsidered situations. This makes deep…

Robotics · Computer Science 2022-05-24 Christopher Gebauer , Nils Dengler , Maren Bennewitz

Hierarchical Reinforcement Learning (HRL) agents often struggle with long-horizon visual planning due to their reliance on error-prone distance metrics. We propose Discrete Hierarchical Planning (DHP), a method that replaces continuous…

Robotics · Computer Science 2025-12-22 Shashank Sharma , Janina Hoffmann , Vinay Namboodiri

Goal representation affects the performance of Hierarchical Reinforcement Learning (HRL) algorithms by decomposing the complex learning problem into easier subtasks. Recent studies show that representations that preserve temporally abstract…

Machine Learning · Computer Science 2024-12-24 Mehdi Zadem , Sergio Mover , Sao Mai Nguyen

In this paper, we study the cooperative Multi-Agent Reinforcement Learning (MARL) problems using Reward Machines (RMs) to specify the reward functions such that the prior knowledge of high-level events in a task can be leveraged to…

Artificial Intelligence · Computer Science 2024-03-13 Xuejing Zheng , Chao Yu

Goal-conditioned hierarchical reinforcement learning (HRL) is a promising approach for scaling up reinforcement learning (RL) techniques. However, it often suffers from training inefficiency as the action space of the high-level, i.e., the…

Machine Learning · Computer Science 2021-03-19 Tianren Zhang , Shangqi Guo , Tian Tan , Xiaolin Hu , Feng Chen

Offline Reinforcement learning (RL) has shown potent in many safe-critical tasks in robotics where exploration is risky and expensive. However, it still struggles to acquire skills in temporally extended tasks. In this paper, we study the…

Robotics · Computer Science 2022-05-25 Jinning Li , Chen Tang , Masayoshi Tomizuka , Wei Zhan

Reinforcement learning-based mapless navigation holds significant potential. However, it faces challenges in indoor environments with local minima area. This paper introduces a safe mapless navigation framework utilizing hierarchical…

Robotics · Computer Science 2025-03-18 Jianqi Gao , Xizheng Pang , Qi Liu , Yanjie Li

Multi-Agent Reinforcement Learning (MARL) is a growing research area which gained significant traction in recent years, extending Deep RL applications to a much wider range of problems. A particularly challenging class of problems in this…

Multiagent Systems · Computer Science 2025-09-25 Charles Dansereau , Junior-Samuel Lopez-Yepez , Karthik Soma , Antoine Fagette

In the domain of combat simulations in support of wargaming, the development of intelligent agents has predominantly been characterized by rule-based, scripted methodologies with deep reinforcement learning (RL) approaches only recently…

Machine Learning · Computer Science 2025-12-02 Scotty Black , Christian Darken

Developing agents capable of exploring, planning and learning in complex open-ended environments is a grand challenge in artificial intelligence (AI). Hierarchical reinforcement learning (HRL) offers a promising solution to this challenge…

Artificial Intelligence · Computer Science 2025-06-18 Martin Klissarov , Akhil Bagaria , Ziyan Luo , George Konidaris , Doina Precup , Marlos C. Machado

Feature selection aims to preprocess the target dataset, find an optimal and most streamlined feature subset, and enhance the downstream machine learning task. Among filter, wrapper, and embedded-based approaches, the reinforcement learning…

Artificial Intelligence · Computer Science 2025-09-17 Weiliang Zhang , Xiaohan Huang , Yi Du , Ziyue Qiao , Qingqing Long , Zhen Meng , Yuanchun Zhou , Meng Xiao

Goal-conditioned hierarchical reinforcement learning (HRL) presents a promising approach for enabling effective exploration in complex, long-horizon reinforcement learning (RL) tasks through temporal abstraction. Empirically, heightened…

Machine Learning · Computer Science 2024-04-09 Haoran Wang , Zeshen Tang , Leya Yang , Yaoru Sun , Fang Wang , Siyu Zhang , Yeming Chen

The problem of sparse rewards is one of the hardest challenges in contemporary reinforcement learning. Hierarchical reinforcement learning (HRL) tackles this problem by using a set of temporally-extended actions, or options, each of which…

Machine Learning · Computer Science 2020-01-14 Nat Dilokthanakul , Christos Kaplanis , Nick Pawlowski , Murray Shanahan

This work presents a Hierarchical Multi-Agent Reinforcement Learning framework for analyzing simulated air combat scenarios involving heterogeneous agents. The objective is to identify effective Courses of Action that lead to mission…

Artificial Intelligence · Computer Science 2025-05-15 Ardian Selmonaj , Oleg Szehr , Giacomo Del Rio , Alessandro Antonucci , Adrian Schneider , Michael Rüegsegger

We introduce Hierarchical Transformers for Meta-Reinforcement Learning (HTrMRL), a powerful online meta-reinforcement learning approach. HTrMRL aims to address the challenge of enabling reinforcement learning agents to perform effectively…

Machine Learning · Computer Science 2024-02-12 Gresa Shala , André Biedenkapp , Josif Grabocka

Hierarchical Reinforcement Learning (HRL) is a promising approach for managing task complexity across multiple levels of abstraction and accelerating long-horizon agent exploration. However, the effectiveness of hierarchical policies…

Machine Learning · Computer Science 2025-06-24 Xianghua Zeng , Hao Peng , Dingli Su , Angsheng Li

Hierarchical Reinforcement Learning (HRL) agents have the potential to demonstrate appealing capabilities such as planning and exploration with abstraction, transfer, and skill reuse. Recent successes with HRL across different domains…

Machine Learning · Computer Science 2023-03-01 Bernardo Avila Pires , Feryal Behbahani , Hubert Soyer , Kyriacos Nikiforou , Thomas Keck , Satinder Singh