中文
相关论文

相关论文: Landmark-Guided Subgoal Generation in Hierarchical…

200 篇论文

Effective governance and steering of behavior in complex multi-agent systems (MAS) are essential for managing system-wide outcomes, particularly in environments where interactions are structured by dynamic networks. In many applications,…

机器学习 · 计算机科学 2024-11-01 Qiliang Chen , Babak Heydari

Hierarchical reinforcement learning (HRL) leverages temporal abstraction to efficiently tackle complex long-horizon tasks. However, HRL often collapses because the continual updates of the low-level primitive make earlier sub-goals issued…

机器学习 · 计算机科学 2025-08-19 Utsav Singh , Vinay P. Namboodiri

Decentralized Multi-Agent Reinforcement Learning (MARL) methods allow for learning scalable multi-agent policies, but suffer from partial observability and induced non-stationarity. These challenges can be addressed by introducing…

机器学习 · 计算机科学 2025-08-01 Tommaso Marzi , Cesare Alippi , Andrea Cini

Hierarchical Reinforcement Learning (HRL) has made notable progress in complex control tasks by leveraging temporal abstraction. However, previous HRL algorithms often suffer from serious data inefficiency as environments get large. The…

机器学习 · 计算机科学 2022-11-22 Seungjae Lee , Jigang Kim , Inkyu Jang , H. Jin Kim

This work is inspired by recent advances in hierarchical reinforcement learning (HRL) (Barto and Mahadevan 2003; Hengst 2010), and improvements in learning efficiency from heuristic-based subgoal selection, experience replay (Lin 1993;…

人工智能 · 计算机科学 2020-09-30 Xinyi Xu , Tiancheng Huang , Pengfei Wei , Akshay Narayan , Tze-Yun Leong

Hierarchical reinforcement learning (HRL) incorporates temporal abstraction into reinforcement learning (RL) by explicitly taking advantage of hierarchical structure. Modern HRL typically designs a hierarchical agent composed of a…

机器学习 · 计算机科学 2024-01-24 Sang-Hyun Lee , Yoonjae Jung , Seung-Woo Seo

Reward shaping in multi-agent reinforcement learning (MARL) for complex tasks remains a significant challenge. Existing approaches often fail to find optimal solutions or cannot efficiently handle such tasks. We propose HYPRL, a…

人工智能 · 计算机科学 2025-10-27 Tzu-Han Hsu , Arshia Rafieioskouei , Borzoo Bonakdarpour

Hierarchies of temporally decoupled policies present a promising approach for enabling structured exploration in complex long-term planning problems. To fully achieve this approach an end-to-end training paradigm is needed. However,…

Offline goal-conditioned reinforcement learning (GCRL) is a practical reinforcement learning paradigm that aims to learn goal-conditioned policies from reward-free offline data. Despite recent advances in hierarchical architectures such as…

机器学习 · 计算机科学 2026-04-13 Zhiqiang Dong , Teng Pang , Rongjian Xu , Guoqiang Wu

We propose a novel hierarchical reinforcement learning framework for quadruped locomotion over challenging terrain. Our approach incorporates a two-layer hierarchy in which a high-level policy (HLP) selects optimal goals for a low-level…

机器人学 · 计算机科学 2025-06-26 Jeremiah Coholich , Muhammad Ali Murtaza , Seth Hutchinson , Zsolt Kira

In this paper, we propose a navigation algorithm oriented to multi-agent environment. This algorithm is expressed as a hierarchical framework that contains a Hidden Markov Model (HMM) and a Deep Reinforcement Learning (DRL) structure. For…

机器人学 · 计算机科学 2018-07-18 Wenhao Ding , Shuaijun Li , Huihuan Qian

The high-dimensional or sparse reward task of a reinforcement learning (RL) environment requires a superior potential controller such as hierarchical reinforcement learning (HRL) rather than an atomic RL because it absorbs the complexity of…

机器学习 · 计算机科学 2021-07-20 JaeYoon Kim , Junyu Xuan , Christy Liang , Farookh Hussain

Inverse Reinforcement Learning (IRL) aims to reconstruct the reward function from expert demonstrations to facilitate policy learning, and has demonstrated its remarkable success in imitation learning. To promote expert-like behavior,…

机器学习 · 计算机科学 2023-06-16 Shunyu Liu , Yunpeng Qing , Shuqi Xu , Hongyan Wu , Jiangtao Zhang , Jingyuan Cong , Tianhao Chen , Yunfu Liu , Mingli Song

Offline goal-conditioned reinforcement learning (GCRL) often struggles with long-horizon tasks, where errors in value estimation accumulate and produce unreliable policies. It is typically assumed that effective long-term planning is…

机器学习 · 计算机科学 2026-05-26 Evgenii Opryshko , Junwei Quan , Claas Voelcker , Yilun Du , Igor Gilitschenski

Robotic systems are nowadays capable of solving complex navigation tasks. However, their capabilities are limited to the knowledge of the designer and consequently lack generalizability to initially unconsidered situations. This makes deep…

机器人学 · 计算机科学 2022-05-24 Christopher Gebauer , Nils Dengler , Maren Bennewitz

Hierarchical reinforcement learning (HRL) addresses complex long-horizon tasks by skillfully decomposing them into subgoals. Therefore, the effectiveness of HRL is greatly influenced by subgoal reachability. Typical HRL methods only…

机器学习 · 计算机科学 2024-06-27 Yu Luo , Fuchun Sun , Tianying Ji , Xianyuan Zhan

Reinforcement learning (RL) exhibits remarkable potential in addressing autonomous driving tasks. However, it is difficult to train a sample-efficient and safe policy in complex scenarios. In this article, we propose a novel hierarchical…

机器人学 · 计算机科学 2025-06-23 Yiou Huang

The options framework in Hierarchical Reinforcement Learning breaks down overall goals into a combination of options or simpler tasks and associated policies, allowing for abstraction in the action space. Ideally, these options can be…

机器学习 · 计算机科学 2022-06-14 Kushal Chauhan , Soumya Chatterjee , Akash Reddy , Balaraman Ravindran , Pradeep Shenoy

Efficient exploration for automatic subgoal discovery is a challenging problem in Hierarchical Reinforcement Learning (HRL). In this paper, we show that intrinsic motivation learning increases the efficiency of exploration, leading to…

机器学习 · 计算机科学 2019-11-25 Jacob Rafati , David C. Noelle

Hierarchical Imitation Learning (HIL) is a promising approach for tackling long-horizon decision-making tasks. While it is a challenging task due to the lack of detailed supervisory labels for sub-goal learning, and reliance on hundreds to…

人工智能 · 计算机科学 2024-10-04 Chengyang Gu , Yuxin Pan , Haotian Bai , Hui Xiong , Yize Chen