English
Related papers

Related papers: Decoupled Hierarchical Reinforcement Learning with…

200 papers

Hierarchical reinforcement learning (HRL) learns to make decisions on multiple levels of temporal abstraction. A key challenge in HRL is that the low-level policy changes over time, making it difficult for the high-level policy to generate…

Machine Learning · Computer Science 2025-05-29 Vivienne Huiling Wang , Tinghuai Wang , Joni Pajarinen

Hybrid reconfigurable intelligent surfaces (HRIS) enhance wireless systems by combining passive reflection with active signal amplification. However, jointly optimizing the transmit beamforming with the HRIS reflection and amplification…

Signal Processing · Electrical Eng. & Systems 2026-04-13 Phuong Nam Tran , Nhan Thanh Nguyen , Markku Juntti

Decentralized Multi-Agent Reinforcement Learning (MARL) methods allow for learning scalable multi-agent policies, but suffer from partial observability and induced non-stationarity. These challenges can be addressed by introducing…

Machine Learning · Computer Science 2025-08-01 Tommaso Marzi , Cesare Alippi , Andrea Cini

Tactical decision making is a critical feature for advanced driving systems, that incorporates several challenges such as complexity of the uncertain environment and reliability of the autonomous system. In this work, we develop a…

Robotics · Computer Science 2019-06-21 Majid Moghadam , Gabriel Hugh Elkaim

Deep Reinforcement Learning (DRL) is widely recognized as sample-inefficient, a limitation attributable in part to the high dimensionality and substantial functional redundancy inherent to the policy parameter space. A recent framework,…

Machine Learning · Computer Science 2026-04-03 Andrea Fraschini , Davide Tenedini , Riccardo Zamboni , Mirco Mutti , Marcello Restelli

We discuss the problem of decentralized multi-agent reinforcement learning (MARL) in this work. In our setting, the global state, action, and reward are assumed to be fully observable, while the local policy is protected as privacy by each…

Multiagent Systems · Computer Science 2021-11-02 Kuo Li , Qing-Shan Jia

Reinforcement learning (RL) techniques, while often powerful, can suffer from slow learning speeds, particularly in high dimensional spaces. Decomposition of tasks into a hierarchical structure holds the potential to significantly speed up…

Artificial Intelligence · Computer Science 2018-11-21 Behzad Ghazanfari , Fatemeh Afghah , Matthew E. Taylor

Despite the close connection between exploration and sample efficiency, most state of the art reinforcement learning algorithms include no considerations for exploration beyond maximizing the entropy of the policy. In this work we address…

Sparse-reward reinforcement learning (RL) can model a wide range of highly complex tasks. Solving sparse-reward tasks is RL's core premise, requiring efficient exploration coupled with long-horizon credit assignment, and overcoming these…

Machine Learning · Computer Science 2025-10-21 Leander Diaz-Bone , Marco Bagatella , Jonas Hübotter , Andreas Krause

Building systems that autonomously create temporal abstractions from data is a key challenge in scaling learning and planning in reinforcement learning. One popular approach for addressing this challenge is the options framework (Sutton et…

Machine Learning · Computer Science 2020-01-01 Matthew Riemer , Miao Liu , Gerald Tesauro

Hierarchical reinforcement learning (HRL) has recently shown promising advances on speeding up learning, improving the exploration, and discovering intertask transferable skills. Most recent works focus on HRL with two levels, i.e., a…

Machine Learning · Computer Science 2018-11-14 Yuhang Song , Jianyi Wang , Thomas Lukasiewicz , Zhenghua Xu , Mai Xu

Effective governance and steering of behavior in complex multi-agent systems (MAS) are essential for managing system-wide outcomes, particularly in environments where interactions are structured by dynamic networks. In many applications,…

Machine Learning · Computer Science 2024-11-01 Qiliang Chen , Babak Heydari

In the quest for efficient and robust reinforcement learning methods, both model-free and model-based approaches offer advantages. In this paper we propose a new way of explicitly bridging both approaches via a shared low-dimensional…

Machine Learning · Computer Science 2018-11-20 Vincent François-Lavet , Yoshua Bengio , Doina Precup , Joelle Pineau

Deep reinforcement learning (DRL) has gained great success by learning directly from high-dimensional sensory inputs, yet is notorious for the lack of interpretability. Interpretability of the subtasks is critical in hierarchical…

Artificial Intelligence · Computer Science 2019-03-01 Daoming Lyu , Fangkai Yang , Bo Liu , Steven Gustafson

Many environments contain numerous available niches of variable value, each associated with a different local optimum in the space of behaviors (policy space). In such situations it is often difficult to design a learning process capable of…

Artificial Intelligence · Computer Science 2023-02-06 Peter Sunehag , Alexander Sasha Vezhnevets , Edgar Duéñez-Guzmán , Igor Mordach , Joel Z. Leibo

Federated Reinforcement Learning (FRL) has been deemed as a promising solution for intelligent decision-making in the era of Artificial Internet of Things. However, existing FRL approaches often entail repeated interactions with the…

Machine Learning · Computer Science 2024-05-30 Sheng Yue , Zerui Qin , Xingyuan Hua , Yongheng Deng , Ju Ren

We propose a novel Reinforcement Learning model for discrete environments, which is inherently interpretable and supports the discovery of deep subgoal hierarchies. In the model, an agent learns information about environment in the form of…

Artificial Intelligence · Computer Science 2022-02-16 Alexander Demin , Denis Ponomaryov

We propose a novel neural architecture search algorithm via reinforcement learning by decoupling structure and operation search processes. Our approach samples candidate models from the multinomial distribution on the policy vectors defined…

Machine Learning · Computer Science 2020-04-28 Heung-Chang Lee , Do-Guk Kim , Bohyung Han

Reinforcement Learning (RL) bears the promise of being a game-changer in many applications. However, since most of the literature in the field is currently focused on opaque models, the use of RL in high-stakes scenarios, where…

Machine Learning · Computer Science 2025-01-22 Leonardo Lucio Custode , Giovanni Iacca

The design and deployment of autonomous systems for space missions require robust solutions to navigate strict reliability constraints, extended operational duration, and communication challenges. This study evaluates the stability and…

Robotics · Computer Science 2025-03-04 Henry Lei , Zachary S. Lippay , Anonto Zaman , Joshua Aurand , Amin Maghareh , Sean Phillips