English
Related papers

Related papers: Hierarchical Reinforcement Learning for Zero-shot …

200 papers

While Reinforcement Learning (RL) has achieved remarkable success in language modeling, its triumph hasn't yet fully translated to visuomotor agents. A primary challenge in RL models is their tendency to overfit specific tasks or…

Robotics · Computer Science 2025-08-01 Shaofei Cai , Zhancun Mu , Haiwen Xia , Bowei Zhang , Anji Liu , Yitao Liang

We study building multi-task agents in open-world environments. Without human demonstrations, learning to accomplish long-horizon tasks in a large open-world environment with reinforcement learning (RL) is extremely inefficient. To tackle…

Machine Learning · Computer Science 2023-12-05 Haoqi Yuan , Chi Zhang , Hongcheng Wang , Feiyang Xie , Penglin Cai , Hao Dong , Zongqing Lu

The study of zero-shot generalisation (ZSG) in deep Reinforcement Learning (RL) aims to produce RL algorithms whose policies generalise well to novel unseen situations at deployment time, avoiding overfitting to their training environments.…

Machine Learning · Computer Science 2023-01-20 Robert Kirk , Amy Zhang , Edward Grefenstette , Tim Rocktäschel

A highly desirable property of a reinforcement learning (RL) agent -- and a major difficulty for deep RL approaches -- is the ability to generalize policies learned on a few tasks over a high-dimensional observation space to similar tasks…

Machine Learning · Computer Science 2022-03-17 Bogdan Mazoure , Ahmed M. Ahmed , Patrick MacAlpine , R Devon Hjelm , Andrey Kolobov

Hierarchical Reinforcement Learning algorithms have successfully been applied to temporal credit assignment problems with sparse reward signals. However, state-of-the-art algorithms require manual specification of sub-task structures, a…

Machine Learning · Computer Science 2019-09-24 Robert Tjarko Lange , Aldo Faisal

This paper presents a hierarchical reinforcement learning (RL) approach to address the agent grouping or pairing problem in cooperative multi-agent systems. The goal is to simultaneously learn the optimal grouping and agent policy. By…

Machine Learning · Computer Science 2025-01-14 Liyuan Hu

Multi-task multi-agent reinforcement learning (MT-MARL) has recently gained attention for its potential to enhance MARL's adaptability across multiple tasks. However, it is challenging for existing multi-task learning methods to handle…

Robotics · Computer Science 2025-07-10 Guobin Zhu , Rui Zhou , Wenkang Ji , Hongyin Zhang , Donglin Wang , Shiyu Zhao

Graph-based environments pose unique challenges to multi-agent reinforcement learning. In decentralized approaches, agents operate within a given graph and make decisions based on partial or outdated observations. The size of the observed…

Multiagent Systems · Computer Science 2024-06-05 Jannis Weil , Zhenghua Bao , Osama Abboud , Tobias Meuser

This paper studies the problem of autonomous exploration under localization uncertainty for a mobile robot with 3D range sensing. We present a framework for self-learning a high-performance exploration policy in a single simulation…

Robotics · Computer Science 2021-05-12 Fanfei Chen , Paul Szenher , Yewei Huang , Jinkun Wang , Tixiao Shan , Shi Bai , Brendan Englot

Effective governance and steering of behavior in complex multi-agent systems (MAS) are essential for managing system-wide outcomes, particularly in environments where interactions are structured by dynamic networks. In many applications,…

Machine Learning · Computer Science 2024-11-01 Qiliang Chen , Babak Heydari

Hierarchical Reinforcement Learning (HRL) is well-suitedd for solving complex tasks by breaking them down into structured policies. However, HRL agents often struggle with efficient exploration and quick adaptation. To overcome these…

Machine Learning · Computer Science 2025-03-18 Arash Khajooeinejad , Fatemeh Sadat Masoumi , Masoumeh Chapariniya

Learning to walk over a graph towards a target node for a given query and a source node is an important problem in applications such as knowledge base completion (KBC). It can be formulated as a reinforcement learning (RL) problem with a…

Artificial Intelligence · Computer Science 2018-12-19 Yelong Shen , Jianshu Chen , Po-Sen Huang , Yuqing Guo , Jianfeng Gao

We focus on reinforcement learning (RL) in relational problems that are naturally defined in terms of objects, their relations, and object-centric actions. These problems are characterized by variable state and action spaces, and finding a…

Machine Learning · Computer Science 2023-08-28 Jaromír Janisch , Tomáš Pevný , Viliam Lisý

How resources are deployed to secure critical targets in networks can be modelled by Network Security Games (NSGs). While recent advances in deep learning (DL) provide a powerful approach to dealing with large-scale NSGs, DL methods such as…

Cryptography and Security · Computer Science 2022-01-20 Wanqi Xue , Bo An , Chai Kiat Yeo

Grouping problems aim to partition a set of items into multiple mutually disjoint subsets according to some specific criterion and constraints. Grouping problems cover a large class of important combinatorial optimization problems that are…

Artificial Intelligence · Computer Science 2016-04-04 Yangming Zhou , Jin-Kao Hao , Béatrice Duval

Common approaches to Reinforcement Learning (RL) are seriously challenged by large-scale applications involving huge state spaces and sparse delayed reward feedback. Hierarchical Reinforcement Learning (HRL) methods attempt to address this…

Artificial Intelligence · Computer Science 2019-04-15 Jacob Rafati , David C. Noelle

Hierarchical Reinforcement Learning (HRL) allows interactive agents to decompose complex problems into a hierarchy of sub-tasks. Higher-level tasks can invoke the solutions of lower-level tasks as if they were primitive actions. In this…

Optimization problems over dynamic networks have been extensively studied and widely used in the past decades to formulate numerous real-world problems. However, (1) traditional optimization-based approaches do not scale to large networks,…

Machine Learning · Computer Science 2023-05-17 Daniele Gammelli , James Harrison , Kaidi Yang , Marco Pavone , Filipe Rodrigues , Francisco C. Pereira

In this work we address the problem of training a Reinforcement Learning agent to follow multiple temporally-extended instructions expressed in Linear Temporal Logic in sub-symbolic environments. Previous multi-task work has mostly relied…

Machine Learning · Computer Science 2026-02-11 Matteo Pannacci , Andrea Fanti , Elena Umili , Roberto Capobianco

The high-dimensional or sparse reward task of a reinforcement learning (RL) environment requires a superior potential controller such as hierarchical reinforcement learning (HRL) rather than an atomic RL because it absorbs the complexity of…

Machine Learning · Computer Science 2021-07-20 JaeYoon Kim , Junyu Xuan , Christy Liang , Farookh Hussain