English
Related papers

Related papers: Zero Shot Coordination for Sparse Reward Tasks wit…

200 papers

Real-world multi-agent systems may require ad hoc teaming, where an agent must coordinate with other previously unseen teammates to solve a task in a zero-shot manner. Prior work often either selects a pretrained policy based on an inferred…

Multiagent Systems · Computer Science 2026-04-01 Rupal Nigam , Niket Parikh , Hamid Osooli , Mikihisa Yuasa , Jacob Heglund , Huy T. Tran

We study multi-agent reinforcement learning (MARL) with centralized training and decentralized execution. During the training, new agents may join, and existing agents may unexpectedly leave the training. In such situations, a standard deep…

Machine Learning · Computer Science 2022-08-05 Xuting Tang , Jia Xu , Shusen Wang

Aligning language models (LMs) based on human-annotated preference data is a crucial step in obtaining practical and performant LM-based systems. However, multilingual human preference data are difficult to obtain at scale, making it…

Computation and Language · Computer Science 2024-10-15 Zhaofeng Wu , Ananth Balashankar , Yoon Kim , Jacob Eisenstein , Ahmad Beirami

There is a growing interest in Multi-Agent Reinforcement Learning (MARL) as the first steps towards building general intelligent agents that learn to make low and high-level decisions in non-stationary complex environments in the presence…

Artificial Intelligence · Computer Science 2020-01-01 Marco Jerome Gasparrini , Ricard Solé , Martí Sánchez-Fibla

The success of teams in robotics, nature, and society often depends on the division of labor among diverse specialists; however, a principled explanation for when such diversity surpasses a homogeneous team is still missing. Focusing on…

Multiagent Systems · Computer Science 2026-03-03 Michael Amir , Matteo Bettini , Amanda Prorok

Full parameter sharing is standard in cooperative multi-agent reinforcement learning (MARL) for homogeneous agents. Under permutation-symmetric observations, however, a shared deterministic policy outputs identical action distributions for…

Artificial Intelligence · Computer Science 2026-05-11 Rohan Patil , Jai Malegaonkar , Henrik I. Christensen

We present a reinforcement learning strategy for use in multi-agent foraging systems in which the learning is centralised to a single agent and its model is periodically disseminated among the population of non-learning agents. In a domain…

Multiagent Systems · Computer Science 2026-01-21 Ian O'Flynn , Harun Šiljak

In collaborative tasks, autonomous agents fall short of humans in their capability to quickly adapt to new and unfamiliar teammates. We posit that a limiting factor for zero-shot coordination is the lack of shared task abstractions, a…

Multiagent Systems · Computer Science 2025-05-08 Stéphane Aroca-Ouellette , Miguel Aroca-Ouellette , Katharina von der Wense , Alessandro Roncone

Successfully navigating a complex environment to obtain a desired outcome is a difficult task, that up to recently was believed to be capable only by humans. This perception has been broken down over time, especially with the introduction…

Machine Learning · Computer Science 2019-11-12 Joshua Hare

Multi-agent reinforcement learning (MARL) has achieved great progress in cooperative tasks in recent years. However, in the local reward scheme, where only local rewards for each agent are given without global rewards shared by all the…

Machine Learning · Computer Science 2023-02-21 Yunbo Qiu , Yue Jin , Lebin Yu , Jian Wang , Xudong Zhang

We study the problem of designing autonomous agents that can learn to cooperate effectively with a potentially suboptimal partner while having no access to the joint reward function. This problem is modeled as a cooperative episodic…

Machine Learning · Computer Science 2022-06-14 Thomas Kleine Buening , Anne-Marie George , Christos Dimitrakakis

We consider the problem of robust multi-agent reinforcement learning (MARL) for cooperative communication and coordination tasks. MARL agents, mainly those trained in a centralized way, can be brittle because they can adopt policies that…

Multiagent Systems · Computer Science 2020-12-16 T. van der Heiden , C. Salge , E. Gavves , H. van Hoof

Zero-shot learning (ZSL) can be defined by correctly solving a task where no training data is available, based on previous acquired knowledge from different, but related tasks. So far, this area has mostly drawn the attention from computer…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Joao Reis , Gil Gonçalves

Reward shaping is effective in addressing the sparse-reward challenge in reinforcement learning (RL) by providing immediate feedback through auxiliary, informative rewards. Based on the reward shaping strategy, we propose a novel multi-task…

Machine Learning · Computer Science 2025-10-28 Haozhe Ma , Zhengding Luo , Thanh Vinh Vo , Kuankuan Sima , Tze-Yun Leong

Cooperative multi-agent reinforcement learning (MARL) has been an increasingly important research topic in the last half-decade because of its great potential for real-world applications. Because of the curse of dimensionality, the popular…

Multiagent Systems · Computer Science 2024-04-05 Weizhe Chen , Sven Koenig , Bistra Dilkina

The inability to communicate poses a major challenge to coordination in multi-agent reinforcement learning (MARL). Prior work has explored correlating local policies via shared randomness, sometimes in the form of a correlation device, as a…

Multiagent Systems · Computer Science 2026-02-12 John Gardiner , Orlando Romero , Brendan Tivnan , Nicolò Dal Fabbro , George J. Pappas

Offline cooperative multi-agent reinforcement learning (MARL) faces unique challenges due to distributional shifts, particularly stemming from the high dimensionality of joint action spaces and the presence of out-of-distribution joint…

Machine Learning · Computer Science 2026-05-29 Dan Qiao , Wenhao Li , Shanchao Yang , Hongyuan Zha , Baoxiang Wang

Learning sparse coordination graphs adaptive to the coordination dynamics among agents is a long-standing problem in cooperative multi-agent learning. This paper studies this problem and proposes a novel method using the variance of payoff…

Machine Learning · Computer Science 2022-06-15 Tonghan Wang , Liang Zeng , Weijun Dong , Qianlan Yang , Yang Yu , Chongjie Zhang

Recent advances in multi-agent reinforcement learning (MARL) allow agents to coordinate their behaviors in complex environments. However, common MARL algorithms still suffer from scalability and sparse reward issues. One promising approach…

Artificial Intelligence · Computer Science 2023-02-08 Rundong Wang , Longtao Zheng , Wei Qiu , Bowei He , Bo An , Zinovi Rabinovich , Yujing Hu , Yingfeng Chen , Tangjie Lv , Changjie Fan

Training for multi-agent reinforcement learning(MARL) is a time-consuming process caused by distribution shift of each agent. One drawback is that strategy of each agent in MARL is independent but actually in cooperation. Thus, a vertical…

Artificial Intelligence · Computer Science 2024-03-06 Ke Zhang , DanDan Zhu , Qiuhan Xu , Hao Zhou , Ce Zheng