English
Related papers

Related papers: Heterogeneous Multi-agent Zero-Shot Coordination b…

200 papers

Many Multi-Agent Reinforcement Learning (MARL) agents fail to adapt properly to cooperating with agents trained with the same objectives but different seeds, algorithms, or other training differences. This is the problem of Zero-Shot…

Machine Learning · Computer Science 2026-04-29 Keenan Powell , Peihong Yu , Pratap Tokekar

Cooperative Multi-agent Reinforcement Learning (MARL) algorithms with Zero-Shot Coordination (ZSC) have gained significant attention in recent years. ZSC refers to the ability of agents to coordinate zero-shot (without additional…

Machine Learning · Computer Science 2023-08-22 Hadi Nekoei , Xutong Zhao , Janarthanan Rajendran , Miao Liu , Sarath Chandar

Zero-shot coordination (ZSC), the ability to adapt to a new partner in a cooperative task, is a critical component of human-compatible AI. While prior work has focused on training agents to cooperate on a single task, these specialized…

Multiagent Systems · Computer Science 2025-04-22 Kunal Jha , Wilka Carvalho , Yancheng Liang , Simon S. Du , Max Kleiman-Weiner , Natasha Jaques

Zero-shot coordination (ZSC) is a new cooperative multi-agent reinforcement learning (MARL) challenge that aims to train an ego agent to work with diverse, unseen partners during deployment. The significant difference between the…

Artificial Intelligence · Computer Science 2024-09-27 Xihuai Wang , Shao Zhang , Wenhao Zhang , Wentao Dong , Jingxiao Chen , Ying Wen , Weinan Zhang

Zero-shot coordination (ZSC) -- the ability to collaborate with unfamiliar partners -- is essential to making autonomous agents effective teammates. Existing ZSC methods evaluate coordination capabilities between two agents who have not…

Zero-shot coordination(ZSC), a key challenge in multi-agent game theory, has become a hot topic in reinforcement learning (RL) research recently, especially in complex evolving games. It focuses on the generalization ability of agents,…

Machine Learning · Computer Science 2025-11-19 Bingyu Hui , Lebin Yu , Quanming Yao , Yunpeng Qu , Xudong Zhang , Jian Wang

We present the task of "Social Rearrangement", consisting of cooperative everyday tasks like setting up the dinner table, tidying a house or unpacking groceries in a simulated multi-agent environment. In Social Rearrangement, two robots…

Machine Learning · Computer Science 2023-06-02 Andrew Szot , Unnat Jain , Dhruv Batra , Zsolt Kira , Ruta Desai , Akshara Rai

Many multiagent systems in the real world include multiple types of agents with different abilities and functionality. Such heterogeneous multiagent systems have significant practical advantages. However, they also come with challenges…

Machine Learning · Computer Science 2023-05-30 Qingxu Fu , Xiaolin Ai , Jianqiang Yi , Tenghai Qiu , Wanmai Yuan , Zhiqiang Pu

Over these years, multi-agent reinforcement learning has achieved remarkable performance in multi-agent planning and scheduling tasks. It typically follows the self-play setting, where agents are trained by playing with a fixed group of…

Multiagent Systems · Computer Science 2023-02-13 Lebin Yu , Yunbo Qiu , Quanming Yao , Xudong Zhang , Jian Wang

Zero-shot coordination (ZSC) aims to enable agents to cooperate with independently trained partners without prior interaction, a key requirement for real-world multi-agent systems and human-AI collaboration. Existing approaches have largely…

Machine Learning · Computer Science 2026-05-13 Mingu Kang , Sunwoo Lee , Yonghyeon Jo , Seungyul Han

Training agents that can coordinate zero-shot with humans is a key mission in multi-agent reinforcement learning (MARL). Current algorithms focus on training simulated human partner policies which are then used to train a Cooperator agent.…

Machine Learning · Computer Science 2024-11-22 Yancheng Liang , Daphne Chen , Abhishek Gupta , Simon S. Du , Natasha Jaques

Zero-shot coordination (ZSC) is a significant challenge in multi-agent collaboration, aiming to develop agents that can coordinate with unseen partners they have not encountered before. Recent cutting-edge ZSC methods have primarily focused…

Robotics · Computer Science 2024-10-02 Yang Li , Dengyu Zhang , Junfan Chen , Ying Wen , Qingrui Zhang , Shaoshuai Mou , Wei Pan

Decentralized combinatorial optimization in evolving multi-agent systems poses significant challenges, requiring agents to balance long-term decision-making, short-term optimized collective outcomes, while preserving autonomy of interactive…

Multiagent Systems · Computer Science 2025-09-23 Chuhao Qin , Evangelos Pournaras

We consider the problem of zero-shot coordination - constructing AI agents that can coordinate with novel partners they have not seen before (e.g. humans). Standard Multi-Agent Reinforcement Learning (MARL) methods typically focus on the…

Artificial Intelligence · Computer Science 2021-05-13 Hengyuan Hu , Adam Lerer , Alex Peysakhovich , Jakob Foerster

There is a recent trend of applying multi-agent reinforcement learning (MARL) to train an agent that can cooperate with humans in a zero-shot fashion without using any human data. The typical workflow is to first repeatedly run self-play…

Artificial Intelligence · Computer Science 2023-02-06 Chao Yu , Jiaxuan Gao , Weilin Liu , Botian Xu , Hao Tang , Jiaqi Yang , Yu Wang , Yi Wu

In multi-agent reinforcement learning, the cooperative learning behavior of agents is very important. In the field of heterogeneous multi-agent reinforcement learning, cooperative behavior among different types of agents in a group is…

Artificial Intelligence · Computer Science 2021-04-14 Taeyoung Kim , Luiz Felipe Vecchietti , Kyujin Choi , Sanem Sariel , Dongsoo Har

Zero-shot coordination problem in multi-agent reinforcement learning (MARL), which requires agents to adapt to unseen agents, has attracted increasing attention. Traditional approaches often rely on the Self-Play (SP) framework to generate…

Multiagent Systems · Computer Science 2024-11-05 Weifan Long , Wen Wen , Peng Zhai , Lihua Zhang

Zero-shot coordination (ZSC) is a popular setting for studying the ability of reinforcement learning (RL) agents to coordinate with novel partners. Prior ZSC formulations assume the $\textit{problem setting}$ is common knowledge: each agent…

Machine Learning · Computer Science 2024-11-08 Usman Anwar , Ashish Pandian , Jia Wan , David Krueger , Jakob Foerster

Heterogeneity is a fundamental property in multi-agent reinforcement learning (MARL), which is closely related not only to the functional differences of agents, but also to policy diversity and environmental interactions. However, the MARL…

Multiagent Systems · Computer Science 2025-12-30 Tianyi Hu , Zhiqiang Pu , Yuan Wang , Tenghai Qiu , Min Chen , Xin Yu

We introduce Heterogeneous Agent Collaborative Reinforcement Learning (HACRL), a new Reinforcement Learning from Verifiable Reward (RLVR) problem that addresses the inefficiencies of isolated multi-agent on-policy optimization. HACRL…

‹ Prev 1 2 3 10 Next ›