English
Related papers

Related papers: Heterogeneous Multi-agent Zero-Shot Coordination b…

200 papers

In Emergent Communication (EC) agents learn to communicate with one another, but the protocols that they develop are specialised to their training community. This observation led to research into Zero-Shot Coordination (ZSC) for learning…

Machine Learning · Computer Science 2024-02-27 Dylan Cope , Peter McBurney

Zero-shot classification (ZSC) is the task of learning predictors for classes not seen during training. Although the different methods in the literature are evaluated using the same class splits, little is known about their stability under…

Machine Learning · Computer Science 2021-03-03 Matías Molina , Jorge Sánchez

A major bottleneck in the training process for Zero-Shot Coordination (ZSC) agents is the generation of partner agents that are diverse in collaborative conventions. Current Cross-play Minimization (XPM) methods for population generation…

Artificial Intelligence · Computer Science 2025-06-10 Yi Loo , Akshunn Trivedi , Malika Meghjani

This paper is concerned with evaluating different multiagent learning (MAL) algorithms in problems where individual agents may be heterogenous, in the sense of utilizing different learning strategies, without the opportunity for prior…

Multiagent Systems · Computer Science 2019-07-23 Stefano V. Albrecht , Subramanian Ramamoorthy

The emergence of multi-agent reinforcement learning (MARL) is significantly transforming various fields like autonomous vehicle networks. However, real-world multi-agent systems typically contain multiple roles, and the scale of these…

Machine Learning · Computer Science 2024-10-03 Xudong Guo , Daming Shi , Junjie Yu , Wenhui Fan

Sparse reward environments pose significant challenges in reinforcement learning, especially within multi-agent systems (MAS) where feedback is delayed and shared across agents, leading to suboptimal learning. We propose Collaborative…

Artificial Intelligence · Computer Science 2025-05-14 Yufei Lin , Chengwei Ye , Huanzhen Zhang , Kangsheng Wang , Linuo Xu , Shuyan Liu , Zeyu Zhang

In many coordination problems, independently reasoning humans are able to discover mutually compatible policies. In contrast, independently trained self-play policies are often mutually incompatible. Zero-shot coordination (ZSC) has…

Artificial Intelligence · Computer Science 2023-07-14 Johannes Treutlein , Michael Dennis , Caspar Oesterheld , Jakob Foerster

Recent success in cooperative multi-agent reinforcement learning (MARL) relies on centralized training and policy sharing. Centralized training eliminates the issue of non-stationarity MARL yet induces large communication costs, and policy…

Multiagent Systems · Computer Science 2022-04-04 Dingyang Chen , Yile Li , Qi Zhang

We study the emergence of cooperative behaviors in reinforcement learning agents by introducing a challenging competitive multi-agent soccer environment with continuous simulated physics. We demonstrate that decentralized, population-based…

Artificial Intelligence · Computer Science 2021-05-21 Siqi Liu , Guy Lever , Josh Merel , Saran Tunyasuvunakool , Nicolas Heess , Thore Graepel

Training agents in cooperative settings offers the promise of AI agents able to interact effectively with humans (and other agents) in the real world. Multi-agent reinforcement learning (MARL) has the potential to achieve this goal,…

Machine Learning · Computer Science 2022-03-16 Jaleh Zand , Jack Parker-Holder , Stephen J. Roberts

In the early stages of human life, babies develop their skills by exploring different scenarios motivated by their inherent satisfaction rather than by extrinsic rewards from the environment. This behavior, referred to as intrinsic…

Machine Learning · Computer Science 2022-02-25 Alain Andres , Esther Villar-Rodriguez , Javier Del Ser

This paper presents a novel approach to Multi-Agent Reinforcement Learning (MARL) that combines cooperative task decomposition with the learning of reward machines (RMs) encoding the structure of the sub-tasks. The proposed method helps…

Artificial Intelligence · Computer Science 2025-02-17 Leo Ardon , Daniel Furelos-Blanco , Alessandra Russo

In this study, we explore the application of game theory, in particular Stackelberg games, to address the issue of effective coordination strategy generation for heterogeneous robots with one-way communication. To that end, focusing on the…

Robotics · Computer Science 2023-08-01 Yuhan Zhao , Baichuan Huang , Jingjin Yu , Quanyan Zhu

Zero-shot human-AI coordination is the training of an ego-agent to coordinate with humans without human data. Most studies on zero-shot human-AI coordination have focused on enhancing the ego-agent's coordination ability in a given…

Artificial Intelligence · Computer Science 2025-08-22 Won-Sang You , Tae-Gwan Ha , Seo-Young Lee , Kyung-Joong Kim

A central challenge in multi-agent reinforcement learning is enabling agents to adapt to previously unseen teammates in a zero-shot fashion. Prior work in zero-shot coordination often follows a two-stage process, first generating a diverse…

Multiagent Systems · Computer Science 2026-02-16 Andrew Ni , Simon Stepputtis , Stefanos Nikolaidis , Michael Lewis , Katia P. Sycara , Woojun Kim

The necessity for cooperation among intelligent machines has popularised cooperative multi-agent reinforcement learning (MARL) in AI research. However, many research endeavours heavily rely on parameter sharing among agents, which confines…

Machine Learning · Computer Science 2023-12-29 Yifan Zhong , Jakub Grudzien Kuba , Xidong Feng , Siyi Hu , Jiaming Ji , Yaodong Yang

We propose a multimodal (vision-and-language) benchmark for cooperative and heterogeneous multi-agent learning. We introduce a benchmark multimodal dataset with tasks involving collaboration between multiple simulated heterogeneous robots…

Artificial Intelligence · Computer Science 2022-08-30 Vasu Sharma , Prasoon Goyal , Kaixiang Lin , Govind Thattai , Qiaozi Gao , Gaurav S. Sukhatme

AI agents hold the potential to transform everyday life by helping humans achieve their goals. To do this successfully, agents need to be able to coordinate with novel partners without prior interaction, a setting known as zero-shot…

Artificial Intelligence · Computer Science 2025-03-25 Tobias Gessler , Tin Dizdarevic , Ani Calinescu , Benjamin Ellis , Andrei Lupu , Jakob Nicolaus Foerster

Zero-shot learning (ZSL) refers to the problem of learning to classify instances from the novel classes (unseen) that are absent in the training set (seen). Most ZSL methods infer the correlation between visual features and attributes to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Zhe Liu , Yun Li , Lina Yao , Xianzhi Wang , Guodong Long

Cooperative Coevolution (CC) effectively addresses Large-Scale Global Optimization (LSGO) via decomposition but struggles with the emerging class of Heterogeneous LSGO (H-LSGO) problems arising from real-world applications, where…

Neural and Evolutionary Computing · Computer Science 2026-04-03 Wenjie Qiu , Zixin Wang , Hongyu Fang , Zeyuan Ma , Yue-Jiao Gong