English
Related papers

Related papers: Zero Shot Coordination for Sparse Reward Tasks wit…

200 papers

Cooperative Multi-agent Reinforcement Learning (MARL) algorithms with Zero-Shot Coordination (ZSC) have gained significant attention in recent years. ZSC refers to the ability of agents to coordinate zero-shot (without additional…

Machine Learning · Computer Science 2023-08-22 Hadi Nekoei , Xutong Zhao , Janarthanan Rajendran , Miao Liu , Sarath Chandar

Zero-shot coordination (ZSC) is a new cooperative multi-agent reinforcement learning (MARL) challenge that aims to train an ego agent to work with diverse, unseen partners during deployment. The significant difference between the…

Artificial Intelligence · Computer Science 2024-09-27 Xihuai Wang , Shao Zhang , Wenhao Zhang , Wentao Dong , Jingxiao Chen , Ying Wen , Weinan Zhang

Generating agents that can achieve zero-shot coordination (ZSC) with unseen partners is a new challenge in cooperative multi-agent reinforcement learning (MARL). Recently, some studies have made progress in ZSC by exposing the agents to…

Neural and Evolutionary Computing · Computer Science 2025-01-03 Ke Xue , Yutong Wang , Cong Guan , Lei Yuan , Haobo Fu , Qiang Fu , Chao Qian , Yang Yu

Zero-shot coordination (ZSC) -- the ability to collaborate with unfamiliar partners -- is essential to making autonomous agents effective teammates. Existing ZSC methods evaluate coordination capabilities between two agents who have not…

Zero-shot coordination(ZSC), a key challenge in multi-agent game theory, has become a hot topic in reinforcement learning (RL) research recently, especially in complex evolving games. It focuses on the generalization ability of agents,…

Machine Learning · Computer Science 2025-11-19 Bingyu Hui , Lebin Yu , Quanming Yao , Yunpeng Qu , Xudong Zhang , Jian Wang

Zero-shot coordination (ZSC), the ability to adapt to a new partner in a cooperative task, is a critical component of human-compatible AI. While prior work has focused on training agents to cooperate on a single task, these specialized…

Multiagent Systems · Computer Science 2025-04-22 Kunal Jha , Wilka Carvalho , Yancheng Liang , Simon S. Du , Max Kleiman-Weiner , Natasha Jaques

It is a long-standing challenge to enable an intelligent agent to learn in one environment and generalize to an unseen environment without further data collection and finetuning. In this paper, we consider a zero shot generalization problem…

Machine Learning · Computer Science 2021-03-16 Huazhe Xu , Boyuan Chen , Yang Gao , Trevor Darrell

AI agents hold the potential to transform everyday life by helping humans achieve their goals. To do this successfully, agents need to be able to coordinate with novel partners without prior interaction, a setting known as zero-shot…

Artificial Intelligence · Computer Science 2025-03-25 Tobias Gessler , Tin Dizdarevic , Ani Calinescu , Benjamin Ellis , Andrei Lupu , Jakob Nicolaus Foerster

We consider the problem of zero-shot coordination - constructing AI agents that can coordinate with novel partners they have not seen before (e.g. humans). Standard Multi-Agent Reinforcement Learning (MARL) methods typically focus on the…

Artificial Intelligence · Computer Science 2021-05-13 Hengyuan Hu , Adam Lerer , Alex Peysakhovich , Jakob Foerster

This paper presents a novel approach to Multi-Agent Reinforcement Learning (MARL) that combines cooperative task decomposition with the learning of reward machines (RMs) encoding the structure of the sub-tasks. The proposed method helps…

Artificial Intelligence · Computer Science 2025-02-17 Leo Ardon , Daniel Furelos-Blanco , Alessandra Russo

Zero-shot coordination (ZSC) aims to enable agents to cooperate with independently trained partners without prior interaction, a key requirement for real-world multi-agent systems and human-AI collaboration. Existing approaches have largely…

Machine Learning · Computer Science 2026-05-13 Mingu Kang , Sunwoo Lee , Yonghyeon Jo , Seungyul Han

There is a recent trend of applying multi-agent reinforcement learning (MARL) to train an agent that can cooperate with humans in a zero-shot fashion without using any human data. The typical workflow is to first repeatedly run self-play…

Artificial Intelligence · Computer Science 2023-02-06 Chao Yu , Jiaxuan Gao , Weilin Liu , Botian Xu , Hao Tang , Jiaqi Yang , Yu Wang , Yi Wu

Over these years, multi-agent reinforcement learning has achieved remarkable performance in multi-agent planning and scheduling tasks. It typically follows the self-play setting, where agents are trained by playing with a fixed group of…

Multiagent Systems · Computer Science 2023-02-13 Lebin Yu , Yunbo Qiu , Quanming Yao , Xudong Zhang , Jian Wang

Multiagent reinforcement learning (MARL) is commonly considered to suffer from non-stationary environments and exponentially increasing policy space. It would be even more challenging when rewards are sparse and delayed over long…

The standard problem setting in cooperative multi-agent settings is self-play (SP), where the goal is to train a team of agents that works well together. However, optimal SP policies commonly contain arbitrary conventions ("handshakes") and…

Artificial Intelligence · Computer Science 2022-07-18 Brandon Cui , Hengyuan Hu , Luis Pineda , Jakob N. Foerster

Sparse rewards are a major bottleneck in multi-agent reinforcement learning (MARL), where simultaneous learning induces non-stationarity and makes reward design especially delicate. Reward shaping can accelerate learning, but in the…

Multiagent Systems · Computer Science 2026-05-25 Elie Abboud , Oren Gal

Reinforcement learning (RL) has recently proven great success in various domains. Yet, the design of the reward function requires detailed domain expertise and tedious fine-tuning to ensure that agents are able to learn the desired…

Robotics · Computer Science 2023-03-06 Murad Dawood , Nils Dengler , Jorge de Heuvel , Maren Bennewitz

Cooperative artificial intelligence with human or superhuman proficiency in collaborative tasks stands at the frontier of machine learning research. Prior work has tended to evaluate cooperative AI performance under the restrictive…

Artificial Intelligence · Computer Science 2022-02-01 Keane Lucas , Ross E. Allen

In many real-world scenarios, reward signal for agents are exceedingly sparse, making it challenging to learn an effective reward function for reward shaping. To address this issue, the proposed approach in this paper performs reward…

Machine Learning · Computer Science 2026-05-18 Wenyun Li , Wenjie Huang , Chen Sun

Sparse reward environments pose significant challenges in reinforcement learning, especially within multi-agent systems (MAS) where feedback is delayed and shared across agents, leading to suboptimal learning. We propose Collaborative…

Artificial Intelligence · Computer Science 2025-05-14 Yufei Lin , Chengwei Ye , Huanzhen Zhang , Kangsheng Wang , Linuo Xu , Shuyan Liu , Zeyu Zhang
‹ Prev 1 2 3 10 Next ›