English
Related papers

Related papers: K-level Reasoning for Zero-Shot Coordination in Ha…

200 papers

Training agents in cooperative settings offers the promise of AI agents able to interact effectively with humans (and other agents) in the real world. Multi-agent reinforcement learning (MARL) has the potential to achieve this goal,…

Machine Learning · Computer Science 2022-03-16 Jaleh Zand , Jack Parker-Holder , Stephen J. Roberts

Generating agents that can achieve zero-shot coordination (ZSC) with unseen partners is a new challenge in cooperative multi-agent reinforcement learning (MARL). Recently, some studies have made progress in ZSC by exposing the agents to…

Neural and Evolutionary Computing · Computer Science 2025-01-03 Ke Xue , Yutong Wang , Cong Guan , Lei Yuan , Haobo Fu , Qiang Fu , Chao Qian , Yang Yu

The card game Hanabi is considered a strong medium for the testing and development of multi-agent reinforcement learning (MARL) algorithms, due to its cooperative nature, partial observability, limited communication and remarkable…

Multiagent Systems · Computer Science 2025-05-27 F. Bredell , H. A. Engelbrecht , J. C. Schoeman

Hanabi has become a popular game for research when it comes to reinforcement learning (RL) as it is one of the few cooperative card games where you have incomplete knowledge of the entire environment, thus presenting a challenge for a RL…

Machine Learning · Computer Science 2025-06-03 Nina Cohen , Kordel K. France

From the early days of computing, games have been important testbeds for studying how well machines can do sophisticated decision making. In recent years, machine learning has made dramatic advances with artificial agents reaching…

Hanabi is a cooperative game that challenges exist-ing AI techniques due to its focus on modeling the mental states ofother players to interpret and predict their behavior. While thereare agents that can achieve near-perfect scores in the…

Artificial Intelligence · Computer Science 2020-04-29 Rodrigo Canaan , Xianbo Gao , Youjin Chung , Julian Togelius , Andy Nealen , Stefan Menzel

Many real-world scenarios involve teams of agents that have to coordinate their actions to reach a shared goal. We focus on the setting in which a team of agents faces an opponent in a zero-sum, imperfect-information game. Team members can…

Multiagent Systems · Computer Science 2021-02-10 Federico Cacciamani , Andrea Celli , Marco Ciccone , Nicola Gatti

Modern large language models (LLMs) have demonstrated impressive capabilities at sophisticated tasks, often through step-by-step reasoning similar to humans. This is made possible by their strong few and zero-shot abilities -- they can…

Computation and Language · Computer Science 2023-05-24 Xingchen Wan , Ruoxi Sun , Hanjun Dai , Sercan O. Arik , Tomas Pfister

Infinitely repeated games can support cooperative outcomes that are not equilibria in the one-shot game. The idea is to make sure that any gains from deviating will be offset by retaliation in future rounds. However, this model of…

Computer Science and Game Theory · Computer Science 2024-06-04 Ratip Emin Berker , Vincent Conitzer

Achieving seamless coordination between AI agents and humans is crucial for real-world applications, yet it remains a significant open challenge. Hanabi is a cooperative card game featuring imperfect information, constrained communication,…

The combination of self-play and planning has achieved great successes in sequential games, for instance in Chess and Go. However, adapting algorithms such as AlphaZero to simultaneous games poses a new challenge. In these games, missing…

Artificial Intelligence · Computer Science 2024-06-12 Yannik Mahlau , Frederik Schubert , Bodo Rosenhahn

Learning in games has been widely used to solve many cooperative multi-agent problems such as coverage control, consensus, self-reconfiguration or vehicle-target assignment. One standard approach in this domain is to formulate the problem…

Systems and Control · Electrical Eng. & Systems 2022-09-07 Abbasali Koochakzadeh , Yasin Yazıcıoğlu

Zero-shot coordination (ZSC) remains a major challenge in the cooperative AI field, which aims to learn an agent to cooperate with an unseen partner in training environments or even novel environments. In recent years, a popular ZSC…

Artificial Intelligence · Computer Science 2024-08-09 Yin Gu , Qi Liu , Zhi Li , Kai Zhang

In modern resource-sharing systems, multiple agents access limited resources with unknown stochastic conditions to perform tasks. When multiple agents access the same resource (arm) simultaneously, they compete for successful usage, leading…

Computer Science and Game Theory · Computer Science 2025-03-28 Hongbo Li , Lingjie Duan

We seek measurable properties of AI agents that make them better or worse teammates from the subjective perspective of human collaborators. Our experiments use the cooperative card game Hanabi -- a common benchmark for AI-teaming research.…

Human-Computer Interaction · Computer Science 2025-03-21 Ho Chit Siu , Jaime D. Peña , Yutai Zhou , Ross E. Allen

Securing coordination between AI agent and teammates (human players or AI agents) in contexts involving unfamiliar humans continues to pose a significant challenge in Zero-Shot Coordination. The issue of cooperative incompatibility becomes…

Artificial Intelligence · Computer Science 2024-03-01 Yang Li , Shao Zhang , Jichen Sun , Wenhao Zhang , Yali Du , Ying Wen , Xinbing Wang , Wei Pan

The standard problem setting in Dec-POMDPs is self-play, where the goal is to find a set of policies that play optimally together. Policies learned through self-play may adopt arbitrary conventions and implicitly rely on multi-step…

Artificial Intelligence · Computer Science 2021-08-19 Hengyuan Hu , Adam Lerer , Brandon Cui , David Wu , Luis Pineda , Noam Brown , Jakob Foerster

Zero-shot coordination problem in multi-agent reinforcement learning (MARL), which requires agents to adapt to unseen agents, has attracted increasing attention. Traditional approaches often rely on the Self-Play (SP) framework to generate…

Multiagent Systems · Computer Science 2024-11-05 Weifan Long , Wen Wen , Peng Zhai , Lihua Zhang

Zero-shot coordination (ZSC), the ability to adapt to a new partner in a cooperative task, is a critical component of human-compatible AI. While prior work has focused on training agents to cooperate on a single task, these specialized…

Multiagent Systems · Computer Science 2025-04-22 Kunal Jha , Wilka Carvalho , Yancheng Liang , Simon S. Du , Max Kleiman-Weiner , Natasha Jaques

Stochastic dynamic teams and games are rich models for decentralized systems and challenging testing grounds for multi-agent learning. Previous work that guaranteed team optimality assumed stateless dynamics, or an explicit coordination…

Optimization and Control · Mathematics 2024-03-28 Bora Yongacoglu , Gürdal Arslan , Serdar Yüksel