English
Related papers

Related papers: Any-Play: An Intrinsic Augmentation for Zero-Shot …

200 papers

Zero-shot coordination in cooperative artificial intelligence (AI) remains a significant challenge, which means effectively coordinating with a wide range of unseen partners. Previous algorithms have attempted to address this challenge by…

Artificial Intelligence · Computer Science 2024-03-01 Yang Li , Shao Zhang , Jichen Sun , Yali Du , Ying Wen , Xinbing Wang , Wei Pan

To be helpful assistants, AI agents must be aware of their own capabilities and limitations. This includes knowing when to answer from parametric knowledge versus using tools, when to trust tool outputs, and when to abstain or hedge. Such…

Machine Learning · Computer Science 2025-09-01 Jacob Eisenstein , Reza Aghajani , Adam Fisch , Dheeru Dua , Fantine Huot , Mirella Lapata , Vicky Zayats , Jonathan Berant

In the future, artificial learning agents are likely to become increasingly widespread in our society. They will interact with both other learning agents and humans in a variety of complex settings including social dilemmas. We consider the…

Computer Science and Game Theory · Computer Science 2019-11-21 Tobias Baumann , Thore Graepel , John Shawe-Taylor

Single-agent reinforcement learning algorithms in a multi-agent environment are inadequate for fostering cooperation. If intelligent agents are to interact and work together to solve complex problems, methods that counter non-cooperative…

Machine Learning · Computer Science 2022-03-09 Ted Fujimoto , Arthur Paul Pedersen

Zero-shot human-AI coordination holds the promise of collaborating with humans without human data. Prevailing methods try to train the ego agent with a population of partners via self-play. However, these methods suffer from two problems:…

Artificial Intelligence · Computer Science 2023-05-23 Xingzhou Lou , Jiaxian Guo , Junge Zhang , Jun Wang , Kaiqi Huang , Yali Du

We study the emergence of cooperative behaviors in reinforcement learning agents by introducing a challenging competitive multi-agent soccer environment with continuous simulated physics. We demonstrate that decentralized, population-based…

Artificial Intelligence · Computer Science 2021-05-21 Siqi Liu , Guy Lever , Josh Merel , Saran Tunyasuvunakool , Nicolas Heess , Thore Graepel

In cooperative training, humans within a team coordinate on complex tasks, building mental models of their teammates and learning to adapt to teammates' actions in real-time. To reduce the often prohibitive scheduling constraints associated…

While we would like agents that can coordinate with humans, current algorithms such as self-play and population-based training create agents that can coordinate with themselves. Agents that assume their partner to be optimal or similar to…

Machine Learning · Computer Science 2020-01-10 Micah Carroll , Rohin Shah , Mark K. Ho , Thomas L. Griffiths , Sanjit A. Seshia , Pieter Abbeel , Anca Dragan

Coordination and cooperation between humans and autonomous agents in cooperative games raises interesting questions of human decision making and behaviour changes. Here we report our findings from a group formation game in a small-world…

Physics and Society · Physics 2021-05-21 Tuomas Takko , Kunal Bhattacharya , Daniel Monsivais , Kimmo Kaski

The intuitive collaboration of humans and intelligent robots (embodied AI) in the real-world is an essential objective for many desirable applications of robotics. Whilst there is much research regarding explicit communication, we focus on…

Robotics · Computer Science 2020-08-04 Ali Shafti , Jonas Tjomsland , William Dudley , A. Aldo Faisal

There is a recent trend of applying multi-agent reinforcement learning (MARL) to train an agent that can cooperate with humans in a zero-shot fashion without using any human data. The typical workflow is to first repeatedly run self-play…

Artificial Intelligence · Computer Science 2023-02-06 Chao Yu , Jiaxuan Gao , Weilin Liu , Botian Xu , Hao Tang , Jiaqi Yang , Yu Wang , Yi Wu

Real-world multi-agent systems may require ad hoc teaming, where an agent must coordinate with other previously unseen teammates to solve a task in a zero-shot manner. Prior work often either selects a pretrained policy based on an inferred…

Multiagent Systems · Computer Science 2026-04-01 Rupal Nigam , Niket Parikh , Hamid Osooli , Mikihisa Yuasa , Jacob Heglund , Huy T. Tran

This paper introduces Team-Attention-Actor-Critic (TAAC), a reinforcement learning algorithm designed to enhance multi-agent collaboration in cooperative environments. TAAC employs a Centralized Training/Centralized Execution scheme…

Artificial Intelligence · Computer Science 2025-12-23 Hugo Garrido-Lestache Belinchon , Jeremy Kedziora

In the evolving landscape of human-autonomy teaming (HAT), fostering effective collaboration and trust between human and autonomous agents is increasingly important. To explore this, we used the game Overcooked AI to create dynamic teaming…

Human-Computer Interaction · Computer Science 2025-06-18 Anthony J. Ries , Stéphane Aroca-Ouellette , Alessandro Roncone , Ewart J. de Visser

In dynamic collaborative settings, for artificial intelligence (AI) agents to better align with humans, they must adapt to novel teammates who utilise unforeseen strategies. While adaptation is often simple for humans, it can be challenging…

Machine Learning · Computer Science 2025-04-22 Ravi Hammond , Dustin Craggs , Mingyu Guo , Jakob Foerster , Ian Reid

Cooperative game theory has diverse applications in contemporary artificial intelligence, including domains like interpretable machine learning, resource allocation, and collaborative decision-making. However, specifying a cooperative game…

Computer Science and Game Theory · Computer Science 2024-12-05 Filip Úradník , David Sychrovský , Jakub Černý , Martin Černý

In many coordination problems, independently reasoning humans are able to discover mutually compatible policies. In contrast, independently trained self-play policies are often mutually incompatible. Zero-shot coordination (ZSC) has…

Artificial Intelligence · Computer Science 2023-07-14 Johannes Treutlein , Michael Dennis , Caspar Oesterheld , Jakob Foerster

Solving tasks with sparse rewards is one of the most important challenges in reinforcement learning. In the single-agent setting, this challenge is addressed by introducing intrinsic rewards that motivate agents to explore unseen regions of…

Machine Learning · Computer Science 2021-05-25 Shariq Iqbal , Fei Sha

The latest developments in AI focus on agentic systems where artificial and human agents cooperate to realize global goals. An example is collaborative learning, which aims to train a global model based on data from individual agents. A…

Computer Science and Game Theory · Computer Science 2025-08-20 Björn Filter , Ralf Möller , Özgür Lütfü Özçep

We study the problem of designing autonomous agents that can learn to cooperate effectively with a potentially suboptimal partner while having no access to the joint reward function. This problem is modeled as a cooperative episodic…

Machine Learning · Computer Science 2022-06-14 Thomas Kleine Buening , Anne-Marie George , Christos Dimitrakakis