English
Related papers

Related papers: Sequence Modeling for N-Agent Ad Hoc Teamwork

200 papers

Successful deployment of multi-agent reinforcement learning often requires agents to adapt their behaviour. In this work, we discuss the problem of teamwork adaptation in which a team of agents needs to adapt their policies to solve novel…

Multiagent Systems · Computer Science 2023-11-21 Lukas Schäfer , Filippos Christianos , Amos Storkey , Stefano V. Albrecht

We present an architecture for ad hoc teamwork, which refers to collaboration in a team of agents without prior coordination. State of the art methods for this problem often include a data-driven component that uses a long history of prior…

Artificial Intelligence · Computer Science 2022-10-20 Hasra Dodampegama , Mohan Sridharan

We introduce a framework for cooperative manipulation, applied on an underactuated manipulation problem. Two stationary robotic manipulators are required to cooperate in order to reposition an object within their shared work space. Control…

Robotics · Computer Science 2023-02-23 Sander De Witte , Tom Lefebvre , Thijs Van Hauwermeiren , Guillaume Crevecoeur

We present the Multi-Agent Transformer World Model (MATWM), a novel transformer-based world model designed for multi-agent reinforcement learning in both vector- and image-based environments. MATWM combines a decentralized imagination…

Machine Learning · Computer Science 2025-06-24 Azad Deihim , Eduardo Alonso , Dimitra Apostolopoulou

This paper addresses the challenges of high resource dynamism and scheduling complexity in cloud-native database systems. It proposes an adaptive resource orchestration method based on multi-agent reinforcement learning. The method…

Machine Learning · Computer Science 2025-08-15 Guanzi Yao , Heyao Liu , Linyan Dai

Multi-agent reinforcement learning (MARL) has received increasing attention for its applications in various domains. Researchers have paid much attention on its partially observable and cooperative settings for meeting real-world…

Multiagent Systems · Computer Science 2021-12-08 Meng Yao , Qiyue Yin , Jun Yang , Tongtong Yu , Shengqi Shen , Junge Zhang , Bin Liang , Kaiqi Huang

We propose a minimax-Bayes approach to Ad Hoc Teamwork (AHT) that optimizes policies against an adversarial prior over partners, explicitly accounting for uncertainty about partners at time of deployment. Unlike existing methods that assume…

Artificial Intelligence · Computer Science 2025-02-05 Victor Villin , Thomas Kleine Buening , Christos Dimitrakakis

Offline reinforcement learning leverages previously-collected offline datasets to learn optimal policies with no necessity to access the real environment. Such a paradigm is also desirable for multi-agent reinforcement learning (MARL)…

Machine Learning · Computer Science 2022-06-13 Linghui Meng , Muning Wen , Yaodong Yang , Chenyang Le , Xiyun Li , Weinan Zhang , Ying Wen , Haifeng Zhang , Jun Wang , Bo Xu

Many multiagent systems in the real world include multiple types of agents with different abilities and functionality. Such heterogeneous multiagent systems have significant practical advantages. However, they also come with challenges…

Machine Learning · Computer Science 2023-05-30 Qingxu Fu , Xiaolin Ai , Jianqiang Yi , Tenghai Qiu , Wanmai Yuan , Zhiqiang Pu

Ad hoc teamwork problem describes situations where an agent has to cooperate with previously unseen agents to achieve a common goal. For an agent to be successful in these scenarios, it has to have a suitable cooperative skill. One could…

Artificial Intelligence · Computer Science 2022-10-21 Rujikorn Charakorn , Poramate Manoonpong , Nat Dilokthanakul

Effective coordination is crucial to solve multi-agent collaborative (MAC) problems. While centralized reinforcement learning methods can optimally solve small MAC instances, they do not scale to large problems and they fail to generalize…

Machine Learning · Computer Science 2019-10-22 Nicolas Carion , Gabriel Synnaeve , Alessandro Lazaric , Nicolas Usunier

Multiagent systems provide an ideal environment for the evaluation and analysis of real-world problems using reinforcement learning algorithms. Most traditional approaches to multiagent learning are affected by long training periods as well…

Artificial Intelligence · Computer Science 2021-05-25 Unnikrishnan Rajendran Menon , Anirudh Rajiv Menon

We study multi-agent reinforcement learning (MARL) with centralized training and decentralized execution. During the training, new agents may join, and existing agents may unexpectedly leave the training. In such situations, a standard deep…

Machine Learning · Computer Science 2022-08-05 Xuting Tang , Jia Xu , Shusen Wang

In-Context Reinforcement Learning (ICRL) has enabled foundation agents to adapt instantaneously to novel tasks, yet its efficacy in Ad-Hoc Teamwork (AHT)-where coordination with unknown partners is required-remains unexplored. To rigorously…

Artificial Intelligence · Computer Science 2026-05-26 Yuheng Jing , Kai Li , Ziwen Zhang , Jiajun Zhang , Zeyao Ma , Jiaxi Yang , Lei Zhang , Zhe Wu , Jinmin He , Junliang Xing , Jian Cheng

Open ad hoc teamwork is the problem of training a single agent to efficiently collaborate with an unknown group of teammates whose composition may change over time. A variable team composition creates challenges for the agent, such as the…

Multiagent Systems · Computer Science 2023-10-31 Arrasy Rahman , Ignacio Carlucho , Niklas Höpner , Stefano V. Albrecht

Training agents in cooperative settings offers the promise of AI agents able to interact effectively with humans (and other agents) in the real world. Multi-agent reinforcement learning (MARL) has the potential to achieve this goal,…

Machine Learning · Computer Science 2022-03-16 Jaleh Zand , Jack Parker-Holder , Stephen J. Roberts

Learning collaborative behaviors is essential for multi-agent systems. Traditionally, multi-agent reinforcement learning solves this implicitly through a joint reward and centralized observations, assuming collaborative behavior will…

Robotics · Computer Science 2025-02-27 Zhengran Ji , Lingyu Zhang , Paul Sajda , Boyuan Chen

Multi-agent systems outperform single agent in complex collaborative tasks. However, in large-scale scenarios, ensuring timely information exchange during decentralized task execution remains a challenge. This work presents an online…

Multiagent Systems · Computer Science 2023-09-07 Junjie Wang , Meng Guo , Zhongkui Li

Many recent successful off-policy multi-agent reinforcement learning (MARL) algorithms for cooperative partially observable environments focus on finding factorized value functions, leading to convoluted network structures. Building on the…

Machine Learning · Computer Science 2023-10-27 Raphaël Avalos , Mathieu Reymond , Ann Nowé , Diederik M. Roijers

Attracted by team scale and function diversity, a heterogeneous multi-robot system (HMRS), where multiple robots with different functions and numbers are coordinated to perform tasks, has been widely used for complex and large-scale…

Robotics · Computer Science 2021-03-16 Chao Huang , Rui Liu