English
Related papers

Related papers: Coordination Failure in Cooperative Offline MARL

200 papers

Recently, deep multi-agent reinforcement learning (MARL) has shown the promise to solve complex cooperative tasks. Its success is partly because of parameter sharing among agents. However, such sharing may lead agents to behave similarly…

Machine Learning · Computer Science 2021-11-02 Chenghao Li , Tonghan Wang , Chengjie Wu , Qianchuan Zhao , Jun Yang , Chongjie Zhang

Robust embodied navigation relies on complementary sensory cues. However, high-quality and well-aligned multi-modal data is often difficult to obtain in practice. Training a monolithic model is also challenging as rich multi-modal inputs…

Robotics · Computer Science 2026-05-08 Shuo Liu , Xinzichen Li , Christopher Amato

We introduce hybrid execution in multi-agent reinforcement learning (MARL), a new paradigm in which agents aim to successfully complete cooperative tasks with arbitrary communication levels at execution time by taking advantage of…

Machine Learning · Computer Science 2023-06-06 Pedro P. Santos , Diogo S. Carvalho , Miguel Vasco , Alberto Sardinha , Pedro A. Santos , Ana Paiva , Francisco S. Melo

Training agents in cooperative settings offers the promise of AI agents able to interact effectively with humans (and other agents) in the real world. Multi-agent reinforcement learning (MARL) has the potential to achieve this goal,…

Machine Learning · Computer Science 2022-03-16 Jaleh Zand , Jack Parker-Holder , Stephen J. Roberts

Offline multi-agent reinforcement learning (MARL) addresses key limitations of online MARL, such as safety concerns, expensive data collection, extended training intervals, and high signaling overhead caused by online interactions with the…

Multiagent Systems · Computer Science 2025-01-23 Eslam Eldeeb , Hirley Alves

Many emerging agentic paradigms require agents to collaborate with one another (or people) to achieve shared goals. Unfortunately, existing approaches to learning policies for such collaborative problems produce brittle solutions that fail…

Machine Learning · Computer Science 2026-03-02 Chengrui Qu , Yizhou Zhang , Nicolas Lanzetti , Eric Mazumdar

In this paper, we introduce an alternative approach to enhancing Multi-Agent Reinforcement Learning (MARL) through the integration of domain knowledge and attention-based policy mechanisms. Our methodology focuses on the incorporation of…

Machine Learning · Computer Science 2025-04-04 Andre R Kuroswiski , Annie S Wu , Angelo Passaro

Discovering successful coordinated behaviors is a central challenge in Multi-Agent Reinforcement Learning (MARL) since it requires exploring a joint action space that grows exponentially with the number of agents. In this paper, we propose…

Machine Learning · Computer Science 2021-10-14 Ammar Fayad , Majd Ibrahim

Multi-agent reinforcement learning (MARL) optimizes strategic interactions in non-cooperative dynamic games, where agents have misaligned objectives. However, data-driven methods such as multi-agent policy gradients (MA-PG) often suffer…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Jingqi Li , Gechen Qu , Jason J. Choi , Somayeh Sojoudi , Claire Tomlin

Teams of people coordinate to perform complex tasks by forming abstract mental models of world and agent dynamics. The use of abstract models contrasts with much recent work in robot learning that uses a high-fidelity simulator and…

Robotics · Computer Science 2025-03-10 Adam Labiosa , Josiah P. Hanna

We consider multi-agent reinforcement learning (MARL) for cooperative communication and coordination tasks. MARL agents can be brittle because they can overfit their training partners' policies. This overfitting can produce agents that…

Artificial Intelligence · Computer Science 2022-03-08 Tessa van der Heiden , Herke van Hoof , Efstratios Gavves , Christoph Salge

Existing distributed cooperative multi-agent reinforcement learning (MARL) frameworks usually assume undirected coordination graphs and communication graphs while estimating a global reward via consensus algorithms for policy evaluation.…

Multiagent Systems · Computer Science 2022-01-14 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush. K. Sharma

Offline-to-online reinforcement learning harnesses the stability of offline pretraining and the flexibility of online fine-tuning. A key challenge lies in the non-stationary distribution shift between offline datasets and the evolving…

Machine Learning · Computer Science 2026-05-15 Letian Yang , Xu Liu , Yiqiang Lu , Jian Liu , Weiqiang Wang , Shuai Li

Cooperative multi-agent reinforcement learning (MARL) for navigation enables agents to cooperate to achieve their navigation goals. Using emergent communication, agents learn a communication protocol to coordinate and share information that…

Machine Learning · Computer Science 2024-02-13 Mohamed K. Abdelaziz , Mohammed S. Elbamby , Sumudu Samarakoon , Mehdi Bennis

Multi-agent reinforcement learning (MARL) has made significant strides in enabling coordinated behaviors among autonomous agents. However, most existing approaches assume that communication is instantaneous, reliable, and has unlimited…

Artificial Intelligence · Computer Science 2025-11-17 Zejiao Liu , Yi Li , Jiali Wang , Junqi Tu , Yitian Hong , Fangfei Li , Yang Liu , Toshiharu Sugawara , Yang Tang

Multi-Agent Reinforcement Learning (MARL) comprises an area of growing interest in the field of machine learning. Despite notable advances, there are still problems that require investigation. The lazy agent pathology is a famous problem in…

Machine Learning · Computer Science 2023-11-07 Rafael Pina , Varuna De Silva , Corentin Artaud

Connected and autonomous vehicles across land, water, and air must often operate in dynamic, unpredictable environments with limited communication, no centralized control, and partial observability. These real-world constraints pose…

Multiagent Systems · Computer Science 2025-11-18 Hung Du , Hy Nguyen , Srikanth Thudumu , Rajesh Vasa , Kon Mouzakis

Multi-agent reinforcement learning (MARL) has been increasingly explored to learn the cooperative policy towards maximizing a certain global reward. Many existing studies take advantage of graph neural networks (GNN) in MARL to propagate…

Machine Learning · Computer Science 2020-12-25 Wenlei Shi , Xinran Wei , Jia Zhang , Xiaoyuan Ni , Arthur Jiang , Jiang Bian , Tie-Yan Liu

In order for artificial agents to coordinate effectively with people, they must act consistently with existing conventions (e.g. how to navigate in traffic, which language to speak, or how to coordinate with teammates). A group's…

Artificial Intelligence · Computer Science 2019-03-14 Adam Lerer , Alexander Peysakhovich

This paper introduces LLM-MARL, a unified framework that incorporates large language models (LLMs) into multi-agent reinforcement learning (MARL) to enhance coordination, communication, and generalization in simulated game environments. The…

Artificial Intelligence · Computer Science 2025-11-04 Zhengyang Li , Sawyer Campos , Nana Wang