English
Related papers

Related papers: Coordination Failure in Cooperative Offline MARL

200 papers

In real-world environments, autonomous agents rely on their egocentric observations. They must learn adaptive strategies to interact with others who possess mixed motivations, discernible only through visible cues. Several Multi-Agent…

Multiagent Systems · Computer Science 2023-12-15 Violet Xiang , Logan Cross , Jan-Philipp Fränken , Nick Haber

Offline multi-agent reinforcement learning (MARL) faces a critical challenge: the joint action space grows exponentially with the number of agents, making dataset coverage exponentially sparse and out-of-distribution (OOD) joint actions…

Machine Learning · Computer Science 2026-03-31 Yue Jin , Giovanni Montana

In cooperative multi-agent reinforcement learning (c-MARL), agents learn to cooperatively take actions as a team to maximize a total team reward. We analyze the robustness of c-MARL to adversaries capable of attacking one of the agents on a…

Machine Learning · Computer Science 2020-03-10 Jieyu Lin , Kristina Dzeparoska , Sai Qian Zhang , Alberto Leon-Garcia , Nicolas Papernot

In human society, the conflict between self-interest and collective well-being often obstructs efforts to achieve shared welfare. Related concepts like the Tragedy of the Commons and Social Dilemmas frequently manifest in our daily lives.…

Multiagent Systems · Computer Science 2025-06-17 Yue Jin , Shuangqing Wei , Giovanni Montana

In multi-agent reinforcement learning (MARL), coordination plays a crucial role in enhancing agents' performance beyond what they could achieve through cooperation alone. The interdependence of agents' actions, coupled with the need for…

Multiagent Systems · Computer Science 2024-04-30 Rolando Fernandez , Garrett Warnell , Derrik E. Asher , Peter Stone

Learning cooperative multi-agent policy from offline multi-task data that can generalize to unseen tasks with varying numbers of agents and targets is an attractive problem in many scenarios. Although aggregating general behavior patterns…

Machine Learning · Computer Science 2025-03-31 Sicong Liu , Yang Shu , Chenjuan Guo , Bin Yang

Efficient path planning for unmanned aerial vehicles (UAVs) is crucial in remote sensing and information collection. As task scales expand, the cooperative deployment of multiple UAVs significantly improves information collection…

Multiagent Systems · Computer Science 2025-03-06 Zilin Zhao , Chishui Chen , Haotian Shi , Jiale Chen , Xuanlin Yue , Zhejian Yang , Yang Liu

This work studies the application of Multi-Agent Reinforcement Learning (MARL) to decentralized control of unmanned aerial vehicles to relay a critical data package to a known position. For this purpose, a family of deterministic games is…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Mika Persson , Jonas Lidman , Jacob Ljungberg , Samuel Sandelius , Adam Andersson

Offline reinforcement learning (RL) seeks to learn optimal policies from static datasets without interacting with the environment. A common challenge is handling multi-modal action distributions, where multiple behaviours are represented in…

Machine Learning · Computer Science 2025-03-20 Mianchu Wang , Yue Jin , Giovanni Montana

Self-play, a learning paradigm where agents iteratively refine their policies by interacting with historical or concurrent versions of themselves or other evolving agents, has shown remarkable success in solving complex non-cooperative…

Artificial Intelligence · Computer Science 2025-10-21 Ruize Zhang , Zelai Xu , Chengdong Ma , Chao Yu , Wei-Wei Tu , Wenhao Tang , Shiyu Huang , Deheng Ye , Wenbo Ding , Yaodong Yang , Yu Wang

This paper presents a cooperative multi-agent deep reinforcement learning (MADRL) approach for unmmaned aerial vehicle (UAV)-aided mobile edge computing (MEC) networks. An UAV with computing capability can provide task offlaoding services…

Information Theory · Computer Science 2024-07-04 Mintae Kim , Hoon Lee , Sangwon Hwang , Merouane Debbah , Inkyu Lee

Role-based learning is a promising approach to improving the performance of Multi-Agent Reinforcement Learning (MARL). Nevertheless, without manual assistance, current role-based methods cannot guarantee stably discovering a set of roles to…

Artificial Intelligence · Computer Science 2023-04-04 Xianghua Zeng , Hao Peng , Angsheng Li

Multi-Agent Reinforcement Learning (MARL) has emerged as a powerfulparadigm for cooperative decision-making in connected autonomous vehicles(CAVs); however, existing approaches often fail to guarantee stability, optimality,and…

General Mathematics · Mathematics 2025-11-25 Mazyar Taghavi , Javad Vahidi

Multi-agent reinforcement learning (MARL) has been increasingly adopted in many real-world applications. While MARL enables decentralized deployment on resource-constrained edge devices, it suffers from severe non-stationarity due to the…

Over these years, multi-agent reinforcement learning has achieved remarkable performance in multi-agent planning and scheduling tasks. It typically follows the self-play setting, where agents are trained by playing with a fixed group of…

Multiagent Systems · Computer Science 2023-02-13 Lebin Yu , Yunbo Qiu , Quanming Yao , Xudong Zhang , Jian Wang

Ramp merging is a critical and challenging task for autonomous vehicles (AVs), particularly in mixed traffic environments with human-driven vehicles (HVs). Existing approaches typically rely on either lane-changing or inter-vehicle gap…

Robotics · Computer Science 2025-11-20 Yassine Ibork , Myounggyu Won , Lokesh Das

The next-generation wireless technologies, including beyond 5G and 6G networks, are paving the way for transformative applications such as vehicle platooning, smart cities, and remote surgery. These innovations are driven by a vast array of…

Multiagent Systems · Computer Science 2026-01-05 Eslam Eldeeb , Hirley Alves

Recent success in cooperative multi-agent reinforcement learning (MARL) relies on centralized training and policy sharing. Centralized training eliminates the issue of non-stationarity MARL yet induces large communication costs, and policy…

Multiagent Systems · Computer Science 2022-04-04 Dingyang Chen , Yile Li , Qi Zhang

Multi-agent reinforcement learning (MARL) has become effective in tackling discrete cooperative game scenarios. However, MARL has yet to penetrate settings beyond those modelled by team and zero-sum games, confining it to a small subset of…

Multiagent Systems · Computer Science 2021-06-16 David Mguni , Yutong Wu , Yali Du , Yaodong Yang , Ziyi Wang , Minne Li , Ying Wen , Joel Jennings , Jun Wang

Multi-agent formation as well as obstacle avoidance is one of the most actively studied topics in the field of multi-agent systems. Although some classic controllers like model predictive control (MPC) and fuzzy control achieve a certain…

Systems and Control · Electrical Eng. & Systems 2021-11-16 Yuzi Yan , Xiaoxiang Li , Xinyou Qiu , Jiantao Qiu , Jian Wang , Yu Wang , Yuan Shen