English
Related papers

Related papers: SMIX($\lambda$): Enhancing Centralized Value Funct…

200 papers

Training multiple agents to coordinate is an essential problem with applications in robotics, game theory, economics, and social sciences. However, most existing Multi-Agent Reinforcement Learning (MARL) methods are online and thus…

Machine Learning · Computer Science 2024-01-19 Paul Barde , Jakob Foerster , Derek Nowrouzezahrai , Amy Zhang

In fully cooperative multi-agent reinforcement learning (MARL) settings, environments are highly stochastic due to the partial observability of each agent and the continuously changing policies of other agents. To address the above issues,…

Multiagent Systems · Computer Science 2023-06-06 Wei-Fang Sun , Cheng-Kuang Lee , Simon See , Chun-Yi Lee

Model-based reinforcement learning algorithms that combine model-based planning and learned value/policy prior have gained significant recognition for their high data efficiency and superior performance in continuous control. However, we…

Machine Learning · Computer Science 2025-02-07 Haotian Lin , Pengcheng Wang , Jeff Schneider , Guanya Shi

We study multi-agent reinforcement learning (MARL) for the general-sum Markov Games (MGs) under the general function approximation. In order to find the minimum assumption for sample-efficient learning, we introduce a novel complexity…

Machine Learning · Computer Science 2023-10-11 Nuoya Xiong , Zhihan Liu , Zhaoran Wang , Zhuoran Yang

This paper proposes a novel distributed approach for solving a cooperative Constrained Multi-agent Reinforcement Learning (CMARL) problem, where agents seek to minimize a global objective function subject to shared constraints. Unlike…

Systems and Control · Electrical Eng. & Systems 2026-05-08 Ali Kahe , Hamed Kebriaei

Multi-Agent Reinforcement Learning (MARL) has emerged as a foundational approach for addressing diverse, intelligent control tasks in various scenarios like the Internet of Vehicles, Internet of Things, and Unmanned Aerial Vehicles.…

Multiagent Systems · Computer Science 2024-10-15 Xiaoxue Yu , Rongpeng Li , Chengchao Liang , Zhifeng Zhao

We study the problem of multi-robot mapless navigation in the popular Centralized Training and Decentralized Execution (CTDE) paradigm. This problem is challenging when each robot considers its path without explicitly sharing observations…

Multiagent Systems · Computer Science 2021-12-17 Enrico Marchesini , Alessandro Farinelli

Multi-Agent Reinforcement Learning (MARL) has demonstrated significant success in training decentralised policies in a centralised manner by making use of value factorization methods. However, addressing surprise across spurious states and…

Machine Learning · Computer Science 2021-01-19 Karush Suri , Xiao Qi Shi , Konstantinos Plataniotis , Yuri Lawryshyn

The cooperative driving technology of Connected and Autonomous Vehicles (CAVs) is crucial for improving the efficiency and safety of transportation systems. Learning-based methods, such as Multi-Agent Reinforcement Learning (MARL), have…

Robotics · Computer Science 2025-08-12 Jiaqi Liu , Chengkai Xu , Peng Hang , Jian Sun , Wei Zhan , Masayoshi Tomizuka , Mingyu Ding

Optimizing the consolidation process in container-based fulfillment centers requires trading off competing objectives such as processing speed, resource usage, and space utilization while adhering to a range of real-world operational…

Machine Learning · Computer Science 2026-03-02 Sikata Sengupta , Guangyi Liu , Omer Gottesman , Joseph W Durham , Michael Kearns , Aaron Roth , Michael Caldara

Multi-agent reinforcement learning (MARL) has emerged as a promising paradigm for adaptive traffic signal control (ATSC) of multiple intersections. Existing approaches typically follow either a fully centralized or a fully decentralized…

Multiagent Systems · Computer Science 2026-03-31 Arash Rezaali , Pouria Yazdani , Monireh Abdoos

In this paper, we are interested in systems with multiple agents that wish to collaborate in order to accomplish a common task while a) agents have different information (decentralized information) and b) agents do not know the model of the…

Optimization and Control · Mathematics 2020-12-04 Jalal Arabneydi , Aditya Mahajan

Multi-agent reinforcement learning methods such as VDN, QMIX, and QTRAN that adopt centralized training with decentralized execution (CTDE) framework have shown promising results in cooperation and competition. However, in some multi-agent…

Multiagent Systems · Computer Science 2022-03-29 Jiajun Chai , Weifan Li , Yuanheng Zhu , Dongbin Zhao , Zhe Ma , Kewu Sun , Jishiyu Ding

Centralized Training with Decentralized Execution (CTDE) has recently emerged as a popular framework for cooperative Multi-Agent Reinforcement Learning (MARL), where agents can use additional global state information to guide training in a…

Artificial Intelligence · Computer Science 2025-05-14 Yihe Zhou , Shunyu Liu , Yunpeng Qing , Kaixuan Chen , Tongya Zheng , Jie Song , Mingli Song

Risk sensitivity has become a central theme in reinforcement learning (RL), where convex risk measures and robust formulations provide principled ways to model preferences beyond expected return. Recent extensions to multi-agent RL (MARL)…

Machine Learning · Computer Science 2025-11-12 Runyu Zhang , Na Li , Asuman Ozdaglar , Jeff Shamma , Gioele Zardini

Cooperative multi-agent reinforcement learning (MARL) is widely used to address large joint observation and action spaces by decomposing a centralized control problem into multiple interacting agents. However, such decomposition often…

Machine Learning · Computer Science 2026-04-16 Zijian Zhao , Jing Gao , Sen Li

We study multi-agent reinforcement learning (MARL) in a stochastic network of agents. The objective is to find localized policies that maximize the (discounted) global reward. In general, scalability is a challenge in this setting because…

Machine Learning · Computer Science 2021-11-03 Yiheng Lin , Guannan Qu , Longbo Huang , Adam Wierman

Non-stationarity is a fundamental challenge in multi-agent reinforcement learning (MARL), where agents update their behaviour as they learn. Many theoretical advances in MARL avoid the challenge of non-stationarity by coordinating the…

Computer Science and Game Theory · Computer Science 2025-03-19 Bora Yongacoglu , Gürdal Arslan , Serdar Yüksel

In this paper, we propose a novel model-based multi-agent reinforcement learning approach named Value Decomposition Framework with Disentangled World Model to address the challenge of achieving a common goal of multiple agents interacting…

Machine Learning · Computer Science 2025-09-29 Zhizun Wang , David Meger

In this paper, we introduce an alternative approach to enhancing Multi-Agent Reinforcement Learning (MARL) through the integration of domain knowledge and attention-based policy mechanisms. Our methodology focuses on the incorporation of…

Machine Learning · Computer Science 2025-04-04 Andre R Kuroswiski , Annie S Wu , Angelo Passaro