English
Related papers

Related papers: More Centralized Training, Still Decentralized Exe…

200 papers

In tabular multi-agent reinforcement learning with average-cost criterion, a team of agents sequentially interacts with the environment and observes local incentives. We focus on the case that the global reward is a sum of local rewards,…

Optimization and Control · Mathematics 2021-10-26 Alec Koppel , Amrit Singh Bedi , Bhargav Ganguly , Vaneet Aggarwal

Multi-agent settings in the real world often involve tasks with varying types and quantities of agents and non-agent entities; however, common patterns of behavior often emerge among these agents/entities. Our method aims to leverage these…

Machine Learning · Computer Science 2021-06-15 Shariq Iqbal , Christian A. Schroeder de Witt , Bei Peng , Wendelin Böhmer , Shimon Whiteson , Fei Sha

In the real world, people/entities usually find matches independently and autonomously, such as finding jobs, partners, roommates, etc. It is possible that this search for matches starts with no initial knowledge of the environment. We…

Machine Learning · Computer Science 2021-12-07 Kshitija Taywade , Judy Goldsmith , Brent Harrison

Connected and autonomous vehicles across land, water, and air must often operate in dynamic, unpredictable environments with limited communication, no centralized control, and partial observability. These real-world constraints pose…

Multiagent Systems · Computer Science 2025-11-18 Hung Du , Hy Nguyen , Srikanth Thudumu , Rajesh Vasa , Kon Mouzakis

Offline cooperative multi-agent reinforcement learning (MARL) faces unique challenges due to distributional shifts, particularly stemming from the high dimensionality of joint action spaces and the presence of out-of-distribution joint…

Machine Learning · Computer Science 2026-05-29 Dan Qiao , Wenhao Li , Shanchao Yang , Hongyuan Zha , Baoxiang Wang

Cooperative multi-agent problems often require coordination between agents, which can be achieved through a centralized policy that considers the global state. Multi-agent policy gradient (MAPG) methods are commonly used to learn such…

Robotics · Computer Science 2023-08-03 Xubo Lyu , Amin Banitalebi-Dehkordi , Mo Chen , Yong Zhang

Multi-Agent Reinforcement Learning (MARL) algorithms are widely adopted in tackling complex tasks that require collaboration and competition among agents in dynamic Multi-Agent Systems (MAS). However, learning such tasks from scratch is…

Artificial Intelligence · Computer Science 2024-02-14 Ayesha Siddika Nipu , Siming Liu , Anthony Harris

In multi-agent systems, agents need to interact and collaborate with other agents in environments. Agent modeling is crucial to facilitate agent interactions and make adaptive cooperation strategies. However, it is challenging for agents to…

Artificial Intelligence · Computer Science 2023-10-20 Baofu Fang , Caiming Zheng , Hao Wang

Analysing learning in Multi-Agent Reinforcement Learning (MARL) environments is challenging, in particular with respect to \textit{individual} decision-making. Practitioners frequently struggle to compare training runs due to the inherent…

Multiagent Systems · Computer Science 2026-05-29 James Rudd-Jones , María Pérez-Ortiz , Mirco Musolesi

Cooperative multi-agent reinforcement learning (MARL) is making rapid progress for solving tasks in a grid world and real-world scenarios, in which agents are given different attributes and goals, resulting in different behavior through the…

Multiagent Systems · Computer Science 2022-07-13 Siyi Hu , Chuanlong Xie , Xiaodan Liang , Xiaojun Chang

We study multi-agent reinforcement learning (MARL) with centralized training and decentralized execution. During the training, new agents may join, and existing agents may unexpectedly leave the training. In such situations, a standard deep…

Machine Learning · Computer Science 2022-08-05 Xuting Tang , Jia Xu , Shusen Wang

Federated learning (FL) in multi-service provider (SP) ecosystems is fundamentally hampered by non-cooperative dynamics, where privacy constraints and competing interests preclude the centralized optimization of multi-SP communication and…

Machine Learning · Computer Science 2025-08-29 Renxuan Tan , Rongpeng Li , Xiaoxue Yu , Xianfu Chen , Xing Xu , Zhifeng Zhao

Multi-agent reinforcement learning (MARL) has exploded in popularity in recent years. Many approaches have been developed but they can be divided into three main types: centralized training and execution (CTE), centralized training for…

Machine Learning · Computer Science 2024-12-22 Christopher Amato

Intraday surgical scheduling is a multi-objective decision problem under uncertainty-balancing elective throughput, urgent and emergency demand, delays, sequence-dependent setups, and overtime. We formulate the problem as a cooperative…

Machine Learning · Computer Science 2025-12-05 Kailiang Liu , Ying Chen , Ralf Borndörfer , Thorsten Koch

Recent work has explored optimizing LLM collaboration through Multi-Agent Reinforcement Learning (MARL). However, most MARL fine-tuning approaches rely on predefined execution protocols, which often require centralized execution.…

Artificial Intelligence · Computer Science 2026-05-27 Shuo Liu , Tianle Chen , Ryan Amiri , Christopher Amato

In fully cooperative multi-agent reinforcement learning (MARL) settings, environments are highly stochastic due to the partial observability of each agent and the continuously changing policies of other agents. To address the above issues,…

Multiagent Systems · Computer Science 2023-06-06 Wei-Fang Sun , Cheng-Kuang Lee , Simon See , Chun-Yi Lee

Standard cooperative multi-agent reinforcement learning (MARL) methods aim to find the optimal team cooperative policy to complete a task. However there may exist multiple different ways of cooperating, which usually are very needed by…

Machine Learning · Computer Science 2023-08-29 Mingxi Tan , Andong Tian , Ludovic Denoyer

The field of cooperative multi-agent reinforcement learning (MARL) has seen widespread use in addressing complex coordination tasks. While value decomposition methods in MARL have been popular, they have limitations in solving tasks with…

Multiagent Systems · Computer Science 2023-07-06 Shanqi Liu , Weiwei Liu , Wenzhou Chen , Guanzhong Tian , Yong Liu

Almost all multi-agent reinforcement learning algorithms without communication follow the principle of centralized training with decentralized execution. During centralized training, agents can be guided by the same signals, such as the…

Multiagent Systems · Computer Science 2022-12-08 Zhiwei Xu , Bin Zhang , Dapeng Li , Zeren Zhang , Guangchong Zhou , Hao Chen , Guoliang Fan

Cooperative multi-agent reinforcement learning (MARL) faces significant scalability issues due to state and action spaces that are exponentially large in the number of agents. As environments grow in size, effective credit assignment…

Artificial Intelligence · Computer Science 2021-09-23 Roy Zohar , Shie Mannor , Guy Tennenholtz