English
Related papers

Related papers: Graphon Mean-Field Control for Cooperative Multi-A…

200 papers

Mean field games (MFGs) provide a mathematically tractable framework for modelling large-scale multi-agent systems by leveraging mean field theory to simplify interactions among agents. It enables applying inverse reinforcement learning…

Machine Learning · Computer Science 2025-12-02 Yang Chen , Libo Zhang , Jiamou Liu , Michael Witbrock

Multiagent reinforcement learning (MARL) can solve complex cooperative tasks. However, the efficiency of existing MARL methods relies heavily on well-defined reward functions. Multiagent tasks with sparse reward feedback are especially…

Artificial Intelligence · Computer Science 2022-08-08 Qingxu Fu , Tenghai Qiu , Zhiqiang Pu , Jianqiang Yi , Wanmai Yuan

Large-scale Multi-Agent Reinforcement Learning (MARL) often suffers from the curse of dimensionality, as the exponential growth in agent interactions significantly increases computational complexity and impedes learning efficiency. To…

Artificial Intelligence · Computer Science 2025-05-21 Yuxuan Zheng , Yihe Zhou , Feiyang Xu , Mingli Song , Shunyu Liu

Existing multi-agent reinforcement learning methods are limited typically to a small number of agents. When the agent number increases largely, the learning becomes intractable due to the curse of the dimensionality and the exponential…

Multiagent Systems · Computer Science 2020-12-16 Yaodong Yang , Rui Luo , Minne Li , Ming Zhou , Weinan Zhang , Jun Wang

This paper presents deep meta coordination graphs (DMCG) for learning cooperative policies in multi-agent reinforcement learning (MARL). Coordination graph formulations encode local interactions and accordingly factorize the joint value…

Machine Learning · Computer Science 2026-02-11 Nikunj Gupta , James Zachary Hare , Jesse Milzman , Rajgopal Kannan , Viktor Prasanna

In this paper, a novel Multi-agent Reinforcement Learning (MARL) approach, Multi-Agent Continuous Dynamic Policy Gradient (MACDPP) was proposed to tackle the issues of limited capability and sample efficiency in various scenarios controlled…

Systems and Control · Electrical Eng. & Systems 2023-09-27 Chenyang Miao , Yunduan Cui , Huiyun Li , Xinyu Wu

This paper presents a novel approach to Multi-Agent Reinforcement Learning (MARL) that combines cooperative task decomposition with the learning of reward machines (RMs) encoding the structure of the sub-tasks. The proposed method helps…

Artificial Intelligence · Computer Science 2025-02-17 Leo Ardon , Daniel Furelos-Blanco , Alessandra Russo

Recent renewed interest in multi-agent reinforcement learning (MARL) has generated an impressive array of techniques that leverage deep reinforcement learning, primarily actor-critic architectures, and can be applied to a limited range of…

Machine Learning · Computer Science 2021-06-21 Keyang He , Prashant Doshi , Bikramjit Banerjee

Empirically derived continuum models of collective behavior among large populations of dynamic agents are a subject of intense study in several fields, including biology, engineering and finance. We formulate and study a mean-field game…

Adaptation and Self-Organizing Systems · Physics 2018-06-22 Piyush Grover , Kaivalya Bakshi , Evangelos A. Theodorou

Transfer Learning has shown great potential to enhance single-agent Reinforcement Learning (RL) efficiency. Similarly, Multiagent RL (MARL) can also be accelerated if agents can share knowledge with each other. However, it remains a problem…

In this paper, we study the problem of robust cooperative multi-agent reinforcement learning (RL) where a large number of cooperative agents with distributed information aim to learn policies in the presence of \emph{stochastic} and…

Multiagent Systems · Computer Science 2025-06-16 Muhammad Aneeq uz Zaman , Mathieu Laurière , Alec Koppel , Tamer Başar

Recent advances in multi-agent reinforcement learning (MARL) have demonstrated success in numerous challenging domains and environments, but typically require specialized models for each task. In this work, we propose a coherent methodology…

In this paper, we propose a maximum mutual information (MMI) framework for multi-agent reinforcement learning (MARL) to enable multiple agents to learn coordinated behaviors by regularizing the accumulated return with the mutual information…

Multiagent Systems · Computer Science 2020-06-05 Woojun Kim , Whiyoung Jung , Myungsik Cho , Youngchul Sung

This paper studies a distributed policy gradient in collaborative multi-agent reinforcement learning (MARL), where agents over a communication network aim to find the optimal policy to maximize the average of all agents' local returns. Due…

Multiagent Systems · Computer Science 2022-12-06 Xiaoxiao Zhao , Jinlong Lei , Li Li , Jie Chen

Achieving distributed reinforcement learning (RL) for large-scale cooperative multi-agent systems (MASs) is challenging because: (i) each agent has access to only limited information; (ii) issues on convergence or computational complexity…

Machine Learning · Computer Science 2024-04-15 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush K. Sharma

This paper studies the discrete-time linear-quadratic-Gaussian mean field (MF) social control problem in an infinite horizon, where the dynamics of all agents are unknown. The objective is to design a reinforcement learning (RL) algorithm…

Optimization and Control · Mathematics 2025-12-05 Hanfang Zhang , Bing-Chang Wang , Shuo Chen

Modern AI systems often comprise multiple learnable components that can be naturally organized as graphs. A central challenge is the end-to-end training of such systems without restrictive architectural or training assumptions. Such tasks…

Multiagent Systems · Computer Science 2025-12-30 Maksim Kryzhanovskiy , Svetlana Glazyrina , Roman Ischenko , Konstantin Vorontsov

Scalability is the key roadstone towards the application of cooperative intelligent algorithms in large-scale networks. Reinforcement learning (RL) is known as model-free and high efficient intelligent algorithm for communication problems…

Signal Processing · Electrical Eng. & Systems 2021-11-08 Fenghe Hu , Yansha Deng , A. Hamid Aghvami

Recently, deep multi-agent reinforcement learning (MARL) has shown the promise to solve complex cooperative tasks. Its success is partly because of parameter sharing among agents. However, such sharing may lead agents to behave similarly…

Machine Learning · Computer Science 2021-11-02 Chenghao Li , Tonghan Wang , Chengjie Wu , Qianchuan Zhao , Jun Yang , Chongjie Zhang

Distributed, scalable, and safe control of large-scale multi-agent systems is a challenging problem. In this paper, we design a distributed framework for safe multi-agent control in large-scale environments with obstacles, where a large…

Robotics · Computer Science 2025-02-10 Songyuan Zhang , Oswin So , Kunal Garg , Chuchu Fan