English
Related papers

Related papers: Major-Minor Mean Field Multi-Agent Reinforcement L…

200 papers

Mean field games (MFGs) provide a mathematically tractable framework for modelling large-scale multi-agent systems by leveraging mean field theory to simplify interactions among agents. It enables applying inverse reinforcement learning…

Machine Learning · Computer Science 2025-12-02 Yang Chen , Libo Zhang , Jiamou Liu , Michael Witbrock

We investigate reinforcement learning in the setting of Markov decision processes for a large number of exchangeable agents interacting in a mean field manner. Applications include, for example, the control of a large number of robots…

Optimization and Control · Mathematics 2025-04-30 René Carmona , Mathieu Laurière , Zongjun Tan

Mean Field Control Games (MFCGs) provide a powerful theoretical framework for analyzing systems of infinitely many interacting agents, blending elements from Mean Field Games (MFGs) and Mean Field Control (MFC). However, solving the coupled…

Machine Learning · Computer Science 2025-01-03 Nianli Peng , Yilin Wang

Mean field games (MFG) and mean field control problems (MFC) are frameworks to study Nash equilibria or social optima in games with a continuum of agents. These problems can be used to approximate competitive or cooperative games with a…

Optimization and Control · Mathematics 2021-06-28 Andrea Angiuli , Jean-Pierre Fouque , Mathieu Lauriere

Coordinating large populations of interacting agents is a central challenge in multi-agent reinforcement learning (MARL), where the size of the joint state-action space scales exponentially with the number of agents. Mean-field methods…

Machine Learning · Computer Science 2026-02-19 Emile Anand , Richard Hoffmann , Sarah Liaw , Adam Wierman

The recent mean field game (MFG) formalism has enabled the application of inverse reinforcement learning (IRL) methods in large-scale multi-agent systems, with the goal of inferring reward signals that can explain demonstrated behaviours of…

Machine Learning · Computer Science 2022-02-15 Yang Chen , Libo Zhang , Jiamou Liu , Shuyue Hu

Traditional multi-agent reinforcement learning algorithms are difficultly applied in a large-scale multi-agent environment. The introduction of mean field theory has enhanced the scalability of multi-agent reinforcement learning in recent…

Artificial Intelligence · Computer Science 2024-09-10 Min Yang , Guanjun Liu , Ziyuan Zhou

Scalability remains a challenge in multi-agent reinforcement learning and is currently under active research. A framework named mean-field reinforcement learning (MFRL) could alleviate the scalability problem by employing the Mean Field…

Artificial Intelligence · Computer Science 2025-02-21 Hao Ma , Zhiqiang Pu , Yi Pan , Boyin Liu , Junlong Gao , Zhenyu Guo

Partial agent failure becomes inevitable when systems scale up, making it crucial to identify the subset of agents whose failure causes worst-case system performance degradations. We study this Vulnerable Agent Identification (VAI) problem…

When controlling multi-agent systems, the trade-off between performance and scalability is a major challenge. Here, we address this difficulty by using mean field games (MFGs), which is a framework that deduces the macroscopic dynamics…

Optimization and Control · Mathematics 2021-08-06 Daisuke Inoue , Yuji Ito , Takahito Kashiwabara , Norikazu Saito , Hiroaki Yoshida

Designing effective reward functions in multi-agent reinforcement learning (MARL) is a significant challenge, often leading to suboptimal or misaligned behaviors in complex, coordinated environments. We introduce Multi-agent Reinforcement…

Multiagent Systems · Computer Science 2025-06-05 Ziyan Wang , Zhicheng Zhang , Fei Fang , Yali Du

Existing multi-agent reinforcement learning methods are limited typically to a small number of agents. When the agent number increases largely, the learning becomes intractable due to the curse of the dimensionality and the exponential…

Multiagent Systems · Computer Science 2020-12-16 Yaodong Yang , Rui Luo , Minne Li , Ming Zhou , Weinan Zhang , Jun Wang

We establish the convergence of the deep actor-critic reinforcement learning algorithm presented in [Angiuli et al., 2023a] in the setting of continuous state and action spaces with an infinite discrete-time horizon. This algorithm provides…

Optimization and Control · Mathematics 2025-11-11 Jean-Pierre Fouque , Mathieu Laurière , Mengrui Zhang

Multi-Agent Reinforcement Learning (MARL) algorithms show amazing performance in simulation in recent years, but placing MARL in real-world applications may suffer safety problems. MARL with centralized shields was proposed and verified in…

Multiagent Systems · Computer Science 2021-03-24 Zhiyuan Cai , Huanhui Cao , Wenjie Lu , Lin Zhang , Hao Xiong

In cooperative multi-agent reinforcement learning (MARL), combining value decomposition with actor-critic enables agents to learn stochastic policies, which are more suitable for the partially observable environment. Given the goal of…

Machine Learning · Computer Science 2023-02-13 Jiangxing Wang , Deheng Ye , Zongqing Lu

Multi-Agent Reinforcement Learning (MARL) is an increasingly important research field that can model and control multiple large-scale autonomous systems. Despite its achievements, existing multi-agent learning methods typically involve…

Multiagent Systems · Computer Science 2023-05-25 Kailash Gogineni , Peng Wei , Tian Lan , Guru Venkataramani

Mean Field Control Games (MFCG), introduced in [Angiuli et al., 2022a], represent competitive games between a large number of large collaborative groups of agents in the infinite limit of number and size of groups. In this paper, we prove…

Optimization and Control · Mathematics 2024-06-05 Andrea Angiuli , Jean-Pierre Fouque , Mathieu Laurière , Mengrui Zhang

Recent techniques based on Mean Field Games (MFGs) allow the scalable analysis of multi-player games with many similar, rational agents. However, standard MFGs remain limited to homogeneous players that weakly influence each other, and…

Computer Science and Game Theory · Computer Science 2023-12-19 Kai Cui , Gökçe Dayanıklı , Mathieu Laurière , Matthieu Geist , Olivier Pietquin , Heinz Koeppl

Multi-Agent Reinforcement Learning (MARL) has emerged as a powerfulparadigm for cooperative decision-making in connected autonomous vehicles(CAVs); however, existing approaches often fail to guarantee stability, optimality,and…

General Mathematics · Mathematics 2025-11-25 Mazyar Taghavi , Javad Vahidi

Large-scale Multi-Agent Reinforcement Learning (MARL) often suffers from the curse of dimensionality, as the exponential growth in agent interactions significantly increases computational complexity and impedes learning efficiency. To…

Artificial Intelligence · Computer Science 2025-05-21 Yuxuan Zheng , Yihe Zhou , Feiyang Xu , Mingli Song , Shunyu Liu