English
Related papers

Related papers: Graphon Mean-Field Control for Cooperative Multi-A…

200 papers

In multi-agent reinforcement learning (MARL), the integration of a communication mechanism, allowing agents to better learn to coordinate their actions and converge on their objectives by sharing information. Based on an interaction graph,…

Machine Learning · Computer Science 2026-04-30 Valentin Cuzin-Rambaud , Laetitia Matignon , Maxime Morge

We consider online reinforcement learning in Mean-Field Games (MFGs). Unlike traditional approaches, we alleviate the need for a mean-field oracle by developing an algorithm that approximates the Mean-Field Equilibrium (MFE) using the…

Machine Learning · Computer Science 2023-04-12 Muhammad Aneeq uz Zaman , Alec Koppel , Sujay Bhatt , Tamer Başar

Multi-agent reinforcement learning (MARL) has been increasingly explored to learn the cooperative policy towards maximizing a certain global reward. Many existing studies take advantage of graph neural networks (GNN) in MARL to propagate…

Machine Learning · Computer Science 2020-12-25 Wenlei Shi , Xinran Wei , Jia Zhang , Xiaoyuan Ni , Arthur Jiang , Jiang Bian , Tie-Yan Liu

Recent advances at the intersection of dense large graph limits and mean field games have begun to enable the scalable analysis of a broad class of dynamical sequential games with large numbers of agents. So far, results have been largely…

Computer Science and Game Theory · Computer Science 2022-02-21 Kai Cui , Heinz Koeppl

Cooperative multi-agent reinforcement learning (MARL) has achieved significant results, most notably by leveraging the representation-learning abilities of deep neural networks. However, large centralized approaches quickly become…

Multiagent Systems · Computer Science 2022-12-05 Nikunj Gupta , G Srinivasaraghavan , Swarup Kumar Mohalik , Nishant Kumar , Matthew E. Taylor

Multiagent reinforcement learning (MARL) has attracted considerable attention due to its potential in addressing complex cooperative tasks. However, existing MARL approaches often rely on frequent exchanges of action or state information…

Machine Learning · Computer Science 2026-01-14 Zhenglong Luo , Zhiyong Chen , Aoxiang Liu , Ke Pan

In this paper, we investigate the interaction of two populations with a large number of indistinguishable agents. The problem consists in two levels: the interaction between agents of a same population, and the interaction between the two…

Optimization and Control · Mathematics 2018-10-30 Alain Bensoussan , Tao Huang , Mathieu Laurière

Many applications, e.g., in shared mobility, require coordinating a large number of agents. Mean-field reinforcement learning addresses the resulting scalability challenge by optimizing the policy of a representative agent interacting with…

Machine Learning · Computer Science 2023-12-29 Matej Jusup , Barna Pásztor , Tadeusz Janik , Kenan Zhang , Francesco Corman , Andreas Krause , Ilija Bogunovic

We establish the convergence of the unified two-timescale Reinforcement Learning (RL) algorithm presented in a previous work by Angiuli et al. This algorithm provides solutions to Mean Field Game (MFG) or Mean Field Control (MFC) problems…

Optimization and Control · Mathematics 2024-05-02 Andrea Angiuli , Jean-Pierre Fouque , Mathieu Laurière , Mengrui Zhang

The recent mean field game (MFG) formalism has enabled the application of inverse reinforcement learning (IRL) methods in large-scale multi-agent systems, with the goal of inferring reward signals that can explain demonstrated behaviours of…

Machine Learning · Computer Science 2022-02-15 Yang Chen , Libo Zhang , Jiamou Liu , Shuyue Hu

Over the years, reinforcement learning has emerged as a popular approach to develop signal control and vehicle platooning strategies either independently or in a hierarchical way. However, jointly controlling both in real-time to alleviate…

Machine Learning · Computer Science 2025-08-13 Xianyue Peng , Shenyang Chen , Hang Gao , Hao Wang , H. Michael Zhang

Deep Reinforcement Learning has made significant progress in multi-agent systems in recent years. In this review article, we have focused on presenting recent approaches on Multi-Agent Reinforcement Learning (MARL) algorithms. In…

Machine Learning · Computer Science 2021-05-03 Afshin OroojlooyJadid , Davood Hajinezhad

We consider a multi-agent Markov strategic interaction over an infinite horizon where agents can be of multiple types. We model the strategic interaction as a mean-field game in the asymptotic limit when the number of agents of each type…

Multiagent Systems · Computer Science 2021-01-01 Arnob Ghosh , Vaneet Aggarwal

To achieve general intelligence, agents must learn how to interact with others in a shared environment: this is the challenge of multiagent reinforcement learning (MARL). The simplest form is independent reinforcement learning (InRL), where…

Artificial Intelligence · Computer Science 2017-11-08 Marc Lanctot , Vinicius Zambaldi , Audrunas Gruslys , Angeliki Lazaridou , Karl Tuyls , Julien Perolat , David Silver , Thore Graepel

This paper investigates the control of a massive population of UAVs such as drones. The straightforward method of control of UAVs by considering the interactions among them to make a flock requires a huge inter-UAV communication which is…

Networking and Internet Architecture · Computer Science 2020-08-13 Hamid Shiri , Jihong Park , Mehdi Bennis

This paper presents a general mean-field game (GMFG) framework for simultaneous learning and decision-making in stochastic games with a large population. It first establishes the existence of a unique Nash Equilibrium to this GMFG, and…

Optimization and Control · Mathematics 2021-10-12 Xin Guo , Anran Hu , Renyuan Xu , Junzi Zhang

Multi-agent reinforcement learning methods have shown remarkable potential in solving complex multi-agent problems but mostly lack theoretical guarantees. Recently, mean field control and mean field games have been established as a…

Machine Learning · Computer Science 2021-12-20 Kai Cui , Anam Tahir , Mark Sinzger , Heinz Koeppl

In this paper, we study large population multi-agent reinforcement learning (RL) in the context of discrete-time linear-quadratic mean-field games (LQ-MFGs). Our setting differs from most existing work on RL for MFGs, in that we consider a…

Systems and Control · Electrical Eng. & Systems 2020-10-02 Muhammad Aneeq uz Zaman , Kaiqing Zhang , Erik Miehling , Tamer Başar

Most real-world domains can be formulated as multi-agent (MA) systems. Intentionality sharing agents can solve more complex tasks by collaborating, possibly in less time. True cooperative actions are beneficial for egoistic and collective…

Artificial Intelligence · Computer Science 2022-04-26 Philipp Dominic Siedler

We study multi-agent reinforcement learning (MARL) for the general-sum Markov Games (MGs) under the general function approximation. In order to find the minimum assumption for sample-efficient learning, we introduce a novel complexity…

Machine Learning · Computer Science 2023-10-11 Nuoya Xiong , Zhihan Liu , Zhaoran Wang , Zhuoran Yang