English
Related papers

Related papers: Learning Mean-Field Games through Mean-Field Actor…

200 papers

This paper presents a general mean-field game (GMFG) framework for simultaneous learning and decision-making in stochastic games with a large population. It first establishes the existence of a unique Nash Equilibrium to this GMFG, and…

Machine Learning · Computer Science 2023-01-05 Xin Guo , Anran Hu , Renyuan Xu , Junzi Zhang

This paper presents a Mean Field Game (MFG) model for maritime traffic flow, treating the navigation of ships between seaports as a large-scale stochastic control problem. The MFG framework enables the modeling of agents at a microscopic…

Optimization and Control · Mathematics 2025-12-02 Charles-Albert Lehalle , Giulia Livieri

Motivated by the recent applications of game-theoretical learning techniques to the design of distributed control systems, we study a class of control problems that can be formulated as potential games with continuous action sets, and we…

Optimization and Control · Mathematics 2014-12-03 Steven Perkins , Panayotis Mertikopoulos , David S. Leslie

Stochastic games provide a framework for interactions among multiple agents and enable a myriad of applications. In these games, agents decide on actions simultaneously, the state of every agent moves to the next state, and each agent…

Machine Learning · Computer Science 2019-10-10 Mridul Agarwal , Vaneet Aggarwal , Arnob Ghosh , Nilay Tiwari

Mean field games (MFGs) model the limit of large populations of strategically interacting agents, yet both forward and inverse problems remain challenging. For the forward problem, a difficulty is to design numerical methods with global…

Optimization and Control · Mathematics 2026-03-12 Hanwei Yan , Xianjin Yang , Jingguo Zhang

Mean Field Games (MFG) have been introduced to tackle games with a large number of competing players. Considering the limit when the number of players is infinite, Nash equilibria are studied by considering the interaction of a typical…

Optimization and Control · Mathematics 2021-06-14 Mathieu Lauriere

Finite-state mean-field games (MFGs) arise as limits of large interacting particle systems and are governed by an MFG system, a coupled forward-backward differential equation consisting of a forward Kolmogorov-Fokker-Planck (KFP) equation…

Optimization and Control · Mathematics 2026-02-16 William Hofgard , Asaf Cohen , Mathieu Laurière

Financial markets are often driven by latent factors which traders cannot observe. Here, we address an algorithmic trading problem with collections of heterogeneous agents who aim to perform optimal execution or statistical arbitrage, where…

Mathematical Finance · Quantitative Finance 2019-04-02 Philippe Casgrain , Sebastian Jaimungal

We present a method enabling a large number of agents to learn how to flock, which is a natural behavior observed in large populations of animals. This problem has drawn a lot of interest but requires many structural assumptions and is…

Multiagent Systems · Computer Science 2021-05-18 Sarah Perrin , Mathieu Laurière , Julien Pérolat , Matthieu Geist , Romuald Élie , Olivier Pietquin

Federated reinforcement learning (FRL) has emerged as a promising paradigm, enabling multiple agents to collaborate and learn a shared policy adaptable across heterogeneous environments. Among the various reinforcement learning (RL)…

Machine Learning · Computer Science 2024-12-25 Ye Zhu , Xiaowen Gong

Gradient flows play a substantial role in addressing many machine learning problems. We examine the convergence in continuous-time of a \textit{Fisher-Rao} (Mean-Field Birth-Death) gradient flow in the context of solving convex-concave…

Optimization and Control · Mathematics 2024-09-19 Razvan-Andrei Lascu , Mateusz B. Majka , Łukasz Szpruch

Mean Field Control Games (MFCG), introduced in [Angiuli et al., 2022a], represent competitive games between a large number of large collaborative groups of agents in the infinite limit of number and size of groups. In this paper, we prove…

Optimization and Control · Mathematics 2024-06-05 Andrea Angiuli , Jean-Pierre Fouque , Mathieu Laurière , Mengrui Zhang

Learning in multi-agent systems is highly challenging due to several factors including the non-stationarity introduced by agents' interactions and the combinatorial nature of their state and action spaces. In particular, we consider the…

Machine Learning · Statistics 2023-05-10 Barna Pásztor , Ilija Bogunovic , Andreas Krause

In this paper, we study large population multi-agent reinforcement learning (RL) in the context of discrete-time linear-quadratic mean-field games (LQ-MFGs). Our setting differs from most existing work on RL for MFGs, in that we consider a…

Systems and Control · Electrical Eng. & Systems 2020-10-02 Muhammad Aneeq uz Zaman , Kaiqing Zhang , Erik Miehling , Tamer Başar

While the topic of mean-field games (MFGs) has a relatively long history, heretofore there has been limited work concerning algorithms for the computation of equilibrium control policies. In this paper, we develop a computable policy…

Systems and Control · Electrical Eng. & Systems 2020-04-07 Muhammad Aneeq uz Zaman , Kaiqing Zhang , Erik Miehling , Tamer Başar

In this paper, we address the resource provisioning problem for service function chaining (SFC) in terms of the placement and chaining of virtual network functions (VNFs) within a multi-access edge computing (MEC) infrastructure to reduce…

Networking and Internet Architecture · Computer Science 2022-01-31 Amine Abouaomar , Soumaya Cherkaoui , Zoubeir Mlika , Abdellatif Kobbane

Conventional Reinforcement Learning (RL) algorithms, typically focused on estimating or maximizing expected returns, face challenges when refining offline pretrained models with online experiences. This paper introduces Generative Actor…

Machine Learning · Computer Science 2025-12-29 Aoyang Qin , Deqian Kong , Wei Wang , Ying Nian Wu , Song-Chun Zhu , Sirui Xie

We study policy gradient for mean-field control in continuous time in a reinforcement learning setting. By considering randomised policies with entropy regularisation, we derive a gradient expectation representation of the value function,…

Machine Learning · Statistics 2023-03-14 Noufel Frikha , Maximilien Germain , Mathieu Laurière , Huyên Pham , Xuanye Song

Mean-Field Control (MFC) is a powerful tool to solve Multi-Agent Reinforcement Learning (MARL) problems. Recent studies have shown that MFC can well-approximate MARL when the population size is large and the agents are exchangeable.…

Machine Learning · Computer Science 2022-06-02 Washim Uddin Mondal , Vaneet Aggarwal , Satish V. Ukkusuri

This paper presents a general mean-field game (GMFG) framework for simultaneous learning and decision-making in stochastic games with a large population. It first establishes the existence of a unique Nash Equilibrium to this GMFG, and…

Optimization and Control · Mathematics 2021-10-12 Xin Guo , Anran Hu , Renyuan Xu , Junzi Zhang