English
Related papers

Related papers: Reinforcement Learning for Finite Space Mean-Field…

200 papers

The theory of mean field games aims at studying deterministic or stochastic differential games (Nash equilibria) as the number of agents tends to infinity. Since very few mean field games have explicit or semi-explicit solutions, numerical…

Optimization and Control · Mathematics 2020-03-11 Yves Achdou , Mathieu Laurière

This work studies non-cooperative Multi-Agent Reinforcement Learning (MARL) where multiple agents interact in the same environment and whose goal is to maximize the individual returns. Challenges arise when scaling up the number of agents…

Artificial Intelligence · Computer Science 2023-04-14 Talal Algumaei , Ruben Solozabal , Reda Alami , Hakim Hacid , Merouane Debbah , Martin Takac

We develop a probabilistic approach to continuous-time finite state mean field games. Based on an alternative description of continuous-time Markov chain by means of semimartingale and the weak formulation of stochastic optimal control, our…

Probability · Mathematics 2018-08-24 Rene Carmona , Peiqi Wang

Mean field theory provides an effective way of scaling multiagent reinforcement learning algorithms to environments with many agents that can be abstracted by a virtual mean agent. In this paper, we extend mean field multiagent algorithms…

Multiagent Systems · Computer Science 2022-06-22 Sriram Ganapathi Subramanian , Pascal Poupart , Matthew E. Taylor , Nidhi Hegde

Methods like multi-agent reinforcement learning struggle to scale with growing population size. Mean-field games (MFGs) are a game-theoretic approach that can circumvent this by finding a solution for an abstract infinite population, which…

Multiagent Systems · Computer Science 2025-12-23 Patrick Benjamin , Alessandro Abate

Mean Field Games (MFG) are the class of games with a very large number of agents and the standard equilibrium concept is a Mean Field Equilibrium (MFE). Algorithms for learning MFE in dynamic MFGs are unknown in general. Our focus is on an…

Optimization and Control · Mathematics 2021-02-02 Kiyeob Lee , Desik Rengarajan , Dileep Kalathil , Srinivas Shakkottai

We consider the problem of representing collective behavior of large populations and predicting the evolution of a population distribution over a discrete state space. A discrete time mean field game (MFG) is motivated as an interpretable…

Machine Learning · Computer Science 2018-04-24 Jiachen Yang , Xiaojing Ye , Rakshit Trivedi , Huan Xu , Hongyuan Zha

This paper proposes a novel Mean-Field Game (MFG) framework for large-scale attacker-defender systems aimed at protecting one or multiple High-Value Units (HVUs). Motivated by classical agent-wise attrition models, we introduce a…

Analysis of PDEs · Mathematics 2026-04-03 Avetik Arakelyan , Tigran Bakaryan , Davit Alaverdyan , Naira Hovakimyan , Isaac Kaminer

The Mean-Field approximation is a tractable approach for studying large population dynamics. However, its assumption on homogeneity and universal connections among all agents limits its applicability in many real-world scenarios.…

Computer Science and Game Theory · Computer Science 2023-10-26 Peihan Huo , Oscar Peralta , Junyu Guo , Qiaomin Xie , Andreea Minca

We propose a single-level numerical approach to solve Stackelberg mean field game (MFG) problems. In Stackelberg MFG, an infinite population of agents play a non-cooperative game and choose their controls to optimize their individual…

Optimization and Control · Mathematics 2024-04-24 Gokce Dayanikli , Mathieu Lauriere

We study two-layer neural networks in the mean field limit, where the number of neurons tends to infinity. In this regime, the optimization over the neuron parameters becomes the optimization over the probability measures, and by adding an…

Optimization and Control · Mathematics 2023-08-17 Fan Chen , Zhenjie Ren , Songbo Wang

Finding Nash equilibria in two-player zero-sum continuous games is a central problem in machine learning, e.g. for training both GANs and robust models. The existence of pure Nash equilibria requires strong conditions which are not…

Machine Learning · Computer Science 2021-05-07 Carles Domingo-Enrich , Samy Jelassi , Arthur Mensch , Grant Rotskoff , Joan Bruna

We study model-based and model-free policy optimization in a class of nonzero-sum stochastic dynamic games called linear quadratic (LQ) deep structured games. In such games, players interact with each other through a set of weighted…

Computer Science and Game Theory · Computer Science 2020-12-15 Masoud Roudneshin , Jalal Arabneydi , Amir G. Aghdam

In this paper, zero-sum mean-field type games (ZSMFTG) with linear dynamics and quadratic utility are studied under infinite-horizon discounted utility function. ZSMFTG are a class of games in which two decision makers whose utilities sum…

Optimization and Control · Mathematics 2020-09-07 René Carmona , Kenza Hamidouche , Mathieu Laurière , Zongjun Tan

We propose a mean field control game model for the intra-and-inter-bank borrowing and lending problem. This framework allows to study the competitive game arising between groups of collaborative banks. The solution is provided in terms of…

Optimization and Control · Mathematics 2022-07-08 Andrea Angiuli , Nils Detering , Jean-Pierre Fouque , Mathieu Laurière , Jimin Lin

This paper addresses the problem of learning a Nash equilibrium in $\gamma$-discounted multiplayer general-sum Markov Games (MG). A key component of this model is the possibility for the players to either collaborate or team apart to…

Computer Science and Game Theory · Computer Science 2017-03-07 Julien Pérolat , Florian Strub , Bilal Piot , Olivier Pietquin

Mean Field Game systems describe equilibrium configurations in differential games with infinitely many infinitesimal interacting agents. We introduce a learning procedure (similar to the Fictitious Play) for these games and show its…

Optimization and Control · Mathematics 2015-08-03 Pierre Cardaliaguet , Saeed Hadikhanloo

Even when confronted with the same data, agents often disagree on a model of the real-world. Here, we address the question of how interacting heterogenous agents, who disagree on what model the real-world follows, optimize their trading…

Mathematical Finance · Quantitative Finance 2019-12-13 Philippe Casgrain , Sebastian Jaimungal

We provide the first fully polynomial time approximation scheme (FPTAS) for computing an approximate mixed-strategy Nash equilibrium in tree-structured graphical multi-hypermatrix games (GMhGs). GMhGs are generalizations of normal-form…

Computer Science and Game Theory · Computer Science 2017-02-07 Luis E. Ortiz , Mohammad T. Irfan

Mean-field games (MFGs) are a modeling framework for systems with a large number of interacting agents. They have applications in economics, finance, and game theory. Normalizing flows (NFs) are a family of deep generative models that…

Optimization and Control · Mathematics 2023-05-24 Han Huang , Jiajia Yu , Jie Chen , Rongjie Lai