English
Related papers

Related papers: Learning in Mean Field Games: A Survey

200 papers

We study a class of stochastic dynamic games that exhibit strategic complementarities between players; formally, in the games we consider, the payoff of a player has increasing differences between her own state and the empirical…

Computer Science and Game Theory · Computer Science 2010-12-13 Sachin Adlakha , Ramesh Johari

Reinforcement learning (RL) solves sequential decision-making problems via a trial-and-error process interacting with the environment. While RL achieves outstanding success in playing complex video games that allow huge trial-and-error,…

Machine Learning · Computer Science 2022-06-22 Fan-Ming Luo , Tian Xu , Hang Lai , Xiong-Hui Chen , Weinan Zhang , Yang Yu

Financial markets and more generally macro-economic models involve a large number of individuals interacting through variables such as prices resulting from the aggregate behavior of all the agents. Mean field games have been introduced to…

Optimization and Control · Mathematics 2021-07-12 René Carmona , Mathieu Laurière

We explore the problem of imitation learning (IL) in the context of mean-field games (MFGs), where the goal is to imitate the behavior of a population of agents following a Nash equilibrium policy according to some unknown payoff function.…

Machine Learning · Computer Science 2023-06-27 Giorgia Ramponi , Pavel Kolev , Olivier Pietquin , Niao He , Mathieu Laurière , Matthieu Geist

In this paper we study iterative procedures for stationary equilibria in games with large number of players. Most of learning algorithms for games with continuous action spaces are limited to strict contraction best reply maps in which the…

Machine Learning · Computer Science 2012-10-18 Hamidou Tembine , Raul Tempone , Pedro Vilanova

Here, we examine a mean-field game (MFG) that models the economic growth of a population of non-cooperative rational agents. In this MFG, agents are described by two state variables - the capital and consumer goods they own. Each agent…

Analysis of PDEs · Mathematics 2019-07-26 Diogo Gomes , Laurent Lafleche , Levon Nurbekyan

In this article we consider finite Mean Field Games (MFGs), i.e. with finite time and finite states. We adopt the framework introduced in Gomes Mohr and Souza in 2010, and study two seemly unexplored subjects. In the first one, we analyze…

Optimization and Control · Mathematics 2018-05-16 Saeed Hadikhanloo , Francisco José Silva

Mean-field games with absorption is a class of games, that have been introduced in Campi and Fischer (2018) and that can be viewed as natural limits of symmetric stochastic differential games with a large number of players who, interacting…

Probability · Mathematics 2021-11-05 Luciano Campi , Maddalena Ghio , Giulia Livieri

Recent advances in deep learning has witnessed many innovative frameworks that solve high dimensional mean-field games (MFG) accurately and efficiently. These methods, however, are restricted to solving single-instance MFG and demands…

Machine Learning · Computer Science 2024-04-25 Han Huang , Rongjie Lai

We propose a single-level numerical approach to solve Stackelberg mean field game (MFG) problems. In Stackelberg MFG, an infinite population of agents play a non-cooperative game and choose their controls to optimize their individual…

Optimization and Control · Mathematics 2024-04-24 Gokce Dayanikli , Mathieu Lauriere

Reinforcement learning (RL) is a powerful machine learning technique that has been successfully applied to a wide variety of problems. However, it can be unpredictable and produce suboptimal results in complicated learning environments.…

Multiagent Systems · Computer Science 2024-11-19 Brian Mintz , Feng Fu

Mean field games (MFGs) offer a powerful framework for modeling large-scale multi-agent systems. This paper addresses MFGs formulated in continuous time with discrete state spaces, where agents' dynamics are governed by continuous-time…

Computer Science and Game Theory · Computer Science 2026-02-27 Yannick Eich , Christian Fabian , Kai Cui , Heinz Koeppl

We study the sample complexity of reinforcement learning (RL) in Mean-Field Games (MFGs) with model-based function approximation that requires strategic exploration to find a Nash Equilibrium policy. We introduce the Partial Model-Based…

Machine Learning · Computer Science 2024-06-04 Jiawei Huang , Niao He , Andreas Krause

Mean field games is a recent area of study introduced by Lions and Lasry in a series of seminal papers in 2006. Mean field games model situations of competition between large number of rational agents that play non-cooperative dynamic games…

Optimization and Control · Mathematics 2011-03-18 Diogo A. Gomes , Joana Mohr , Rafael R. Souza

Mean field games (MFGs) have been introduced to study Nash equilibria in very large population of self-interested agents. However, when applied to common pool resource (CPR) games, MFG equilibria lead to the so-called tragedy of the commons…

Optimization and Control · Mathematics 2025-04-15 Gokce Dayanikli , Mathieu Lauriere

Mean field games (MFGs) are a promising framework for modeling the behavior of large-population systems. However, solving MFGs can be challenging due to the coupling of forward population evolution and backward agent dynamics. Typically,…

Machine Learning · Computer Science 2024-07-17 Chenyu Zhang , Xu Chen , Xuan Di

Mean-Field Control (MFC) is a powerful tool to solve Multi-Agent Reinforcement Learning (MARL) problems. Recent studies have shown that MFC can well-approximate MARL when the population size is large and the agents are exchangeable.…

Machine Learning · Computer Science 2022-06-02 Washim Uddin Mondal , Vaneet Aggarwal , Satish V. Ukkusuri

While multi-agent reinforcement learning (MARL) has been proven effective across both collaborative and competitive tasks, existing algorithms often struggle to scale to large populations of agents. Recent advancements in mean-field (MF)…

Multiagent Systems · Computer Science 2026-02-16 Bhavini Jeloka , Yue Guan , Panagiotis Tsiotras

Mean-field games (MFG) were introduced to efficiently analyze approximate Nash equilibria in large population settings. In this work, we consider entropy-regularized mean-field games with a finite state-action space in a discrete time…

Computer Science and Game Theory · Computer Science 2022-07-26 Yue Guan , Mi Zhou , Ali Pakniyat , Panagiotis Tsiotras

Stochastic games provide a framework for interactions among multiple agents and enable a myriad of applications. In these games, agents decide on actions simultaneously, the state of every agent moves to the next state, and each agent…

Machine Learning · Computer Science 2019-10-10 Mridul Agarwal , Vaneet Aggarwal , Arnob Ghosh , Nilay Tiwari