English
Related papers

Related papers: Generalization in Mean Field Games by Learning Mas…

200 papers

Inspired by successful biological collective decision mechanisms such as honey bees searching for a new colony or the collective navigation of fish schools, we consider a mean field games (MFG)-like scenario where a large number of agents…

Systems and Control · Computer Science 2016-01-26 Rabih Salhab , Roland P. Malhamé , Jerome Le Ny

Imitation learning algorithms can be used to learn a policy from expert demonstrations without access to a reward signal. However, most existing approaches are not applicable in multi-agent settings due to the existence of multiple (Nash)…

Machine Learning · Computer Science 2018-07-27 Jiaming Song , Hongyu Ren , Dorsa Sadigh , Stefano Ermon

We consider a class of mean field games in which the agents interact through both their states and controls, and we focus on situations in which a generic agent tries to adjust her speed (control) to an average speed (the average is made in…

Analysis of PDEs · Mathematics 2020-03-10 Y Achdou , Z Kobeissi

Mean Field Games (MFGs) offer a powerful framework for studying large-scale multi-agent systems. Yet, learning Nash equilibria in MFGs remains a challenging problem, particularly when the initial distribution is unknown or when the…

Machine Learning · Computer Science 2025-09-04 Zida Wu , Mathieu Lauriere , Matthieu Geist , Olivier Pietquin , Ankur Mehta

In this paper, we explore using deep reinforcement learning for problems with multiple agents. Most existing methods for deep multi-agent reinforcement learning consider only a small number of agents. When the number of agents increases,…

Machine Learning · Computer Science 2018-05-24 Arbaaz Khan , Clark Zhang , Daniel D. Lee , Vijay Kumar , Alejandro Ribeiro

Mean field game theory studies the behavior of a large number of interacting individuals in a game theoretic setting and has received a lot of attention in the past decade (Lasry and Lions, Japanese journal of mathematics, 2007). In this…

Optimization and Control · Mathematics 2019-10-31 Martin Frank , Michael Herty , Torsten Trimborn

The mean field limit of large-population symmetric stochastic differential games is derived in a general setting, with and without common noise, on a finite time horizon. Minimal assumptions are imposed on equilibrium strategies, which may…

Probability · Mathematics 2014-08-13 Daniel Lacker

Mean-field games have been used as a theoretical tool to obtain an approximate Nash equilibrium for symmetric and anonymous $N$-player games. However, limiting applicability, existing theoretical results assume variations of a "population…

Optimization and Control · Mathematics 2023-06-12 Batuhan Yardim , Semih Cayci , Matthieu Geist , Niao He

The policy iteration method is a classical algorithm for solving optimal control problems. In this paper, we introduce a policy iteration method for Mean Field Games systems, and we study the convergence of this procedure to a solution of…

Analysis of PDEs · Mathematics 2021-07-12 Simone Cacace , Fabio Camilli , Alessandro Goffi

Imitation learning is an effective approach for training game-playing agents and, consequently, for efficient game production. However, generalization - the ability to perform well in related but unseen scenarios - is an essential…

Machine Learning · Computer Science 2024-04-09 Derek Yadgaroff , Alessandro Sestini , Konrad Tollmar , Ayca Ozcelikkale , Linus Gisslén

The Mean-Field approximation is a tractable approach for studying large population dynamics. However, its assumption on homogeneity and universal connections among all agents limits its applicability in many real-world scenarios.…

Computer Science and Game Theory · Computer Science 2023-10-26 Peihan Huo , Oscar Peralta , Junyu Guo , Qiaomin Xie , Andreea Minca

This paper presents a Gaussian Process (GP) framework, a non-parametric technique widely acknowledged for regression and classification tasks, to address inverse problems in mean field games (MFGs). By leveraging GPs, we aim to recover…

Computer Science and Game Theory · Computer Science 2023-12-27 Jinyan Guo , Chenchen Mou , Xianjin Yang , Chao Zhou

Learning the behavior of large agent populations is an important task for numerous research areas. Although the field of multi-agent reinforcement learning (MARL) has made significant progress towards solving these systems, solutions for…

Multiagent Systems · Computer Science 2024-02-26 Christian Fabian , Kai Cui , Heinz Koeppl

In many stochastic games stemming from financial models, the environment evolves with latent factors and there may be common noise across agents' states. Two classic examples are: (i) multi-agent trading on electronic exchanges, and (ii)…

Optimization and Control · Mathematics 2019-07-24 Dena Firoozi , Peter E. Caines , Sebastian Jaimungal

This paper studies an optimal investment-consumption problem for competitive agents with exponential or power utilities and a common finite time horizon. Each agent regards the average of habit formation and wealth from all peers as…

Optimization and Control · Mathematics 2024-05-06 Zongxia Liang , Keyu Zhang

Mean field games (MFG) and mean field control (MFC) are critical classes of multi-agent models for efficient analysis of massive populations of interacting agents. Their areas of application span topics in economics, finance, game theory,…

Machine Learning · Computer Science 2022-06-08 Lars Ruthotto , Stanley Osher , Wuchen Li , Levon Nurbekyan , Samy Wu Fung

The goal of this paper is to study a Mean Field Game (MFG) system stemming from the harvesting of resources. Modelling the latter through a reaction-diffusion equation and the harvesters as competing rational agents, we are led to a…

Analysis of PDEs · Mathematics 2024-06-11 Ziad Kobeissi , Idriss Mazari-Fouquer , Domènec Ruiz-Balet

Mean-field reinforcement learning has become a popular theoretical framework for efficiently approximating large-scale multi-agent reinforcement learning (MARL) problems exhibiting symmetry. However, questions remain regarding the…

Computer Science and Game Theory · Computer Science 2024-02-09 Batuhan Yardim , Artur Goldman , Niao He

Multi-agent reinforcement learning (MARL) remains difficult to scale to many agents. Recent MARL using Mean Field Control (MFC) provides a tractable and rigorous approach to otherwise difficult cooperative MARL. However, the strict MFC…

Machine Learning · Computer Science 2024-05-09 Kai Cui , Christian Fabian , Anam Tahir , Heinz Koeppl

Mean Field Games (MFG) have been introduced to tackle games with a large number of competing players. Considering the limit when the number of players is infinite, Nash equilibria are studied by considering the interaction of a typical…

Optimization and Control · Mathematics 2021-06-14 Mathieu Lauriere