English
Related papers

Related papers: A Single Online Agent Can Efficiently Learn Mean F…

200 papers

In this paper, we study a large population game with heterogeneous dynamics and cost functions solving a consensus problem. Moreover, the agents have communication constraints which appear as: (1) an Additive-White Gaussian Noise (AWGN)…

Systems and Control · Electrical Eng. & Systems 2022-08-26 Shubham Aggarwal , Muhammad Aneeq uz Zaman , Tamer Başar

Mean-field games have been used as a theoretical tool to obtain an approximate Nash equilibrium for symmetric and anonymous $N$-player games. However, limiting applicability, existing theoretical results assume variations of a "population…

Optimization and Control · Mathematics 2023-06-12 Batuhan Yardim , Semih Cayci , Matthieu Geist , Niao He

We consider a class of mean field games in which the agents interact through both their states and controls, and we focus on situations in which a generic agent tries to adjust her speed (control) to an average speed (the average is made in…

Analysis of PDEs · Mathematics 2020-03-10 Y Achdou , Z Kobeissi

Subject to reasonable conditions, in large population stochastic dynamics games, where the agents are coupled by the system's mean field (i.e. the state distribution of the generic agent) through their nonlinear dynamics and their nonlinear…

Optimization and Control · Mathematics 2019-05-28 Nevroz Sen , Peter E. Caines

We consider learning approximate Nash equilibria for discrete-time mean-field games with nonlinear stochastic state dynamics subject to both average and discounted costs. To this end, we introduce a mean-field equilibrium (MFE) operator,…

Systems and Control · Electrical Eng. & Systems 2022-11-11 Berkay Anahtarcı , Can Deha Karıksız , Naci Saldi

Mean Field Games (MFG) are the class of games with a very large number of agents and the standard equilibrium concept is a Mean Field Equilibrium (MFE). Algorithms for learning MFE in dynamic MFGs are unknown in general. Our focus is on an…

Optimization and Control · Mathematics 2021-02-02 Kiyeob Lee , Desik Rengarajan , Dileep Kalathil , Srinivas Shakkottai

Mean Field Games (MFGs) provide a powerful framework for modeling the collective behavior of large populations of interacting agents. In this paper, we address the problem of Imitation Learning (IL) in MFGs subject to common noise, where…

Machine Learning · Computer Science 2026-05-06 Grégoire Lambrecht , Mathieu Laurière

The recent mean field game (MFG) formalism facilitates otherwise intractable computation of approximate Nash equilibria in many-agent settings. In this paper, we consider discrete-time finite MFGs subject to finite-horizon objectives. We…

Multiagent Systems · Computer Science 2022-07-11 Kai Cui , Heinz Koeppl

When controlling multi-agent systems, the trade-off between performance and scalability is a major challenge. Here, we address this difficulty by using mean field games (MFGs), which is a framework that deduces the macroscopic dynamics…

Optimization and Control · Mathematics 2021-08-06 Daisuke Inoue , Yuji Ito , Takahito Kashiwabara , Norikazu Saito , Hiroaki Yoshida

In this tutorial, we provide an introduction to machine learning methods for finding Nash equilibria in games with large number of agents. These types of problems are important for the operations research community because of their…

Optimization and Control · Mathematics 2024-06-18 Gokce Dayanikli , Mathieu Lauriere

In this paper, we present a model of a game among teams. Each team consists of a homogeneous population of agents. Agents within a team are cooperative while the teams compete with other teams. The dynamics and the costs are coupled through…

Computer Science and Game Theory · Computer Science 2023-10-20 Jayakumar Subramanian , Akshat Kumar , Aditya Mahajan

Mean field games (MFGs) offer a powerful framework for modeling large-scale multi-agent systems. This paper addresses MFGs formulated in continuous time with discrete state spaces, where agents' dynamics are governed by continuous-time…

Computer Science and Game Theory · Computer Science 2026-02-27 Yannick Eich , Christian Fabian , Kai Cui , Heinz Koeppl

We propose a policy iteration method to solve an inverse problem for a mean-field game (MFG) model, specifically to reconstruct the obstacle function in the game from the partial observation data of value functions, which represent the…

Optimization and Control · Mathematics 2026-02-12 Kui Ren , Nathan Soedjak , Shanyin Tong

Recent techniques based on Mean Field Games (MFGs) allow the scalable analysis of multi-player games with many similar, rational agents. However, standard MFGs remain limited to homogeneous players that weakly influence each other, and…

Computer Science and Game Theory · Computer Science 2023-12-19 Kai Cui , Gökçe Dayanıklı , Mathieu Laurière , Matthieu Geist , Olivier Pietquin , Heinz Koeppl

Stochastic games provide a framework for interactions among multiple agents and enable a myriad of applications. In these games, agents decide on actions simultaneously, the state of every agent moves to the next state, and each agent…

Machine Learning · Computer Science 2019-10-10 Mridul Agarwal , Vaneet Aggarwal , Arnob Ghosh , Nilay Tiwari

Reinforcement learning is a powerful tool to learn the optimal policy of possibly multiple agents by interacting with the environment. As the number of agents grow to be very large, the system can be approximated by a mean-field problem.…

Optimization and Control · Mathematics 2020-08-18 Weichen Wang , Jiequn Han , Zhuoran Yang , Zhaoran Wang

Non-cooperative and cooperative games with a very large number of players have many applications but remain generally intractable when the number of players increases. Introduced by Lasry and Lions, and Huang, Caines and Malham\'e, Mean…

Federated learning offers a decentralized approach to machine learning, where multiple agents collaboratively train a model while preserving data privacy. In this paper, we investigate the decision-making and equilibrium behavior in…

Computer Science and Game Theory · Computer Science 2025-03-13 Lihui Yi , Xiaochun Niu , Ermin Wei

We explore the problem of imitation learning (IL) in the context of mean-field games (MFGs), where the goal is to imitate the behavior of a population of agents following a Nash equilibrium policy according to some unknown payoff function.…

Machine Learning · Computer Science 2023-06-27 Giorgia Ramponi , Pavel Kolev , Olivier Pietquin , Niao He , Mathieu Laurière , Matthieu Geist

In this paper, we study large population multi-agent reinforcement learning (RL) in the context of discrete-time linear-quadratic mean-field games (LQ-MFGs). Our setting differs from most existing work on RL for MFGs, in that we consider a…

Systems and Control · Electrical Eng. & Systems 2020-10-02 Muhammad Aneeq uz Zaman , Kaiqing Zhang , Erik Miehling , Tamer Başar