English
Related papers

Related papers: A Mean-Field Game Model For Large-Scale Attrition …

200 papers

Mean Field Games (MFGs) have the ability to handle large-scale multi-agent systems, but learning Nash equilibria in MFGs remains a challenging task. In this paper, we propose a deep reinforcement learning (DRL) algorithm that achieves…

Computer Science and Game Theory · Computer Science 2024-03-07 Zida Wu , Mathieu Lauriere , Samuel Jia Cong Chua , Matthieu Geist , Olivier Pietquin , Ankur Mehta

For noncooperative games the mean field (MF) methodology provides decentralized strategies which yield Nash equilibria for large population systems in the asymptotic limit of an infinite (mass) population. The MF control laws use only the…

Optimization and Control · Mathematics 2012-10-22 Arman C. Kizilkale , Peter E. Caines

Multi-agent deep reinforcement learning makes optimal decisions dependent on system states observed by agents, but any uncertainty on the observations may mislead agents to take wrong actions. The Mean-Field Actor-Critic reinforcement…

Machine Learning · Computer Science 2023-06-01 Ziyuan Zhou , Guanjun Liu

Traditional solvable game theory and mean-field-type game theory (risk-aware games) predominantly focus on quadratic costs due to their analytical tractability. Nevertheless, they often fail to capture critical non-linearities inherent in…

Optimization and Control · Mathematics 2025-05-09 Julian Barreiro-Gomez , Tyrone E. Duncan , Bozenna Pasik-Duncan , Hamidou Tembine

While the general theory for the terminal-initial value problem for mean-field games (MFGs) has achieved a substantial progress, the corresponding forward-forward problem is still poorly understood - even in the one-dimensional setting.…

Analysis of PDEs · Mathematics 2016-06-30 Diogo Gomes , Levon Nurbekyan , Marc Sedjro

Moving target defense (MTD) is a proactive defense approach that aims to thwart attacks by continuously changing the attack surface of a system (e.g., changing host or network configurations), thereby increasing the adversary's uncertainty…

Cryptography and Security · Computer Science 2020-08-21 Taha Eghtesad , Yevgeniy Vorobeychik , Aron Laszka

Mean field games (MFGs) have been introduced to study Nash equilibria in very large population of self-interested agents. However, when applied to common pool resource (CPR) games, MFG equilibria lead to the so-called tragedy of the commons…

Optimization and Control · Mathematics 2025-04-15 Gokce Dayanikli , Mathieu Lauriere

We study the sample complexity of reinforcement learning (RL) in Mean-Field Games (MFGs) with model-based function approximation that requires strategic exploration to find a Nash Equilibrium policy. We introduce the Partial Model-Based…

Machine Learning · Computer Science 2024-06-04 Jiawei Huang , Niao He , Andreas Krause

In this paper we use a minimal model based on Mean-Field Games (a mathematical framework apt to describe situations where a large number of agents compete strategically) to simulate the scenario where a static dense human crowd is crossed…

Physics and Society · Physics 2024-05-29 Matteo Butano , Thibault Bonnemain , Cécile Appert-Rolland , Alexandre Nicolas , Denis Ullmo

Here, we observe that mean-field game (MFG) systems admit a two-player infinite-dimensional general-sum differential game formulation. We show that particular regimes of this game reduce to previously known variational principles.…

Analysis of PDEs · Mathematics 2018-04-25 Marco Cirant , Levon Nurbekyan

This paper studies Mean Field Games (MFGs) in which agent dynamics are given by jump processes of controlled intensity, with mean-field interaction via the controls and affecting the jump intensities. We establish the existence of MFG…

Optimization and Control · Mathematics 2025-04-23 Nicolas Garcia , Ronnie Sircar , H. Mete Soner

Existing multi-agent reinforcement learning methods are limited typically to a small number of agents. When the agent number increases largely, the learning becomes intractable due to the curse of the dimensionality and the exponential…

Multiagent Systems · Computer Science 2020-12-16 Yaodong Yang , Rui Luo , Minne Li , Ming Zhou , Weinan Zhang , Jun Wang

Mean Field Game (MFG) systems describe equilibrium configurations in games with infinitely many interacting controllers. We are interested in the behavior of this system as the horizon becomes large, or as the discount factor tends to $0$.…

Optimization and Control · Mathematics 2019-03-13 Pierre Cardaliaguet , Alessio Porretta

Generative adversarial networks (GANs) have enjoyed tremendous success in image generation and processing, and have recently attracted growing interests in financial modelings. This paper analyzes GANs from the perspectives of mean-field…

Computer Science and Game Theory · Computer Science 2025-09-23 Haoyang Cao , Xin Guo , Mathieu Laurière

We introduce Mean-Field Trust Region Policy Optimization (MF-TRPO), a novel algorithm designed to compute approximate Nash equilibria for ergodic Mean-Field Games (MFG) in finite state-action spaces. Building on the well-established…

Machine Learning · Statistics 2025-05-30 Antonio Ocello , Daniil Tiapkin , Lorenzo Mancini , Mathieu Laurière , Eric Moulines

For two classes of Mean Field Game systems we study the convergence of solutions as the interest rate in the cost functional becomes very large, modeling agents caring only about a very short time-horizon, and the cost of the control…

Optimization and Control · Mathematics 2020-04-10 Martino Bardi , Pierre Cardaliaguet

Mean Field Control (MFC) is a powerful approximation tool to solve large-scale Multi-Agent Reinforcement Learning (MARL) problems. However, the success of MFC relies on the presumption that given the local states and actions of all the…

Machine Learning · Computer Science 2023-05-30 Washim Uddin Mondal , Vaneet Aggarwal , Satish V. Ukkusuri

Mean Field Games (MFGs) have been introduced to efficiently approximate games with very large populations of strategic agents. Recently, the question of learning equilibria in MFGs has gained momentum, particularly using model-free…

Mean field theory provides an effective way of scaling multiagent reinforcement learning algorithms to environments with many agents that can be abstracted by a virtual mean agent. In this paper, we extend mean field multiagent algorithms…

Multiagent Systems · Computer Science 2022-06-22 Sriram Ganapathi Subramanian , Pascal Poupart , Matthew E. Taylor , Nidhi Hegde

Multiagent reinforcement learning algorithms have not been widely adopted in large scale environments with many agents as they often scale poorly with the number of agents. Using mean field theory to aggregate agents has been proposed as a…

Multiagent Systems · Computer Science 2022-04-14 Sriram Ganapathi Subramanian , Matthew E. Taylor , Mark Crowley , Pascal Poupart