English
Related papers

Related papers: Model-Based RL for Mean-Field Games is not Statist…

200 papers

Save for some special cases, current training methods for Generative Adversarial Networks (GANs) are at best guaranteed to converge to a `local Nash equilibrium` (LNE). Such LNEs, however, can be arbitrarily far from an actual Nash…

Machine Learning · Computer Science 2019-11-19 Frans A. Oliehoek , Rahul Savani , Jose Gallego , Elise van der Pol , Roderich Groß

Mean-Field Control (MFC) is a powerful tool to solve Multi-Agent Reinforcement Learning (MARL) problems. Recent studies have shown that MFC can well-approximate MARL when the population size is large and the agents are exchangeable.…

Machine Learning · Computer Science 2022-06-02 Washim Uddin Mondal , Vaneet Aggarwal , Satish V. Ukkusuri

Even when confronted with the same data, agents often disagree on a model of the real-world. Here, we address the question of how interacting heterogenous agents, who disagree on what model the real-world follows, optimize their trading…

Mathematical Finance · Quantitative Finance 2019-12-13 Philippe Casgrain , Sebastian Jaimungal

In this paper, we consider a mean field game (MFG) model perturbed by small common noise. Our goal is to give an approximation of the Nash equilibrium strategy of this game using a solution from the original no common noise MFG whose…

Probability · Mathematics 2017-07-31 Saran Ahuja , Weiluo Ren , Tzu-Wei Yang

Constrained Markov games offer a formal mathematical framework for modeling multi-agent reinforcement learning problems where the behavior of the agents is subject to constraints. In this work, we focus on the recently introduced class of…

Machine Learning · Computer Science 2024-02-29 Philip Jordan , Anas Barakat , Niao He

Autonomous driving (AD) requires safe and reliable decision-making among interacting agents, e.g., vehicles, bicycles, and pedestrians. Multi-agent reinforcement learning (MARL) modeled by Markov games (MGs) provides a suitable framework to…

Systems and Control · Electrical Eng. & Systems 2026-03-20 Huiwen Yan , Mushuang Liu

To achieve sample efficiency in reinforcement learning (RL), it necessitates efficiently exploring the underlying environment. Under the offline setting, addressing the exploration challenge lies in collecting an offline dataset with…

Machine Learning · Computer Science 2022-02-15 Shuang Qiu , Jieping Ye , Zhaoran Wang , Zhuoran Yang

Meta-reinforcement learning (meta-RL) is a promising framework for tackling challenging domains requiring efficient exploration. Existing meta-RL algorithms are characterized by low sample efficiency, and mostly focus on low-dimensional…

Machine Learning · Computer Science 2024-03-18 Zohar Rimon , Tom Jurgenson , Orr Krupnik , Gilad Adler , Aviv Tamar

Finding Nash equilibria in two-player zero-sum continuous games is a central problem in machine learning, e.g. for training both GANs and robust models. The existence of pure Nash equilibria requires strong conditions which are not…

Machine Learning · Computer Science 2021-05-07 Carles Domingo-Enrich , Samy Jelassi , Arthur Mensch , Grant Rotskoff , Joan Bruna

We study multi-agent general-sum Markov games with nonlinear function approximation. We focus on low-rank Markov games whose transition matrix admits a hidden low-rank structure on top of an unknown non-linear representation. The goal is to…

Machine Learning · Computer Science 2022-11-01 Chengzhuo Ni , Yuda Song , Xuezhou Zhang , Chi Jin , Mengdi Wang

In this tutorial, we provide an introduction to machine learning methods for finding Nash equilibria in games with large number of agents. These types of problems are important for the operations research community because of their…

Optimization and Control · Mathematics 2024-06-18 Gokce Dayanikli , Mathieu Lauriere

This paper provides theoretical bounds for empirical game theoretical analysis of complex multi-agent interactions. We provide insights in the empirical meta game showing that a Nash equilibrium of the meta-game is an approximate Nash…

Computer Science and Game Theory · Computer Science 2018-03-20 Karl Tuyls , Julien Perolat , Marc Lanctot , Joel Z Leibo , Thore Graepel

Mean-field games with absorption is a class of games, that have been introduced in Campi and Fischer (2018) and that can be viewed as natural limits of symmetric stochastic differential games with a large number of players who, interacting…

Probability · Mathematics 2021-11-05 Luciano Campi , Maddalena Ghio , Giulia Livieri

Multi-agent reinforcement learning (MARL) holds great potential but faces robustness challenges due to environmental uncertainty. To address this, distributionally robust Markov games (RMGs) optimize worst-case performance when the…

Machine Learning · Computer Science 2026-05-08 Jingchu Gai , Laixi Shi

Multi-task benchmarks have become a central pillar of machine learning research, yet their growing influence has incentivised benchmark gaming -- strategic actions taken to improve the leaderboard rank of a specific model. Treating datasets…

Machine Learning · Computer Science 2026-05-25 Polina Gordienko , Georg Schollmeyer , Frauke Kreuter , Christoph Jansen

We study Nash equilibrium learning in partially observable Markov games (POMGs), a multi-agent reinforcement learning framework in which agents cannot fully observe the underlying state. Prior work in this setting relies on centralization…

Computer Science and Game Theory · Computer Science 2026-05-08 Philip Jordan , Maryam Kamgarpour

Nash Equilibrium (NE) is the canonical solution concept of game theory, which provides an elegant tool to understand the rationalities. Though mixed strategy NE exists in any game with finite players and actions, computing NE in two- or…

Computer Science and Game Theory · Computer Science 2024-05-07 Xinrun Wang , Chang Yang , Shuxin Li , Pengdeng Li , Xiao Huang , Hau Chan , Bo An

This thesis is going to give a gentle introduction to Mean Field Games. It aims to produce a coherent text beginning for simple notions of deterministic control theory progressively to current Mean Field Games theory. The framework…

Optimization and Control · Mathematics 2019-07-03 Athanasios Vasiliadis

Multi-agent reinforcement learning (MARL) remains difficult to scale to many agents. Recent MARL using Mean Field Control (MFC) provides a tractable and rigorous approach to otherwise difficult cooperative MARL. However, the strict MFC…

Machine Learning · Computer Science 2024-05-09 Kai Cui , Christian Fabian , Anam Tahir , Heinz Koeppl

Designing incentives for a multi-agent system to induce a desirable Nash equilibrium is both a crucial and challenging problem appearing in many decision-making domains, especially for a large number of agents $N$. Under the exchangeability…

Computer Science and Game Theory · Computer Science 2025-10-27 Nathan Corecco , Batuhan Yardim , Vinzenz Thoma , Zebang Shen , Niao He