English
Related papers

Related papers: Value Iteration Algorithm for Mean-field Games

200 papers

In this paper, we consider the social optimal problem of discrete time finite state space mean field games (referred to as finite mean field games [1]). Unlike the individual optimization of their own cost function in competitive models, in…

Optimization and Control · Mathematics 2024-08-09 Zijia Niu , Sanjin Huang , Lu Ren , Wang Yao , Xiao Zhang

In this paper, we use mean field games (MFGs) to investigate approximations of $N$-player games with uniformly symmetrically continuous heterogeneous closed-loop actions. To incorporate agents' risk aversion (beyond the classical expected…

Optimization and Control · Mathematics 2024-09-26 Ziteng Cheng , Sebastian Jaimungal

Strategy iteration is a technique frequently used for two-player games in order to determine the winner or compute payoffs, but to the best of our knowledge no general framework for strategy iteration has been considered. Inspired by…

Logic in Computer Science · Computer Science 2022-12-14 Paolo Baldan , Richard Eggert , Barbara König , Tommaso Padoan

This paper presents a general mean-field game (GMFG) framework for simultaneous learning and decision-making in stochastic games with a large population. It first establishes the existence of a unique Nash Equilibrium to this GMFG, and…

Optimization and Control · Mathematics 2021-10-12 Xin Guo , Anran Hu , Renyuan Xu , Junzi Zhang

We address the numerical solution of second-order Mean Field Game problems through Newton iterations in infinite dimensions, introduced in [14], where quadratic convergence of the method was rigorously established. Building upon this…

Numerical Analysis · Mathematics 2026-03-20 Elisabetta Carlini , Ahmad Zorkot

We study discrete-time mean-field Markov games with infinite numbers of agents where each agent aims to minimize its ergodic cost. We consider the setting where the agents have identical linear state transitions and quadratic cost…

Optimization and Control · Mathematics 2019-10-17 Zuyue Fu , Zhuoran Yang , Yongxin Chen , Zhaoran Wang

This thesis develops equilibrium asset pricing models in incomplete markets with a large number of heterogeneous agents using mean field game theory. The market equilibrium is characterized by a novel form of mean field backward stochastic…

Mathematical Finance · Quantitative Finance 2026-03-24 Masashi Sekine

In this short note, we consider an inverse problem to a mean-field games system where we are interested in reconstructing the state-independent running cost function from observed value-function data. We provide an elementary proof of a…

Analysis of PDEs · Mathematics 2024-08-16 Kui Ren , Nathan Soedjak , Kewei Wang , Hongyu Zhai

We introduce two algorithms based on a policy iteration method to numerically solve time-dependent Mean Field Game systems of partial differential equations with non-separable Hamiltonians. We prove the convergence of such algorithms in…

Optimization and Control · Mathematics 2022-10-03 Mathieu Laurière , Jiahao Song , Qing Tang

In this letter, we study a class of linear-quadratic mean-field-type difference games with coupled affine inequality constraints. We show that the mean-field-type equilibrium can be characterized by the existence of a multiplier process…

Optimization and Control · Mathematics 2025-10-06 Partha Sarathi Mohapatra , Puduru Viswanadha Reddy

In an extended mean field game the vector field governing the flow of the population can be different from that of the individual player at some mean field equilibrium. This new class strictly includes the standard mean field games. It is…

Probability · Mathematics 2023-09-19 Chenchen Mou , Jianfeng Zhang

In this paper, we introduce a natural learning rule for mean field games with finite state and action space, the so-called myopic adjustment process. The main motivation for these considerations are the complex computations necessary to…

Optimization and Control · Mathematics 2020-09-01 Berenice Anne Neumann

We consider mean field games with ergodic cost in the framework of a general discrete time controlled Markov processes. The state space of the processes is given by a general $\sigma$-compact Polish space. Under certain conditions, we show…

Probability · Mathematics 2015-11-02 Anup Biswas

A classic solution technique for Markov decision processes (MDP) and stochastic games (SG) is value iteration (VI). Due to its good practical performance, this approximative approach is typically preferred over exact techniques, even though…

Artificial Intelligence · Computer Science 2023-04-21 Jan Křetínský , Tobias Meggendorfer , Maximilian Weininger

In this paper, using the mean-field game theory, we study a problem of equilibrium price formation among many investors with exponential utility in the presence of liabilities unspanned by the security prices. The investors are…

Mathematical Finance · Quantitative Finance 2025-01-07 Masaaki Fujii , Masashi Sekine

We propose a new viewpoint on variational mean-field games with diffusion and quadratic Hamiltonian. We show the equivalence of such mean-field games with a relative entropy minimization at the level of probabilities on curves. We also…

Optimization and Control · Mathematics 2019-04-01 Jean-David Benamou , Guillaume Carlier , Simone Di Marino , Luca Nenna

A principled method to obtain approximate solutions of general constrained integer optimization problems is introduced. The approach is based on the calculation of a mean field probability distribution for the decision variables which is…

Optimization and Control · Mathematics 2013-05-08 Arturo Berrones , Jonás Velasco , Juan Banda

Recently, the paper [12] introduces a derivative-free consensus-based particle method that finds the Nash equilibrium of non-convex multiplayer games, where it proves the global exponential convergence in the sense of mean-field law. This…

Optimization and Control · Mathematics 2025-05-21 Hui Huang , Jethro Warnett

In this paper we formulate and solve a mean-field game described by a linear stochastic dynamics and a quadratic or exponential-quadratic cost functional for each generic player. The optimal strategies for the players are given explicitly…

Optimization and Control · Mathematics 2014-12-02 Djehiche Boualem , Tembine Hamidou

This paper is devoted to finite horizon deterministic mean field games in which the state space is a network. The agents control their velocity, and when they occupy a vertex, they can enter into any incident edge. The running and terminal…

Optimization and Control · Mathematics 2023-11-21 Yves Achdou , Paola Mannucci , Claudio Marchi , Nicoletta Tchou