English
Related papers

Related papers: Reinforcement Learning for Finite Space Mean-Field…

200 papers

We consider the problem of distributed channel allocation in large networks under the frequency-selective interference channel. Performance is measured by the weighted sum of achievable rates. Our proposed algorithm is a modified Fictitious…

Information Theory · Computer Science 2018-11-13 Ilai Bistritz , Amir Leshem

This paper considers mean field games with optimal stopping time (OSMFGs) where agents make optimal exit decisions, the coupled obstacle and Fokker-Planck equations in such models pose challenges versus classic MFGs. This paper proposes a…

Numerical Analysis · Mathematics 2023-10-10 Chengfeng Shen , Yifan Luo , Zhennan Zhou

In this paper, we study large population multi-agent reinforcement learning (RL) in the context of discrete-time linear-quadratic mean-field games (LQ-MFGs). Our setting differs from most existing work on RL for MFGs, in that we consider a…

Systems and Control · Electrical Eng. & Systems 2020-10-02 Muhammad Aneeq uz Zaman , Kaiqing Zhang , Erik Miehling , Tamer Başar

The goal of this paper is to study a Mean Field Game (MFG) system stemming from the harvesting of resources. Modelling the latter through a reaction-diffusion equation and the harvesters as competing rational agents, we are led to a…

Analysis of PDEs · Mathematics 2024-06-11 Ziad Kobeissi , Idriss Mazari-Fouquer , Domènec Ruiz-Balet

We investigate Nash equilibrium learning in a competitive Markov Game (MG) environment, where multiple agents compete, and multiple Nash equilibria can exist. In particular, for an oligopolistic dynamic pricing environment, exact Nash…

Computer Science and Game Theory · Computer Science 2024-03-05 Larkin Liu

We consider quadratic, nonmonotone generalized Nash equilibrium problems with symmetric interactions among the agents. Albeit this class of games is known to admit a potential function, its formal expression can be unavailable in several…

Optimization and Control · Mathematics 2022-03-31 Filippo Fabiani , Andrea Simonetto , Paul J. Goulart

In single-agent Markov decision processes, an agent can optimize its policy based on the interaction with environment. In multi-player Markov games (MGs), however, the interaction is non-stationary due to the behaviors of other players, so…

Computer Science and Game Theory · Computer Science 2021-10-19 Yuanheng Zhu , Dongbin Zhao , Mengchen Zhao , Dong Li

Computing Nash equilibrium policies is a central problem in multi-agent reinforcement learning that has received extensive attention both in theory and in practice. However, provable guarantees have been thus far either limited to fully…

Many real-world applications can be described as large-scale games of imperfect information. To deal with these challenging domains, prior work has focused on computing Nash equilibria in a handcrafted abstraction of the domain. In this…

Machine Learning · Computer Science 2016-06-29 Johannes Heinrich , David Silver

We show that under some general conditions the finite memory determinacy of a class of two-player win/lose games played on finite graphs implies the existence of a Nash equilibrium built from finite memory strategies for the corresponding…

Computer Science and Game Theory · Computer Science 2017-01-03 Stéphane Le Roux , Arno Pauly

Learning problems commonly exhibit an interesting feedback mechanism wherein the population data reacts to competing decision makers' actions. This paper formulates a new game theoretic framework for this phenomenon, called "multi-player…

Computer Science and Game Theory · Computer Science 2022-04-08 Adhyyan Narang , Evan Faulkner , Dmitriy Drusvyatskiy , Maryam Fazel , Lillian J. Ratliff

In this paper we study iterative procedures for stationary equilibria in games with large number of players. Most of learning algorithms for games with continuous action spaces are limited to strict contraction best reply maps in which the…

Machine Learning · Computer Science 2012-10-18 Hamidou Tembine , Raul Tempone , Pedro Vilanova

We introduce a general representation of large-population games in which each player s influence ON the others IS centralized AND limited, but may otherwise be arbitrary.This representation significantly generalizes the class known AS…

Computer Science and Game Theory · Computer Science 2013-01-07 Michael Kearns , Yishay Mansour

We consider a general class of finite-player stochastic games with mean-field interaction, in which the linear-quadratic cost functional includes linear operators acting on controls in $L^2$. We propose a novel approach for deriving the…

Optimization and Control · Mathematics 2024-02-16 Eduardo Abi Jaber , Eyal Neuman , Moritz Voß

Federated learning aims to train predictive models for data that is distributed across clients, under the orchestration of a server. However, participating clients typically each hold data from a different distribution, whereby predictive…

Machine Learning · Computer Science 2022-05-24 Sharut Gupta , Kartik Ahuja , Mohammad Havaei , Niladri Chatterjee , Yoshua Bengio

In this paper, we consider a mean field game (MFG) with a major and $N$ minor agents. We first consider the limiting problem and allow the coefficients to vary with the conditional distribution in a nonlinear way. We use the stochastic…

Optimization and Control · Mathematics 2024-11-05 Ziyu Huang , Shanjian Tang

We study mean field portfolio games with random market parameters, where each player is concerned with not only her own wealth but also relative performance to her competitors. We use the martingale optimality principle approach to…

Mathematical Finance · Quantitative Finance 2022-04-26 Guanxing Fu , Chao Zhou

Conventional Mean-field games/control study the behavior of a large number of rational agents moving in the Euclidean spaces. In this work, we explore the mean-field games on Riemannian manifolds. We formulate the mean-field game Nash…

Optimization and Control · Mathematics 2023-04-26 Jiajia Yu , Rongjie Lai , Wuchen Li , Stanley Osher

We study discrete-time mean-field Markov games with infinite numbers of agents where each agent aims to minimize its ergodic cost. We consider the setting where the agents have identical linear state transitions and quadratic cost…

Optimization and Control · Mathematics 2019-10-17 Zuyue Fu , Zhuoran Yang , Yongxin Chen , Zhaoran Wang

We establish the convergence of the unified two-timescale Reinforcement Learning (RL) algorithm presented in a previous work by Angiuli et al. This algorithm provides solutions to Mean Field Game (MFG) or Mean Field Control (MFC) problems…

Optimization and Control · Mathematics 2024-05-02 Andrea Angiuli , Jean-Pierre Fouque , Mathieu Laurière , Mengrui Zhang