English
Related papers

Related papers: Fast Planning in Stochastic Games

200 papers

We study the performance of the gradient play algorithm for stochastic games (SGs), where each agent tries to maximize its own total discounted reward by making decisions independently based on current state information which is shared…

Machine Learning · Computer Science 2023-12-08 Runyu Zhang , Zhaolin Ren , Na Li

We consider multi-agent decision making where each agent's cost function depends on all agents' strategies. We propose a distributed algorithm to learn a Nash equilibrium, whereby each agent uses only obtained values of her cost function at…

Multiagent Systems · Computer Science 2019-04-04 Tatiana Tatarenko , Maryam Kamgarpour

This work studies Nash equilibrium seeking for a class of stochastic aggregative games, where each player has an expectation-valued objective function depending on its local strategy and the aggregate of all players' strategies. We propose…

Optimization and Control · Mathematics 2022-05-17 Tongyu Wang , Peng Yi , Jie Chen

This work considers stochastic differential games with a large number of players, whose costs and dynamics interact through the empirical distribution of both their states and their controls. We develop a new framework to prove convergence…

Probability · Mathematics 2022-03-24 Mathieu Laurière , Ludovic Tangpi

Computing approximate Nash equilibria in multi-player general-sum Markov games is a computationally intractable task. However, multi-player Markov games with certain cooperative or competitive structures might circumvent this…

Computer Science and Game Theory · Computer Science 2023-08-17 Zailin Ma , Jiansheng Yang , Zhihua Zhang

We consider a nonzero-sum N-player Markov game on an abstract measurable state space with compact metric action spaces. The payoff functions are bounded Carath\'eodory functions and the transitions of the system are assumed to have a…

Optimization and Control · Mathematics 2023-05-09 François Dufour , Tomás Prieto-Rumeau

Game theory finds nowadays a broad range of applications in engineering and machine learning. However, in a derivative-free, expensive black-box context, very few algorithmic solutions are available to find game equilibria. Here, we propose…

Machine Learning · Statistics 2018-02-28 Victor Picheny , Mickael Binois , Abderrahmane Habbal

Nonzero-sum stochastic differential games with impulse controls offer a realistic and far-reaching modelling framework for applications within finance, energy markets, and other areas, but the difficulty in solving such problems has…

Numerical Analysis · Mathematics 2020-06-29 Diego Zabaljauregui

In this paper, we study the distributed generalized Nash equilibrium seeking problem of non-cooperative games in dynamic environments. Each player in the game aims to minimize its own time-varying cost function subject to a local action…

Optimization and Control · Mathematics 2020-04-02 Kaihong Lu , Guangqi Li , Long Wang

We consider a distributed stochastic approximation (SA) scheme for computing an equilibrium of a stochastic Nash game. Standard SA schemes employ diminishing steplength sequences that are square summable but not summable. Such requirements…

Optimization and Control · Mathematics 2013-03-20 Farzad Yousefian , Angelia Nedich , Uday V. Shanbhag

A fundamental open problem in monotone game theory is the computation of a specific generalized Nash equilibrium (GNE) among all the available ones, e.g. the optimal equilibrium with respect to a system-level objective. The existing GNE…

Systems and Control · Electrical Eng. & Systems 2022-03-16 Emilio Benenati , Wicak Ananduta , Sergio Grammatico

We show that an N-person non-cooperative semi-Markov game under limiting ratio average pay-off has a pure semi-stationary Nash equilibrium. In an earlier paper, the zero-sum two person case has been dealt with. The proof follows by reducing…

Computer Science and Game Theory · Computer Science 2024-02-27 K. G. Bakshi , S. Sinha

Finding Nash equilibria in two-player zero-sum continuous games is a central problem in machine learning, e.g. for training both GANs and robust models. The existence of pure Nash equilibria requires strong conditions which are not…

Machine Learning · Computer Science 2021-05-07 Carles Domingo-Enrich , Samy Jelassi , Arthur Mensch , Grant Rotskoff , Joan Bruna

We study stochastic mean-field games among finite number of teams with large finite as well as infinite number of decision makers. For this class of games within static and dynamic settings, we establish the existence of a Nash equilibrium,…

Optimization and Control · Mathematics 2022-11-11 Sina Sanjari , Naci Saldi , Serdar Yüksel

We consider a nonzero-sum Markov game on an abstract measurable state space with compact metric action spaces. The goal of each player is to maximize his respective discounted payoff function under the condition that some constraints on a…

Optimization and Control · Mathematics 2021-09-28 François Dufour , Tomás Prieto-Rumeau

The designs of many large-scale systems today, from traffic routing environments to smart grids, rely on game-theoretic equilibrium concepts. However, as the size of an $N$-player game typically grows exponentially with $N$, standard game…

Computer Science and Game Theory · Computer Science 2022-08-23 Paul Muller , Romuald Elie , Mark Rowland , Mathieu Lauriere , Julien Perolat , Sarah Perrin , Matthieu Geist , Georgios Piliouras , Olivier Pietquin , Karl Tuyls

We consider a class of Nash games, termed as aggregative games, being played over a networked system. In an aggregative game, a player's objective is a function of the aggregate of all the players' decisions. Every player maintains an…

Optimization and Control · Mathematics 2016-06-10 Jayash Koshal , Angelia Nedić , Uday V. Shanbhag

An extensive literature in economics and social science addresses contests, in which players compete to outperform each other on some measurable criterion, often referred to as a player's score, or output. Players incur costs that are an…

Computer Science and Game Theory · Computer Science 2013-08-01 Leslie Ann Goldberg , Paul W. Goldberg , Piotr Krysta , Carmine Ventre

Several notions of game enjoy a Nash-like notion of equilibrium without guarantee of existence. There are different ways of weakening a definition of Nash-like equilibrium in order to guarantee the existence of a weakened equilibrium.…

Computer Science and Game Theory · Computer Science 2007-12-11 Stéphane Le Roux

Computing an equilibrium in congestion games can be challenging when the number of players is large. Yet, it is a problem to be addressed in practice, for instance to forecast the state of the system and be able to control it. In this work,…

Computer Science and Game Theory · Computer Science 2018-10-04 Cheng Wan , Paulin Jacquot , Olivier Beaude , Nadia Oudjane