English
Related papers

Related papers: Approximate solutions of continuous-time stochasti…

200 papers

Mean payoff stochastic games can be studied by means of a nonlinear spectral problem involving the Shapley operator: the ergodic equation. A solution consists in a scalar, called the ergodic constant, and a vector, called bias. The…

Optimization and Control · Mathematics 2016-05-17 Antoine Hochart

In a zero-sum stochastic game, at each stage, two adversary players take decisions and receive a stage payoff determined by them and by a controlled random variable representing the state of nature. The total payoff is the normalized…

Optimization and Control · Mathematics 2022-05-06 Olivier Catoni , Miquel Oliu-Barton , Bruno Ziliotto

We address payoff-based decentralized learning in infinite-horizon zero-sum Markov games. In this setting, each player makes decisions based solely on received rewards, without observing the opponent's strategy or actions nor sharing…

Computer Science and Game Theory · Computer Science 2025-02-11 Reda Ouhamma , Maryam Kamgarpour

Using methods from the statistical mechanics of disordered systems we analyze the properties of bimatrix games with random payoffs in the limit where the number of pure strategies of each player tends to infinity. We analytically calculate…

Disordered Systems and Neural Networks · Physics 2009-10-31 Johannes Berg

The infinite horizon risk-sensitive discounted-cost and ergodic-cost nonzero-sum stochastic games for controlled Markov chains with countably many states are analyzed. For the discounted-cost game, we prove the existence of Nash equilibrium…

Optimization and Control · Mathematics 2016-03-14 Arnab Basu , Mrinal K. Ghosh

We consider a class of fully stochastic and fully distributed algorithms, that we prove to learn equilibria in games. Indeed, we consider a family of stochastic distributed dynamics that we prove to converge weakly (in the sense of weak…

Computer Science and Game Theory · Computer Science 2009-07-14 Olivier Bournez , Johanne Cohen

We develop provably efficient reinforcement learning algorithms for two-player zero-sum finite-horizon Markov games with simultaneous moves. To incorporate function approximation, we consider a family of Markov games where the reward…

Machine Learning · Computer Science 2020-06-25 Qiaomin Xie , Yudong Chen , Zhaoran Wang , Zhuoran Yang

We study nonzero-sum stochastic switching games. Two players compete for market dominance through controlling (via timing options) the discrete-state market regime $M$. Switching decisions are driven by a continuous stochastic factor $X$…

General Economics · Economics 2018-07-23 Liangchen Li , Michael Ludkovski

We investigate a two-player zero-sum differential game with asymmetric information on the payoff and without Isaacs condition. The dynamics is an ordinary differential equation parametrised by two controls chosen by the players. Each player…

Optimization and Control · Mathematics 2015-07-30 Rainer Buckdahn , Marc Quincampoix , Catherine Rainer , Yuhong Xu

In the context of simple finite-state discrete time systems, we introduce a generalization of mean field game solution, called correlated solution, which can be seen as the mean field game analogue of a correlated equilibrium. Our notion of…

Optimization and Control · Mathematics 2021-07-12 Luciano Campi , Markus Fischer

This paper is an attempt to compute the value and saddle points of zero-sum risk-sensitive average stochastic games. For the average games with finite states and actions, we first introduce the so-called irreducibility coefficient and then…

Optimization and Control · Mathematics 2025-05-08 Fang Chen , Xianping Guo , Xin Guo , Junyu Zhang

We formulate a class of mean field games on a finite state space with variational principles resembling those in continuous-state mean field games. We construct a controlled continuity equation featuring a nonlinear activation function on…

Optimization and Control · Mathematics 2023-10-10 Yuan Gao , Wuchen Li , Jian-Guo Liu

For a zero-sum stochastic game which does not satisfy the Isaacs condition, we provide a value function representation for an Isaacs-type equation whose Hamiltonian lies in between the lower and upper Hamiltonians, as a convex combination…

Probability · Mathematics 2016-09-30 Daniel Hernández-Hernández , Mihai Sîrbu

We prove the dynamic programming principe for uniformly nondegenerate stochastic differential games in the framework of time-homogeneous diffusion processes considered up to the first exit time from a domain. In contrast with previous…

Optimization and Control · Mathematics 2012-07-17 N. V. Krylov

We consider two-player stochastic games played on a finite graph for infinitely many rounds. Stochastic games generalize both Markov decision processes (MDP) by adding an adversary player, and two-player deterministic games by adding…

Computer Science and Game Theory · Computer Science 2022-02-28 Laurent Doyen

We propose a continuous version of the classical Gale--Berlekamp switching game. We also study a weighted version of this new continuous game. The main results of this paper concern growth estimates for the corresponding optimization…

Combinatorics · Mathematics 2020-03-16 Daniel Pellegrino , Janiely Silva , Eduardo V. Teixeira

In this paper we investigate two-player zero-sum stochastic differential games with an ergodic payoff, in which the diffusion coefficient does not need to be non-degenerate. We first establish the existence of a viscosity solution to the…

Optimization and Control · Mathematics 2026-01-21 Juan Li , Wenqiang Li , Yanwei Li , Huaizhong Zhao

This paper considers a two-person zero-sum continuous-time Markov pure jump game in Borel state and action spaces over a fixed finite horizon. The main assumption on the model is the existence of a drift function, which bounds the reward…

Optimization and Control · Mathematics 2017-03-31 Xin Guo , Yi Zhang

The theory of mean field games aims at studying deterministic or stochastic differential games (Nash equilibria) as the number of agents tends to infinity. Since very few mean field games have explicit or semi-explicit solutions, numerical…

Optimization and Control · Mathematics 2020-03-11 Yves Achdou , Mathieu Laurière

We discuss and compare two methods of investigations for the asymptotic regime of stochastic differential games with a finite number of players as the number of players tends to the infinity. These two methods differ in the order in which…

Probability · Mathematics 2012-10-23 Rene Carmona , Francois Delarue , Aime Lachapelle