English
Related papers

Related papers: Discrete-time Zero-Sum Games for Markov chains wit…

200 papers

In the paper we study continuous time controlled Markov processes using discrete time controlled Markov processes. We consider long run functionals: average reward per unit time or long run risk sensitive functional. We also investigate…

Optimization and Control · Mathematics 2025-08-12 Lukasz Stettner

We consider a general type of non-Markovian impulse control problems under adverse non-linear expectation or, more specifically, the zero-sum game problem where the adversary player decides the probability measure. We show that the upper…

Optimization and Control · Mathematics 2022-06-30 Magnus Perninge

For two-person dynamic zero-sum games (both discrete and continuous settings), we investigate the limit of value functions of finite horizon games with long run average cost as the time horizon tends to infinity and the limit of value…

Optimization and Control · Mathematics 2017-09-26 Dmitry Khlopin

We study agents competing against each other in a repeated network zero-sum game while applying the multiplicative weights update (MWU) algorithm with fixed learning rates. In our implementation, agents select their strategies…

Computer Science and Game Theory · Computer Science 2021-10-06 James P. Bailey , Sai Ganesh Nagarajan , Georgios Piliouras

We consider a general nonzero-sum impulse game with two players. The main mathematical contribution of the paper is a verification theorem which provides, under some regularity conditions, a suitable system of quasi-variational inequalities…

Probability · Mathematics 2018-11-09 René Aïd , Matteo Basei , Giorgia Callegaro , Luciano Campi , Tiziano Vargiolu

We introduce a new non-zero-sum game of optimal stopping with asymmetric exercise opportunities. Given a stochastic process modelling the value of an asset, one player observes and can act on the process continuously, while the other player…

Probability · Mathematics 2024-05-16 José Luis Pérez , Neofytos Rodosthenous , Kazutoshi Yamazaki

In this paper we study the N-player nonzero-sum Dynkin game ($N\geq 3$) in continuous time, which is a non-cooperative game where the strategies are stopping times. We show that the game has a Nash equilibrium point for general payoff…

Computer Science and Game Theory · Computer Science 2011-10-27 Hamadene Said , Hassani Mohammed

Discrete time linear dynamical systems, including Markov chains, have found many applications including in security settings such as in cybersecurity operations center (CSOC) management and in managing health risks. However, in these two…

Optimization and Control · Mathematics 2025-10-28 Nilava Metya , Ankit Shah , Arunesh Sinha

This paper proves several Tauberian theorems for general iterations of operators, and provides two applications to zero-sum stochastic games where the total payoff is a weighted sum of the stage payoffs. The first application is to provide…

Optimization and Control · Mathematics 2016-09-09 Bruno Ziliotto

We consider time-homogeneous uniformly nondegenerate stochastic differential games in domains and propose constructing $\varepsilon$-optimal strategies and policies by using adjoint Markov strategies and adjoint Markov policies which are…

Optimization and Control · Mathematics 2019-03-26 N. V. Krylov

We study a two-player, zero-sum, stochastic game with incomplete information on one side in which the players are allowed to play more and more frequently. The informed player observes the realization of a Markov chain on which the payoffs…

Optimization and Control · Mathematics 2013-07-15 Pierre Cardaliaguet , Catherine Rainer , Dinah Rosenberg , Nicolas Vieille

This paper is concerned with a non-zero sum differential game problem of an anticipated forward-backward stochastic differential delayed equation under partial information. We establish a necessary maximum principle and sufficient…

Optimization and Control · Mathematics 2017-02-17 Yi Zhuang

This paper is concerned with a linear quadratic stochastic two-person zero-sum differential game with constant coefficients in an infinite time horizon. Open-loop and closed-loop saddle points are introduced. The existence of closed-loop…

Optimization and Control · Mathematics 2014-04-30 Jingrui Sun , Jiongmin Yong , Shuguang Zhang

Shapley (1953) introduced two-player zero-sum discounted stochastic games, henceforth stochastic games, a model where a state variable follows a two-controlled Markov chain, the players receive rewards at each stage which add up to $0$, and…

Optimization and Control · Mathematics 2020-03-06 Bruno Jaffuel , Miquel Oliu-Barton

In this paper, we consider a partial observed two-person zero-sum stochastic differential game problem where the system is governed by a stochastic differential equation of mean-field type. Under standard assumptions on the coefficients,…

Optimization and Control · Mathematics 2016-11-15 Maoning Tang , Qingxin Meng

For a zero-sum stochastic game which does not satisfy the Isaacs condition, we provide a value function representation for an Isaacs-type equation whose Hamiltonian lies in between the lower and upper Hamiltonians, as a convex combination…

Probability · Mathematics 2016-09-30 Daniel Hernández-Hernández , Mihai Sîrbu

Pursuit-Evasion Games (in discrete time) are stochastic games with nonnegative daily payoffs, with the final payoff being the cumulative sum of payoffs during the game. We show that such games admit a value even in the presence of…

Probability · Mathematics 2007-08-21 Ori Gurel-Gurevich

Priced timed games are two-player zero-sum games played on priced timed automata (whose locations and transitions are labeled by weights modelling the cost of spending time in a state and executing an action, respectively). The goals of the…

Computer Science and Game Theory · Computer Science 2023-06-22 Thomas Brihaye , Gilles Geeraerts , Axel Haddad , Engel Lefaucheux , Benjamin Monmege

This paper considers the theoretical, computational, and econometric properties of continuous time dynamic discrete choice games with stochastically sequential moves, introduced by Arcidiacono, Bayer, Blevins, and Ellickson (2016). We…

Econometrics · Economics 2025-11-05 Jason R. Blevins

We address stability of a class of Markovian discrete-time stochastic hybrid systems. This class of systems is characterized by the state-space of the system being partitioned into a safe or target set and its exterior, and the dynamics of…

Optimization and Control · Mathematics 2011-03-09 Debasish Chatterjee , Soumik Pal