English
Related papers

Related papers: A tutorial on Zero-sum Stochastic Games

200 papers

We study a model of two-player, zero-sum, stopping games with asymmetric information. We assume that the payoff depends on two continuous-time Markov chains (X, Y), where X is only observed by player 1 and Y only by player 2, implying that…

Optimization and Control · Mathematics 2017-12-06 Fabien Gensbittel , Christine Grün

The purpose of this paper is to study 2-person zero-sum stochastic differential games, in which one player is a major one and the other player is a group of $N$ minor agents which are collectively playing, statistically identical and have…

Probability · Mathematics 2013-08-26 Rainer Buckdahn , Juan Li , Shige Peng

We consider a class of two-player zero-sum stochastic games with finite state and compact control spaces, which we call stochastic shortest path (SSP) games. They are undiscounted total cost stochastic dynamic games that have a cost-free…

Optimization and Control · Mathematics 2014-12-31 Huizhen Yu

In this article we consider zero and non-zero sum risk-sensitive average criterion games for semi-Markov processes with a finite state space. For the zero-sum case, under suitable assumptions we show that the game has a value. We also…

Optimization and Control · Mathematics 2021-06-10 Arnab Bhabak , Subhamay Saha

We study $\lambda$-discounted zero-sum games as the discount factor $\lambda$ approaches $0$ (that is, the players are more and more patient), in the context of games with stage duration. In stochastic games with stage duration $h$, players…

Optimization and Control · Mathematics 2026-02-20 Ivan Novikov

We develop an approach for two player constraint zero-sum and nonzero-sum stochastic differential games, which are modeled by Markov regime-switching jump-diffusion processes. We provide the relations between a usual stochastic optimal…

Optimization and Control · Mathematics 2023-01-31 Emel Savku

This paper introduces state abstraction for two-player zero-sum Markov games (TZMGs), where the payoffs for the two players are determined by the state representing the environment and their respective actions, with state transitions…

Computer Science and Game Theory · Computer Science 2024-12-23 Hiroki Ishibashi , Kenshi Abe , Atsushi Iwasaki

Zero-sum Markov Stackelberg games can be used to model myriad problems, in domains ranging from economics to human robot interaction. In this paper, we develop policy gradient methods that solve these games in continuous state and action…

Computer Science and Game Theory · Computer Science 2024-01-24 Denizalp Goktas , Arjun Prakash , Amy Greenwald

For a zero-sum stochastic game which does not satisfy the Isaacs condition, we provide a value function representation for an Isaacs-type equation whose Hamiltonian lies in between the lower and upper Hamiltonians, as a convex combination…

Probability · Mathematics 2016-09-30 Daniel Hernández-Hernández , Mihai Sîrbu

We consider a stochastic differential equation that is controlled by means of an additive finite-variation process. A singular stochastic controller, who is a minimizer, determines this finite-variation process, while a discretionary…

Probability · Mathematics 2015-01-20 Daniel Hernandez-Hernandez , Robert S. Simon , Mihail Zervos

In this paper, an open-loop two-person non-zero sum stochastic differential game is considered for forward-backward stochastic systems. More precisely, the controlled systems are described by a fully coupled nonlinear multi- dimensional…

Optimization and Control · Mathematics 2010-10-13 Maoning Tang , Qingxin Meng , Yongzheng Sun

Shapley (1953) introduced two-player zero-sum discounted stochastic games, henceforth stochastic games, a model where a state variable follows a two-controlled Markov chain, the players receive rewards at each stage which add up to $0$, and…

Optimization and Control · Mathematics 2020-03-06 Bruno Jaffuel , Miquel Oliu-Barton

We consider a general nonzero-sum impulse game with two players. The main mathematical contribution of the paper is a verification theorem which provides, under some regularity conditions, a suitable system of quasi-variational inequalities…

Probability · Mathematics 2018-11-09 René Aïd , Matteo Basei , Giorgia Callegaro , Luciano Campi , Tiziano Vargiolu

In this paper, we formulate a two-player zero-sum game under dynamic constraints defined by hybrid dynamical equations. The game consists of a min-max problem involving a cost functional that depends on the actions and resulting solutions…

Optimization and Control · Mathematics 2025-05-20 Santiago J. Leudo , Ricardo G. Sanfelice

In this paper, we study a class of zero-sum two-player stochastic differential games with the controlled stochastic differential equations and the payoff/cost functionals of recursive type. As opposed to the pioneering work by Fleming and…

Probability · Mathematics 2021-05-21 Jinniao Qiu , Jing Zhang

Decentralized team problems where players have asymmetric information about the state of the underlying stochastic system have been actively studied, but \emph{games} between such teams are less understood. We consider a general model of…

Multiagent Systems · Computer Science 2021-09-29 Dhruva Kartik , Ashutosh Nayyar , Urbashi Mitra

We study infinite horizon discounted-cost and ergodic-cost risk-sensitive zero-sum stochastic games for controlled continuous time Markov chains on a countable state space. For the discounted-cost game we prove the existence of value and…

Optimization and Control · Mathematics 2016-03-09 Mrinal K. Ghosh , K. Suresh Kumar , Chandan Pal

Simple stochastic games are two-player zero-sum stochastic games with turn-based moves, perfect information, and reachability winning conditions. We present two new algorithms computing the values of simple stochastic games. Both of them…

Computer Science and Game Theory · Computer Science 2015-07-01 Hugo Gimbert , Florian Horn

We study the memory resources required for near-optimal play in two-player zero-sum stochastic games with the long-run average payoff. Although optimal strategies may not exist in such games, near-optimal strategies always do. Mertens and…

Computer Science and Game Theory · Computer Science 2025-05-06 Kristoffer Arnsfelt Hansen , Rasmus Ibsen-Jensen , Abraham Neyman

Stochastic games generalize Markov decision processes (MDPs) to a multiagent setting by allowing the state transitions to depend jointly on all player actions, and having rewards determined by multiplayer matrix games at each state. We…

Computer Science and Game Theory · Computer Science 2013-01-18 Michael Kearns , Yishay Mansour , Satinder Singh