English
Related papers

Related papers: Multigrid methods for two-player zero-sum stochast…

200 papers

Stochastic games generalize Markov decision processes (MDPs) to a multiagent setting by allowing the state transitions to depend jointly on all player actions, and having rewards determined by multiplayer matrix games at each state. We…

Computer Science and Game Theory · Computer Science 2013-01-18 Michael Kearns , Yishay Mansour , Satinder Singh

Zero-sum stochastic games are easy to solve as they can be cast as simple Markov decision processes. This is however not the case with general-sum stochastic games. A fairly general optimization problem formulation is available for…

Machine Learning · Computer Science 2015-07-02 H. L. Prasad , Shalabh Bhatnagar

An interesting iterative procedure is proposed to solve a two-player zero-sum Markov games. Under suitable assumption, the boundedness of the proposed iterates is obtained theoretically. Using results from stochastic approximation, the…

Machine Learning · Computer Science 2025-09-23 Shreyas S R , Antony Vijesh

This paper is about a set-based computing method for solving a general class of two-player zero-sum Stackelberg differential games. We assume that the game is modeled by a set of coupled nonlinear differential equations, which can be…

Optimization and Control · Mathematics 2019-09-10 Xuhui Feng , Mario E. Villanueva , Boris Houska

Simple stochastic games are two-player zero-sum stochastic games with turn-based moves, perfect information, and reachability winning conditions. We present two new algorithms computing the values of simple stochastic games. Both of them…

Computer Science and Game Theory · Computer Science 2015-07-01 Hugo Gimbert , Florian Horn

Automated verification techniques for stochastic games allow formal reasoning about systems that feature competitive or collaborative behaviour among rational agents in uncertain or probabilistic settings. Existing tools and techniques…

Logic in Computer Science · Computer Science 2020-09-01 Marta Kwiatkowska , Gethin Norman , David Parker , Gabriel Santos

Many important real-world settings contain multiple players interacting over an unknown duration with probabilistic state transitions, and are naturally modeled as stochastic games. Prior research on algorithms for stochastic games has…

Computer Science and Game Theory · Computer Science 2021-02-19 Sam Ganzfried

We consider discrete time partially observable zero-sum stochastic game with average payoff criterion. We study the game using an equivalent completely observable game. We show that the game has a value and also we come up with a pair of…

Optimization and Control · Mathematics 2014-09-16 Subhamay Saha

We propose and investigate a general class of discrete time and finite state space mean field game (MFG) problems with potential structure. Our model incorporates interactions through a congestion term and a price variable. It also allows…

Optimization and Control · Mathematics 2023-03-07 J. Frédéric Bonnans , Pierre Lavigne , Laurent Pfeiffer

We present a polynomial-time algorithm that always finds an (approximate) Nash equilibrium for repeated two-player stochastic games. The algorithm exploits the folk theorem to derive a strategy profile that forms an equilibrium by…

Computer Science and Game Theory · Computer Science 2012-06-18 Enrique Munoz de Cote , Michael L. Littman

We consider the problem of two-player zero-sum games. This problem is formulated as a min-max Markov game in the literature. The solution of this game, which is the min-max payoff, starting from a given state is called the min-max value of…

Machine Learning · Computer Science 2022-03-21 Raghuram Bharadwaj Diddigi , Chandramouli Kamanchi , Shalabh Bhatnagar

We investigate a two-player zero-sum differential game with asymmetric information on the payoff and without Isaacs condition. The dynamics is an ordinary differential equation parametrised by two controls chosen by the players. Each player…

Optimization and Control · Mathematics 2015-07-30 Rainer Buckdahn , Marc Quincampoix , Catherine Rainer , Yuhong Xu

This paper considers the problem of two-player zero-sum stochastic differential game with both players adopting impulse controls in finite horizon under rather weak assumptions on the cost functions ($c$ and $\chi$ not decreasing in time).…

Optimization and Control · Mathematics 2018-09-26 Brahim El Asri , Sehail Mazid

We study zero-sum stochastic differential games with player dynamics governed by a nondegenerate controlled diffusion process. Under the assumption of uniform stability, we establish the existence of a solution to the Isaac's equation for…

Optimization and Control · Mathematics 2019-03-20 Ari Arapostathis , Vivek S. Borkar , K. Suresh Kumar

Strategy iteration is a technique frequently used for two-player games in order to determine the winner or compute payoffs, but to the best of our knowledge no general framework for strategy iteration has been considered. Inspired by…

Logic in Computer Science · Computer Science 2022-12-14 Paolo Baldan , Richard Eggert , Barbara König , Tommaso Padoan

This paper is concerned with a non-zero sum differential game problem of an anticipated forward-backward stochastic differential delayed equation under partial information. We establish a necessary maximum principle and sufficient…

Optimization and Control · Mathematics 2017-02-17 Yi Zhuang

In this work, we propose, for the first time, a reinforcement learning framework specifically designed for zero-sum linear-quadratic stochastic differential games. This approach offers a generalized solution for scenarios in which accurate…

Optimization and Control · Mathematics 2026-02-10 Yiyuan Wang

We study stochastic zero-sum games on graphs, which are prevalent tools to model decision-making in presence of an antagonistic opponent in a random environment. In this setting, an important question is the one of strategy complexity: what…

Computer Science and Game Theory · Computer Science 2024-02-14 Patricia Bouyer , Youssouf Oualhadj , Mickael Randour , Pierre Vandenhove

Many efficient algorithms have been designed to recover Nash equilibria of various classes of finite games. Special classes of continuous games with infinite strategy spaces, such as polynomial games, can be solved by semidefinite…

Computer Science and Game Theory · Computer Science 2020-10-01 Lukáš Adam , Rostislav Horčík , Tomáš Kasl , Tomáš Kroupa

For zero-sum two-player continuous-time games with integral payoff and incomplete information on one side, one shows that the optimal strategy of the informed player can be computed through an auxiliary optimization problem over some…

Probability · Mathematics 2008-10-02 Pierre Cardaliaguet , Catherine Rainer