English
Related papers

Related papers: A Pseudo-Polynomial Algorithm for Mean Payoff Stoc…

200 papers

We study the computational complexity of solving stochastic games with mean-payoff objectives. Instead of identifying special classes in which simple strategies are sufficient to play $\epsilon$-optimally, or form $\epsilon$-Nash…

Computer Science and Game Theory · Computer Science 2024-05-16 Sougata Bose , Rasmus Ibsen-Jensen , Patrick Totzke

We consider zero-sum stochastic games with perfect information and finitely many states and actions. The payoff is computed by a function which associates to each infinite sequence of states and actions a real number. We prove that if the…

Computer Science and Game Theory · Computer Science 2022-03-29 Hugo Gimbert , Edon Kelmendi

In this paper we consider two-person zero-sum risk-sensitive stochastic dynamic games with Borel state and action spaces and bounded reward. The term risk-sensitive refers to the fact that instead of the usual risk neutral optimization…

Optimization and Control · Mathematics 2021-07-21 Nicole Bäuerle , Ulrich Rieder

We prove that zero-sum Dynkin games in continuous time with partial and asymmetric information admit a value in randomised stopping times when the stopping payoffs of the players are general \cadlag measurable processes. As a by-product of…

Probability · Mathematics 2022-06-08 Tiziano De Angelis , Nikita Merkulov , Jan Palczewski

Graph games provide the foundation for modeling and synthesizing reactive processes. In the synthesis of stochastic reactive processes, the traditional model is perfect-information stochastic games, where some transitions of the game graph…

Logic in Computer Science · Computer Science 2016-04-22 Krishnendu Chatterjee , Laurent Doyen

It is well known that the rock-paper-scissors game has no pure saddle point. We show that this holds more generally: A symmetric two-player zero-sum game has a pure saddle point if and only if it is not a generalized rock-paper-scissors…

Computer Science and Game Theory · Computer Science 2013-01-25 Peter Duersch , Joerg Oechssler , Burkhard C. Schipper

This study strengthens the links between Mean Payoff Games (\MPG{s}) and Energy Games (EG{s}). Firstly, we offer a faster $O(|V|^2|E|W)$ pseudo-polynomial time and $\Theta(|V|+|E|)$ space deterministic algorithm for solving the Value…

Data Structures and Algorithms · Computer Science 2016-09-07 Carlo Comin , Romeo Rizzi

Simple stochastic games are two-player zero-sum stochastic games with turn-based moves, perfect information, and reachability winning conditions. We present two new algorithms computing the values of simple stochastic games. Both of them…

Computer Science and Game Theory · Computer Science 2015-07-01 Hugo Gimbert , Florian Horn

We define a class of zero-sum games with combinatorial structure, where the best response problem of one player is to maximize a submodular function. For example, this class includes security games played on networks, as well as the problem…

Computer Science and Game Theory · Computer Science 2017-12-04 Bryan Wilder

The value of a finite-state two-player zero-sum stochastic game with limit-average payoff can be approximated to within $\epsilon$ in time exponential in a polynomial in the size of the game times polynomial in logarithmic in…

Computer Science and Game Theory · Computer Science 2008-12-18 Krishnendu Chatterjee , Rupak Majumdar , Thomas A. Henzinger

We consider a subclass of $n$-player stochastic games, in which players have their own internal state/action spaces while they are coupled through their payoff functions. It is assumed that players' internal chains are driven by independent…

Machine Learning · Computer Science 2023-03-23 S. Rasoul Etesami

We consider both discrete and continuous time finite state-action stochastic games. In discrete time stochastic games, it is known that a stationary Blackwell-Nash equilibrium (BNE) exists for a single controller additive reward (SC-AR)…

Optimization and Control · Mathematics 2016-05-04 Vikas Vikram Singh , N. Hemachandra

Mean-payoff zero-sum stochastic games can be studied by means of a nonlinear spectral problem. When the state space is finite, the latter consists in finding an eigenpair $(u,\lambda)$ solution of $T(u)=\lambda e + u$, where $T:\mathbb{R}^n…

Optimization and Control · Mathematics 2019-12-30 Marianne Akian , Stéphane Gaubert , Antoine Hochart

Mean-payoff games (MPGs) are infinite duration two-player zero-sum games played on weighted graphs. Under the hypothesis of perfect information, they admit memoryless optimal strategies for both players and can be solved in…

Logic in Computer Science · Computer Science 2015-04-14 Paul Hunter , Guillermo A. Pérez , Jean-François Raskin

We devise a policy-iteration algorithm for deterministic two-player discounted and mean-payoff games, that runs in polynomial time with high probability, on any input where each payoff is chosen independently from a sufficiently random…

Computer Science and Game Theory · Computer Science 2024-02-07 Bruno Loff , Mateusz Skomra

We consider infinite duration alternating move games. These games were previously studied by Roth, Balcan, Kalai and Mansour. They presented an FPTAS for computing an approximated equilibrium, and conjectured that there is a polynomial…

Computer Science and Game Theory · Computer Science 2013-04-25 Yaron Velner

Energy games belong to a class of turn-based two-player infinite-duration games}played on a weighted directed graph. It is one of the rare and intriguing combinatorial problems that lie in ${\sf NP} \cap {\sf co\mbox{-}NP}$, but are not…

Data Structures and Algorithms · Computer Science 2018-03-02 Krishnendu Chatterjee , Monika Henzinger , Sebastian Krinninger , Danupon Nanongkai

We consider two-player games played on weighted directed graphs with mean-payoff and total-payoff objectives, two classical quantitative objectives. While for single-dimensional games the complexity and memory bounds for both objectives…

Computer Science and Game Theory · Computer Science 2014-11-04 Krishnendu Chatterjee , Laurent Doyen , Mickael Randour , Jean-François Raskin

We consider zero-sum stochastic games with finite state and action spaces, perfect information, mean payoff criteria, without any irreducibility assumption on the Markov chains associated to strategies (multichain games). The value of such…

Optimization and Control · Mathematics 2012-08-03 Marianne Akian , Jean Cochet-Terrasson , Sylvie Detournay , Stéphane Gaubert

The stochastic multi-armed bandit setting has been recently studied in the non-stationary regime, where the mean payoff of each action is a non-decreasing function of the number of rounds passed since it was last played. This model captures…

Machine Learning · Computer Science 2022-10-13 Orestis Papadigenopoulos , Constantine Caramanis , Sanjay Shakkottai