English
Related papers

Related papers: Comparison of Algorithms for Simple Stochastic Gam…

200 papers

An interesting iterative procedure is proposed to solve a two-player zero-sum Markov games. Under suitable assumption, the boundedness of the proposed iterates is obtained theoretically. Using results from stochastic approximation, the…

Machine Learning · Computer Science 2025-09-23 Shreyas S R , Antony Vijesh

In two-player finite-state stochastic games of partial observation on graphs, in every state of the graph, the players simultaneously choose an action, and their joint actions determine a probability distribution over the successor states.…

Computer Science and Game Theory · Computer Science 2011-07-13 Krishnendu Chatterjee , Laurent Doyen

We suggest a new algorithm for two-person zero-sum undiscounted stochastic games focusing on stationary strategies. Given a positive real $\epsilon$, let us call a stochastic game $\epsilon$-ergodic, if its values from any two initial…

Computer Science and Game Theory · Computer Science 2015-08-17 Endre Boros , Khaled Elbassioni , Vladimir Gurvich , Kazuhisa Makino

We define the class of "simple recursive games". A simple recursive game is defined as a simple stochastic game (a notion due to Anne Condon), except that we allow arbitrary real payoffs but disallow moves of chance. We study the complexity…

Computer Science and Game Theory · Computer Science 2007-11-08 Daniel Andersson , Kristoffer Arnsfelt Hansen , Peter Bro Miltersen , Troels Bjerre Sorensen

We consider concurrent games played on graphs. At every round of a game, each player simultaneously and independently selects a move; the moves jointly determine the transition to a successor state. Two basic objectives are the safety…

Computer Science and Game Theory · Computer Science 2008-09-25 Krishnendu Chatterjee , Luca de Alfaro , Thomas A. Henzinger

Stochastic games are a convenient formalism for modelling systems that comprise rational agents competing or collaborating within uncertain environments. Probabilistic model checking techniques for this class of models allow us to formally…

Logic in Computer Science · Computer Science 2022-11-14 Marta Kwiatkowska , Gethin Norman , David Parker , Gabriel Santos

With the success of modern machine learning, it is becoming increasingly important to understand and control how learning algorithms interact. Unfortunately, negative results from game theory show there is little hope of understanding or…

We consider turn-based stochastic two-player games with a combination of a parity condition that must hold surely, that is in all possible outcomes, and of a parity condition that must hold almost-surely, that is with probability 1. The…

Computer Science and Game Theory · Computer Science 2026-01-08 Laurent Doyen , Shibashis Guha

Energy parity games are infinite two-player turn-based games played on weighted graphs. The objective of the game combines a (qualitative) parity condition with the (quantitative) requirement that the sum of the weights (i.e., the level of…

Logic in Computer Science · Computer Science 2012-04-04 Krishnendu Chatterjee , Laurent Doyen

A zero-sum two person Perfect Information Stochastic game (PISG) under limiting average payoff has a value and both the maximiser and the minimiser have optimal pure stationary strategies. Firstly we form the matrix of undiscounted payoffs…

Optimization and Control · Mathematics 2023-02-15 K. G. Bakshi , S. Sinha

In two-player zero-sum stochastic games, where two competing players make decisions under uncertainty, a pair of optimal strategies is traditionally described by Nash equilibrium and computed under the assumption that the players have…

Optimization and Control · Mathematics 2019-07-30 Yagiz Savas , Mohamadreza Ahmadi , Takashi Tanaka , Ufuk Topcu

We study the applicability of quantum algorithms in computational game theory and generalize some results related to Subtraction games, which are sometimes referred to as one-heap Nim games. In quantum game theory, a subset of Subtraction…

Quantum Physics · Physics 2020-06-15 Dmitry Kravchenko , Kamil Khadiev , Danil Serov , Ruslan Kapralov

We consider some well-known families of two-player, zero-sum, perfect information games that can be viewed as special cases of Shapley's stochastic games. We show that the following tasks are polynomial time equivalent: - Solving simple…

Computer Science and Game Theory · Computer Science 2008-12-03 Vladimir Gurvich , Peter Bro Miltersen

We present a fast numerical algorithm for large scale zero-sum stochastic games with perfect information, which combines policy iteration and algebraic multigrid methods. This algorithm can be applied either to a true finite state space…

Optimization and Control · Mathematics 2015-03-19 Marianne Akian , Sylvie Detournay

This work contains the mathematical exploration of a few prototypical games in which central concepts from statistics and probability theory naturally emerge. The first two kinds of games are termed Fisher and Bayesian games, which are…

Statistics Theory · Mathematics 2024-02-27 Jozsef Konczer

Two standard algorithms for approximately solving two-player zero-sum concurrent reachability games are value iteration and strategy iteration. We prove upper and lower bounds of 2^(m^(Theta(N))) on the worst case number of iterations…

Computer Science and Game Theory · Computer Science 2012-03-02 Kristoffer Arnsfelt Hansen , Rasmus Ibsen-Jensen , Peter Bro Miltersen

Reachability games are two-player games played on a graph, where the objective of $\texttt{REACH}$ player is to reach the target set whereas the objective of $\texttt{SAFE}$ player is to stay away from the target set. Reachability games…

Artificial Intelligence · Computer Science 2026-05-12 Krishnendu Chatterjee , Ehsan Kafshdar Goharshady , Mehrdad Karrabi , Maximilian Seeliger , Đorđe Žikelić

2.5 player parity games combine the challenges posed by 2.5 player reachability games and the qualitative analysis of parity games. These two types of problems are best approached with different types of algorithms: strategy improvement…

Logic in Computer Science · Computer Science 2016-07-07 Ernst Moritz Hahn , Sven Schewe , Andrea Turrini , Lijun Zhang

Two-player complete-information game trees are perhaps the simplest possible setting for studying general-sum games and the computational problem of finding equilibria. These games admit a simple bottom-up algorithm for finding subgame…

Computer Science and Game Theory · Computer Science 2012-07-02 Michael L. Littman , Nishkam Ravi , Arjun Talwar , Martin Zinkevich

We consider two-player partial-observation stochastic games on finite-state graphs where player 1 has partial observation and player 2 has perfect observation. The winning condition we study are \omega-regular conditions specified as parity…

Logic in Computer Science · Computer Science 2014-01-15 Krishnendu Chatterjee , Laurent Doyen , Sumit Nain , Moshe Y. Vardi