English
Related papers

Related papers: Learning to Play Stochastic Two-player Perfect-Inf…

200 papers

We consider two-player stochastic games played on a finite graph for infinitely many rounds. Stochastic games generalize both Markov decision processes (MDP) by adding an adversary player, and two-player deterministic games by adding…

Computer Science and Game Theory · Computer Science 2022-02-28 Laurent Doyen

Decoding strategies play a pivotal role in text generation for modern language models, yet a puzzling gap divides theory and practice. Surprisingly, strategies that should intuitively be optimal, such as Maximum a Posteriori (MAP), often…

Machine Learning · Computer Science 2025-05-20 Sijin Chen , Omar Hagrass , Jason M. Klusowski

We consider two-player zero-sum games on graphs. These games can be classified on the basis of the information of the players and on the mode of interaction between them. On the basis of information the classification is as follows: (a)…

Computer Science and Game Theory · Computer Science 2015-05-19 Krishnendu Chatterjee , Laurent Doyen , Hugo Gimbert , Thomas A. Henzinger

We consider the problem of simultaneous learning in stochastic games with many players in the finite-horizon setting. While the typical target solution for a stochastic game is a Nash equilibrium, this is intractable with many players. We…

Computer Science and Game Theory · Computer Science 2022-10-27 William Brown

We introduce games with probabilistic uncertainty, a natural model for controller synthesis in which the controller observes the state of the system through imprecise sensors that provide correct information about the current state with a…

Computer Science and Game Theory · Computer Science 2012-07-03 Krishnendu Chatterjee , Martin Chmelik , Rupak Majumdar

We present a functional framework for automated mechanism design based on a two-stage game model of strategic interaction between the designer and the mechanism participants, and apply it to several classes of two-player infinite games of…

Computer Science and Game Theory · Computer Science 2012-06-26 Yevgeniy Vorobeychik , Daniel Reeves , Michael P. Wellman

Stochastic games combine controllable and adversarial non-determinism with stochastic behavior and are a common tool in control, verification and synthesis of reactive systems facing uncertainty. Multi-objective stochastic games are natural…

Computer Science and Game Theory · Computer Science 2021-09-20 Tobias Winkler , Maximilian Weininger

When learning to play an imperfect information game, it is often easier to first start with the basic mechanics of the game rules. For example, one can play several example rounds with private cards revealed to all players to better…

Computer Science and Game Theory · Computer Science 2025-05-27 Benjamin Heymann , Marc Lanctot

This article extends the idea of solving parity games by strategy iteration to non-deterministic strategies: In a non-deterministic strategy a player restricts himself to some non-empty subset of possible actions at a given node, instead of…

Computer Science and Game Theory · Computer Science 2012-03-20 Michael Luttenberger

We consider zero-sum stochastic games with perfect information and finitely many states and actions. The payoff is computed by a function which associates to each infinite sequence of states and actions a real number. We prove that if the…

Computer Science and Game Theory · Computer Science 2022-03-29 Hugo Gimbert , Edon Kelmendi

We tackle the problem of learning equilibria in simulation-based games. In such games, the players' utility functions cannot be described analytically, as they are given through a black-box simulator that can be queried to obtain noisy…

Computer Science and Game Theory · Computer Science 2020-02-26 Alberto Marchesi , Francesco Trovò , Nicola Gatti

We consider a deterministic game with alternate moves and complete information, of which the issue is always the victory of one of the two opponents. We assume that this game is the realization of a random model enjoying some independence…

Probability · Mathematics 2018-01-25 Sylvain Delattre , Nicolas Fournier

We propose a novel independent and payoff-based learning framework for stochastic games that is model-free, game-agnostic, and gradient-free. The learning dynamics follow a best-response-type actor-critic architecture, where agents update…

Machine Learning · Computer Science 2026-02-03 Ahmed Said Donmez , Yuksel Arslantas , Muhammed O. Sayin

In a Stackelberg game, a leader commits to a randomized strategy, and a follower chooses their best strategy in response. We consider an extension of a standard Stackelberg game, called a discrete-time dynamic Stackelberg game, that has an…

Computer Science and Game Theory · Computer Science 2022-02-11 Niklas Lauffer , Mahsa Ghasemi , Abolfazl Hashemi , Yagiz Savas , Ufuk Topcu

In the last years, the DeepMind algorithm AlphaZero has become the state of the art to efficiently tackle perfect information two-player zero-sum games with a win/lose outcome. However, when the win/lose outcome is decided by a final score…

Artificial Intelligence · Computer Science 2023-01-10 Luca Pasqualini , Gianluca Amato , Marco Fantozzi , Rosa Gini , Alessandro Marchetti , Carlo Metta , Francesco Morandin , Maurizio Parton

We consider turn-based stochastic two-player games with a combination of a parity condition that must hold surely, that is in all possible outcomes, and of a parity condition that must hold almost-surely, that is with probability 1. The…

Computer Science and Game Theory · Computer Science 2026-01-08 Laurent Doyen , Shibashis Guha

Stochastic games are an important class of problems that generalize Markov decision processes to game theoretic scenarios. We consider finite state two-player zero-sum stochastic games over an infinite time horizon with discounted rewards.…

Optimization and Control · Mathematics 2008-06-17 Parikshit Shah , Pablo A. Parrilo

We examine perfect information stochastic mean-payoff games - a class of games containing as special sub-classes the usual mean-payoff games and parity games. We show that deterministic memoryless strategies that are optimal for discounted…

Computer Science and Game Theory · Computer Science 2010-06-09 Hugo Gimbert , Wiesław Zielonka

Two-player, turn-based, stochastic games with reachability conditions are considered, where the maximizer has no information (he is blind) and is restricted to deterministic strategies whereas the minimizer is perfectly informed. We ask the…

Computer Science and Game Theory · Computer Science 2016-05-26 Edon Kelmendi , Hugo Gimbert

We present an algorithm for computing evolutionarily stable strategies (ESSs) in symmetric perfect-recall extensive-form games of imperfect information. Our main algorithm is for two-player games, and we describe how it can be extended to…

Computer Science and Game Theory · Computer Science 2025-12-15 Sam Ganzfried