English
Related papers

Related papers: Learning to Play Stochastic Two-player Perfect-Inf…

200 papers

Probabilistic timed automata are a suitable formalism to model systems with real-time, nondeterministic and probabilistic behaviour. We study two-player zero-sum games on such automata where the objective of the game is specified as the…

Logic in Computer Science · Computer Science 2016-04-18 Vojtěch Forejt , Marta Kwiatkowska , Gethin Norman , Ashutosh Trivedi

Simple stochastic games are turn-based 2.5-player zero-sum graph games with a reachability objective. The problem is to compute the winning probability as well as the optimal strategies of both players. In this paper, we compare the three…

Computer Science and Game Theory · Computer Science 2020-09-24 Jan Křetínský , Emanuel Ramneantu , Alexander Slivinskiy , Maximilian Weininger

We propose a novel online learning method for minimizing regret in large extensive-form games. The approach learns a function approximator online to estimate the regret for choosing a particular action. A no-regret algorithm uses these…

Artificial Intelligence · Computer Science 2015-01-05 Kevin Waugh , Dustin Morrill , J. Andrew Bagnell , Michael Bowling

We revisit the problem of solving two-player zero-sum games in the decentralized setting. We propose a simple algorithmic framework that simultaneously achieves the best rates for honest regret as well as adversarial regret, and in addition…

Computer Science and Game Theory · Computer Science 2018-06-07 Ehsan Asadi Kangarshahi , Ya-Ping Hsieh , Mehmet Fatih Sahin , Volkan Cevher

We consider a general online stochastic optimization problem with multiple budget constraints over a horizon of finite time periods. In each time period, a reward function and multiple cost functions are revealed, and the decision maker…

Machine Learning · Computer Science 2022-07-26 Jiashuo Jiang , Xiaocheng Li , Jiawei Zhang

We study decentralized equilibrium selection in stochastic games under severe information and communication constraints. In such settings, convergence to equilibrium alone is insufficient, as stochastic games typically admit many equilibria…

Computer Science and Game Theory · Computer Science 2026-02-16 Seref Taha Kiremitci , Ahmed Said Donmez , Muhammed O. Sayin

In this work, we study stochastic non-cooperative games, where only noisy black-box function evaluations are available to estimate the cost function for each player. Since each player's cost function depends on both its own decision…

Computer Science and Game Theory · Computer Science 2025-11-18 Haidong Li , Anzhi Sheng , Yijie Peng , Long Wang

Games are natural models for multi-agent machine learning settings, such as generative adversarial networks (GANs). The desirable outcomes from algorithmic interactions in these games are encoded as game theoretic equilibrium concepts, e.g.…

Computer Science and Game Theory · Computer Science 2022-02-25 Gabriel P. Andrade , Rafael Frongillo , Georgios Piliouras

This paper describes stochastic search approaches, including a new stochastic algorithm and an adaptive mutation operator, for learning Bayesian networks from incomplete data. This problem is characterized by a huge solution space with a…

Artificial Intelligence · Computer Science 2013-01-30 James W. Myers , Kathryn Blackmond Laskey , Tod S. Levitt

Stochastic two-player games model systems with an environment that is both adversarial and stochastic. The adversarial part of the environment is modeled by a player (Player 2) who tries to prevent the system (Player 1) from achieving its…

Computer Science and Game Theory · Computer Science 2025-06-11 Laurent Doyen , Pranshu Gaba , Shibashis Guha

The literature on game-theoretic equilibrium finding predominantly focuses on single games or their repeated play. Nevertheless, numerous real-world scenarios feature playing a game sampled from a distribution of similar, but not identical…

Computer Science and Game Theory · Computer Science 2024-02-21 David Sychrovský , Michal Šustr , Elnaz Davoodi , Michael Bowling , Marc Lanctot , Martin Schmid

Infinite games with imperfect information are known to be undecidable unless the information flow is severely restricted. One fundamental decidable case occurs when there is a total ordering among players, such that each player has access…

Computer Science and Game Theory · Computer Science 2016-07-19 Dietmar Berwanger , Anup Basil Mathew , Marie van den Bogaard

We present a mathematical framework for modeling two-player noncooperative games in which one player is uncertain of the other player's costs but can preemptively allocate information-gathering resources to reduce this uncertainty. We refer…

Computer Science and Game Theory · Computer Science 2024-10-28 Fernando Palafox , Jesse Milzman , Dong Ho Lee , Ryan Park , David Fridovich-Keil

Estimating discrete games of complete information is often computationally difficult due to partial identification and the absence of closed-form moment characterizations. This paper proposes computationally tractable approaches to…

Econometrics · Economics 2025-10-02 Paul S. Koh

Decomposition, i.e. independently analyzing possible subgames, has proven to be an essential principle for effective decision-making in perfect information games. However, in imperfect information games, decomposition has proven to be…

Computer Science and Game Theory · Computer Science 2014-04-22 Neil Burch , Michael Johanson , Michael Bowling

This paper investigates the discrete-time asynchronous games in which noncooperative agents seek to minimize their individual cost functions. Building on the assumption of partial asynchronism, i.e., each agent updates at least once within…

Optimization and Control · Mathematics 2025-08-13 Zifan Wang , Xinlei Yi , Michael M. Zavlanos , Karl H. Johansson

Ensuring that AI systems make strategic decisions aligned with the specified preferences in adversarial sequential interactions is a critical challenge for developing trustworthy AI systems, especially when the environment is stochastic and…

Computer Science and Game Theory · Computer Science 2025-01-28 Abhishek Ninad Kulkarni , Jie Fu , Ufuk Topcu

Optimization of deep learning algorithms to approach Nash Equilibrium remains a significant problem in imperfect information games, e.g. StarCraft and poker. Neural Fictitious Self-Play (NFSP) has provided an effective way to learn…

Artificial Intelligence · Computer Science 2021-04-23 Yuxuan Chen , Li Zhang , Shijian Li , Gang Pan

An interesting iterative procedure is proposed to solve a two-player zero-sum Markov games. Under suitable assumption, the boundedness of the proposed iterates is obtained theoretically. Using results from stochastic approximation, the…

Machine Learning · Computer Science 2025-09-23 Shreyas S R , Antony Vijesh

We study variants of a stochastic game inspired by backgammon where players may propose to double the stake, with the game state dictated by a one-dimensional random walk. Our variants allow for different numbers of proposals and different…

Optimization and Control · Mathematics 2024-10-28 Haoru Ju , Daniel Leifer , Steven J. Miller , Sooraj A. Padmanabhan , Chenyang Sun , Luke Tichi , Benjamin Tocher , Kiley Wallace