English
Related papers

Related papers: Polynomial stochastic games via sum of squares opt…

200 papers

We prove that zero-sum Dynkin games in continuous time with partial and asymmetric information admit a value in randomised stopping times when the stopping payoffs of the players are general \cadlag measurable processes. As a by-product of…

Probability · Mathematics 2022-06-08 Tiziano De Angelis , Nikita Merkulov , Jan Palczewski

In this paper, we consider the problem of optimization and learning for constrained and multi-objective Markov decision processes, for both discounted rewards and expected average rewards. We formulate the problems as zero-sum games where…

Optimization and Control · Mathematics 2021-03-05 Ather Gattami , Qinbo Bai , Vaneet Agarwal

This paper studies partially observable two-person zero-sum semi-Markov games under a probability criterion, in which the system state may not be completely observed. It focuses on the probability that the accumulated rewards of player 1…

Optimization and Control · Mathematics 2025-08-26 Xin Wen , Li Xia , Zhihui Yu

We consider a stochastic tournament game in which each player is rewarded based on her rank in terms of the completion time of her own task and is subject to cost of effort. When players are homogeneous and the rewards are purely rank…

Optimization and Control · Mathematics 2018-11-02 Erhan Bayraktar , Jakša Cvitanić , Yuchong Zhang

We explore a mechanism of decision-making in Mean Field Games with myopic players. At each instant, agents set a strategy which optimizes their expected future cost by assuming their environment as immutable. As the system evolves, the…

Optimization and Control · Mathematics 2018-02-05 Charafeddine Mouzouni

This paper examines multiplayer symmetric constant-sum games with more than two players in a competitive setting, including examples like Mahjong, Poker, and various board and video games. In contrast to two-player zero-sum games,…

Machine Learning · Computer Science 2024-10-04 Jiawei Ge , Yuanhao Wang , Wenzhe Li , Chi Jin

Two-player (antagonistic) games on (possibly stochastic) graphs are a prevalent model in theoretical computer science, notably as a framework for reactive synthesis. Optimal strategies may require randomisation when dealing with inherently…

Computer Science and Game Theory · Computer Science 2024-11-25 James C. A. Main , Mickael Randour

Mean-payoff games are important quantitative models for open reactive systems. They have been widely studied as games of full observation. In this paper we investigate the algorithmic properties of several sub-classes of mean-payoff games…

Computer Science and Game Theory · Computer Science 2017-10-10 Paul Hunter , Arno Pauly , Guillermo A. Pérez , Jean-François Raskin

Motivated by the sequence form formulation of Koller et al. (GEB'96), this paper defines {\em bilinear games}, and proposes efficient algorithms for its rank based subclasses. Bilinear games are two-player non-cooperative single-shot games…

Computer Science and Game Theory · Computer Science 2011-09-29 Jugal Garg , Albert Xin Jiang , Ruta Mehta

Stochastic games are a convenient formalism for modelling systems that comprise rational agents competing or collaborating within uncertain environments. Probabilistic model checking techniques for this class of models allow us to formally…

Logic in Computer Science · Computer Science 2022-11-14 Marta Kwiatkowska , Gethin Norman , David Parker , Gabriel Santos

This paper examines finite zero-sum stochastic games and demonstrates that when the game's duration is sufficiently long, there exists a pair of approximately optimal strategies such that the expected average payoff at any point in the game…

Optimization and Control · Mathematics 2024-12-02 Thomas Ragel , Bruno Ziliotto

Many real-world domains contain multiple agents behaving strategically with probabilistic transitions and uncertain (potentially infinite) duration. Such settings can be modeled as stochastic games. While algorithms have been developed for…

Computer Science and Game Theory · Computer Science 2020-06-25 Sam Ganzfried , Conner Laughlin , Charles Morefield

We consider a nonzero-sum Markov game on an abstract measurable state space with compact metric action spaces. The goal of each player is to maximize his respective discounted payoff function under the condition that some constraints on a…

Optimization and Control · Mathematics 2021-09-28 François Dufour , Tomás Prieto-Rumeau

Recent results of Ye and Hansen, Miltersen and Zwick show that policy iteration for one or two player (perfect information) zero-sum stochastic games, restricted to instances with a fixed discount rate, is strongly polynomial. We show that…

Optimization and Control · Mathematics 2013-10-21 Marianne Akian , Stéphane Gaubert

In this article we consider zero and non-zero sum risk-sensitive average criterion games for semi-Markov processes with a finite state space. For the zero-sum case, under suitable assumptions we show that the game has a value. We also…

Optimization and Control · Mathematics 2021-06-10 Arnab Bhabak , Subhamay Saha

Weighted timed games are two-player zero-sum games played in a timed automaton equipped with integer weights. We consider optimal reachability objectives, in which one of the players, that we call Min, wants to reach a target location while…

Computer Science and Game Theory · Computer Science 2025-03-05 Benjamin Monmege , Julie Parreaux , Pierre-Alain Reynier

We show that every two-player stochastic game with finite state and action sets and bounded, Borel-measurable, and shift-invariant payoffs, admits an $\ep$-equilibrium for all $\varepsilon>0$.

Optimization and Control · Mathematics 2022-03-29 János Flesch , Eilon Solan

A general model for zero-sum stochastic games with asymmetric information is considered. In this model, each player's information at each time can be divided into a common information part and a private information part. Under certain…

Systems and Control · Electrical Eng. & Systems 2019-12-25 Dhruva Kartik , Ashutosh Nayyar

This paper presents a learning dynamic with almost sure convergence guarantee for any stochastic game with turn-based controllers (on state transitions) as long as stage-payoffs induce a zero-sum or identical-interest game. Stage-payoffs…

Computer Science and Game Theory · Computer Science 2023-10-11 Muhammed O. Sayin

Stochastic games are often used to model reactive processes. We consider the problem of synthesizing an optimal almost-sure winning strategy in a two-player (namely a system and its environment) turn-based stochastic game with both a…

Systems and Control · Computer Science 2015-11-03 Min Wen , Ufuk Topcu