English
Related papers

Related papers: Discrete-time Zero-Sum Games for Markov chains wit…

200 papers

We study a class of zero-sum stochastic games between a stopper and a singular-controller, previously considered in [Bovo and De Angelis (2025)]. The underlying singularly-controlled dynamics takes values in…

Optimization and Control · Mathematics 2025-06-25 Andrea Bovo , Alessandro Milazzo

This paper is related to nonzero-sum stochastic differential games in the Markovian framework. We show existence of a Nash equilibrium point for the game when the drift is no longer bounded and only satisfies a linear growth condition. The…

Optimization and Control · Mathematics 2014-08-06 Said Hamadène , Rui Mu

In this paper, we consider discrete-time dynamic games of the mean-field type with a finite number $N$ of agents subject to an infinite-horizon discounted-cost optimality criterion. The state space of each agent is a locally compact Polish…

Systems and Control · Computer Science 2017-01-17 Naci Saldi , Tamer Başar , Maxim Raginsky

Zero-determinant strategies are memory-one strategies in repeated games which unilaterally enforce linear relations between expected payoffs of players. Recently, the concept of zero-determinant strategies was extended to the class of…

Optimization and Control · Mathematics 2022-09-07 Masahiko Ueda

Zero-determinant strategies are a class of strategies in repeated games which unilaterally control payoffs. Zero-determinant strategies have attracted much attention in studies of social dilemma, particularly in the context of evolution of…

Statistical Mechanics · Physics 2024-11-11 Masahiko Ueda

In a zero-sum stochastic game, at each stage, two adversary players take decisions and receive a stage payoff determined by them and by a controlled random variable representing the state of nature. The total payoff is the normalized…

Optimization and Control · Mathematics 2022-05-06 Olivier Catoni , Miquel Oliu-Barton , Bruno Ziliotto

We develop provably efficient reinforcement learning algorithms for two-player zero-sum finite-horizon Markov games with simultaneous moves. To incorporate function approximation, we consider a family of Markov games where the reward…

Machine Learning · Computer Science 2020-06-25 Qiaomin Xie , Yudong Chen , Zhaoran Wang , Zhuoran Yang

In this paper, we consider a linear quadratic stochastic two-person zero-sum differential game. The controls for both players are allowed to appear in both drift and diffusion of the state equation. The weighting matrices in the performance…

Optimization and Control · Mathematics 2014-01-21 Jingrui Sun , Jiongmin Yong

Mean-payoff games on timed automata are played on the infinite weighted graph of configurations of priced timed automata between two players, Player Min and Player Max, by moving a token along the states of the graph to form an infinite…

Computer Science and Game Theory · Computer Science 2020-01-16 Shibashis Guha , Marcin Jurdzinski , Krishna S. , Ashutosh Trivedi

Mean payoff stochastic games can be studied by means of a nonlinear spectral problem involving the Shapley operator: the ergodic equation. A solution consists in a scalar, called the ergodic constant, and a vector, called bias. The…

Optimization and Control · Mathematics 2016-05-17 Antoine Hochart

This paper addresses a continuous-time risk-minimizing two-player zero-sum stochastic differential game (SDG), in which each player aims to minimize its probability of failure. Failure occurs in the event when the state of the game enters…

Optimization and Control · Mathematics 2023-08-23 Apurva Patil , Yujing Zhou , David Fridovich-Keil , Takashi Tanaka

Motivated by the scarcity of accurate payoff feedback in practical applications of game theory, we examine a class of learning dynamics where players adjust their choices based on past payoff observations that are subject to noise and…

Optimization and Control · Mathematics 2016-06-03 Mario Bravo , Panayotis Mertikopoulos

The article presents a general discrete time dividend valuation model when the dividend growth rate is a general continuous variable. The main assumption is that the dividend growth rate follows a discrete time semi-Markov chain with…

Mathematical Finance · Quantitative Finance 2016-05-10 Guglielmo D'Amico

This paper investigates a robust incentive Stackelberg stochastic differential game problem for a linear-quadratic mean field system, where the model uncertainty appears in the drift term of the leader's state equation. Moreover, both the…

Optimization and Control · Mathematics 2026-03-31 Na Xiang , Jingtao Shi

This paper proposes a new method for finding closed-loop saddle points in zero-sum linear-quadratic stochastic differential games by decoupling their inherent structure. Specifically, we develop a nested iterative scheme that constructs a…

Optimization and Control · Mathematics 2025-12-10 Yiyuan Wang

Markov games provide a powerful framework for modeling strategic multi-agent interactions in dynamic environments. Traditionally, convergence properties of decentralized learning algorithms in these settings have been established only for…

Multiagent Systems · Computer Science 2025-06-13 Chinmay Maheshwari , Manxi Wu , Shankar Sastry

In this paper, $2\times2$ zero-sum games are studied under the following assumptions: $(1)$ One of the players (the leader) commits to choose its actions by sampling a given probability measure (strategy); $(2)$ The leader announces its…

Computer Science and Game Theory · Computer Science 2023-05-12 Ke Sun , Samir M. Perlaza , Alain Jean-Marie

We consider Gillette's two-person zero-sum stochastic games with perfect information. For each $k \in \ZZ_+$ we introduce an effective reward function, called $k$-total. For $k = 0$ and $1$ this function is known as {\it mean payoff} and…

Discrete Mathematics · Computer Science 2015-08-17 Endre Boros , Khaled Elbassioni , Vladimir Gurvich , Kazuhisa Makino

This article aims to investigate sufficient conditions for the stability of stochastic differential equations with a random structure, particularly in contexts involving the presence of concentration points. The proof of asymptotic…

Probability · Mathematics 2023-05-22 Taras Lukashiv , Igor V. Malyk , Maryna Chepeleva , Petr V. Nazarov

Similar to the role of Markov decision processes in reinforcement learning, Stochastic Games (SGs) lay the foundation for the study of multi-agent reinforcement learning (MARL) and sequential agent interactions. In this paper, we derive…

Computer Science and Game Theory · Computer Science 2023-01-12 Xiaotie Deng , Ningyuan Li , David Mguni , Jun Wang , Yaodong Yang