English
Related papers

Related papers: Partially Observable Discrete-time Discounted Mark…

200 papers

We introduce a general probabilistic framework for discrete-time, infinite-horizon discounted Mean Field Type Games (MFTGs) with both global common noise and team-specific common noises. In our model, agents are allowed to use randomized…

Optimization and Control · Mathematics 2026-01-01 Grégoire Lambrecht , Mathieu Laurière

We study a two-player zero-sum stochastic differential game with asymmetric information where the payoff depends on a controlled continuous-time Markov chain X with finite state space which is only observed by player 1. This model was…

Optimization and Control · Mathematics 2018-02-26 Fabien Gensbittel

Potential game is an emerging notion and framework for studying N-player games, especially with heterogeneous players. In this paper, we build an analytical framework for dynamic potential games. We prove that a game is a dynamic potential…

Optimization and Control · Mathematics 2024-09-09 Xin Guo , Yufei Zhang

The paper proposes a natural measure space of zero-sum perfect information games with upper semicontinuous payoffs. Each game is specified by the game tree, and by the assignment of the active player and of the capacity to each node of the…

Computer Science and Game Theory · Computer Science 2021-04-22 János Flesch , Arkadi Predtetchinski , Ville Suomala

Value methods for solving stochastic games with partial observability model the uncertainty about states of the game as a probability distribution over possible states. The dimension of this belief space is the number of states. For many…

Computer Science and Game Theory · Computer Science 2019-03-14 Karel Horák , Branislav Bošanský , Christopher Kiekintveld , Charles Kamhoua

We study two-player zero-sum repeated games with incomplete information on one side, where the payoff function is tail measurable (and not necessarily the long-run average payoff). We show that the maxmin value equals the concavification of…

Optimization and Control · Mathematics 2025-12-02 Gil Bar Castellon Koltun , Ehud Lehrer , Eilon Solan

In this work, we investigate a security game between an attacker and a defender, originally proposed in \cite{emadi2019security}. As is well known, the combinatorial nature of security games leads to a large cost matrix. Therefore,…

Computer Science and Game Theory · Computer Science 2020-07-30 HAmid Emadi , Sourabh Bhattacharya

Estimating discrete games of complete information is often computationally difficult due to partial identification and the absence of closed-form moment characterizations. This paper proposes computationally tractable approaches to…

Econometrics · Economics 2025-10-02 Paul S. Koh

We study a finite-horizon two-person zero-sum risk-sensitive stochastic game for continuous-time Markov chains and Borel state and action spaces, in which payoff rates, transition rates and terminal reward functions are allowed to be…

Optimization and Control · Mathematics 2021-03-09 Junyu Zhang , Xianping Guo , Li Xia

This paper analyzes a class of infinite-time-horizon stochastic games with singular controls motivated from the partially reversible problem. It provides an explicit solution for the mean-field game (MFG) and presents sensitivity analysis…

Optimization and Control · Mathematics 2020-08-12 Haoyang Cao , Xin Guo

In the present paper, we consider a class of two players infinite horizon differential games, with piecewise smooth costs exponentially discounted in time. Through the analysis of the value functions, we study in which cases it is possible…

Analysis of PDEs · Mathematics 2014-08-07 Fabio S. Priuli

This paper is dedicated to the investigation of a new numerical method to approximate the optimal stopping problem for a discrete-time continuous state space Markov chain under partial observations. It is based on a two-step discretization…

Optimization and Control · Mathematics 2016-02-16 Benoîte de Saporta , François Dufour , Christophe Nivot

We study some ergodicity property of zero-sum stochastic games with a finite state space and possibly unbounded payoffs. We formulate this property in operator-theoretical terms, involving the solvability of an optimality equation for the…

Optimization and Control · Mathematics 2018-11-15 Antoine Hochart

We investigate zero-sum turn-based two-player stochastic games in which the objective of one player is to maximize the amount of rewards obtained during a play, while the other aims at minimizing it. We focus on games in which the minimizer…

Logic in Computer Science · Computer Science 2022-05-20 Pablo F. Castro , Pedro R. D'Argenio , Luciano Putruele , Ramiro Demasi

This paper investigates the discrete-time asynchronous games in which noncooperative agents seek to minimize their individual cost functions. Building on the assumption of partial asynchronism, i.e., each agent updates at least once within…

Optimization and Control · Mathematics 2025-08-13 Zifan Wang , Xinlei Yi , Michael M. Zavlanos , Karl H. Johansson

The paper deals with a zero-sum differential game in which the dynamical system is described by a fractional differential equation with the Caputo derivative of an order $\alpha \in (0, 1).$ The goal of the first (second) player is to…

Optimization and Control · Mathematics 2019-08-06 Mikhail Gomoyunov

We study a general formulation of the classical two-player Dynkin game in a discrete time Markovian setting. We identify an appropriate class of mixed strategies -- \textit{Markovian randomized stopping times} -- in which players stop at…

Probability · Mathematics 2025-08-13 Sören Christensen , Kristoffer Lindensjö , Berenice Anne Neumann

We examine the problem of the existence of optimal deterministic stationary strategiesintwo-players antagonistic (zero-sum) perfect information stochastic games with finitely many states and actions.We show that the existenceof such…

Computer Science and Game Theory · Computer Science 2016-11-28 Hugo Gimbert , Wieslaw Zielonka

We address payoff-based decentralized learning in infinite-horizon zero-sum Markov games. In this setting, each player makes decisions based solely on received rewards, without observing the opponent's strategy or actions nor sharing…

Computer Science and Game Theory · Computer Science 2025-02-11 Reda Ouhamma , Maryam Kamgarpour

In this paper, detectability is first put forward for discrete-time Markov jump linear systems with the Markov chain on a Borel space ($\Theta$, $\mathcal{B}(\Theta)$). Under the assumption that the unforced system is detectable, a…

Optimization and Control · Mathematics 2025-02-20 Chunjie Xiao , Ting Hou , Weihai Zhang , Feiqi Deng