English
Related papers

Related papers: Approximate solutions of continuous-time stochasti…

200 papers

Nonzero sum games typically have multiple Nash equilibriums (or no equilibrium), and unlike the zero sum case, they may have different values at different equilibriums. Instead of focusing on the existence of individual equilibriums, we…

Optimization and Control · Mathematics 2020-08-27 Zachary Feinstein , Birgit Rudloff , Jianfeng Zhang

Definable zero-sum stochastic games involve a finite number of states and action sets, reward and transition functions that are definable in an o-minimal structure. Prominent examples of such games are finite, semi-algebraic or globally…

Optimization and Control · Mathematics 2015-01-05 Jérôme Bolte , Stéphane Gaubert , Guillaume Vigeral

The theory of first-order mean field type differential games examines the systems of infinitely many identical agents interacting via some external media under assumption that each agent is controlled by two players. We study the…

Optimization and Control · Mathematics 2020-11-24 Yurii Averboukh

We study the links between the values of stochastic games with varying stage duration $h$, the corresponding Shapley operators $\bf{T}$ and ${\bf{T}}\_h$and the solution of $\dot f\_t = ({\bf{T}} - Id )f\_t$. Considering general non…

Optimization and Control · Mathematics 2016-01-11 Sylvain Sorin , Guillaume Vigeral

We study a two-player discounted zero-sum stochastic game model for dynamic operational planning in military campaigns. At each stage, the players manage multiple commanders who order military actions on objectives that have an open line of…

Computer Science and Game Theory · Computer Science 2024-03-04 Joseph E. McCarthy , Mathieu Dahan , Chelsea C. White

This paper considers a class of reinforcement-learning that belongs to the family of Learning Automata and provides a stochastic-stability analysis in strategic-form games. For this class of dynamics, convergence to pure Nash equilibria has…

Computer Science and Game Theory · Computer Science 2017-02-28 Georgios C. Chasparis

Semi-Markov model is one of the most general models for stochastic dynamic systems. This paper deals with a two-person zero-sum game for semi-Markov processes. We focus on the expected discounted payoff criterion with state-action-dependent…

Computer Science and Game Theory · Computer Science 2021-03-09 Zhihui Yu , Xianping Guo , Li Xia

Zero-sum stochastic games have found important applications in a variety of fields, from machine learning to economics. Work on this model has primarily focused on the computation of Nash equilibrium due to its effectiveness in solving…

Computer Science and Game Theory · Computer Science 2022-11-28 Denizalp Goktas , Jiayi Zhao , Amy Greenwald

We develop a martingale approach for studying continuous-time stochastic differential games of control and stopping, in a non-Markovian framework and with the control affecting only the drift term of the state-process. Under appropriate…

Probability · Mathematics 2008-08-28 Ioannis Karatzas , Ingrid-Mona Zamfirescu

We consider zero-sum stochastic games with finite state and action spaces, perfect information, mean payoff criteria, without any irreducibility assumption on the Markov chains associated to strategies (multichain games). The value of such…

Optimization and Control · Mathematics 2012-08-03 Marianne Akian , Jean Cochet-Terrasson , Sylvie Detournay , Stéphane Gaubert

We study nonzero-sum stochastic games for continuous time Markov chains on a denumerable state space with risk sensitive discounted and ergodic cost criteria. For the discounted cost criterion we first show that the corresponding system of…

Optimization and Control · Mathematics 2016-03-09 Mrinal K. Ghosh , K. Suresh Kumar , Chandan Pal

We consider a two-player zero-sum game with integral payoff and with incomplete information on one side, where the payoff is chosen among a continuous set of possible payoffs. We prove that the value function of this game is solution of an…

Probability · Mathematics 2012-02-23 Pierre Cardaliaguet , Catherine Rainer

In stochastic games with stage duration h, players act at times 0, h, 2h, and so on. The payoff and leaving probabilities are proportional to h. As h approaches 0, such discrete-time games approximate games played in continuous time. The…

Optimization and Control · Mathematics 2024-09-25 Ivan Novikov

The value of a finite-state two-player zero-sum stochastic game with limit-average payoff can be approximated to within $\epsilon$ in time exponential in a polynomial in the size of the game times polynomial in logarithmic in…

Computer Science and Game Theory · Computer Science 2008-12-18 Krishnendu Chatterjee , Rupak Majumdar , Thomas A. Henzinger

We study a class of stochastic target games where one player tries to find a strategy such that the state process almost-surely reaches a given target, no matter which action is chosen by the opponent. Our main result is a geometric dynamic…

Probability · Mathematics 2015-02-03 Bruno Bouchard , Marcel Nutz

Dynamic games arise when multiple agents with differing objectives choose control inputs to a dynamic system. Dynamic games model a wide variety of applications in economics, defense, and energy systems. However, compared to single-agent…

Optimization and Control · Mathematics 2018-09-25 Bolei Di , Andrew Lamperski

In many multi-player interactions, players incur strictly positive costs each time they execute actions e.g. 'menu costs' or transaction costs in financial systems. Since acting at each available opportunity would accumulate prohibitively…

Multiagent Systems · Computer Science 2024-08-02 David Mguni

In this paper, we consider a large class of constrained non-cooperative stochastic Markov games with countable state spaces and discounted cost criteria. In one-player case, i.e., constrained discounted Markov decision models, it is…

Optimization and Control · Mathematics 2021-12-16 Anna Jaśkiewicz , Andrzej S. Nowak

Motivated by a vaccination coverage problem, we consider here a zero-sum differential game governed by a differential system consisting of a hyperbolic partial differential equation (PDE) and an ordinary differential equation (ODE). Two…

Analysis of PDEs · Mathematics 2024-12-18 Mauro Garavello , Elena Rossi , Abraham Sylla

Nonzero-sum stochastic differential games with impulse controls offer a realistic and far-reaching modelling framework for applications within finance, energy markets, and other areas, but the difficulty in solving such problems has…

Numerical Analysis · Mathematics 2020-06-29 Diego Zabaljauregui