English
Related papers

Related papers: Relative Value Iteration for Stochastic Differenti…

200 papers

The main purpose of this paper is to approximate several non-local evolution equations by zero-sum repeated games in the spirit of the previous works of Kohn and the second author (2006 and 2009): general fully non-linear parabolic…

Analysis of PDEs · Mathematics 2010-12-07 Cyril Imbert , Sylvia Serfaty

We study two-player (zero-sum) concurrent mean-payoff games played on a finite-state graph. We focus on the important sub-class of ergodic games where all states are visited infinitely often with probability 1. The algorithmic study of…

Computer Science and Game Theory · Computer Science 2014-04-24 Krishnendu Chatterjee , Rasmus Ibsen-Jensen

We propose a novel independent and payoff-based learning framework for stochastic games that is model-free, game-agnostic, and gradient-free. The learning dynamics follow a best-response-type actor-critic architecture, where agents update…

Machine Learning · Computer Science 2026-02-03 Ahmed Said Donmez , Yuksel Arslantas , Muhammed O. Sayin

We study zero-sum stochastic games between a singular controller and a stopper when the (state-dependent) diffusion matrix of the underlying controlled diffusion process is degenerate. In particular, we show the existence of a value for the…

Optimization and Control · Mathematics 2024-07-15 Andrea Bovo , Tiziano De Angelis , Jan Palczewski

In the present work, we consider 2-person zero-sum stochastic differential games with a nonlinear pay-off functional which is defined through a backward stochastic differential equation. Our main objective is to study for such a game the…

Probability · Mathematics 2014-07-29 Rainer Buckdahn , Juan Li , Marc Quincampoix

This paper proposes a novel iterative algorithm to compute the stabilizing solution of regime-switching stochastic game-theoretic Riccati differential equations with periodic coefficients. The method decomposes the original complex…

Numerical Analysis · Mathematics 2025-11-11 Yiyuan Wang

A multiplicative relative value iteration algorithm for solving the dynamic programming equation for the risk-sensitive control problem is studied for discrete time controlled Markov chains with a compact Polish state space, and controlled…

Optimization and Control · Mathematics 2019-12-19 Ari Arapostathis , Vivek S. Borkar

This paper is concerned with two-person dynamic zero-sum games. Let games for some family have common dynamics, running costs and capabilities of players, and let these games differ in densities only. We show that the Dynamic Programming…

Optimization and Control · Mathematics 2017-09-26 Dmitry Khlopin

We develop here the Stochastic Perron Method in the framework of two-player zero-sum differential games. We consider the formulation of the game where both players play, symmetrically, feed-back strategies (as in [CR09] or [PZ12]) as…

Optimization and Control · Mathematics 2014-02-20 Mihai Sîrbu

We investigate a two-player zero-sum stochastic differential game problem with the state process being constrained in a connected bounded closed domain, and the cost functional described by the solution of a generalized backward stochastic…

Probability · Mathematics 2017-05-12 Lishun Xiao , Dejian Tian

This paper focuses on zero-sum stochastic differential games in the framework of forward-backward stochastic differential equations on a finite time horizon with both players adopting impulse controls. By means of BSDE methods, in…

Optimization and Control · Mathematics 2021-04-08 Liangquan Zhang

We study the smoothness of the upper and lower value functions of stochastic differential games in the framework of time-homogeneous (possibly degenerate) diffusion processes in a domain, under the assumption that the diffusion, drift and…

Analysis of PDEs · Mathematics 2013-11-26 Wei Zhou

To investigate solutions of (near-)optimal control problems, we extend and exploit a notion of homogeneity recently proposed in the literature for discrete-time systems. Assuming the plant dynamics is homogeneous, we first derive a scaling…

Optimization and Control · Mathematics 2021-09-24 Mathieu Granzotto , Romain Postoyan , Lucian Buşoniu , Dragan Nešić , Jamal Daafouz

We study a two-player zero-sum stochastic differential game with asymmetric information where the payoff depends on a controlled continuous-time Markov chain X with finite state space which is only observed by player 1. This model was…

Optimization and Control · Mathematics 2018-02-26 Fabien Gensbittel

This paper studies robust time-inconsistent (TIC) linear-quadratic stochastic control problems, formulated by stochastic differential games. By a spike variation approach, we derive sufficient conditions for achieving the Nash equilibrium,…

Optimization and Control · Mathematics 2025-04-29 Bingyan Han , Chi Seng Pun , Hoi Ying Wong

In this paper we consider non zero-sum games where multiple players control the drift of a process, and their payoffs depend on its ergodic behaviour. We establish their connection with systems of Ergodic BSDEs, and prove the existence of a…

Probability · Mathematics 2017-06-16 Samuel N. Cohen , Victor Fedyashov

This article is related to risk-sensitive nonzero-sum stochastic differential games in the Markovian framework. This game takes into account the attitudes of the players toward risk and the utility is of exponential form. We show the…

Optimization and Control · Mathematics 2014-12-04 Said Hamadène , Rui Mu

We analyse an algorithm solving stochastic mean-payoff games, combining the ideas of relative value iteration and of Krasnoselskii-Mann damping. We derive parameterized complexity bounds for several classes of games satisfying…

Optimization and Control · Mathematics 2023-05-05 Marianne Akian , Stéphane Gaubert , Ulysse Naepels , Basile Terver

We study a finite-horizon two-person zero-sum risk-sensitive stochastic game for continuous-time Markov chains and Borel state and action spaces, in which payoff rates, transition rates and terminal reward functions are allowed to be…

Optimization and Control · Mathematics 2021-03-09 Junyu Zhang , Xianping Guo , Li Xia

This paper proves several Tauberian theorems for general iterations of operators, and provides two applications to zero-sum stochastic games where the total payoff is a weighted sum of the stage payoffs. The first application is to provide…

Optimization and Control · Mathematics 2016-09-09 Bruno Ziliotto