English
Related papers

Related papers: On Zero-sum Optimal Stopping Games

200 papers

This paper revisits the well-studied \emph{optimal stopping} problem but within the \emph{large-population} framework. In particular, two classes of optimal stopping problems are formulated by taking into account the \emph{relative…

Optimization and Control · Mathematics 2022-06-08 Jianhui Huang , Tinghan Xie

Given two probability measures $\mu, \nu$ on $\mathbb{R}^d$, in subharmonic order, we describe optimal stopping times $\tau$ that maximize/minimize the cost functional $\mathbb{E} |B_0 - B_\tau|^{\alpha}$, $\alpha > 0$, where $(B_t)_t$ is…

Analysis of PDEs · Mathematics 2019-06-28 Nassif Ghoussoub , Young-Heon Kim , Tongseok Lim

We study automated intrusion prevention using reinforcement learning. Following a novel approach, we formulate the interaction between an attacker and a defender as an optimal stopping game and let attack and defense strategies evolve…

Machine Learning · Computer Science 2022-05-31 Kim Hammar , Rolf Stadler

In this paper we develop a deep learning method for optimal stopping problems which directly learns the optimal stopping rule from Monte Carlo samples. As such, it is broadly applicable in situations where the underlying randomness can…

Numerical Analysis · Mathematics 2021-11-02 Sebastian Becker , Patrick Cheridito , Arnulf Jentzen

This paper considers the problem of designing optimal algorithms for reinforcement learning in two-player zero-sum games. We focus on self-play algorithms which learn the optimal policy by playing against itself without any direct…

Machine Learning · Computer Science 2020-07-15 Yu Bai , Chi Jin , Tiancheng Yu

We present a probabilistic approach to the obstacle problem for for the $p$-Laplace operator. The solutions are approximated by running processes determined by tug-of-war games plus noise, and letting the step size go to zero, not unlike…

Analysis of PDEs · Mathematics 2015-11-24 Marta Lewicka , Juan J. Manfredi

This paper is concerned with the controller-and-stopper stochastic differential game under a regime switching model in an infinite horizon. The state of the system consists of a number of diffusions \emph{coupled} by a continuous-time…

Optimization and Control · Mathematics 2021-11-02 Siyu Lv

Definable zero-sum stochastic games involve a finite number of states and action sets, reward and transition functions that are definable in an o-minimal structure. Prominent examples of such games are finite, semi-algebraic or globally…

Optimization and Control · Mathematics 2015-01-05 Jérôme Bolte , Stéphane Gaubert , Guillaume Vigeral

In this paper we introduce and study {\em all-pay bidding games}, a class of two player, zero-sum games on graphs. The game proceeds as follows. We place a token on some vertex in the graph and assign budgets to the two players. Each turn,…

Computer Science and Game Theory · Computer Science 2019-11-20 Guy Avni , Rasmus Ibsen-Jensen , Josef Tkadlec

Standard Markovian optimal stopping problems are consistent in the sense that the first entrance time into the stopping set is optimal for each initial state of the process. Clearly, the usual concept of optimality cannot in a…

Optimization and Control · Mathematics 2018-12-05 Sören Christensen , Kristoffer Lindensjö

In this work, we establish near-linear and strong convergence for a natural first-order iterative algorithm that simulates Von Neumann's Alternating Projections method in zero-sum games. First, we provide a precise analysis of Optimistic…

Optimization and Control · Mathematics 2021-08-18 Ioannis Anagnostides , Paolo Penna

We introduce a discrete-time search game, in which two players compete to find an object first. The object moves according to a time-varying Markov chain on finitely many states. The players know the Markov chain and the initial probability…

Computer Science and Game Theory · Computer Science 2020-08-28 Benoit Duvocelle , János Flesch , Mathias Staudigl , Dries Vermeulen

Turn-based discounted-sum games are two-player zero-sum games played on finite directed graphs. The vertices of the graph are partitioned between player 1 and player 2. Plays are infinite walks on the graph where the next vertex is decided…

Computer Science and Game Theory · Computer Science 2024-05-21 Ali Asadi , Krishnendu Chatterjee , Raimundo Saona , Jakub Svoboda

Optimal stopping is the problem of determining when to stop a stochastic system in order to maximize reward, which is of practical importance in domains such as finance, operations management and healthcare. Existing methods for…

Optimization and Control · Mathematics 2022-03-28 Xinyi Guan , Velibor V. Mišić

We solve the problem of optimal stopping of a Brownian motion subject to the constraint that the stopping time's distribution is a given measure consisting of finitely-many atoms. In particular, we show that this problem can be converted to…

Optimization and Control · Mathematics 2017-07-07 Erhan Bayraktar , Christopher W. Miller

We study an infinite-horizon discrete-time optimal stopping problem under non-exponential discounting. A new method, which we call the iterative approach, is developed to find subgame perfect Nash equilibria. When the discount function…

Optimization and Control · Mathematics 2021-07-15 Yu-Jui Huang , Zhou Zhou

We develop a new approach to drifting games, a class of two-person games with many applications to boosting and online learning settings. Our approach involves (a) guessing an asymptotically optimal potential by solving an associated…

Machine Learning · Computer Science 2023-02-14 Zhilei Wang , Robert V. Kohn

We explore properties of the value function and existence of optimal stopping times for functionals with discontinuities related to the boundary of an open (possibly unbounded) set $\mathcal{O}$. The stopping horizon is either random, equal…

Optimization and Control · Mathematics 2017-01-11 Jan Palczewski , Lukasz Stettner

We consider the optimal stopping problem consisting in, given a strong Markov process, a reward function and a discount rate, finding the stopping time such that the expected reward at the stopping time is maximum. The approach we follow,…

Probability · Mathematics 2014-05-30 Fabián Crocce

We study an infinite horizon optimal stopping problem which arises naturally in the optimal timing of a firm/project sale or in the valuation of natural resources: the functional to be maximised is a sum of a discounted running reward and a…

Optimization and Control · Mathematics 2016-12-08 Jan Palczewski , Lukasz Stettner