English
Related papers

Related papers: Risk sensitive optimal stopping

200 papers

We consider the optimal stopping problem for a Gauss-Markov process conditioned to adopt a prescribed terminal distribution. By applying a time-space transformation, we show it is equivalent to stopping a Brownian bridge pinned at a random…

Probability · Mathematics 2025-05-26 Abel Azze , Bernardo D'Auria

The literature on continuous-time stochastic optimal control seldom deals with the case of discrete state spaces. In this paper, we provide a general framework for the optimal control of continuous-time Markov chains on finite graphs. In…

Optimization and Control · Mathematics 2019-12-05 Olivier Guéant , Iuliia Manziuk

As a main step in the numerical solution of control problems in continuous time, the controlled process is approximated by sequences of controlled Markov chains, thus discretising time and space. A new feature in this context is to allow…

Optimization and Control · Mathematics 2007-05-23 Markus Fischer , Markus Reiss

This paper is devoted to the study of acceleration methods for an inequality constrained convex optimization problem by using Lyapunov functions. We first approximate such a problem as an unconstrained optimization problem by employing the…

Optimization and Control · Mathematics 2024-11-25 Juan Liu , Nan-Jing Huang , Xian-Jun Long , Xue-song Li

We investigate the stability of equilibrium-induced optimal values with respect to (w.r.t.) reward functions $f$ and transition kernels $Q$ for time-inconsistent stopping problems under nonexponential discounting in discrete time. First,…

Optimization and Control · Mathematics 2022-05-19 Erhan Bayraktar , Zhenhua Wang , Zhou Zhou

We study discrete-time Markov Decision Processes (MDPs) on finite state-action spaces and analyze the stability of optimal policies and value functions in the long-run discounted risk-sensitive objective setting. Our analysis addresses…

Optimization and Control · Mathematics 2026-01-13 Nicole Bäuerle , Marcin Pitera , Łukasz Stettner

In this paper, we study the optimal stopping problem in the case where the reward is given by a family $(\phi(\tau ),\;\;\tau \in \stopo)$ of non negative random variables indexed by predictable stopping times. We treat the problem by means…

Probability · Mathematics 2018-12-06 Siham Bouhadou , Youssef Ouknine

A general result on the method of randomized stopping is proved. It is applied to optimal stopping of controlled diffusion processes with unbounded coefficients to reduce it to an optimal control problem without stopping. This is motivated…

Probability · Mathematics 2008-05-15 Istvan Gyongy , David Siska

This paper studies a central planner's decision making on behalf of a group of members with diverse discount rates. In the context of optimal stopping, we work with an aggregation preference to incorporate all discount rates via an attitude…

Mathematical Finance · Quantitative Finance 2025-10-15 Shuoqing Deng , Xiang Yu , Jiacheng Zhang

In this paper, we propose a new framework for solving a general dynamic optimal stopping problem without time consistency. A sophisticated solution is proposed and is well-defined for any time setting with general flows of objectives. A…

Optimization and Control · Mathematics 2026-02-02 Hanqing Jin , Yanzhao Yang

This work studies discrete-time discounted Markov decision processes with continuous state and action spaces and addresses the inverse problem of inferring a cost function from observed optimal behavior. We first consider the case in which…

Optimization and Control · Mathematics 2024-05-27 Angeliki Kamoutsi , Peter Schmitt-Förster , Tobias Sutter , Volkan Cevher , John Lygeros

In this paper we study a class of risk-sensitive Markovian control problems in discrete time subject to model uncertainty. We consider a risk-sensitive discounted cost criterion with finite time horizon. The used methodology is the one of…

Optimization and Control · Mathematics 2021-04-15 Tomasz R. Bielecki , Tao Chen , Igor Cialenco

We study causal optimal transport in continuous time, with Markovian cost, between a finite-state Markov source and a diffusion target. By replacing the source with its conditional law given the observation of the target, we characterize…

Optimization and Control · Mathematics 2026-05-20 Julio Backhoff , Erhan Bayraktar , Ibrahim Ekren , Antonios Zitridis

This paper presents a distributed continuous-time optimization framework aimed at overcoming the challenges posed by time-varying cost functions and constraints in multi-agent systems, particularly those subject to disturbances. By…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Zeinab Ebrahimi , Mohammad Deghat

The purpose of this paper is two-fold: We extend the well-known relation between optimal stopping and randomized stopping of a given stochastic process to a situation where the available information flow is a filtration with no a priori…

Optimization and Control · Mathematics 2021-04-28 Nacira Agram , Sven Haadem , Bernt Oksendal , Frank Proske

Inspired by recent work of P.-L. Lions on conditional optimal control, we introduce a problem of optimal stopping under bounded rationality: the objective is the expected payoff at the time of stopping, conditioned on another event. For…

Optimization and Control · Mathematics 2019-10-15 Marcel Nutz , Yuchong Zhang

Consider a set of discounted optimal stopping problems for a one-parameter family of objective functions and a fixed diffusion process, started at a fixed point. A standard problem in stochastic control/optimal stopping is to solve for the…

Probability · Mathematics 2010-05-04 David Hobson , Martin Klimmek

We consider the problem of optimally stopping a general one-dimensional stochastic differential equation (SDE) with generalised drift over an infinite time horizon. First, we derive a complete characterisation of the solution to this…

Probability · Mathematics 2019-09-26 Mihail Zervos , Neofytos Rodosthenous , Pui Chan Lon , Thomas Bernhardt

This paper studies the properties of discrete time stochastic optimal control problems associated with portfolio selection. We investigate if optimal continuous time strategies can be used effectively for a discrete time market after a…

Portfolio Management · Quantitative Finance 2014-11-26 Alexandra Rodkina , Nikolai Dokuchaev

This paper investigates the asymptotic behaviour of solutions to certain infinite systems of coupled recurrence relations. In particular, we obtain a characterisation of those initial values which lead to a convergent solution, and for…

Functional Analysis · Mathematics 2019-02-14 L. Paunonen , D. Seifert