English
Related papers

Related papers: Optimal stopping problems for some Markov processe…

200 papers

We study the convergence of an $N$-particle Markovian controlled system to the solution of a family of stochastic McKean-Vlasov control problems, either with a finite horizon or Schr\"odinger type cost functional. Specifically, under…

Probability · Mathematics 2024-05-22 Francesco C. De Vecchi , Chiara Rigoni

We consider optimal stopping problems with finite-time horizon and state-dependent discounting. The underlying process is a one-dimensional linear diffusion and the gain function is time-homogeneous and difference of two convex functions.…

Probability · Mathematics 2022-01-19 Tiziano De Angelis

This paper investigates the robustness of stochastic optimal control for controlled regime switching diffusions. We consider systems driven by both continuous fluctuations and discrete regime changes, allowing for model misspecification in…

Optimization and Control · Mathematics 2025-11-24 Somnath Pradhan , Dinesh Rathia

We describe an algorithm to solve Bellman optimization that replaces a sum over paths determining the optimal cost-to-go by an analytic method localized in state space. Our approach follows from the established relation between stochastic…

Optimization and Control · Mathematics 2022-12-02 Michael D. Schneider , Caleb Miller , George F. Chapline , Jane Pratt , Dan Merl

This paper analyzes the convergence of the finite population optimal stopping problem towards the corresponding mean field limit. Building on the viscosity solution characterization of the mean field optimal stopping problem of our previous…

Probability · Mathematics 2023-11-30 Mehdi Talbi , Nizar Touzi , Jianfeng Zhang

We study causal optimal transport in continuous time, with Markovian cost, between a finite-state Markov source and a diffusion target. By replacing the source with its conditional law given the observation of the target, we characterize…

Optimization and Control · Mathematics 2026-05-20 Julio Backhoff , Erhan Bayraktar , Ibrahim Ekren , Antonios Zitridis

We propose a method based on continuous time Markov chain approximation to compute the distribution of Parisian stopping times and price Parisian options under general one-dimensional Markov processes. We prove the convergence of the method…

Computational Finance · Quantitative Finance 2021-07-15 Gongqiu Zhang , Lingfei Li

We study the (weak) equilibrium problem arising from the problem of optimally stopping a one-dimensional diffusion subject to an expectation constraint on the time until stopping. The weak equilibrium problem is realized with a set of…

Probability · Mathematics 2024-06-14 Sören Christensen , Maike Klein , Boy Schultz

In this paper we study simulation based optimization algorithms for solving discrete time optimal stopping problems. This type of algorithms became popular among practioneers working in the area of quantitative finance. Using large…

Optimization and Control · Mathematics 2009-09-22 Denis Belomestny

Stochastic optimal control problems with constraints on the probability distribution of the final output are considered. Necessary conditions for optimality in the form of a coupled system of partial differential equations involving a…

Optimization and Control · Mathematics 2022-03-10 Samuel Daudin

We analyze an optimal stopping problem with a constraint on the expected cost. When the reward function and cost function are Lipschitz continuous in state variable, we show that the value of such an optimal stopping problem is a continuous…

Optimization and Control · Mathematics 2017-08-08 Erhan Bayraktar , Song Yao

Robbins' problem of optimal stopping asks one to minimise the expected {\it rank} of observation chosen by some nonanticipating stopping rule. We settle a conjecture regarding the {\it value} of the stopped variable under the rule optimal…

Probability · Mathematics 2019-07-10 Alexander Gnedin , Alexander Iksanov

We adapt ideas and concepts developed in optimal transport (and its martingale variant) to give a geometric description of optimal stopping times of Brownian motion subject to the constraint that the distribution of the stopping time is a…

Probability · Mathematics 2017-09-14 Mathias Beiglboeck , Manu Eder , Christiane Elgert , Uwe Schmock

We consider the determination of the optimal stationary singular stochastic control of a linear diffusion for a class of average cumulative cost minimization problems arising in various financial and economic applications of stochastic…

Optimization and Control · Mathematics 2018-03-12 Luis H. R. Alvarez E.

We consider the problem of stopping a diffusion process with a payoff functional that renders the problem time-inconsistent. We study stopping decisions of naive agents who reoptimize continuously in time, as well as equilibrium strategies…

Mathematical Finance · Quantitative Finance 2021-07-15 Yu-Jui Huang , Adrien Nguyen-Huu , Xun Yu Zhou

We discuss the optimal Markovian coupling before an exponential time of the Kolmogorov diffusion, and a class of related stochastic control problems in which the aim is to hit the origin before an exponential time. We provide a scaling…

Probability · Mathematics 2007-05-23 Kalvis M. Jansons , Paul D. Metcalfe

This paper attempts to study the optimal stopping time for semi-Markov processes (SMPs) under the discount optimization criteria with unbounded cost rates. In our work, we introduce an explicit construction of the equivalent semi-Markov…

Probability · Mathematics 2021-01-05 Fang Chen , Xianping Guo , Zhong-Wei Liao

In this paper, we study the optimal dividend problem under the continuous time diffusion model with the bounded dividend rate from the Reinforcement Learning (RL) perspective. Unlike the standard literature, our main focus will be on…

Optimization and Control · Mathematics 2026-03-30 Lihua Bai , Thejani Gamage , Jin Ma , Gaozhan Wang

We investigate an optimal stopping problem for the expected value of a discounted payoff on a regime-switching geometric Brownian motion under two constraints on the possible stopping times: only at exogenous random times and only during a…

Probability · Mathematics 2024-11-20 Takuji Arai , Masahiko Takenaka

An important problem in applied dynamical systems is to compute the external forcing that provokes the largest response of a desired observable quantity. For this, we investigate the perturbation theory of Markov matrices in connection with…

Dynamical Systems · Mathematics 2025-07-21 Manuel Santos Gutierrez , Niccolo Zagli , Giulia Carigi