English
Related papers

Related papers: Optimal stopping problems for some Markov processe…

200 papers

The value function of an optimal stopping problem for jump diffusions is known to be a generalized solution of a variational inequality. Assuming that the diffusion component of the process is nondegenerate and a mild assumption on the…

Optimization and Control · Mathematics 2012-03-16 Erhan Bayraktar , Hao Xing

In this note we propose a new approach towards solving numerically optimal stopping problems via reinforced regression based Monte Carlo algorithms. The main idea of the method is to reinforce standard linear regression algorithms in each…

Numerical Analysis · Mathematics 2019-07-02 Denis Belomestny , John Schoenmakers , Vladimir Spokoiny , Bakhyt Zharkynbay

I consider a stochastic optimization problem for a time-changed Bessel process whose diffusion rate is constrained to be between two positive values $r_{1}<r_{2}$. The problem is to find an optimal adapted strategy for the choice of…

Probability · Mathematics 2014-09-16 Jeremy Thane Clark

We characterize the optimal control for a class of singular stochastic control problems as the unique solution to a related Skorokhod reflection problem. The considered optimization problems concern the minimization of a discounted cost…

Optimization and Control · Mathematics 2023-05-22 Jodi Dianetti , Giorgio Ferrari

We explore properties of the value function and existence of optimal stopping times for functionals with discontinuities related to the boundary of an open (possibly unbounded) set $\mathcal{O}$. The stopping horizon is either random, equal…

Optimization and Control · Mathematics 2017-01-11 Jan Palczewski , Lukasz Stettner

This paper concerns optimal stopping problems driven by the running maximum of a spectrally negative L\'{e}vy process $X$. More precisely, we are interested in modifications of the Shepp-Shiryaev optimal stopping problem [Avram, Kyprianou…

Probability · Mathematics 2013-12-04 Curdin Ott

We study the infinite-horizon average (ergodic) risk sensitive control problem for diffusion processes under a general structural hypothesis: there is a partition of state space into two subsets, where the controlled diffusion process…

Optimization and Control · Mathematics 2025-12-01 Sumith Reddy Anugu , Guodong Pang

In this paper we formulate and solve an optimal problem for Stochastic process with a regime absorbing state. The solution for this problem is obtained through a system of partial differential equations. The method is applied to obtain an…

Optimization and Control · Mathematics 2023-05-03 yaacov Kopeliovich

In this paper, we study an optimal stopping problem in the presence of model uncertainty and regime switching. The max-min formulation for robust control and the dynamic programming approach are adopted to establish a general theoretical…

Optimization and Control · Mathematics 2025-09-04 Siyu Lv , Zhen Wu , Jie Xiong , Xin Zhang

A solution to the optimal problem for determining vector fields which maximize (resp. minimize) the transition probabilities from one location to another for a class of reflecting diffusion processes is obtained in the present paper. The…

Probability · Mathematics 2023-04-27 Zhongmin Qian , Xingcheng Xu

We combine the fields of heuristic optimization and optimal stopping. We propose a strategy for benchmarking randomized optimization algorithms that minimizes the expected total cost for obtaining a good solution with an optimal number of…

Quantum Physics · Physics 2016-12-07 Walter Vinci , Daniel A. Lidar

We introduce a class of continuous planar processes, called "semimartingales on rays", and develop for them a change-of-variable formula involving quite general classes of test functions. Special cases of such planar processes are…

Probability · Mathematics 2017-04-18 Ioannis Karatzas , Minghan Yan

This paper is concerned with a discounted stochastic optimal control problem for regime switching diffusion in an infinite horizon. First, as a preliminary with particular interests in its own right, the global well-posedness of infinite…

Optimization and Control · Mathematics 2026-02-06 Kai Ding , Xun Li , Siyu Lv , Xin Zhang

The linear response of a dynamical system refers to changes to properties of the system when small external perturbations are applied. We consider the little-studied question of selecting an optimal perturbation so as to (i) maximise the…

Dynamical Systems · Mathematics 2018-04-04 Fadi Antown , Davor Dragičević , Gary Froyland

Consider the discounted optimal stopping problem for a real valued Markov process with only positive jumps. We provide a theorem to verify that the optimal stopping region has the form {x >= x^*} for some critical threshold x^*, and a…

Probability · Mathematics 2024-11-14 Fabian Crocce , Ernesto Mordecki

We prove that weakly continuous solutions to martingale problems admit a canonical regular conditional probability distribution. This allows for the construction of time consistent convex dynamic procedures in a non dominated setting.…

Probability · Mathematics 2012-10-09 Jocelyne Bion-Nadal

We study the minimization of a spectral risk measure of the total discounted cost generated by a Markov Decision Process (MDP) over a finite or infinite planning horizon. The MDP is assumed to have Borel state and action spaces and the cost…

Optimization and Control · Mathematics 2025-10-16 Nicole Bäuerle , Alexander Glauner

We consider a model convection-diffusion problem and present our recent numerical and analysis results regarding mixed finite element formulation and discretization in the singular perturbed case when the convection term dominates the…

Numerical Analysis · Mathematics 2024-02-07 Constantin Bacuta , Daniel Hayes , Tyler O'Grady

We study a discounted singular stochastic control problem driven by a general L\'evy process, where the objective is to minimize a cost functional composed of a running cost and a control cost that depends on the current state of the…

Optimization and Control · Mathematics 2026-05-18 Mordecki Ernesto , Muler Nora , Oliú Facundo

We address the problem of making a managerial decision when the investment project is subsidized, which results in the resolution of an infinite-horizon optimal stopping problem of a switching diffusion driven by either an homogeneous or an…

Probability · Mathematics 2018-02-28 Carlos Oliveira , Nicolas Perkowski