English
Related papers

Related papers: Optimal stopping of strong Markov processes

200 papers

In this paper we extend the stability results of [4]}. Our utility maximization problem is defined as an essential supremum of conditional expectations of the terminal values of wealth processes, conditioned on the filtration at the…

Portfolio Management · Quantitative Finance 2011-03-28 Erhan Bayraktar , Ross Kravitz

Standard Markovian optimal stopping problems are consistent in the sense that the first entrance time into the stopping set is optimal for each initial state of the process. Clearly, the usual concept of optimality cannot in a…

Optimization and Control · Mathematics 2018-12-05 Sören Christensen , Kristoffer Lindensjö

We consider an infinite horizon optimal control problem for a continuous-time Markov chain $X$ in a finite set $I$ with noise-free partial observation. The observation process is defined as $Y_t = h(X_t)$, $t \geq 0$, where $h$ is a given…

Optimization and Control · Mathematics 2018-06-04 Alessandro Calvia

We consider additive functionals of Markov processes in continuous time with general (metric) state spaces. We derive concentration bounds for their exponential moments and moments of finite order. Applications include diffusions,…

Probability · Mathematics 2022-02-18 Frank Redig , Florian Völlering

In this paper we study optimal stopping problems for nonlinear Markov processes driven by a McKean-Vlasov SDE and aim at solving them numerically by Monte Carlo. To this end we propose a novel regression algorithm based on the corresponding…

Numerical Analysis · Mathematics 2018-06-26 Denis Belomestny , John Schoenmakers

We consider a class of infinite-time horizon optimal stopping problems for spectrally negative Levy processes. Focusing on strategies of threshold type, we write explicit expressions for the corresponding expected payoff via the scale…

Optimization and Control · Mathematics 2013-05-03 Masahiko Egami , Kazutoshi Yamazaki

We construct and study branching Markov processes on the space of finite configurations of the state space of a given standard process, controlled by a branching kernel and a killing one. In particular, we may start with a superprocess,…

Probability · Mathematics 2015-08-03 Lucian Beznea , Oana Lupascu

We consider mean-field control problems in discrete time with discounted reward, infinite time horizon and compact state and action space. The existence of optimal policies is shown and the limiting mean-field problem is derived when the…

Optimization and Control · Mathematics 2025-10-16 Nicole Bäuerle

We develop a completely new and straightforward method for simulating the joint law of the position and running maximum at a fixed time of a general L\'{e}vy process with a view to application in insurance and financial mathematics.…

Probability · Mathematics 2012-02-20 A. Kuznetsov , A. E. Kyprianou , J. C. Pardo , K. van Schaik

We construct a Hunt process that can be described as an isotropic $\alpha$-stable L\'evy process reflected from the complement of a bounded open Lipschitz set. In fact, we introduce a new analytic method for concatenating Markov processes.…

Probability · Mathematics 2024-10-07 Krzysztof Bogdan , Markus Kunze

We consider a pair $(X,Y)$ of stochastic processes satisfying the equation $dX=a(X)Y\,dB$ driven by a Brownian motion and study the monotonicity and continuity in $y$ of the value function $v(x,y)=\sup_{\tau}E_{x,y}[e^{-q\tau}g(X_{\tau})]$,…

Probability · Mathematics 2014-05-19 Sigurd Assing , Saul Jacka , Adriana Ocejo

We study an optimal process control problem with multiple assignable causes. The process is initially in-control but is subject to random transition to one of multiple out-of-control states due to assignable causes. The objective is to find…

Optimization and Control · Mathematics 2012-12-12 Jue Wang , Chi-Guhn Lee

We study stationary max-stable processes $\{\eta(t)\colon t\in\mathbb R\}$ admitting a representation of the form $\eta(t)=\max_{i\in\mathbb N}(U_i+ Y_i(t))$, where $\sum_{i=1}^{\infty} \delta_{U_i}$ is a Poisson point process on $\mathbb…

Probability · Mathematics 2015-07-03 Sebastian Engelke , Zakhar Kabluchko

We study optimal stopping problems related to the pricing of perpetual American options in an extension of the Black-Merton-Scholes model in which the dividend and volatility rates of the underlying risky asset depend on the running values…

Probability · Mathematics 2014-05-20 Pavel V. Gapeev , Neofytos Rodosthenous

We consider a non-Markovian optimal stopping problem on finite horizon. We prove that the value process can be represented by means of a backward stochastic differential equation (BSDE), defined on an enlarged probability space, containing…

Probability · Mathematics 2015-02-20 Marco Fuhrman , Huyên Pham , Federica Zeni

We propose a method for approximating solutions to optimization problems involving the global stability properties of parameter-dependent continuous-time autonomous dynamical systems. The method relies on an approximation of the…

Optimization and Control · Mathematics 2013-08-12 Péter Koltai , Alexander Volf

We investigate the problem of optimal control synthesis for Markov Decision Processes (MDPs), addressing both qualitative and quantitative objectives. Specifically, we require the system to satisfy a qualitative task specified by a Linear…

Systems and Control · Electrical Eng. & Systems 2025-09-19 Yu Chen , Xuanyuan Yin , Shaoyuan Li , Xiang Yin

We consider the optimal prediction problem of stopping a spectrally negative L\'evy process as close as possible to a given distance $b \geq 0$ from its ultimate supremum, under a squared error penalty function. Under some mild conditions,…

Probability · Mathematics 2020-08-04 Mónica B. Carvajal Pinto , Kees van Schaik

Extending earlier work by Rogers, Wiener-Hopf factorisation is studied for a class of functions closely related to Nevanlinna-Pick functions and complete Bernstein functions. The name 'Rogers functions' is proposed for this class. Under…

Complex Variables · Mathematics 2013-12-09 Mateusz Kwaśnicki

The window mean-payoff objective strengthens the classical mean-payoff objective by computing the mean-payoff over a finite window that slides along an infinite path. Two variants have been considered: in one variant, the maximum window…

Computer Science and Game Theory · Computer Science 2025-01-10 Pranshu Gaba , Shibashis Guha