Related papers: A temporal factorization at the maximum for spectr…
In this paper, we establish a version of the central limit theorem for Markov-Feller continuous time processes (with a Polish state space) that are exponentially ergodic in the bounded-Lipschitz distance and enjoy a continuous form of the…
We propose a method for approximating solutions to optimization problems involving the global stability properties of parameter-dependent continuous-time autonomous dynamical systems. The method relies on an approximation of the…
We prove that the spatial Wiener-Hopf factorisation of a L\'evy process or random walk without killing is unique.
We present a class of Gauss-Markov processes which can be represented as space-time scaled stationary Ornstein-Uhlenbeck processes defined on the real line. We give several explicit examples of the representation for certain Gauss bridge…
This paper deals with the unconstrained and constrained cases for continuous-time Markov decision processes under the finite-horizon expected total cost criterion. The state space is denumerable and the transition and cost rates are allowed…
In this work, we investigate the optimal control problem for continuous-time Markov decision processes with the random impact of the environment. We provide conditions to show the existence of optimal controls under finite-horizon criteria.…
Studies of fixation dynamics in Markov processes predominantly focus on the mean time to absorption. This may be inadequate if the distribution is broad and skewed. We compute the distribution of fixation times in one-step birth-death…
In this paper, we establish a strong maximum principle for fractional diffusion equations with multiple Caputo derivatives in time, and investigate a related inverse problem of practical importance. Exploiting the solution properties and…
We consider Markov decision processes with synchronizing objectives, which require that a probability mass of $1-\epsilon$ accumulates in a designated set of target states, either once, always, infinitely often, or always from some point…
In this paper we present the distribution of the maximum of the telegraph process in the cases where the initial velocity is positive or negative with an even and an odd number of velocity reversals. For the telegraph process with positive…
Monotone processes, just like martingales, can often be recovered from their final values. Examples include running maxima of supermartingales, as well as running maxima, local times, and various integral functionals of sticky processes…
We discuss the existence and characterization of quasi-stationary distributions and Yaglom limits of self-similar Markov processes that reach 0 in finite time. By Yaglom limit, we mean the existence of a deterministic function $g$ and a…
We establish integral tests and laws of the iterated logarithm at 0 and at $+\infty$, for the upper envelope of positive self-similar Markov processes. Our arguments are based on the Lamperti representation, time reversal arguments and on…
We are interested in the rate of convergence of a subordinate Markov process to its invariant measure. Given a subordinator and the corresponding Bernstein function (Laplace exponent) we characterize the convergence rate of the subordinate…
We provide a characterization of the family of non-negative local martingales that have continuous running supremum and vanish at infinity. This is done by describing the class of random times that identify the times of maximum of such…
Previous authors have considered optimal stopping problems driven by the running maximum of a spectrally negative L\'evy process $X$, as well as of a one-dimensional diffusion. Many of the aforementioned results are either implicitly or…
In this paper, we consider the optimal stopping problem on semi-Markov processes (SMPs) with finite horizon, and aim to establish the existence and computation of optimal stopping times. To achieve the goal, we first develop the main…
For Markov processes with absorption, we provide general criteria ensuring the existence and the exponential non-uniform convergence in total variation norm to a quasi-stationary distribution. We also characterize a subset of its domain of…
We consider robust Markov Decision Processes with Borel state and action spaces, unbounded cost and finite time horizon. Our formulation leads to a Stackelberg game against nature. Under integrability, continuity and compactness assumptions…
We give sufficient conditions on the underlying filtration such that all totally inaccessible stopping times have compensators which are absolutely continuous. If a semimartingale, strong Markov process X has a representation as a solution…