Related papers: Optimal prediction for positive self-similar Marko…
This paper studies function approximation for finite horizon discrete time Markov decision processes under certain convexity assumptions. Uniform convergence of these approximations on compact sets is proved under several sampling schemes…
This paper concerns optimal stopping problems driven by the running maximum of a spectrally negative L\'{e}vy process $X$. More precisely, we are interested in modifications of the Shepp-Shiryaev optimal stopping problem [Avram, Kyprianou…
For a wide class of continuous-time Markov processes, including all irreducible hypoelliptic diffusions evolving on an open, connected subset of $\RL^d$, the following are shown to be equivalent: (i) The process satisfies (a slightly weaker…
This paper deals with convergence of the maximum a posterior probability path estimator in hidden Markov models. We show that when the state space of the hidden process is continuous, the optimal path may stabilize in a way which is…
We construct a four-parameter family of Markov processes on infinite Gelfand-Tsetlin schemes that preserve the class of central (Gibbs) measures. Any process in the family induces a Feller Markov process on the infinite-dimensional boundary…
In the present work, we consider spectrally positive L\'evy processes $(X_t,t\geq0)$ not drifting to $+\infty$ and we are interested in conditioning these processes to reach arbitrarily large heights (in the sense of the height process…
We derive the exact asymptotics of $P(\sup_{u\leq t}X(u) > x)$ if $x$ and $t$ tend to infinity with $x/t$ constant, for a L\'{e}vy process $X$ that admits exponential moments. The proof is based on a renewal argument and a two-dimensional…
A maximal inequality is an inequality which involves the (absolute) supremum $\sup_{s\leq t}|X_{s}|$ or the running maximum $\sup_{s\leq t}X_{s}$ of a stochastic process $(X_t)_{t\geq 0}$. We discuss maximal inequalities for several classes…
We establish a new connection between the class of Nevanlinna-Pick functions and the one of the exponents associated to spectrally negative L\'evy processes. As a consequence, we compute the characteristics related to some hyperbolic…
In this paper we derive a technique of obtaining limit theorems for suprema of L\'evy processes from their random walk counterparts. For each $a>0$, let $\{Y^{(a)}_n:n\ge 1\}$ be a sequence of independent and identically distributed random…
We aim at studying approximate null-controllability properties of a particular class of piecewise linear Markov processes (Markovian switch systems). The criteria are given in terms of algebraic invariance and are easily computable. We…
This work concerns the Ornstein-Uhlenbeck type process associated to a positive self-similar Markov process $(X(t))_{t\geq 0}$ which drifts to $\infty$, namely $U(t):= {\rm e}^{-t}X({\rm e}^t-1)$. We point out that $U$ is always a…
In this study, we address the central issue of statistical inference for Markov jump processes using discrete time observations. The primary problem at hand is to accurately estimate the infinitesimal generator of a Markov jump process, a…
We propose a method for approximating solutions to optimization problems involving the global stability properties of parameter-dependent continuous-time autonomous dynamical systems. The method relies on an approximation of the…
In this paper, we provide strong $L_2$-rates of approximation of the integral-type functionals of Markov processes by integral sums. We improve the method developed in [2]. Under assumptions on the process formulated only in terms of its…
Studying the subexponential convergence towards equilibrium of a strong Markov process, we exhibit an intermediate Lyapunov condition equivalent to the control of some moment of a hitting time. This provides a link, similar (although more…
Our purpose is to study a particular class of optimal stopping problems for Markov processes. We justify the value function convexity and we deduce that there exists a boundary function such that the smallest optimal stopping time is the…
Since the seminal work of Lamperti there is a lot of interest in the understanding of the general structure of self-similar Markov processes. Lamperti gave a representation of positive self-similar Markov processes with initial condition…
In this article we derive formulas for the probability $P(\sup_{t\leq T} X(t)>u)$ $T>0$ and $P(\sup_{t<\infty} X(t)>u)$ where $X$ is a spectrally positive L\'evy process with infinite variation. The formulas are generalizations of the…
Suppose that $(X_t)_{t \ge 0}$ is a one-dimensional Brownian motion with negative drift $-\mu$. It is possible to make sense of conditioning this process to be in the state $0$ at an independent exponential random time and if we kill the…