Related papers: Markov processes conditioned on their location at …
We prove a functional limit theorem for Markov chains that, in each step, move up or down by a possibly state dependent constant with probability $1/2$, respectively. The theorem entails that the law of every one-dimensional regular…
We consider the model of Brownian motion indexed by the Brownian tree, which has appeared in a variety of different contexts in probability, statistical physics and combinatorics. For this model, the total occupation measure is known to…
We start by remarking a one-to-one correspondence between self-similar Markov processes (ssMps) on a Banach space and Markov additive processes (MAPs) that is analogous to the well-known one between positive ssMps and L\'evy processes…
We study Markov processes where the "time" parameter is replaced by paths in a directed graph from an initial vertex to a terminal one. Along each directed path the process is Markov and has the same distribution as the one along any other…
We study a Markov decision problem in which the state space is the set of finite marked point configurations in the plane, the actions represent thinnings, the reward is proportional to the mark sum which is discounted over time, and the…
Let $(X_t)_{t\geq 0}$ be a regular one-dimensional diffusion that models a biological population. If one assumes that the population goes extinct in finite time it is natural to study the $Q$-process associated to $(X_t)_{t\geq 0}$. This is…
We construct the conditional version of $k$ independent and identically distributed random walks on $\R$ given that they stay in strict order at all times. This is a generalisation of so-called non-colliding or non-intersecting random…
When the number of particles is finite, the noncolliding Brownian motion (the Dyson model) and the noncolliding squared Bessel process are determinantal diffusion processes for any deterministic initial configuration $\xi=\sum_{j \in…
We define the concept of an `open' Markov process, a continuous-time Markov chain equipped with specified boundary states through which probability can flow in and out of the system. External couplings which fix the probabilities of…
In this paper, we consider a continuous-time Markov decision process (CTMDP) in Borel spaces, where the certainty equivalent with respect to the exponential utility of the total undiscounted cost is to be minimized. The cost rate is…
In this paper we establish spatial central limit theorems for a large class of supercritical branching Markov processes with general spatial-dependent branching mechanisms. These are generalizations of the spatial central limit theorems…
For two independent L\'{e}vy processes $\xi$ and $\eta$ and an exponentially distributed random variable $\tau$ with parameter $q>0$ that is independent of $\xi$ and $\eta$, the killed exponential functional is given by $V_{q,\xi,\eta} :=…
We consider an optimal control problem, where a Brownian motion with drift is sequentially observed, and the sign of the drift coefficient changes at jump times of a symmetric two-state Markov process. The Markov process itself is not…
We consider sequences $(X_t^N)_{t\geq0}$ of Markov processes in two dimensions whose fluid limit is a stable solution of an ordinary differential equation of the form $\dot{x}_t=b(x_t)$, where $b(x)={\pmatrix{-\mu 0 0 \lambda}}x+\tau(x)$…
We analyze the stationary distribution of regulated Markov modulated Brownian motions (MMBM) modified so that their evolution is slowed down when the process reaches level zero --- level zero is said to be {\em sticky}. To determine the…
In this paper we propose a new method for approximating the nonstationary moment dynamics of one dimensional Markovian birth-death processes. By expanding the transition probabilities of the Markov process in terms of Poisson-Charlier…
We consider a particle moving in continuous time as a Markov jump process; its discrete chain is given by an ordinary random walk on ${\mathbb Z}^d$ , and its jump rate at $({\mathbf x},t)$ is given by a fixed function $\varphi$ of the…
We consider a branching Markov process in continuous time in which the particles evolve independently as spectrally negative L\'evy processes. When the branching mechanism is critical or subcritical, the process will eventually die and we…
Markov processes restarted or reset at random times to a fixed state or region in space have been actively studied recently in connection with random searches, foraging, and population dynamics. Here we study the large deviations of…
A general theory is derived for the moments of the first passage time of a one-dimensional Markov process in presence of a weak time-dependent forcing. The linear corrections to the moments can be expressed by quadratures of the potential…