Related papers: Markov processes conditioned on their location at …
Constrained Markov processes, such as reflecting diffusions, behave as an unconstrained process in the interior of a domain but upon reaching the boundary are controlled in some way so that they do not leave the closure of the domain. In…
When analysing statistical systems or stochastic processes, it is often interesting to ask how they behave given that some observable takes some prescribed value. This conditioning problem is well understood within the linear operator…
In this brief paper we find computable exponential convergence rates for a large class of stochastically ordered Markov processes. We extend the result of Lund, Meyn, and Tweedie (1996), who found exponential convergence rates for…
In this paper, we establish limit theorems for the supremum of the support, denoted by $M_t$, of a supercritical super-Brownian motion $\{X_t, t\ge0\}$ on $\mathbb{R}$. We prove that there exists an $m(t)$ such that $(X_t-m(t), M_t-m(t))$…
We study discrete-time discounted constrained Markov decision processes (CMDPs) on Borel spaces with unbounded reward functions. In our approach the transition probability functions are weakly or set-wise continuous. The reward functions…
In this paper, a study of random times on filtered probability spaces is undertaken. The main message is that, as long as distributional properties of optional processes up to the random time are involved, there is no loss of generality in…
Motivated by L\'{e}vy's characterization of Brownian motion on the line, we propose an analogue of Brownian motion that has as its state space an arbitrary closed subset of the line that is unbounded above and below: such a process will be…
We study a space-time Brownian motion with drift B(t)=(t_0+t,y_0+W(t)+t) killed at the moving boundary of the cone {(t,x):0<x<t}. This article determines the parabolic Martin boundary and all harmonic functions associated with this process.…
We construct a continuous-time, positively divisible non-Markovian process with memory of the initial state that satisfies the differential Chapman--Kolmogorov equation. In the stationary state, the correlation function exhibits exponential…
A discrete time branching process where the offspring distribution is generation-dependent, and the number of reproductive individuals is controlled by a random mechanism is considered. This model is a Markov chain but, in general, the…
We are interested in the asymptotic behavior of Markov chains on the set of positive integers for which, loosely speaking, large jumps are rare and occur at a rate that behaves like a negative power of the current state, and such that small…
We consider one-dimensional Brownian motion conditioned (in a suitable sense) to have a local time at every point and at every moment bounded by some fixed constant. Our main result shows that a phenomenon of entropic repulsion occurs: that…
We consider a multi-type Moran model (in continuous time) with selection and type-dependent mutation. This paper is concerned with the evolution of genealogical information forward in time. For this purpose we define and analytically…
We introduce the concept of asymptotic period for an irreducible and aperiodic, discrete-time Markov chain X on a countable state space, and develop the theory leading to its formal definition. The asymptotic period of X equals one - its…
We consider continuous state branching processes that are perturbed by a Brownian motion. These processes are constructed as the unique strong solution of a stochastic differential equation. The long-term extinction and explosion behaviours…
We consider Brox's model: a one-dimensional diffusion in a Brownian potential W. We show that the normalized local time process (L(t;m_(log t) + x)=t; x \in R), where m_(log t) is the bottom of the deepest valley reached by the process…
In this short paper, we connect the procedure of constructing a totally inaccessible stopping time for a given process using the well-known Cox construction, dependent on an independent exponential random variable; with naturally occurring…
We prove a complete class theorem that characterizes \emph{all} stationary time reversible Markov processes whose finite dimensional marginal distributions (of all orders) are infinitely divisible. Aside from two degenerate cases (iid and…
We study the ergodic behaviour of a discrete-time process $X$ which is a Markov chain in a stationary random environment. The laws of $X_t$ are shown to converge to a limiting law in (weighted) total variation distance as $t\to\infty$.…
This paper deals with the unconstrained and constrained cases for continuous-time Markov decision processes under the finite-horizon expected total cost criterion. The state space is denumerable and the transition and cost rates are allowed…