Related papers: Renewal Theory for Transient Markov Chains with As…

We show analogs of the classical arcsine theorem for the occupation time of a random walk in $(-\infty,0)$ in the case of a small positive drift. To study the asymptotic behavior of the total time spent in $(-\infty,0)$ we consider…

In this work the asymptotic properties of $Q_t(N)$ ,the probability of the number of renewals ($N$), that occur during time $t$ are explored. While the forms of the distribution at very long times, i.e. $t\to\infty$, are very well known and…

Spatially-distributed, nonequilibrium chemical systems described by a Markov chain model are considered. The evolution of such systems arises from a combination of local birth-death reactive events and random walks executed by the particles…

We study the almost sure convergence of the occupation measure of evolution models where mutation rates decrease over time. We show that if the mutation parameter vanishes at a controlled rate, then the empirical occupation measure…

In this paper we establish a diffusion limit for a multivariate continuous time Markov chain whose components are indexed by vertices of a finite graph. The components take values in a common finite set of non-negative integers and evolve…

We study the effect of observing a stationary process at irregular time points via a renewal process. We establish a sharp difference in the asymptotic behaviour of the self-normalized sample mean of the observed process depending on the…

In the field of Markov models for image generation, the main idea is to learn how non-trivial images are gradually destroyed by a trivial forward Markov dynamics over the large time window $[0,t]$ converging towards pure noise for $t \to +…

As a starting point we prove a functional central limit theorem for estimators of the invariant measure of a geometrically ergodic Harris-recurrent Markov chain in a multi-scale space. This allows to construct confidence bands for the…

In this paper, we consider semi-Markov processes whose transition times and transition probabilities depend on a small parameter $\varepsilon$. Understanding the asymptotic behavior of such processes is needed in order to study the…

We examine two analytical characterisation of the metastable behavior of a Markov chain. The first one expressed in terms of its transition probabilities, and the second one in terms of its large deviations rate functional. Consider a…

In recent papers it has been demonstrated that sampling a Gibbs distribution from an appropriate time-irreversible Langevin process is, from several points of view, advantageous when compared to sampling from a time-reversible one. Adding…

We derive asymptotics of moments and identify limiting distributions, under the random permutation model on m-ary search trees, for functionals that satisfy recurrence relations of a simple additive form. Many important functionals…

Let X be a locally finite, connected graph without vertices of degree 1. Non-backtracking random walk moves at each step with equal probability to one of the "forward" neighbours of the actual state, i.e., it does not go back along the…

The asymptotic properties of some Markov processes associated to stochastic chemical reaction networks (CRNs) driven by the kinetics of the law of mass action are analyzed. The scaling regime introduced in the paper assumes that the norm of…

We study a system of two non-interacting quantum wires with fermions of opposite chirality with a point contact junction at the origin across which tunneling can take place when an arbitrary time-dependent bias between the wires is applied.…

The cutoff phenomenon is an abrupt transition from out of equilibrium to equilibrium undergone by certain Markov processes in the limit where the size of the state space tends to infinity: instead of decaying gradually over time, their…

Using ideas borrowed from topological dynamics and ergodic theory we introduce topological and metric versions of the recurrence property for general Markov chains. The main question of interest here is how large is the set of recurrent…

We prove exponential decay of pair correlations for 1D stationary point processes when spacings satisfy a Markov condition, geometric ergodicity, and a condition on exponential moments. The conditions are phrased for stationary sequences of…

For a continuous-time random walk $X=\{X_t,t\ge 0\}$ (in general non-Markov), we study the asymptotic behavior, as $t\rightarrow \infty$, of the normalized additive functional $c_t\int_0^{t} f(X_s)ds$, $t\ge 0$. Similarly to the Markov…

Discrete-time discrete-state finite Markov chains are versatile mathematical models for a wide range of real-life stochastic processes. One of most common tasks in studies of Markov chains is computation of the stationary distribution.…