Related papers: The Key Renewal Theorem for a Transient Markov Cha…

This paper is a survey of various proofs of the so called {\em fundamental theorem of Markov chains}: every ergodic Markov chain has a unique positive stationary distribution and the chain attains this distribution in the limit independent…

Non-linear renewal theory is extended to include random walks perturbed by both a slowly changing sequence and a stationary one. Main results include a version of the Key Renewal Theorem, a derivation of the limiting distribution of the…

Starting from a given Markov kernel on a finite set $V$ and a bijection $g$ of $V$, we construct and study a time inhomogeneous Markov chain whose kernel at time $n$ is obtained from $K$ by transport of $g^{n-1}$. We show that this…

We study positive recurrence and transience of a two-station network in which the behavior of the server in each station is governed by a Markov chain with a finite number of server states; this service process can represent various service…

Renewal theorems are developed for point processes with interarrival times $W_n=\xi(X_{n+1}X_n\cdots)$, where $(X_n)_{n\in\mathbb Z}$ is a stochastic process with finite state space $\Sigma$ and $\xi\colon\Sigma_A\to\mathbb R$ is a H\"older…

Let $G$ be a real connected algebraic semi-simple Lie group, and $H$ an algebraic subgroup of $G$. Let $\mu$ be a probability measure on $G$, with finite exponential moment, whose support spans a Zariski-dense subsemigroup of $G$. Let…

We present two data-driven procedures to estimate the transition density of an homogeneous Markov chain. The first yields to a piecewise constant estimator on a suitable random partition. By using an Hellinger-type loss, we establish…

Let X and Y be time-homogeneous Markov processes with common state space E, and assume that the transition kernels of X and Y admit densities with respect to suitable reference measures. We show that if there is a time t>0 such that, for…

We obtain results on mixing for a large class of (not necessarily Markov) infinite measure semiflows and flows. Erickson proved, amongst other things, a strong renewal theorem in the corresponding i.i.d. setting. Using operator renewal…

In this work, we consider an inhomogeneous (discrete time) Markov chain and are interested in its long time behavior. We provide sufficient conditions to ensure that some of its asymptotic properties can be related to the ones of a…

In this paper we develop a statistical estimation technique to recover the transition kernel $P$ of a Markov chain $X=(X_m)_{m \in \mathbb N}$ in presence of censored data. We consider the situation where only a sub-sequence of $X$ is…

We consider a time inhomogeneous jump Markov process $X = (X_t)_t$ with state dependent jump intensity, taking values in $R^d . $ Its infinitesimal generator is given by \begin{multline*} L_t f (x) = \sum_{i=1}^d \frac{\partial f}{\partial…

The paper studies an improved estimate for the rate of convergence for nonlinear homogeneous discrete-time Markov chains. These processes are nonlinear in terms of the distribution law. Hence, the transition kernels are dependent on the…

We introduce a simple approach for testing the reliability of homogeneous generators and the Markov property of the stochastic processes underlying empirical time series of credit ratings. We analyze open access data provided by Moody's and…

Consider a Markov chain on an infinite tree T=(V,E) rooted at \rho. In such a chain, once the initial root state \sigma(\rho) is chosen, each vertex iteratively chooses its state from the one of its parent by an application of a Markov…

We study one-sided and $\alpha$-correct sequential hypothesis testing for data generated by an ergodic Markov chain. The null hypothesis is that the unknown transition matrix belongs to a prescribed set $P$ of stochastic matrices, and the…

We introduce and study time-inhomogeneous quantum Markov chains with parameter $\zeta \ge 0$ and decoherence parameter $0 \leq p \leq 1$ on finite spaces and their large scale equilibrium properties. Here $\zeta$ resembles the inverse…

We consider a Markov chain on $R^+$ with asymptotically zero drift and finite second moments of jumps which is positive recurrent. A power-like asymptotic behaviour of the invariant tail distribution is proven; such a heavy-tailed invariant…

Convergence properties of time inhomogeneous Markov chain based discrete and continuous time linear consensus algorithms are analyzed. Provided that a so-called infinite jet flow property is satisfied by the underlying chains, necessary…

Consider a Markov chain $(X_i)_{i\ge0}$ with invariant measure $\mu$ that admits the representation $X_{i+1}=\Phi(X_i,U_i)$, where $(U_i)_{i\ge0}$ are i.i.d. random variables and $\Phi$ is a measurable map. We introduce a tangent-decoupled…