English
Related papers

Related papers: Renewal Theory for Transient Markov Chains with As…

200 papers

We consider triangular arrays of Markov chains that converge weakly to a diffusion process. Local limit theorems for transition densities are proved. The observation time [0,T] may be fixed or lim n T = 0, where nh = T and h is a mesh…

Probability · Mathematics 2007-06-13 Valentin Konakov

We consider two reflecting diffusion processes $(X_t)_{t \ge 0}$ with a moving reflection boundary given by a non-decreasing pure jump Markov process $(R_t)_{t \ge 0}$. Between the jumps of the reflection boundary the diffusion part behaves…

Probability · Mathematics 2012-02-07 Andrej Depperschmidt , Sophia Götz

We consider the recurrence and transience problem for a time-homogeneous Markov chain on the real line with transition kernel $p(x,\mathrm{d}y)=f_x(y-x)\,\mathrm{d}y$, where the density functions $f_x(y)$, for large $|y|$, have a power-law…

Probability · Mathematics 2013-12-19 Nikola Sandrić

We investigate the convergence to (quasi--)equilibrium of a density dependent Markov chain in~${\mathbb Z}^d$, whose drift satisfies a system of ordinary differential equations having an attractive fixed point. For a sequence of such…

Probability · Mathematics 2025-08-21 Andrew Barbour , Graham Brightwell , Malwina Luczak

If the step distribution in a renewal process has finite mean and regularly varying tail with index -{\alpha}, 1<{\alpha}<2, the first two terms in the asymptotic expansion of the renewal function have been known for many years. Here we…

Probability · Mathematics 2019-09-26 Ron Doney

We develop a theory of operator renewal sequences in the context of infinite ergodic theory. For large classes of dynamical systems preserving an infinite measure, we determine the asymptotic behaviour of iterates $L^n$ of the transfer…

Dynamical Systems · Mathematics 2015-05-19 Ian Melbourne , Dalia Terhesiu

We consider a sequence of Markov chains $(\mathcal X^n)_{n=1,2,...}$ with $\mathcal X^n = (X^n_\sigma)_{\sigma\in\mathcal T}$, indexed by the full binary tree $\mathcal T = \mathcal T_0 \cup \mathcal T_1 \cup ...$, where $\mathcal T_k$ is…

Probability · Mathematics 2014-06-17 Peter Czuppon , Peter Pfaffelhuber

We consider a Markov chain $\{X_n\}_{n=0}^\8$ on $\R^d$ defined by the stochastic recursion $X_{n}=M_n X_{n-1}+Q_n$, where $(Q_n,M_n)$ are i.i.d. random variables taking values in the affine group $H=\R^d\rtimes {\rm GL}(\R^d)$. Assume that…

Probability · Mathematics 2008-11-10 Dariusz Buraczewski , Ewa Damek , Yves Guivarc'h

We consider the first exit time of a nonnegative Harris-recurrent Markov process from the interval $[0,A]$ as $A\to\infty$. We provide an alternative method of proof of asymptotic exponentiality of the first exit time (suitably…

Probability · Mathematics 2010-06-07 Moshe Pollak , Alexander G. Tartakovsky

We study a Markov chain on $\mathbb{R}_+ \times S$, where $\mathbb{R}_+$ is the non-negative real numbers and $S$ is a finite set, in which when the $\mathbb{R}_+$-coordinate is large, the $S$-coordinate of the process is approximately…

Probability · Mathematics 2017-04-14 Chak Hei Lo , Andrew R. Wade

Let $(X_n)_{n\ge 1}$ be a Markov chain on a measurable state space $X$, and let $S_n = \sum_{k=1}^n f(X_k)$ be the associated Markov walk. For $y>0$, denote by $\tau_y$ the first time at which $y+S_n$ becomes non-positive. Assuming that the…

Probability · Mathematics 2025-12-19 Yunfan Zhao , Xiaojing Chen

Let $F\{dx\}$ be a relatively stable probability distribution on the whole real line and $S_n$ the random walk started at the origin with step distribution $F$. We obtain an exact asymptotic form of the Green measure $U\{x+dy\}=…

Probability · Mathematics 2020-07-29 Kohei Uchiyama

We give computable bounds on the rate of convergence of the transition probabilities to the stationary distribution for a certain class of geometrically ergodic Markov chains. Our results are different from earlier estimates of Meyn and…

Probability · Mathematics 2007-05-23 Peter H. Baxendale

In this paper we study the long term evolution of a continuous time Markov chain formed by two interacting birth-and-death processes. The interaction between the processes is modelled by transition rates which are functions with suitable…

Probability · Mathematics 2017-03-23 Mikhail Menshikov , Vadim Shcherbakov

Based on discrete observations $X_0,X_{\Delta},\dots, X_{n\Delta}$ for $\Delta=n^{-\gamma}$ with $\gamma\in [0,1)$ of the null-recurrent dynamic $dX_t = \sigma(X_t)dW_t$ with a Brownian motion $W$ and $\sigma(x)=\alpha\mathbb{1}\{x<\rho\} +…

Statistics Theory · Mathematics 2026-04-29 Johannes Brutsche , Sebastian Hahn , Angelika Rohde

Let $\Phi_n$ be an i.i.d. sequence of Lipschitz mappings of $\R^d$. We study the Markov chain $\{X_n^x\}_{n=0}^\infty$ on $\R^d$ defined by the recursion $X_n^x = \Phi_n(X^x_{n-1})$, $n\in\N$, $X_0^x=x\in\R^d$. We assume that…

Probability · Mathematics 2011-10-20 Dariusz Buraczewski , Ewa Damek , Mariusz Mirek

We study the large-time asymptotic of renewal-reward processes with a heavy-tailed waiting time distribution. It is known that the heavy tail of the distribution produces an extremely slow dynamics, resulting in a singular large deviation…

Mathematical Physics · Physics 2022-01-05 Hiroshi Horii , Raphael Lefevere , Takahiro Nemoto

The paper presents a generalization of the local limit theorem on the convergence of inhomogeneous Markov chains to the diffusion limit for the case where the corresponding process coefficients satisfy weak regularity conditions and…

Probability · Mathematics 2025-06-02 I. Bitter , V. Konakov

We study the long-time asymptotics of prototypical non-linear diffusion equations. Specifically, we consider the case of a non-degenerate diffusivity function that is a (non-negative) polynomial of the dependent variable of the problem. We…

Analysis of PDEs · Mathematics 2020-08-13 Ivan C. Christov , Akif Ibraguimov , Rahnuma Islam

We analyze the convergence rates for a family of auto-regressive Markov chains $(X^{(n)}_k)_{k\geq 0}$ on $\mathbb R^d$, where at each step a randomly chosen coordinate is replaced by a noisy damped weighted average of the others. The…

Probability · Mathematics 2023-01-10 Balázs Gerencsér , Andrea Ottolini