Related papers: Renewal Theory for Transient Markov Chains with As…
In this paper, we consider a general class of two-time-scale Markov chains whose transition rate matrix depends on a parameter $\lambda>0$. We assume that some transition rates of the Markov chain will tend to infinity as…
In the paper, a regenerative process $\{X_n:n\in\mathbb{N}\}$ with finite mean cycle length is considered. For~$M_n^{(q)}$ denoting the $q$-th largest value in $\{X_k : 1\leqslant k \leqslant n\}$, we prove that \begin{equation*}…
We study discrete-time stochastic processes $(X_t)$ on $[0,\infty)$ with asymptotically zero mean drifts. Specifically, we consider the critical (Lamperti-type) situation in which the mean drift at $x$ is about $c/x$. Our focus is the…
We prove a Chernoff-type bound for sums of matrix-valued random variables sampled via a regular (aperiodic and irreducible) finite Markov chain. Specially, consider a random walk on a regular Markov chain and a Hermitian matrix-valued…
Conditions on the generator of a Markov process to control the fluctuations of its bridges are found. In particular, continuous time random walks on graphs and gradient diffusions are considered. Under these conditions, a concentration of…
Let $X$ be a Harris recurrent strong Markov process in continuous time with general Polish state space $E,$ having invariant measure $\mu .$ In this paper we use the regeneration method to derive non asymptotic deviation bounds for $$P_{x}…
This text is written based on the author's publications during the period from 1991 to 2001. The work is devoted to the theory of Markov intertwining operators and joinings of measure-preserving group actions, as well as to their…
The extremes of a univariate Markov chain with regulary varying stationary marginal distribution and asymptotically linear behavior are known to exhibit a multiplicative random walk structure called the tail chain. In this paper, we extend…
Non-linear renewal theory is extended to include random walks perturbed by both a slowly changing sequence and a stationary one. Main results include a version of the Key Renewal Theorem, a derivation of the limiting distribution of the…
We prove that for a random walk on the real line whose increments have zero mean and are either integer-valued or spread out (i.e. the distributions of the steps of the walk are eventually non-singular), the Markov chain of overshoots above…
In this article, we investigate the condensation phenomena for a class of nonreversible zero-range processes on a fixed finite set. By establishing a novel inequality bounding the capacity between two sets, and by developing a robust…
We investigate the transience/recurrence of a non-Markovian, one-dimensional diffusion process which consists of a Brownian motion with a non-anticipating drift that has two phases---a transient to $+\infty$ mode which is activated when the…
We offer several perspectives on the behavior at infinity of solutions of discrete Schroedinger equations. First we study pairs of discrete Schroedinger equations whose potential functions differ by a quantity that can be considered small…
The tail chain of a Markov chain can be used to model the dependence between extreme observations. For a positive recurrent Markov chain, the tail chain aids in describing the limit of a sequence of point processes $\{N_n,n\geq1\}$,…
The jump behavior of an infinitely active It\^o semimartingale can be conveniently characterized by a jump activity index of Blumenthal-Getoor type, typically assumed to be constant in time. We study Markovian semimartingales with a…
Suppose $ E$ is a space with a null-recurrent Markov kernel $ P$. Furthermore, suppose there are infinite particles with variable weights on $ E$ performing a random walk following $ P$. Let $ X_{t}$ be a weighted functional of the position…
Understanding the stability and long-time behavior of generative models is a fundamental problem in modern machine learning. This paper provides quantitative bounds on the sampling error of score-based generative models by leveraging…
Consider a finite irreducible Markov chain with invariant distribution $\pi$. We use the inner product induced by $\pi$ and the associated heat operator to simplify and generalize some results related to graph partitioning and the small-set…
We study the asymptotic behavior of ruin probabilities, as the initial reserve goes to infinity, for a reserve process model where claims arrive according to a renewal process, while between the claim times the process has the dynamics of…
We investigate the mixing properties of a finite Markov chain in random environment defined as a mixture of a deterministic chain and a chain whose state space has been permuted uniformly at random. This work is the counterpart of a…