English
Related papers

Related papers: Limit theorems for additive functionals of a Marko…

200 papers

We consider Markov jump processes on a graph described by a rate matrix that depends on various control parameters. We derive explicit expressions for the static responses of edge currents and steady-state probabilities. We show that they…

Statistical Mechanics · Physics 2024-08-28 Timur Aslyamov , Massimiliano Esposito

We prove the first Chernoff-Hoeffding bounds for general nonreversible finite-state Markov chains based on the standard L_1 (variation distance) mixing-time of the chain. Specifically, consider an ergodic Markov chain M and a weight…

Probability · Mathematics 2012-01-31 Kai-Min Chung , Henry Lam , Zhenming Liu , Michael Mitzenmacher

We obtain complementary recurrence and transience criteria for processes $X=(X_n)_{n \ge 0}$ with values in $\mathbb R^d_+$ fulfilling a non-linear equation $X_{n+1}=MX_n+g(X_n)+ \xi_{n+1}$. Here $M$ denotes a primitive matrix having…

Probability · Mathematics 2016-05-16 Götz Kersting

We prove an invariance principle for non-stationary random processes and establish a rate of convergence under a new type of mixing condition. The dependence is exponentially decaying in the gap between the past and the future and is…

Probability · Mathematics 2024-12-23 Ion Grama , Émile Le Page , Marc Peigné

Consideration is given to the three different analytical methods for the computation of upper bounds for the rate of convergence to the limiting regime of one specific class of (in)homogeneous continuous-time Markov chains. This class is…

We consider a Markov chain $(M_{n})_{n\ge 0}$ on the set $\mathbb{N}_{0}$ of nonnegative integers which is eventually decreasing, i.e. $\mathbb{P}\{M_{n+1}<M_{n}|M_{n}\ge a\}=1$ for some $a\in\mathbb{N}$ and all $n\ge 0$. We are interested…

Probability · Mathematics 2015-09-08 Gerold Alsmeyer , Alexander Marynych

We determine the convergence speed of a numerical scheme for approximating one-dimensional continuous strong Markov processes. The scheme is based on the construction of coin tossing Markov chains whose laws can be embedded into the process…

Probability · Mathematics 2020-08-26 Stefan Ankirchner , Thomas Kruse , Mikhail Urusov

Let \xi_t, t\in[0,T], be a strong Markov process with values in a complete separable metric space (X,\rho) and with transition probability function P_{s,t}(x,dy), 0\le s\le t\le T, x\in X. For any h\in[0,T] and a>0, consider the function…

Probability · Mathematics 2016-09-07 Martynas Manstavicius

Let $(X_n)_{n \in\mathbb{N}}$ be a $V$-geometrically ergodic Markov chain on a measurable space $\mathbb{X}$ with invariant probability distribution $\pi$. In this paper, we propose a discretization scheme providing a computable sequence…

Probability · Mathematics 2019-10-09 Loic Hervé , James Ledoux

We establish general theorems quantifying the notion of recurrence --- through an estimation of the moments of passage times --- for irreducible continuous-time Markov chains on countably infinite state spaces. Sharp conditions of…

Probability · Mathematics 2014-07-15 Mikhail Menshikov , Dimitri Petritis

Let $Z = (Z_t)_{t\in[0,\infty)}$ be an ergodic Markov process and, for every $n\in\mathbb{N}$, let $Z^n = (Z_{n^2 t})_{t\in[0,\infty)}$ drive a process $X^n$. Classical results show under suitable conditions that the sequence of…

Probability · Mathematics 2018-03-06 Martin Hutzenthaler , Peter Pfaffelhuber , Clemens Printz

We prove Local Central Limit Theorems (LLT) for partial sums of the form $S_n=\sum_{j=0}^{n-1}f_j(...,X_{j-1},X_j,X_{j+1},...)$, where $(X_j)$ is a Markov chains with equicontinuous conditional probabilities satisfying contraction…

Probability · Mathematics 2025-12-05 Yeor Hafouta

We prove a Chernoff-type bound for sums of matrix-valued random variables sampled via a regular (aperiodic and irreducible) finite Markov chain. Specially, consider a random walk on a regular Markov chain and a Hermitian matrix-valued…

Machine Learning · Statistics 2020-10-30 Jiezhong Qiu , Chi Wang , Ben Liao , Richard Peng , Jie Tang

In this short paper, we connect the procedure of constructing a totally inaccessible stopping time for a given process using the well-known Cox construction, dependent on an independent exponential random variable; with naturally occurring…

Probability · Mathematics 2023-10-12 Philip Protter , Andrés Riveros Valdevenito

We study a real-valued L\'evy-type process $X$, which is locally $\alpha$-stable in the sense that its jump kernel is a combination of a `principal' (state dependent) $\alpha$-stable part with a `residual' lower order part. We show that…

Probability · Mathematics 2019-07-09 Alexei Kulik

Consider a sequence of Markov processes $X^1, X^2,...$ with state space $E$, where $X^N$ has a strong drift to $D \subseteq E$, such that $\Phi(X^N)$ is slow for some appropriate $\Phi: E\to D$. Using the method of martingale problems, we…

Probability · Mathematics 2026-02-19 Samuel Ayomide Adeosun , Peter Pfaffelhuber

In this paper, we establish novel concentration inequalities for additive functionals of geometrically ergodic Markov chains similar to Rosenthal inequalities for sums of independent random variables. We pay special attention to the…

Probability · Mathematics 2025-09-26 Alain Durmus , Eric Moulines , Alexey Naumov , Sergey Samsonov , Marina Sheshukova

For $N\in\mathbb{N}$, let $\pi_N$ be the law of the number of fixed points of a random permutation of $\{1, 2, ..., N\}$. Let $\mathcal{P}$ be a Poisson law of parameter 1.A classical result shows that $\pi_N$ converges to $\mathcal{P}$ for…

Probability · Mathematics 2023-05-05 Persi Diaconis , Laurent Miclo

We present a probabilistic construction of $\mathbb{R}^d$-valued non-linear affine processes with jumps. Given a set $\Theta$ of affine parameters, we define a family of sublinear expectations on the Skorokhod space under which the…

Probability · Mathematics 2022-07-19 Francesca Biagini , Georg Bollweg , Katharina Oberpriller

We show that the convergence of finite state space Markov chains to stationarity can often be considerably speeded up by alternating every step of the chain with a deterministic move. Under fairly general conditions, we show that not only…

Probability · Mathematics 2020-08-27 Sourav Chatterjee , Persi Diaconis