English
Related papers

Related papers: Sharp Mixing Rates for Markov Chains on General Sp…

200 papers

The first motivation of this paper is to study stationarity and ergodic properties for a general class of time series models defined conditional on an exogenous covariates process. The dynamic of these models is given by an autoregressive…

Statistics Theory · Mathematics 2020-07-16 Paul Doukhan , Michael H. Neumann , Lionel Truquet

We consider irreducible reversible discrete time Markov chains on a finite state space. Mixing times and hitting times are fundamental parameters of the chain. We relate them by showing that the mixing time of the lazy chain is equivalent…

Probability · Mathematics 2013-04-30 Yuval Peres , Perla Sousi

In this note, a general approach to the study of non-stationary Markov chains with catastrophes and the corresponding queuing models is considered, as well as to obtain estimates of the limiting regime itself. As an illustration, an example…

Probability · Mathematics 2021-05-05 Alexander Zeifman

Markov chains are convenient means of generating realizations of networks with a given (joint or otherwise) degree distribution, since they simply require a procedure for rewiring edges. The major challenge is to find the right number of…

Social and Information Networks · Computer Science 2012-11-01 J. Ray , A. Pinar , C. Seshadhri

Large deviation results are given for a class of perturbed nonhomogeneous Markov chains on finite state space which formally includes some stochastic optimization algorithms. Specifically, let {P_n} be a sequence of transition matrices on a…

Probability · Mathematics 2007-05-23 Zach Dietz , Sunder Sethuraman

We show that a new probabilistic technique, recently introduced by the first author, yields the sharpest bounds obtained to date on mixing times of Markov chains in terms of isoperimetric properties of the state space (also known as…

Probability · Mathematics 2007-05-23 Ben Morris , Yuval Peres

We provide conditions that guarantee local rates of convergence in distribution of iterated random functions that are not nonexpansive mappings in locally compact Hadamard spaces. Our results are applied to stochastic instances of common…

Probability · Mathematics 2023-11-01 Neal Hermer , D. Russell Luke , Anja Sturm

In the analysis of Markov chains and processes, it is sometimes convenient to replace an unbounded state space with a "truncated" bounded state space. When such a replacement is made, one often wants to know whether the equilibrium behavior…

Probability · Mathematics 2022-06-24 Alex Infanger , Peter W. Glynn

Markov chains on the non-negative quadrant of dimension $d$ are often used to model the stochastic dynamics of the number of $d$ entities, such as $d$ chemical species in stochastic reaction networks. The infinite state space poses…

Probability · Mathematics 2024-10-17 Wai-Tong Louis Fan , Jinsu Kim , Chaojie Yuan

We prove a Chernoff-type bound for sums of matrix-valued random variables sampled via a regular (aperiodic and irreducible) finite Markov chain. Specially, consider a random walk on a regular Markov chain and a Hermitian matrix-valued…

Machine Learning · Statistics 2020-10-30 Jiezhong Qiu , Chi Wang , Ben Liao , Richard Peng , Jie Tang

We consider the convergence of a continuous-time Markov chain approximation X^h, h>0, to an R^d-valued Levy process X. The state space of X^h is an equidistant lattice and its Q-matrix is chosen to approximate the generator of X. In…

Probability · Mathematics 2014-07-02 Aleksandar Mijatović , Matija Vidmar , Saul Jacka

In this paper we investigate the local limit theorem for additive functionals of a nonstationary Markov chain with finite or infinite second moment. The moment conditions are imposed on the individual summands and the weak dependence…

Probability · Mathematics 2020-06-25 Florence Merlevède , Magda Peligrad , Costel Peligrad

We develop Markov chain mixing time estimates for a class of Markov chains with restricted transitions. We assume transitions may occur along a cycle of $n$ nodes and on $n^\gamma$ additional edges, where $\gamma < 1$. We find that the…

Probability · Mathematics 2015-06-26 Balázs Gerencsér

We study one-dimensional lattice systems with pair-wise interactions of infinite range. We show projective convergence of Markov measures to the unique equilibrium state. For this purpose we impose a slightly stronger condition than…

Mathematical Physics · Physics 2016-11-26 Cesar Maldonado , Raul Salgado-Garcia

In this paper, we give quantitative bounds on the $f$-total variation distance from convergence of an Harris recurrent Markov chain on an arbitrary under drift and minorisation conditions implying ergodicity at a sub-geometric rate. These…

Probability · Mathematics 2007-05-23 Randal Douc , Eric Moulines , Philippe Soulier

We consider irreversible Markov chains on finite commutative rings randomly generated using both addition and multiplication. We restrict ourselves to the case where the addition is uniformly random and multiplication is arbitrary. We first…

Representation Theory · Mathematics 2020-06-11 Arvind Ayyer , Pooja Singla

Density dependent families of Markov chains, such as the stochastic models of mass-action chemical kinetics, converge for large values of the indexing parameter $N$ to deterministic systems of differential equations (Kurtz, 1970). Moreover…

Probability · Mathematics 2017-07-11 Enrico Bibbona , Roberta Sirovich

Nonlinear time series models with exogenous regressors are essential in econometrics, queuing theory, and machine learning, though their statistical analysis remains incomplete. Key results, such as the law of large numbers and the…

Statistics Theory · Mathematics 2025-10-24 Attila Lovas

We determine the convergence speed of a numerical scheme for approximating one-dimensional continuous strong Markov processes. The scheme is based on the construction of coin tossing Markov chains whose laws can be embedded into the process…

Probability · Mathematics 2020-08-26 Stefan Ankirchner , Thomas Kruse , Mikhail Urusov

We study the stochastic 3D primitive equations of the atmospheric mechanics. We consider them under a bounded and non-degenerate noise, which is statistically periodic in time with period $1$. In such a case we prove that the associated…

Analysis of PDEs · Mathematics 2021-03-03 Pierre-Marie Boulvard