English
Related papers

Related papers: Full $\Gamma$-expansion of reversible Markov chain…

200 papers

An autoregressive process with Markov regime is an autoregressive process for which the regression function at each time point is given by a nonobservable Markov chain. In this paper we consider the asymptotic properties of the maximum…

Statistics Theory · Mathematics 2007-06-13 Randal Douc , Eric Moulines , Tobias Ryden

Let X be a locally finite, connected graph without vertices of degree 1. Non-backtracking random walk moves at each step with equal probability to one of the "forward" neighbours of the actual state, i.e., it does not go back along the…

Probability · Mathematics 2012-12-05 Ronald Ortner , Wolfgang Woess

We consider continuous-time Markov chains on integers which allow transitions to adjacent states only, with alternating rates. We give explicit formulas for probability generating functions, and also for means, variances and state…

Probability · Mathematics 2019-10-30 Luisa Beghin , Claudio Macci , Barbara Martinucci

The theory of $L^2$-spectral gaps for reversible Markov chains has been studied by many authors. In this paper we consider positive recurrent general state space Markov chains with stationary transition probabilities. Replacing the…

Probability · Mathematics 2009-08-07 Achim Wuebker , Zakhar Kabluchko

One-dimensional run-and-tumble processes may converge towards some localized non-equilibrium steady state when the two velocities and/or the two switching rates are space-dependent. A long dynamical trajectory can be then analyzed via the…

Statistical Mechanics · Physics 2021-08-23 Cecile Monthus

We study the asymptotic behavior of a Markov chain on $\mathbb{Z}^2$ that corresponds to the two-dimensional marginals of a reinforcement process on $\mathbb{Z}^{\mathbb{N}}$. Three distinct asymptotic regimes are identified, depending on…

Probability · Mathematics 2007-05-23 Jean Bérard

A sequence of real numbers (x_n) is Benford if the significands, i.e. the fraction parts in the floating-point representation of (x_n) are distributed logarithmically. Similarly, a discrete-time irreducible and aperiodic finite-state Markov…

Probability · Mathematics 2010-03-05 Bahar Kaynar , Arno Berger , Theodore P. Hill , Ad Ridder

We prove a Chernoff-type bound for sums of matrix-valued random variables sampled via a regular (aperiodic and irreducible) finite Markov chain. Specially, consider a random walk on a regular Markov chain and a Hermitian matrix-valued…

Machine Learning · Statistics 2020-10-30 Jiezhong Qiu , Chi Wang , Ben Liao , Richard Peng , Jie Tang

For ${1/2}<\alpha<1$, we propose the MDP analysis for family $$ S^\alpha_n=\frac{1}{n^\alpha}\sum_{i=1}^nH(X_{i-1}), n\ge 1, $$ where $(X_n)_{n\ge 0}$ be a homogeneous ergodic Markov chain, $X_n\in \mathbb{R}^d$, when the spectrum of…

Probability · Mathematics 2007-05-23 B. Delyon , A. Juditsky , R. Liptser

We study the large deviations of Markov chains under the sole assumption that the state space is discrete. In particular, we do not require any of the usual irreducibility and exponential tightness assumptions. Using subadditive arguments,…

Probability · Mathematics 2026-05-15 Léo Daures

We consider continuous-time Markov chains which display a family of wells at the same depth. We provide sufficient conditions which entail the convergence of the finite-dimensional distributions of the order parameter to the ones of a…

Probability · Mathematics 2019-10-03 Claudio Landim , Michail Loulakis , Mustapha Mourragui

We consider a simple discrete-time Markov chain with values in $[0,\infty)^{Z^d}$. The Markov chain describes various interesting examples such as oriented percolation, directed polymers in random environment, time discretizations of binary…

Probability · Mathematics 2009-06-26 Nobuo Yoshida

The inference of Markov models from data on stochastic dynamical trajectories over the large time-window $T$ is revisited via the Large Deviations at Level 2.5 for the time-empirical density and the time-empirical flows. The goal is to…

Statistical Mechanics · Physics 2021-07-01 Cecile Monthus

Let $(X,d)$ be a geodesic Gromov-hyperbolic space, $o \in X$ a basepoint and $\mu$ a countably supported non-elementary probability measure on $\operatorname{Isom}(X)$. Denote by $z_n$ the random walk on $X$ driven by the probability…

Probability · Mathematics 2022-03-15 Richard Aoun , Pierre Mathieu , Cagri Sert

In this paper, we consider a general class of two-time-scale Markov chains whose transition rate matrix depends on a parameter $\lambda>0$. We assume that some transition rates of the Markov chain will tend to infinity as…

Probability · Mathematics 2015-07-10 Chen Jia

We consider the problem of estimating the asymptotic variance of a function defined on a Markov chain, an important step for statistical inference of the stationary mean. We design a novel recursive estimator that requires $O(1)$…

Statistics Theory · Mathematics 2024-09-24 Shubhada Agrawal , Prashanth L. A. , Siva Theja Maguluri

Let $(\Omega,\mathcal{F}, \mathbb{P})$ be a probability space and $E$ be a finite set. Assume that $X=(X_n)$ is an irreducible and aperiodic Markov chain, defined on $(\Omega,\mathcal{F}, \mathbb{P})$, with values in $E$ and with transition…

Probability · Mathematics 2017-12-05 Yinna Ye

This article provides the first procedure for computing a fully data-dependent interval that traps the mixing time $t_{\text{mix}}$ of a finite reversible ergodic Markov chain at a prescribed confidence level. The interval is computed from…

Machine Learning · Computer Science 2015-11-04 Daniel Hsu , Aryeh Kontorovich , Csaba Szepesvári

A theory of systems with long-range correlations based on the consideration of binary N-step Markov chains is developed. In our model, the conditional probability that the i-th symbol in the chain equals zero (or unity) is a linear function…

Data Analysis, Statistics and Probability · Physics 2007-05-23 O. V. Usatenko , V. A. Yampol'skii

In this paper we extend the results of the research started by the first author, in which Karlin-McGregor diagonalization of certain reversible Markov chains over countably infinite general state spaces by orthogonal polynomials was used to…

Classical Analysis and ODEs · Mathematics 2012-02-15 Yevgeniy Kovchegov , Nicholas Michalowski
‹ Prev 1 4 5 6 7 8 10 Next ›