English
Related papers

Related papers: Decoupling for Markov Chains

200 papers

The transition matrix of a Markov chain $(X_k,k\geq 0)$ on a finite or infinite rooted tree is said to be almost upper-directed if, given $X_k$, the node $X_{k+1}$ is either a descendant of $X_k$ or the parent of $X_k$. It is said to be…

Probability · Mathematics 2024-11-12 Luis Fredes , Jean-François Marckert

We consider a Markov chain X_1, X_2, ..., X_n belonging to a class of iterated random functions, which is "one-step contracting" with respect to some distance d. If f is any separately Lipschitz function with respect to d, we use a well…

Probability · Mathematics 2014-02-18 Jérôme Dedecker , Xiequan Fan

We consider the computational task of sampling a bit string $x$ from a distribution $\pi(x)=|\langle x|\psi\rangle|^2$, where $\psi$ is the unique ground state of a local Hamiltonian $H$. Our main result describes a direct link between the…

Quantum Physics · Physics 2023-11-09 Sergey Bravyi , Giuseppe Carleo , David Gosset , Yinchen Liu

We study the following model of hidden Markov chain: $Y_i=X_i+\epsilon_i$, $ i=1,...,n+1$ with $(X_i)$ a real-valued positive recurrent and stationary Markov chain and $(\epsilon_i)_{1\leq i\leq n+1}$ a noise independent of the sequence…

Statistics Theory · Mathematics 2008-03-27 Claire Lacour

Let $X_{t}$ and $Y_{t}$ be two Markov chains, on state spaces $\Omega \subset \hat{\Omega}$. In this paper, we discuss how to prove bounds on the spectrum of $X_{t}$ based on bounds on the spectrum of $Y_{t}$. This generalizes work of…

Probability · Mathematics 2013-02-11 Aaron Smith

Suppose $(f,\mathcal{X},\mu)$ is a measure preserving dynamical system and $\phi \colon \mathcal{X} \to \mathbb{R}$ a measurable function. Consider the maximum process $M_n:=\max\{X_1 \ldots,X_n\}$, where $X_i=\phi\circ f^{i-1}$ is a time…

Dynamical Systems · Mathematics 2021-09-15 Mark Holland , Maxim Kirsebom , Philipp Kunde , Tomas Persson

We consider a time-homogeneous Markov chain $X_n$, $n\ge0$, valued in ${\bf R}$. Suppose that this chain is transient, that is, $X_n$ generates a $\sigma$-finite renewal measure. We prove the key renewal theorem under condition that this…

Probability · Mathematics 2007-11-15 Dmitry Korshunov

For general spin systems, we prove that a contractive coupling for any local Markov chain implies optimal bounds on the mixing time and the modified log-Sobolev constant for a large class of Markov chains including the Glauber dynamics,…

Let $\sigma(u)$, $u\in \mathbb{R}$ be an ergodic stationary Markov chain, taking a finite number of values $a_1,...,a_m$, and $b(u)=g(\sigma(u))$, where $g$ is a bounded and measurable function. We consider the diffusion type process $$…

Probability · Mathematics 2011-08-24 P. Chigansky , R. Liptser

We prove an ergodic theorem for Markov chains indexed by the Ulam-Harris-Neveu tree over large subsets with arbitrary shape under two assumptions: with high probability, two vertices in the large subset are far from each other and have…

Probability · Mathematics 2026-03-11 Julien Weibel

The spectral gap $\gamma$ of a finite, ergodic, and reversible Markov chain is an important parameter measuring the asymptotic rate of convergence. In applications, the transition matrix $P$ may be unknown, yet one sample of the chain up to…

Statistics Theory · Mathematics 2017-08-25 Daniel Hsu , Aryeh Kontorovich , David A. Levin , Yuval Peres , Csaba Szepesvári

Let $X$ be a continuous-time strongly mixing or weakly dependent process and $T$ a renewal process independent of $X$ with inter-arrival times $\tau$. We show general conditions under which the sampled process $(X_{T_i},T_i-T_{i-1})^{\top}$…

Statistics Theory · Mathematics 2022-02-02 Dirk-Philip Brandes , Imma Valentina Curato , Robert Stelzer

In this paper we establish a decoupling feature of the random interlacement process I^u in Z^d, at level u, for d \geq 3. Roughly speaking, we show that observations of I^u restricted to two disjoint subsets A_1 and A_2 of Z^d are…

Probability · Mathematics 2015-09-29 Serguei Popov , Augusto Teixeira

Let $\Phi_n$ be an i.i.d. sequence of Lipschitz mappings of $\R^d$. We study the Markov chain $\{X_n^x\}_{n=0}^\infty$ on $\R^d$ defined by the recursion $X_n^x = \Phi_n(X^x_{n-1})$, $n\in\N$, $X_0^x=x\in\R^d$. We assume that…

Probability · Mathematics 2011-10-20 Dariusz Buraczewski , Ewa Damek , Mariusz Mirek

The notion of a successful coupling of Markov processes, based on the idea that both components of the coupled system ``intersect'' in finite time with probability one, is extended to cover situations when the coupling is unnecessarily…

Probability · Mathematics 2007-05-23 Michael Blank , Sergey Pirogov

Markov chains are a natural and well understood tool for describing one-dimensional patterns in time or space. We show how to infer $k$-th order Markov chains, for arbitrary $k$, from finite data by applying Bayesian methods to both…

Statistics Theory · Mathematics 2009-11-13 Christopher C. Strelioff , James P. Crutchfield , Alfred W. Hubler

We introduce the concept of asymptotic period for an irreducible and aperiodic, discrete-time Markov chain X on a countable state space, and develop the theory leading to its formal definition. The asymptotic period of X equals one - its…

Probability · Mathematics 2019-03-05 Erik A. van Doorn

We consider a Markov chain $(x_n)$ whose kernel is indexed by a scaling parameter $\gamma>0$, refered to as the step size. The aim is to analyze the behavior of the Markov chain in the doubly asymptotic regime where $n\to\infty$ then…

Probability · Mathematics 2017-12-18 Pascal Bianchi , Walid Hachem , Adil Salim

We introduce a reversible Markovian coagulation-fragmentation process on the set of partitions of $\{1,\ldots,L\}$ into disjoint intervals. Each interval can either split or merge with one of its two neighbors. The invariant measure can be…

Probability · Mathematics 2013-11-27 Cedric Bernardin , Fabio Lucio Toninelli

For a reversible and ergodic Markov chain $\{X_n,n\geq0\}$ with invariant distribution $\pi$, we show that a valid confidence interval for $\pi(h)$ can be constructed whenever the asymptotic variance $\sigma^2_P(h)$ is finite and positive.…

Statistics Theory · Mathematics 2016-08-14 Yves F. Atchadé