English
Related papers

Related papers: Bounds on Lifting Continuous Markov Chains to Spee…

200 papers

In this paper, we are interested in investigating the perturbation bounds for the stationary distributions for discrete-time or continuous-time Markov chains on a countable state space. For discrete-time Markov chains, two new norm-wise…

Probability · Mathematics 2012-08-27 Yuanyuan Liu

The switch chain is a well-studied Markov chain which can be used to sample approximately uniformly from the set $\Omega(\boldsymbol{d})$ of all graphs with a given degree sequence $\boldsymbol{d}$. Polynomial mixing time (rapid mixing) has…

Combinatorics · Mathematics 2020-12-01 Pu Gao , Catherine Greenhill

It is known that state-dependent, multi-step Lyapunov bounds lead to greatly simplified verification theorems for stability for large classes of Markov chain models. This is one component of the "fluid model" approach to stability of…

Optimization and Control · Mathematics 2012-05-18 Serdar Yüksel , Sean P. Meyn

In this paper we consider the field of local times of a discrete-time Markov chain on a general state space, and obtain uniform (in time) upper bounds on the total variation distance between this field and the one of a sequence of $n$…

Probability · Mathematics 2019-03-25 Diego F. de Bernardini , Christophe Gallesco , Serguei Popov

We provide an optimally mixing Markov chain for 6-colorings of the square lattice on rectangular regions with free, fixed, or toroidal boundary conditions. This implies that the uniform distribution on the set of such colorings has strong…

Statistical Mechanics · Physics 2015-06-25 Dimitris Achlioptas , Michael Molloy , Cristopher Moore , Frank Van Bussell

We discuss a Monte Carlo Markov Chain (MCMC) procedure for the random sampling of some one-dimensional lattice paths with constraints, for various constraints. We show that an approach inspired by optimal transport allows us to bound…

Probability · Mathematics 2010-07-28 Lucas Gerin

The Metropolis-Hastings method is often used to construct a Markov chain with a given $\pi$ as its stationary distribution. The method works even if $\pi$ is known only up to an intractable constant of proportionality. Polynomial time…

Statistics Theory · Mathematics 2019-09-27 David Pollard , Dana Yang

Motivated by various applications, we describe the scaling limits of bivariate Markov chains $(X,J)$ on $\mathbb Z_+ \times \{1,\ldots,\kappa\}$ where $X$ can be viewed as a position marginal and $\{1,\ldots,\kappa\}$ is a set of $\kappa$…

Probability · Mathematics 2016-12-20 Bénédicte Haas , Robin Stephenson

Improved rates of convergence for ergodic Markov chains and relaxed conditions for them, as well as analogous convergence results for some non-homogeneous Markov chains are studied. The setting from the previous works is extended. Examples…

Probability · Mathematics 2022-09-27 A. Yu. Veretennikov , M. A. Veretennikova

We present a Markov chain on the $n$-dimensional hypercube $\{0,1\}^n$ which satisfies $t_{{\rm mix}}(\epsilon) = n[1 + o(1)]$. This Markov chain alternates between random and deterministic moves and we prove that the chain has cut-off with…

Probability · Mathematics 2022-02-08 David A. Levin , Chandan Tankala

We study the mixing time of systematic scan Markov chains on finite spin systems. It is known that, in a single site setting, the mixing time of systematic scan can be bounded in terms of the influences sites have on each other. We…

Probability · Mathematics 2007-06-12 Kasper Pedersen

For Markov chains and Markov processes exhibiting a form of stochastic monotonicity (larger states shift up transition probabilities in terms of stochastic dominance), stability and ergodicity results can be obtained using order-theoretic…

Probability · Mathematics 2024-10-01 Takashi Kamihigashi , John Stachurski

We study the continuous one-dimensional hard-sphere model and present irreversible local Markov chains that mix on faster time scales than the reversible heatbath or Metropolis algorithms. The mixing time scales appear to fall into two…

Statistical Mechanics · Physics 2018-01-16 Sebastian C. Kapfer , Werner Krauth

We introduce a novel concept of convergence for Markovian processes within Orlicz spaces, extending beyond the conventional approach associated with $L_p$ spaces. After showing that Markovian operators are contractive in Orlicz spaces, our…

Information Theory · Computer Science 2025-11-24 Amedeo Roberto Esposito , Marco Mondelli

Given an irreducible discrete-time Markov chain on a finite state space, we consider the largest expected hitting time $T(\alpha)$ of a set of stationary measure at least $\alpha$ for $\alpha\in(0,1)$. We obtain tight inequalities among the…

Probability · Mathematics 2015-10-29 Simon Griffiths , Ross J. Kang , Roberto Imbuzeiro Oliveira , Viresh Patel

We give a new rapid mixing result for a natural random walk on the independent sets of a graph $G$. We show that when $G$ has bounded treewidth, this random walk -- known as the Glauber dynamics for the hardcore model -- mixes rapidly for…

Data Structures and Algorithms · Computer Science 2023-10-03 David Eppstein , Daniel Frishberg

We consider stochastic optimization problems where data is drawn from a Markov chain. Existing methods for this setting crucially rely on knowing the mixing time of the chain, which in real-world applications is usually unknown. We propose…

Machine Learning · Computer Science 2023-07-14 Ron Dorfman , Kfir Y. Levy

Concentration bounds for non-product, non-Haar measures are fairly recent: the first such result was obtained for contracting Markov chains by Marton in 1996 via the coupling method. The work that followed, with few exceptions, also used…

Probability · Mathematics 2012-07-10 Leonid , Kontorovich

We propose a mechanism by which the efficiency of mixing in chaotic flows can be enhanced. Our mechanism consists of introducing small changes in the system parameters in regions of phase space where the local Lyapunov exponent falls…

chao-dyn · Physics 2008-02-03 Neelima Gupte , R. E. Amritkar

Classical coupling constructions arrange for copies of the \emph{same} Markov process started at two \emph{different} initial states to become equal as soon as possible. In this paper, we consider an alternative coupling framework in which…

Probability · Mathematics 2019-01-01 P. A. Ernst , W. S. Kendall , G. O. Roberts , J. S. Rosenthal