English
Related papers

Related papers: Concentration inequalities for Markov processes vi…

200 papers

We establish two concentration inequalities for nonlinear stochastic system under time-varying contraction conditions. The key to our approach is an energy function termed Averaged Moment Generating Function (AMGF). By combining it with…

Optimization and Control · Mathematics 2026-04-03 Zishun Liu , Liqian Ma , Hongzhe Yu , Yongxin Chen

We survey existing techniques to bound the mixing time of Markov chains. The mixing time is related to a geometric parameter called conductance which is a measure of edge-expansion. Bounds on conductance are typically obtained by a…

Data Structures and Algorithms · Computer Science 2016-03-07 Venkatesan Guruswami

Studying the subexponential convergence towards equilibrium of a strong Markov process, we exhibit an intermediate Lyapunov condition equivalent to the control of some moment of a hitting time. This provides a link, similar (although more…

Probability · Mathematics 2021-08-03 Armand Bernou

We observe that the technique of Markov contraction can be used to establish measure concentration for a broad class of non-contracting chains. In particular, geometric ergodicity provides a simple and versatile framework. This leads to a…

Probability · Mathematics 2013-12-06 Aryeh Kontorovich , Roi Weiss

We consider symmetric Markov chains on $\Bbb Z^d$ where we do {\bf not} assume that the conductance between two points must be zero if the points are far apart. Under a uniform second moment condition on the conductances, we obtain upper…

Probability · Mathematics 2007-05-23 Richard F. Bass , Takashi Kumagai

Based on a coupling approach, we prove uniform in time propagation of chaos for weakly interacting mean-field particle systems with possibly non-convex confinement and interaction potentials. The approach is based on a combination of…

Probability · Mathematics 2018-05-30 Alain Durmus , Andreas Eberle , Arnaud Guillin , Raphael Zimmer

We prove an apparently novel concentration of measure result for Markov tree processes. The bound we derive reduces to the known bounds for Markov processes when the tree is a chain, thus strictly generalizing the known Markov process…

Probability · Mathematics 2007-05-23 Leonid Kontorovich

In this paper we develop a general framework for constructing and analysing coupled Markov chain Monte Carlo samplers, allowing for both (possibly degenerate) diffusion and piecewise deterministic Markov processes. For many performance…

Probability · Mathematics 2018-06-29 N. Nuesken , G. A. Pavliotis

The purpose of this dissertation is to introduce a version of Stein's method of exchangeable pairs to solve problems in measure concentration. We specifically target systems of dependent random variables, since that is where the power of…

Probability · Mathematics 2016-03-09 Sourav Chatterjee

We prove an upper bound on the total variation mixing time of a finite Markov chain in terms of the absolute spectral gap and the number of elements in the state space. Unlike results requiring reversibility or irreducibility, this bound is…

Probability · Mathematics 2013-10-31 Daniel Jerison

We consider the problem of sampling from the uniform distribution on the set of Eulerian orientations of subgraphs of the triangular lattice. Although it is known that this can be achieved in polynomial time for any graph, the algorithm…

Discrete Mathematics · Computer Science 2007-05-23 Paidi Creed

Slow mixing is the central hurdle when working with Markov chains, especially those used for Monte Carlo approximations (MCMC). In many applications, it is only of interest to estimate the stationary expectations of a small set of…

Statistics Theory · Mathematics 2016-10-04 Maxim Rabinovich , Aaditya Ramdas , Michael I. Jordan , Martin J. Wainwright

Non-Gaussian concentration estimates are obtained for invariant probability measures of reversible Markov processes. We show that the functional inequalities approach combined with a suitable Lyapunov condition allows us to circumvent the…

Probability · Mathematics 2012-02-13 Arnaud Guillin , Aldéric Joulin

We investigate the mixing properties of a finite Markov chain in random environment defined as a mixture of a deterministic chain and a chain whose state space has been permuted uniformly at random. This work is the counterpart of a…

Probability · Mathematics 2024-02-07 Bastien Dubail

In this paper, we study moment and concentration inequalities for the spectral norm of sums of dependent random matrices. We establish novel Rosenthal-Burkholder inequalities for discrete-time matrix local martingales,…

Probability · Mathematics 2025-11-13 Yang Peng , Yuchen Xin , Zhihua Zhang

We present new concentration of measure inequalities for Markov chains, generalising results for chains that are contracting in Wasserstein distance. These are particularly suited to establishing the cut-off phenomenon for suitable chains.…

Probability · Mathematics 2022-05-24 Andrew Barbour , Graham Brightwell , Malwina Luczak

Since 1997 a considerable effort has been spent to study the mixing time of switch Markov chains on the realizations of graphic degree sequences of simple graphs. Several results were proved on rapidly mixing Markov chains on unconstrained,…

The partial sum of the states of a Markov chain or more generally a Markov source is asymptotically normally distributed under suitable conditions. One of these conditions is that the variance is unbounded. A simple combinatorial…

Combinatorics · Mathematics 2023-06-22 Sara Kropf

In this work we consider time series with a finite number of discrete point changes. We assume that the data in each segment follows a different probability density functions (pdf). We focus on the case where the data in all segments are…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ali Mohammad-Djafari , Olivier Feron

We apply general moment identities for Poisson stochastic integrals with random integrands to the computation of the moments of Markovian growth-collapse processes. This extends existing formulas for mean and variance available in the…

Probability · Mathematics 2021-03-09 Nicolas Privault