English
Related papers

Related papers: Entropic Independence II: Optimal Sampling and Con…

200 papers

We introduce a notion called entropic independence that is an entropic analog of spectral notions of high-dimensional expansion. Informally, entropic independence of a background distribution $\mu$ on $k$-sized subsets of a ground set of…

Data Structures and Algorithms · Computer Science 2021-11-08 Nima Anari , Vishesh Jain , Frederic Koehler , Huy Tuan Pham , Thuy-Duong Vuong

For general spin systems, we prove that a contractive coupling for any local Markov chain implies optimal bounds on the mixing time and the modified log-Sobolev constant for a large class of Markov chains including the Glauber dynamics,…

Two recent and seemingly-unrelated techniques for proving mixing bounds for Markov chains are: (i) the framework of Spectral Independence, introduced by Anari, Liu and Oveis Gharan, and its numerous extensions, which have given rise to…

Probability · Mathematics 2022-06-07 Yuansi Chen , Ronen Eldan

We establish universal modified log-Sobolev inequalities for reversible Markov chains on the boolean lattice $\{0,1\}^n$, under the only assumption that the invariant law $\pi$ satisfies a form of negative dependence known as the stochastic…

Probability · Mathematics 2020-02-28 Jonathan Hermon , Justin Salez

Entropic independence is a structural property of measures that underlies modern proofs of functional inequalities, notably (modified) log-Sobolev inequalities, via ``annealing'' or local-to-global schemes. Existing sufficient criteria for…

Information Theory · Computer Science 2026-04-14 Vishesh Jain , Huy Tuan Pham , Thuy-Duong Vuong

Estimating the entropy based on data is one of the prototypical problems in distribution property testing and estimation. For estimating the Shannon entropy of a distribution on $S$ elements with independent samples, [Paninski2004] showed…

Machine Learning · Computer Science 2018-09-25 Yanjun Han , Jiantao Jiao , Chuan-Zheng Lee , Tsachy Weissman , Yihong Wu , Tiancheng Yu

We address the problem of estimating the mixing time of a Markov chain from a single trajectory of observations. Unlike most previous works which employed Hilbert space methods to estimate spectral gaps, we opt for an approach based on…

Probability · Mathematics 2023-09-13 Geoffrey Wolfer

We prove an optimal $O(n \log n)$ mixing time of the Glauber dynamics for the Ising models with edge activity $\beta \in \left(\frac{\Delta-2}{\Delta}, \frac{\Delta}{\Delta-2}\right)$. This mixing time bound holds even if the maximum degree…

Probability · Mathematics 2021-11-05 Xiaoyu Chen , Weiming Feng , Yitong Yin , Xinyuan Zhang

We study Markov chains with non-negative sectional curvature on finite metric spaces. Neither reversibility, nor the restriction to a particular combinatorial distance are imposed. In this level of generality, we prove that a 1-step…

Probability · Mathematics 2024-02-12 Pietro Caputo , Florentin Münch , Justin Salez

In this work, we develop a comparison procedure for the Modified log-Sobolev Inequality (MLSI) constants of two reversible Markov chains on a finite state space. Efficient comparison of the MLSI Dirichlet forms is a well known obstacle in…

Probability · Mathematics 2022-06-28 Konstantin Tikhomirov , Pierre Youssef

This paper considers the speed of convergence (mixing) of a finite Markov kernel $P$ with respect to the Kullback-Leibler divergence (entropy). Given a Markov kernel one defines either a discrete-time Markov chain (with the $n$-step…

Probability · Mathematics 2024-09-13 Pietro Caputo , Zongchen Chen , Yuzhou Gu , Yury Polyanskiy

We consider a new functional inequality controlling the rate of relative entropy decay for random walks, the interchange process and more general block-type dynamics for permutations. The inequality lies between the classical logarithmic…

Probability · Mathematics 2022-05-12 Alexandre Bristiel , Pietro Caputo

We study the mixing time of Glauber dynamics on monotone systems. For monotone systems satisfying the entropic independence condition, we prove a new mixing time comparison result for Glauber dynamics. For concrete applications, we obtain…

Discrete Mathematics · Computer Science 2025-07-16 Weiming Feng , Minji Yang

We study the mixing time of the single-site update Markov chain, known as the Glauber dynamics, for generating a random independent set of a tree. Our focus is obtaining optimal convergence results for arbitrary trees. We consider the more…

Discrete Mathematics · Computer Science 2025-03-05 Charilaos Efthymiou , Thomas P. Hayes , Daniel Stefankovic , Eric Vigoda

This monograph is an exposition on an exciting new technique known as spectral independence, which has been instrumental in analyzing the convergence rate of Markov Chain Monte Carlo (MCMC) algorithms. For a high-dimensional distribution…

Discrete Mathematics · Computer Science 2025-09-18 Zongchen Chen , Daniel Stefankovic , Eric Vigoda

Spectral independence is a recently-developed framework for obtaining sharp bounds on the convergence time of the classical Glauber dynamics. This new framework has yielded optimal $O(n \log n)$ sampling algorithms on bounded-degree graphs…

Data Structures and Algorithms · Computer Science 2023-10-16 Ivona Bezáková , Andreas Galanis , Leslie Ann Goldberg , Daniel Štefankovič

In this paper, we establish novel concentration inequalities for additive functionals of geometrically ergodic Markov chains similar to Rosenthal inequalities for sums of independent random variables. We pay special attention to the…

Probability · Mathematics 2025-09-26 Alain Durmus , Eric Moulines , Alexey Naumov , Sergey Samsonov , Marina Sheshukova

We study the exponential dissipation of entropic functionals for continuous time Markov chains and the associated convex Sobolev inequalities, including MLSI and Beckner inequalities. We propose a method that combines the Bakry \'Emery…

Probability · Mathematics 2020-05-28 Giovanni Conforti

The mixing time of a Markov chain determines how fast the iterates of the Markov chain converge to the stationary distribution; however, it does not control the dependencies between samples along the Markov chain. In this paper, we study…

Statistics Theory · Mathematics 2025-06-30 Jiaming Liang , Siddharth Mitra , Andre Wibisono

We show that if the random walk on a graph has positive coarse Ricci curvature in the sense of Ollivier, then the stationary measure satisfies a W^1 transport-entropy inequality. Peres and Tetali have conjectured a stronger consequence,…

Probability · Mathematics 2016-12-28 Ronen Eldan , James R. Lee , Joseph Lehec
‹ Prev 1 2 3 10 Next ›