English
Related papers

Related papers: Mixing Time Bounds for the Gibbs Sampler under Iso…

200 papers

We study the problem of sampling from the power posterior distribution in Bayesian Gaussian mixture models, a robust version of the classical posterior. This power posterior is known to be non-log-concave and multi-modal, which leads to…

Machine Learning · Statistics 2019-12-12 Wenlong Mou , Nhat Ho , Martin J. Wainwright , Peter L. Bartlett , Michael I. Jordan

We consider Markov chain Monte Carlo (MCMC) algorithms for Bayesian high-dimensional regression with continuous shrinkage priors. A common challenge with these algorithms is the choice of the number of iterations to perform. This is…

Methodology · Statistics 2021-07-13 Niloy Biswas , Anirban Bhattacharya , Pierre E. Jacob , James E. Johndrow

We prove an optimal $O(n \log n)$ mixing time of the Glauber dynamics for the Ising models with edge activity $\beta \in \left(\frac{\Delta-2}{\Delta}, \frac{\Delta}{\Delta-2}\right)$. This mixing time bound holds even if the maximum degree…

Probability · Mathematics 2021-11-05 Xiaoyu Chen , Weiming Feng , Yitong Yin , Xinyuan Zhang

Given a topologically transitive system on the unit interval, one can investigate the cover time, i.e. time for an orbit to reach certain level of resolution in the repeller. We introduce a new notion of dimension, namely the stretched…

Dynamical Systems · Mathematics 2025-01-03 Boyuan Zhao

In statistical learning theory, a generalization bound usually involves a complexity measure imposed by the considered theoretical framework. This limits the scope of such bounds, as other forms of capacity measures or regularizations are…

Machine Learning · Statistics 2024-02-22 Paul Viallard , Rémi Emonet , Amaury Habrard , Emilie Morvant , Valentina Zantedeschi

For general spin systems, we prove that a contractive coupling for any local Markov chain implies optimal bounds on the mixing time and the modified log-Sobolev constant for a large class of Markov chains including the Glauber dynamics,…

Incorporating time-varying elements into electromagnetic systems has shown to be a powerful approach to challenge well-established performance limits, for example bounds on absorption and impedance matching. So far, the majority of these…

Optics · Physics 2024-04-09 Zeki Hayran , Francesco Monticone

We introduce a Markov chain for sampling from the uniform distribution on a Riemannian manifold $\mathcal{M}$, which we call the $\textit{geodesic walk}$. We prove that the mixing time of this walk on any manifold with positive sectional…

Probability · Mathematics 2017-11-28 Oren Mangoubi , Aaron Smith

We construct a parallel stochastic dynamics with invariant measure converging to the Gibbs measure of the low temperature Ising model. The proof of such convergence requires a polymer expansion based on suitably defined Peierls-type…

Mathematical Physics · Physics 2016-12-21 Aldo Procacci , Benedetto Scoppola , Elisabetta Scoppola

Geometric tempering is a popular approach to sampling from challenging multi-modal probability distributions by instead sampling from a sequence of distributions which interpolate, using the geometric mean, between an easier proposal…

Machine Learning · Statistics 2025-04-09 Omar Chehab , Anna Korba , Austin Stromme , Adrien Vacher

In this paper, we analyze the convergence rate of a collapsed Gibbs sampler for crossed random effects models. Our results apply to a substantially larger range of models than previous works, including models that incorporate missingness…

Computation · Statistics 2021-10-22 Swarnadip Ghosh , Chenyang Zhong

We develop a new technique for proving distribution testing lower bounds for properties defined by inequalities involving the bin probabilities of the distribution in question. Using this technique we obtain new lower bounds for…

Machine Learning · Computer Science 2023-08-02 Yuqian Cheng , Daniel M. Kane , Zhicheng Zheng

We analyze Riemannian Hamiltonian Monte Carlo (RHMC) for sampling a polytope defined by $m$ inequalities in $\R^n$ endowed with the metric defined by the Hessian of a convex barrier function. The advantage of RHMC over Euclidean methods…

Data Structures and Algorithms · Computer Science 2023-04-20 Khashayar Gatmiry , Jonathan Kelner , Santosh S. Vempala

This paper studies when a sequence of probability measures on a metric space admit subsequential weak limits. A sufficient condition called sequential tightness is formulated, which relaxes some assumptions for asymptotic tightness used in…

Probability · Mathematics 2025-11-20 Osama Abuzaid

In the field of sampling algorithms, MCMC (Markov Chain Monte Carlo) methods are widely used when direct sampling is not possible. However, multimodality of target distributions often leads to slow convergence and mixing. One common…

Machine Learning · Computer Science 2023-04-05 Holden Lee , Zeyu Shen

We discuss a natural extension of Gilles Pisier's approach to the study of measure concentration, isoperimetry and Poincar\'e-type inequalities. This approach allows one to explore counterparts of various results about Gaussian measure in…

Probability · Mathematics 2023-11-08 Sergey G. Bobkov , Bruno Volzone

Motivated, in part, by the desire to develop an information-theoretic foundation for compound Poisson approximation limit theorems (analogous to the corresponding developments for the central limit theorem and for simple Poisson…

Information Theory · Computer Science 2010-10-21 Oliver Johnson , Ioannis Kontoyiannis , Mokshay Madiman

In recent years, the shortcomings of Bayesian posteriors as inferential devices have received increased attention. A popular strategy for fixing them has been to instead target a Gibbs measure based on losses that connect a parameter of…

Statistics Theory · Mathematics 2025-04-24 David T. Frazier , Jeremias Knoblauch , Jack Jewson , Christopher Drovandi

We show that under a low complexity condition on the gradient of a Hamiltonian, Gibbs distributions on the Boolean hypercube are approximate mixtures of product measures whose probability vectors are critical points of an associated…

Probability · Mathematics 2018-04-20 Ronen Eldan , Renan Gross

We survey existing techniques to bound the mixing time of Markov chains. The mixing time is related to a geometric parameter called conductance which is a measure of edge-expansion. Bounds on conductance are typically obtained by a…

Data Structures and Algorithms · Computer Science 2016-03-07 Venkatesan Guruswami