English
Related papers

Related papers: Hit-and-run mixing via localization schemes

200 papers

The Gibbs sampler, also known as the coordinate hit-and-run algorithm, is a Markov chain that is widely used to draw samples from probability distributions in arbitrary dimensions. At each iteration of the algorithm, a randomly selected…

Statistics Theory · Mathematics 2024-12-25 Neha S. Wadia

We obtain a polynomial upper bound on the mixing time $T_{CHR}(\epsilon)$ of the coordinate Hit-and-Run random walk on an $n-$dimensional convex body, where $T_{CHR}(\epsilon)$ is the number of steps needed in order to reach within…

Data Structures and Algorithms · Computer Science 2022-04-12 Hariharan Narayanan , Piyush Srivastava

We propose the Hit-and-Run algorithm for planning and sampling problems in non-convex spaces. For sampling, we show the first analysis of the Hit-and-Run algorithm in non-convex spaces and show that it mixes fast as long as certain…

Computation · Statistics 2016-10-28 Yasin Abbasi-Yadkori , Peter L. Bartlett , Victor Gabillon , Alan Malek

The Gibbs Sampler is a general method for sampling high-dimensional distributions, dating back to Turchin, 1971. In each step of the Gibbs Sampler, we pick a random coordinate and re-sample that coordinate from the distribution induced by…

Data Structures and Algorithms · Computer Science 2022-03-03 Aditi Laddha , Santosh Vempala

Running a random walk in a convex body $K\subseteq\mathbb{R}^n$ is a standard approach to sample approximately uniformly from the body. The requirement is that from a suitable initial distribution, the distribution of the walk comes close…

Data Structures and Algorithms · Computer Science 2024-12-18 Hariharan Narayanan , Amit Rajaraman , Piyush Srivastava

We present a new random walk for uniformly sampling high-dimensional convex bodies. It achieves state-of-the-art runtime complexity with stronger guarantees on the output than previously known, namely in R\'enyi divergence (which implies…

Data Structures and Algorithms · Computer Science 2026-03-23 Yunbum Kook , Santosh S. Vempala , Matthew S. Zhang

We study the numerical computation of an expectation of a bounded function with respect to a measure given by a non-normalized density on a convex body. We assume that the density is log-concave, satisfies a variability condition and is not…

Probability · Mathematics 2014-12-03 Daniel Rudolf

We introduce a Markov chain for sampling from the uniform distribution on a Riemannian manifold $\mathcal{M}$, which we call the $\textit{geodesic walk}$. We prove that the mixing time of this walk on any manifold with positive sectional…

Probability · Mathematics 2017-11-28 Oren Mangoubi , Aaron Smith

We consider the problem of optimizing an approximately convex function over a bounded convex set in $\mathbb{R}^n$ using only function evaluations. The problem is reduced to sampling from an \emph{approximately} log-concave distribution…

Numerical Analysis · Computer Science 2020-07-27 Alexandre Belloni , Tengyuan Liang , Hariharan Narayanan , Alexander Rakhlin

Hit-and-Run is known to be one of the best random sampling algorithms, its mixing time is polynomial in dimension. Nevertheless, in practice the number of steps required to achieve uniformly distributed samples is rather high. We propose…

Optimization and Control · Mathematics 2014-02-13 Elena Gryazina , Boris Polyak

We present a Markov chain (Dikin walk) for sampling from a convex body equipped with a self-concordant barrier, whose mixing time from a "central point" is strongly polynomial in the description of the convex set. The mixing time of this…

Data Structures and Algorithms · Computer Science 2015-11-17 Hariharan Narayanan

Hit-and-Run is a coordinate-free Gibbs sampler, yet the quantitative advantages of its coordinate-free property remain largely unexplored beyond empirical studies. In this paper, we prove sharp estimates for the Wasserstein contraction of…

Probability · Mathematics 2025-10-20 Nawaf Bou-Rabee , Andreas Eberle , Stefan Oberdörster

We present an affine-invariant random walk for drawing uniform random samples from a convex body $\mathcal{K} \subset \mathbb{R}^n$ that uses maximum volume inscribed ellipsoids, known as John's ellipsoids, for the proposal distribution.…

Machine Learning · Statistics 2020-07-24 Adam Gustafson , Hariharan Narayanan

We study an example of a {\em hit-and-run} random walk on the symmetric group $\mathbf S_n$. Our starting point is the well understood {\em top-to-random} shuffle. In the hit-and-run version, at each {\em single step}, after picking the…

Probability · Mathematics 2021-03-11 Samuel Boardman , Daniel Rudolf , Laurent Saloff-Coste

Different Markov chains can be used for approximate sampling of a distribution given by an unnormalized density function with respect to the Lebesgue measure. The hit-and-run, (hybrid) slice sampler and random walk Metropolis algorithm are…

Probability · Mathematics 2019-08-15 Daniel Rudolf , Mario Ullrich

We extend the Langevin Monte Carlo (LMC) algorithm to compactly supported measures via a projection step, akin to projected Stochastic Gradient Descent (SGD). We show that (projected) LMC allows to sample in polynomial time from a…

Probability · Mathematics 2016-08-08 Sébastien Bubeck , Ronen Eldan , Joseph Lehec

We study the problem of "isotropically rounding" a polytope $K\subset\mathbb{R}^n$, that is, computing a linear transformation which makes the uniform distribution on the polytope have roughly identity covariance matrix. We assume $K$ is…

Data Structures and Algorithms · Computer Science 2019-09-17 Oren Mangoubi , Nisheeth K. Vishnoi

We study the mixing time of Metropolis-Adjusted Langevin algorithm (MALA) for sampling a target density on $\mathbb{R}^d$. We assume that the target density satisfies $\psi_\mu$-isoperimetry and that the operator norm and trace of its…

Machine Learning · Statistics 2023-06-09 Yuansi Chen , Khashayar Gatmiry

We study the convergence behavior of the stochastic heavy-ball method with a small stepsize. Under a change of time scale, we approximate the discrete method by a stochastic differential equation that models small random perturbations of a…

Probability · Mathematics 2019-10-21 Wenqing Hu , Chris Junchi Li , Xiang Zhou

Many classical randomized algorithms (e.g., approximation algorithms for #P-complete problems) utilize the following random walk algorithm for {\em almost uniform sampling} from a state space $S$ of cardinality $N$: run a symmetric ergodic…

Quantum Physics · Physics 2007-05-23 Peter C. Richter
‹ Prev 1 2 3 10 Next ›