English
Related papers

Related papers: Fast MCMC sampling algorithms on polytopes

200 papers

We study the mixing time of the Dikin walk in a polytope - a random walk based on the log-barrier from the interior point method literature. This walk, and a close variant, were studied by Narayanan (2016) and Kannan-Narayanan (2012).…

Data Structures and Algorithms · Computer Science 2016-08-10 Sushant Sachdeva , Nisheeth K. Vishnoi

We study the problem of drawing samples from a logconcave distribution truncated on a polytope, motivated by computational challenges in Bayesian statistical models with indicator variables, such as probit regression. Building on interior…

Data Structures and Algorithms · Computer Science 2024-12-17 Minhui Jiang , Yuansi Chen

We present a Markov chain (Dikin walk) for sampling from a convex body equipped with a self-concordant barrier, whose mixing time from a "central point" is strongly polynomial in the description of the convex set. The mixing time of this…

Data Structures and Algorithms · Computer Science 2015-11-17 Hariharan Narayanan

We present an affine-invariant random walk for drawing uniform random samples from a convex body $\mathcal{K} \subset \mathbb{R}^n$ that uses maximum volume inscribed ellipsoids, known as John's ellipsoids, for the proposal distribution.…

Machine Learning · Statistics 2020-07-24 Adam Gustafson , Hariharan Narayanan

We introduce the geodesic walk for sampling Riemannian manifolds and apply it to the problem of generating uniform random points from polytopes in R^n specified by m inequalities. The walk is a discrete-time simulation of a stochastic…

Data Structures and Algorithms · Computer Science 2017-06-02 Yin Tat Lee , Santosh S. Vempala

We analyze Riemannian Hamiltonian Monte Carlo (RHMC) for sampling a polytope defined by $m$ inequalities in $\R^n$ endowed with the metric defined by the Hessian of a convex barrier function. The advantage of RHMC over Euclidean methods…

Data Structures and Algorithms · Computer Science 2023-04-20 Khashayar Gatmiry , Jonathan Kelner , Santosh S. Vempala

We consider the problem of sampling from a $d$-dimensional log-concave distribution $\pi(\theta) \propto \exp(-f(\theta))$ for $L$-Lipschitz $f$, constrained to a convex body with an efficiently computable self-concordant barrier function,…

Data Structures and Algorithms · Computer Science 2024-11-14 Yuzhou Gu , Nikki Lijing Kuang , Yi-An Ma , Zhao Song , Lichen Zhang

We study the problem of "isotropically rounding" a polytope $K\subset\mathbb{R}^n$, that is, computing a linear transformation which makes the uniform distribution on the polytope have roughly identity covariance matrix. We assume $K$ is…

Data Structures and Algorithms · Computer Science 2019-09-17 Oren Mangoubi , Nisheeth K. Vishnoi

The theory of rapid mixing random walks plays a fundamental role in the study of modern randomised algorithms. Usually, the mixing time is measured with respect to the worst initial position. It is well known that the presence of…

Probability · Mathematics 2024-01-30 Alberto Espuny Díaz , Patrick Morris , Guillem Perarnau , Oriol Serra

We introduce a Markov chain for sampling from the uniform distribution on a Riemannian manifold $\mathcal{M}$, which we call the $\textit{geodesic walk}$. We prove that the mixing time of this walk on any manifold with positive sectional…

Probability · Mathematics 2017-11-28 Oren Mangoubi , Aaron Smith

Random walk algorithms are crucial for sampling and approximation problems in statistical physics and theoretical computer science. The mixing property is necessary for Markov chains to approach stationary distributions and is facilitated…

Quantum Physics · Physics 2024-12-02 Shyam Dhamapurkar , Yuhang Dang , Saniya Wagh , Xiu-Hao Deng

The connections between (convex) optimization and (logconcave) sampling have been considerably enriched in the past decade with many conceptual and mathematical analogies. For instance, the Langevin algorithm can be viewed as a sampling…

Data Structures and Algorithms · Computer Science 2024-03-25 Yunbum Kook , Santosh S. Vempala

We discuss a Monte Carlo Markov Chain (MCMC) procedure for the random sampling of some one-dimensional lattice paths with constraints, for various constraints. We show that an approach inspired by optimal transport allows us to bound…

Probability · Mathematics 2010-07-28 Lucas Gerin

Random walks on expanders play a crucial role in Markov Chain Monte Carlo algorithms, derandomization, graph theory, and distributed computing. A desirable property is that they are rapidly mixing, which is equivalent to having a spectral…

Probability · Mathematics 2024-12-18 Sam Olesker-Taylor , Thomas Sauerwald , John Sylvester

Systems Biology is a fundamental field and paradigm that introduces a new era in Biology. The crux of its functionality and usefulness relies on metabolic networks that model the reactions occurring inside an organism and provide the means…

Quantitative Methods · Quantitative Biology 2022-06-03 Apostolos Chalkis , Vissarion Fisikopoulos , Elias Tsigaridas , Haris Zafeiropoulos

We study the problem of sampling from the power posterior distribution in Bayesian Gaussian mixture models, a robust version of the classical posterior. This power posterior is known to be non-log-concave and multi-modal, which leads to…

Machine Learning · Statistics 2019-12-12 Wenlong Mou , Nhat Ho , Martin J. Wainwright , Peter L. Bartlett , Michael I. Jordan

We introduce a set of techniques that allow for efficiently generating many independent random walks in the Massive Parallel Computation (MPC) model with space per machine strongly sublinear in the number of vertices. In this…

Data Structures and Algorithms · Computer Science 2019-11-07 Jakub Łącki , Slobodan Mitrović , Krzysztof Onak , Piotr Sankowski

This work focuses on the quantum mixing time, which is crucial for efficient quantum sampling and algorithm performance. We extend Richter's previous analysis of continuous time quantum walks on the periodic lattice $\mathbb{Z}_{n_1}\times…

Quantum Physics · Physics 2024-06-03 Shyam Dhamapurkar , Xiu-Hao Deng

We prove that a uniformized variant of both the Rosenthal walk \cite{Rosenthal} and the Kac random walk \cite{Kac} on SO(n) mixes in $\cO(n^3)$ steps in total variation distance. The proof also extends easily to Rosenthal walk with fixed…

Probability · Mathematics 2011-10-26 Yunjiang Jiang

Hit-and-Run is known to be one of the best random sampling algorithms, its mixing time is polynomial in dimension. Nevertheless, in practice the number of steps required to achieve uniformly distributed samples is rather high. We propose…

Optimization and Control · Mathematics 2014-02-13 Elena Gryazina , Boris Polyak
‹ Prev 1 2 3 10 Next ›