English
Related papers

Related papers: Sampling with Barriers: Faster Mixing via Lewis We…

200 papers

Mixed level orthogonal arrays are basic structures in experimental design. We develop three algorithms that compute Rao and Gilbert-Varshamov type bounds for mixed level orthogonal arrays. The computational complexity of the terms involved…

Statistics Theory · Mathematics 2009-05-03 Ferruh Ozbudak , Ali Devin Sezer

Underdamped Langevin Monte Carlo (ULMC) is an algorithm used to sample from unnormalized densities by leveraging the momentum of a particle moving in a potential well. We provide a novel analysis of ULMC, motivated by two central questions:…

Statistics Theory · Mathematics 2023-02-17 Matthew Zhang , Sinho Chewi , Mufan Bill Li , Krishnakumar Balasubramanian , Murat A. Erdogdu

In this paper, we study the problem of sampling from a given probability density function that is known to be smooth and strongly log-concave. We analyze several methods of approximate sampling based on discretizations of the (highly…

Statistics Theory · Mathematics 2024-02-26 Arnak S. Dalalyan , Avetik G. Karagulyan

Riemannian manifold Hamiltonian (RMHMC) and Lagrangian Monte Carlo (LMC) have emerged as powerful methods of Bayesian inference. Unlike Euclidean Hamiltonian Monte Carlo (EHMC) and the Metropolis-adjusted Langevin algorithm (MALA), the…

Methodology · Statistics 2023-01-05 James A. Brofos , Vivekananda Roy , Roy R. Lederman

We describe a new MCMC method optimized for the sampling of probability measures on Hilbert space which have a density with respect to a Gaussian; such measures arise in the Bayesian approach to inverse problems, and in conditioned…

Probability · Mathematics 2014-04-04 Michela Ottobre , Natesh S. Pillai , Frank J. Pinski , Andrew M. Stuart

In this article we consider importance sampling (IS) and sequential Monte Carlo (SMC) methods in the context of 1-dimensional random walks with absorbing barriers. In particular, we develop a very precise variance analysis for several IS…

Computation · Statistics 2016-11-11 Pierre Del Moral , Ajay Jasra

We propose a sampling algorithm that achieves superior complexity bounds in all the classical settings (strongly log-concave, log-concave, Logarithmic-Sobolev inequality (LSI), Poincar\'e inequality) as well as more general settings with…

Statistics Theory · Mathematics 2023-06-29 Jiaojiao Fan , Bo Yuan , Yongxin Chen

There has been considerable interest in designing Markov chain Monte Carlo algorithms by exploiting numerical methods for Langevin dynamics, which includes Hamiltonian dynamics as a deterministic case. A prominent approach is Hamiltonian…

Computation · Statistics 2021-06-08 Zexi Song , Zhiqiang Tan

Hybrid Monte-Carlo (HMC) sampling smoother is a fully non-Gaussian four-dimensional data assimilation algorithm that works by directly sampling the posterior distribution formulated in the Bayesian framework. The smoother in its original…

Numerical Analysis · Computer Science 2016-12-21 Ahmed Attia , Razvan Stefanescu , Adrian Sandu

Hamiltonian Flow Monte Carlo(HFMC) methods have been implemented in engineering, biology and chemistry. HFMC makes large gradient based steps to rapidly explore the state space. The application of the Hamiltonian dynamics allows to estimate…

Computation · Statistics 2017-09-06 Raphael Douady , Shohruh Miryusupov

Langevin Monte Carlo (LMC) is a popular Markov chain Monte Carlo sampling method. One drawback is that it requires the computation of the full gradient at each iteration, an expensive operation if the dimension of the problem is high. We…

Machine Learning · Statistics 2020-10-06 Zhiyan Ding , Qin Li , Jianfeng Lu , Stephen J. Wright

In this work we present a new and efficient Bayesian method for nonlinear three dimensional large scale structure inference. We employ a Hamiltonian Monte Carlo (HMC) sampler to obtain samples from a multivariate highly non-Gaussian…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-14 J. Jasche , F. S. Kitaura

We discuss Hamiltonian Monte Carlo (HMC) and event-chain Monte Carlo (ECMC) for the one-dimensional chain of particles with harmonic interactions and benchmark them against local reversible Metropolis algorithms. While HMC achieves…

Statistical Mechanics · Physics 2024-11-19 Werner Krauth

This article considers the popular MCMC method of unadjusted Langevin Monte Carlo (LMC) and provides a non-asymptotic analysis of its sampling error in 2-Wasserstein distance. The proof is based on a refinement of mean-square analysis in Li…

Machine Learning · Computer Science 2022-02-22 Ruilin Li , Hongyuan Zha , Molei Tao

For big data analysis, high computational cost for Bayesian methods often limits their applications in practice. In recent years, there have been many attempts to improve computational efficiency of Bayesian inference. Here we propose an…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

Sampling from the lattice Gaussian distribution plays an important role in various research fields. In this paper, the Markov chain Monte Carlo (MCMC)-based sampling technique is advanced in several fronts. Firstly, the spectral gap for the…

Information Theory · Computer Science 2018-07-31 Zheng Wang , Cong Ling

We explore the construction of new symplectic numerical integration schemes to be used in Hamiltonian Monte Carlo and study their efficiency. Two integration schemes from Blanes et al. (2014), and a new scheme based on optimal acceptance…

Computation · Statistics 2016-08-26 Janne Mannseth , Tore Selland Kleppe , Hans J. Skaug

The past few years have seen considerable progress in algorithmic development for the generation of gauge fields including the effects of dynamical fermions. The Rational Hybrid Monte Carlo (RHMC) algorithm, where Hybrid Monte Carlo is…

High Energy Physics - Lattice · Physics 2008-11-26 M. A. Clark

We study sampling from a target distribution $\nu_* = e^{-f}$ using the unadjusted Langevin Monte Carlo (LMC) algorithm when the potential $f$ satisfies a strong dissipativity condition and it is first-order smooth with a Lipschitz…

Machine Learning · Statistics 2021-07-09 Murat A. Erdogdu , Rasa Hosseinzadeh , Matthew S. Zhang

The problem of the reconstruction of the large scale density and velocity fields from peculiar velocities surveys is addressed here within a Bayesian framework by means of Hamiltonian Monte Carlo (HMC) sampling. The HAmiltonian Monte carlo…

Cosmology and Nongalactic Astrophysics · Physics 2022-06-01 Aurélien Valade , Yehuda Hoffman , Noam I Libeskind , Romain Graziani