English
Related papers

Related papers: Geometry and Dynamics for Markov Chain Monte Carlo

200 papers

Hamiltonian Monte Carlo (HMC) is a Markov chain algorithm for sampling from a high-dimensional distribution with density $e^{-f(x)}$, given access to the gradient of $f$. A particular case of interest is that of a $d$-dimensional Gaussian…

Machine Learning · Statistics 2022-09-27 Simon Apers , Sander Gribling , Dániel Szilágyi

Hamiltonian dynamics can be used to produce distant proposals for the Metropolis algorithm, thereby avoiding the slow exploration of the state space that results from the diffusive behaviour of simple random-walk proposals. Though…

Computation · Statistics 2021-06-30 Radford M. Neal

One of the open challenges in quantum computing is to find meaningful and practical methods to leverage quantum computation to accelerate classical machine learning workflows. A ubiquitous problem in machine learning workflows is sampling…

Quantum Physics · Physics 2024-08-08 Owen Lockwood , Peter Weiss , Filip Aronshtein , Guillaume Verdon

Hamiltonian Monte Carlo (HMC) sampling methods provide a mechanism for defining distant proposals with high acceptance probabilities in a Metropolis-Hastings framework, enabling more efficient exploration of the state space than standard…

Methodology · Statistics 2014-05-13 Tianqi Chen , Emily B. Fox , Carlos Guestrin

Hamiltonian Monte Carlo (HMC) has emerged as a powerful Markov Chain Monte Carlo (MCMC) method to sample from complex continuous distributions. However, a fundamental limitation of HMC is that it can not be applied to distributions with…

Computation · Statistics 2021-12-10 Guangyao Zhou

Monte Carlo techniques have been widely employed in statistical physics as well as in quantum theory in the Lagrangian formulation. However, in some areas of application to quantum theories computational progress has been slow. Here we…

Statistical Mechanics · Physics 2011-04-15 Xiang-Qian Luo , C. Huang , J. Jiang , H. Jirari , H. Kroger , K. Moriarty

Although Hamiltonian Monte Carlo has proven an empirical success, the lack of a rigorous theoretical understanding of the algorithm has in many ways impeded both principled developments of the method and use of the algorithm in practice. In…

Methodology · Statistics 2014-10-21 M. J. Betancourt , Simon Byrne , Samuel Livingstone , Mark Girolami

Hamiltonian Monte Carlo (HMC) is a popular Markov chain Monte Carlo (MCMC) algorithm that generates proposals for a Metropolis-Hastings algorithm by simulating the dynamics of a Hamiltonian system. However, HMC is sensitive to large time…

Machine Learning · Statistics 2016-09-15 Xiaoyu Lu , Valerio Perrone , Leonard Hasenclever , Yee Whye Teh , Sebastian J. Vollmer

Recently Dutta and Bhattacharya (2013) introduced a novel Markov Chain Monte Carlo methodology that can simultaneously update all the components of high dimensional parameters using simple deterministic transformations of a one-dimensional…

Methodology · Statistics 2017-01-24 Kushal Kumar Dey , Sourabh Bhattacharya

Hamiltonian Monte Carlo has emerged as a standard tool for posterior computation. In this article, we present an extension that can efficiently explore target distributions with discontinuous densities. Our extension in particular enables…

Computation · Statistics 2020-06-09 Akihiko Nishimura , David Dunson , Jianfeng Lu

Markov Chain Monte Carlo based Bayesian data analysis has now become the method of choice for analyzing and interpreting data in almost all disciplines of science. In astronomy, over the last decade, we have also seen a steady increase in…

Instrumentation and Methods for Astrophysics · Physics 2017-08-30 Sanjib Sharma

Hamiltonian Monte Carlo is a widely used algorithm for sampling from posterior distributions of complex Bayesian models. It can efficiently explore high-dimensional parameter spaces guided by simulated Hamiltonian flows. However, the…

Computation · Statistics 2019-04-29 Lingge Li , Andrew Holbrook , Babak Shahbaba , Pierre Baldi

In machine learning and statistics, probabilistic inference involving multimodal distributions is quite difficult. This is especially true in high dimensional problems, where most existing algorithms cannot easily move from one mode to…

Computation · Statistics 2015-06-22 Shiwei Lan , Jeffrey Streets , Babak Shahbaba

Since the middle of the 1940's scientists have used Monte Carlo (MC) simulations to obtain information about physical processes. This has proved a accurate and and reliable method to obtain this information. Through out resent years…

Astrophysics of Galaxies · Physics 2012-07-02 Thomas Amby Ottosen

Markov Chain Monte Carlo (MCMC) is an invaluable means of inference with complicated models, and Hamiltonian Monte Carlo, in particular Riemannian Manifold Hamiltonian Monte Carlo (RMHMC), has demonstrated impressive success in many…

Methodology · Statistics 2015-03-02 M. J. Betancourt

The aim of this work is to give an introduction to the theoretical background and computational complexity of Markov chain Monte Carlo methods. Most of the mathematical results related to the convergence are not found in most of the…

Computation · Statistics 2020-04-16 Izhar Asael Alonzo Matamoros

Hamiltonian Monte Carlo (HMC) is an efficient and effective means of sampling posterior distributions on Euclidean space, which has been extended to manifolds with boundary. However, some applications require an extension to more general…

Populations and Evolution · Quantitative Biology 2017-06-26 Vu Dinh , Arman Bilge , Cheng Zhang , Frederick A. Matsen

Markov chain Monte Carlo (MCMC) algorithms offer various strategies for sampling; the Hamiltonian Monte Carlo (HMC) family of samplers are MCMC algorithms which often exhibit improved mixing properties. The recently introduced magnetic HMC,…

Machine Learning · Statistics 2020-10-16 James A. Brofos , Roy R. Lederman

Sampling occupies an important position in theories of various scientific fields, and Markov chain Monte Carlo (MCMC) provides the most common technique of sampling. In the progress of MCMC, a huge number of studies have aimed the…

Statistical Mechanics · Physics 2021-07-20 Akihisa Ichiki , Masayuki Ohzeki

Hamiltonian Monte Carlo (HMC) is an efficient method of simulating smooth distributions and has motivated the widely used No-U-turn Sampler (NUTS) and software Stan. We build on NUTS and the technique of "unbiased sampling" to design HMC…

Computation · Statistics 2022-12-26 George M. Leigh , Amanda R. Northrop