English
Related papers

Related papers: Relativistic Monte Carlo

200 papers

Hamiltonian Monte Carlo (HMC) exploits Hamiltonian dynamics to construct efficient proposals for Markov chain Monte Carlo (MCMC). In this paper, we present a generalization of HMC which exploits \textit{non-canonical} Hamiltonian dynamics.…

Machine Learning · Statistics 2017-08-22 Nilesh Tripuraneni , Mark Rowland , Zoubin Ghahramani , Richard Turner

Hamiltonian Monte Carlo (HMC) is a powerful tool for Bayesian computation. In comparison with the traditional Metropolis-Hastings algorithm, HMC offers greater computational efficiency, especially in higher dimensional or more complex…

Computation · Statistics 2020-12-21 Samuel Thomas , Wanzhu Tu

Hamiltonian Monte Carlo (HMC) is a state of the art method for sampling from distributions with differentiable densities, but can converge slowly when applied to challenging multimodal problems. Running HMC with a time varying Hamiltonian,…

Machine Learning · Statistics 2026-02-26 Reuben Cohn-Gordon , Uroš Seljak , Dries Sels

Hamiltonian Monte Carlo (HMC) algorithms which combine numerical approximation of Hamiltonian dynamics on finite intervals with stochastic refreshment and Metropolis correction are popular sampling schemes, but it is known that they may…

Computation · Statistics 2022-08-16 Peter A. Whalley , Daniel Paulin , Benedict Leimkuhler

Hamiltonian Monte Carlo (HMC) is an efficient method of simulating smooth distributions and has motivated the widely used No-U-turn Sampler (NUTS) and software Stan. We build on NUTS and the technique of "unbiased sampling" to design HMC…

Computation · Statistics 2022-12-26 George M. Leigh , Amanda R. Northrop

In recent years, the Hamiltonian Monte Carlo (HMC) algorithm has been found to work more efficiently compared to other popular Markov Chain Monte Carlo (MCMC) methods (such as random walk Metropolis-Hastings) in generating samples from a…

Computation · Statistics 2014-02-18 Andrew L. Beam , Sujit K. Ghosh , Jon Doyle

Hamiltonian Monte Carlo is a widely used algorithm for sampling from posterior distributions of complex Bayesian models. It can efficiently explore high-dimensional parameter spaces guided by simulated Hamiltonian flows. However, the…

Computation · Statistics 2019-04-29 Lingge Li , Andrew Holbrook , Babak Shahbaba , Pierre Baldi

This paper considers Bayesian parameter estimation of dynamic systems using a Markov Chain Monte Carlo (MCMC) approach. The Metroplis-Hastings (MH) algorithm is employed, and the main contribution of the paper is to examine and illustrate…

Applications · Statistics 2021-10-18 Johannes Hendriks , Adrian Wills , Brett Ninness , Johan Dahlin

Hamiltonian Monte Carlo (HMC) improves the computational efficiency of the Metropolis algorithm by reducing its random walk behavior. Riemannian Manifold HMC (RMHMC) further improves HMC's performance by exploiting the geometric properties…

Computation · Statistics 2015-06-22 Shiwei Lan , Vassilios Stathopoulos , Babak Shahbaba , Mark Girolami

We propose a hybrid Monte Carlo (HMC) technique applicable to high-dimensional multivariate normal distributions that effectively samples along chaotic trajectories. The method is predicated on the freedom of choice of the HMC momentum…

Data Analysis, Statistics and Probability · Physics 2016-04-26 Nirag Kadakia

For big data analysis, high computational cost for Bayesian methods often limits their applications in practice. In recent years, there have been many attempts to improve computational efficiency of Bayesian inference. Here we propose an…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

One of the open challenges in quantum computing is to find meaningful and practical methods to leverage quantum computation to accelerate classical machine learning workflows. A ubiquitous problem in machine learning workflows is sampling…

Quantum Physics · Physics 2024-08-08 Owen Lockwood , Peter Weiss , Filip Aronshtein , Guillaume Verdon

Hamiltonian Monte Carlo (HMC) is a powerful Markov Chain Monte Carlo (MCMC) method for sampling from complex high-dimensional continuous distributions. However, in many situations it is necessary or desirable to combine HMC with other…

Computation · Statistics 2022-01-24 Guangyao Zhou

In this paper we propose to evaluate and compare Markov chain Monte Carlo (MCMC) methods to estimate the parameters in a generalized extreme value model. We employed the Bayesian approach using traditional Metropolis-Hastings methods,…

Computation · Statistics 2016-11-03 Marcelo Hartmann , Ricardo Ehlers

The hybrid Monte Carlo (HMC) algorithm is applied for the Bayesian inference of the stochastic volatility (SV) model. We use the HMC algorithm for the Markov chain Monte Carlo updates of volatility variables of the SV model. First we…

Computational Finance · Quantitative Finance 2010-12-30 Tetsuya Takaishi

Hamiltonian dynamics can be used to produce distant proposals for the Metropolis algorithm, thereby avoiding the slow exploration of the state space that results from the diffusive behaviour of simple random-walk proposals. Though…

Computation · Statistics 2021-06-30 Radford M. Neal

We investigate the properties of the Hybrid Monte-Carlo algorithm (HMC) in high dimensions. HMC develops a Markov chain reversible w.r.t. a given target distribution $\Pi$ by using separable Hamiltonian dynamics with potential $-\log\Pi$.…

Markov chain Monte Carlo (MCMC) algorithms have long been the main workhorses of Bayesian inference. Among them, Hamiltonian Monte Carlo (HMC) has recently become very popular due to its efficiency resulting from effective use of the…

Computation · Statistics 2021-06-18 Ossi Räisä , Antti Koskela , Antti Honkela

We introduce a Hamiltonian Monte Carlo (HMC) methodology based on a randomized selection of integration times, referred to as eHMC, where "e" stands for empirical. The approach relies on an offline calibration phase that leverages…

Computation · Statistics 2026-05-25 Changye Wu , Pierre Pudlo , Christian P. Robert , Julien Stoehr

Hamiltonian Monte Carlo (HMC) is a widely deployed method to sample from high-dimensional distributions in Statistics and Machine learning. HMC is known to run very efficiently in practice and its popular second-order "leapfrog"…

Data Structures and Algorithms · Computer Science 2018-08-13 Oren Mangoubi , Nisheeth K. Vishnoi