English
Related papers

Related papers: Learning Hamiltonian Monte Carlo in R

200 papers

Hamiltonian Monte Carlo (HMC) and related algorithms have become routinely used in Bayesian computation. In this article, we present a simple and provably accurate method to improve the efficiency of HMC and related algorithms with…

Computation · Statistics 2020-03-10 Akihiko Nishimura , David Dunson

Hamiltonian Monte Carlo (HMC) has been progressively incorporated within the statistician's toolbox as an alternative sampling method in settings when standard Metropolis-Hastings is inefficient. HMC generates a Markov chain on an augmented…

Computation · Statistics 2026-02-09 Julien Stoehr , Alan Benson , Nial Friel

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo method that allows to sample high dimensional probability measures. It relies on the integration of the Hamiltonian dynamics to propose a move which is then accepted or rejected…

Numerical Analysis · Mathematics 2023-08-08 Tony Lelièvre , Régis Santet , Gabriel Stoltz

Hamiltonian Monte Carlo (HMC) is a very popular and generic collection of Markov chain Monte Carlo (MCMC) algorithms. One explanation for the popularity of HMC algorithms is their excellent performance as the dimension $d$ of the target…

Probability · Mathematics 2018-09-05 Oren Mangoubi , Natesh S. Pillai , Aaron Smith

Hamiltonian Monte Carlo (HMC) is a powerful Markov chain Monte Carlo (MCMC) method for performing approximate inference in complex probabilistic models of continuous variables. In common with many MCMC methods, however, the standard HMC…

Computation · Statistics 2017-04-12 Matthew M. Graham , Amos J. Storkey

Hamiltonian Monte Carlo (HMC) is arguably the dominant statistical inference algorithm used in most popular "first-order differentiable" Probabilistic Programming Languages (PPLs). However, the fact that HMC uses derivative information…

Computation · Statistics 2019-05-31 Bradley Gram-Hansen , Yuan Zhou , Tobias Kohn , Tom Rainforth , Hongseok Yang , Frank Wood

Hamiltonian Monte Carlo (HMC) is a powerful Markov chain Monte Carlo (MCMC) algorithm for estimating expectations with respect to continuous un-normalized probability distributions. MCMC estimators typically have higher variance than…

Computation · Statistics 2020-03-04 Dan Piponi , Matthew D. Hoffman , Pavel Sountsov

We propose a new framework for Hamiltonian Monte Carlo (HMC) on truncated probability distributions with smooth underlying density functions. Traditional HMC requires computing the gradient of potential function associated with the target…

Machine Learning · Statistics 2017-09-12 Kexin Yi , Finale Doshi-Velez

Markov Chain Monte Carlo (MCMC) algorithms play an important role in statistical inference problems dealing with intractable probability distributions. Recently, many MCMC algorithms such as Hamiltonian Monte Carlo (HMC) and Riemannian…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high…

Machine Learning · Statistics 2025-09-11 Ponkrshnan Thiagarajan , Tamer A. Zaki , Michael D. Shields

Hamiltonian Monte Carlo (HMC) has emerged as a powerful Markov Chain Monte Carlo (MCMC) method to sample from complex continuous distributions. However, a fundamental limitation of HMC is that it can not be applied to distributions with…

Computation · Statistics 2021-12-10 Guangyao Zhou

State space models (SSM) have been widely applied for the analysis and visualization of large sequential datasets. Sequential Monte Carlo (SMC) is a very popular particle-based method to sample latent states from intractable posteriors.…

Machine Learning · Computer Science 2019-01-07 Duo Xu

Markov Chain Monte Carlo (MCMC) is an invaluable means of inference with complicated models, and Hamiltonian Monte Carlo, in particular Riemannian Manifold Hamiltonian Monte Carlo (RMHMC), has demonstrated impressive success in many…

Methodology · Statistics 2015-03-02 M. J. Betancourt

Monte Carlo method is a broad class of computational algorithms that rely on repeated random sampling to obtain numerical results. They are often used in physical and mathematical problems and are most useful when it is difficult or…

Computation · Statistics 2018-09-28 Bochao Jia

Riemannian manifold Hamiltonian Monte Carlo (RMHMC) is a sampling algorithm that seeks to adapt proposals to the local geometry of the posterior distribution. The specific form of the Hamiltonian used in RMHMC necessitates {\it…

Computation · Statistics 2021-11-22 James A. Brofos , Roy R. Lederman

In this paper we propose to evaluate and compare Markov chain Monte Carlo (MCMC) methods to estimate the parameters in a generalized extreme value model. We employed the Bayesian approach using traditional Metropolis-Hastings methods,…

Computation · Statistics 2016-11-03 Marcelo Hartmann , Ricardo Ehlers

Hamiltonian Monte Carlo is a widely used algorithm for sampling from posterior distributions of complex Bayesian models. It can efficiently explore high-dimensional parameter spaces guided by simulated Hamiltonian flows. However, the…

Computation · Statistics 2019-04-29 Lingge Li , Andrew Holbrook , Babak Shahbaba , Pierre Baldi

Bayesian max-margin models have shown superiority in various practical applications, such as text categorization, collaborative prediction, social network link prediction and crowdsourcing, and they conjoin the flexibility of Bayesian…

Machine Learning · Statistics 2016-10-19 Wenbo Hu , Jun Zhu , Bo Zhang

This paper introduces the R package sgmcmc; which can be used for Bayesian inference on problems with large datasets using stochastic gradient Markov chain Monte Carlo (SGMCMC). Traditional Markov chain Monte Carlo (MCMC) methods, such as…

Computation · Statistics 2018-04-16 Jack Baker , Paul Fearnhead , Emily B. Fox , Christopher Nemeth

Hamiltonian Monte Carlo (HMC) is a powerful Markov Chain Monte Carlo (MCMC) method for sampling from complex high-dimensional continuous distributions. However, in many situations it is necessary or desirable to combine HMC with other…

Computation · Statistics 2022-01-24 Guangyao Zhou