English
Related papers

Related papers: The Fundamental Incompatibility of Hamiltonian Mon…

200 papers

Hamiltonian Monte Carlo (HMC) samples efficiently from high-dimensional posterior distributions with proposed parameter draws obtained by iterating on a discretized version of the Hamiltonian dynamics. The iterations make HMC…

Computation · Statistics 2019-05-03 Khue-Dung Dang , Matias Quiroz , Robert Kohn , Minh-Ngoc Tran , Mattias Villani

When properly tuned, Hamiltonian Monte Carlo scales to some of the most challenging high-dimensional problems at the frontiers of applied statistics, but when that tuning is suboptimal the performance leaves much to be desired. In this…

Methodology · Statistics 2016-04-05 Michael Betancourt

We present a new Subset Simulation approach using Hamiltonian neural network-based Monte Carlo sampling for reliability analysis. The proposed strategy combines the superior sampling of the Hamiltonian Monte Carlo method with…

Machine Learning · Statistics 2024-01-11 Denny Thaler , Somayajulu L. N. Dhulipala , Franz Bamer , Bernd Markert , Michael D. Shields

Hamiltonian Monte Carlo is a prominent Markov Chain Monte Carlo algorithm, which employs symplectic integrators to sample from high dimensional target distributions in many applications, such as statistical mechanics, Bayesian statistics…

Numerical Analysis · Mathematics 2025-02-13 Geoffrey McGregor , Andy T. S. Wan

Hamiltonian Monte Carlo is a widely used algorithm for sampling from posterior distributions of complex Bayesian models. It can efficiently explore high-dimensional parameter spaces guided by simulated Hamiltonian flows. However, the…

Computation · Statistics 2019-04-29 Lingge Li , Andrew Holbrook , Babak Shahbaba , Pierre Baldi

Hamiltonian Monte Carlo (HMC) has been widely adopted in the statistics community because of its ability to sample high-dimensional distributions much more efficiently than other Metropolis-based methods. Despite this, HMC often performs…

Computation · Statistics 2019-11-19 Arya A. Pourzanjani , Linda R. Petzold

Traditionally, the field of computational Bayesian statistics has been divided into two main subfields: variational methods and Markov chain Monte Carlo (MCMC). In recent years, however, several methods have been proposed based on combining…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

The paper proposes a Riemannian Manifold Hamiltonian Monte Carlo sampler to resolve the shortcomings of existing Monte Carlo algorithms when sampling from target densities that may be high dimensional and exhibit strong correlations. The…

Computation · Statistics 2019-12-18 Mark Girolami , Ben Calderhead , Siu A. Chin

For big data analysis, high computational cost for Bayesian methods often limits their applications in practice. In recent years, there have been many attempts to improve computational efficiency of Bayesian inference. Here we propose an…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

Hamiltonian Monte Carlo (HMC) is a Markov chain algorithm for sampling from a high-dimensional distribution with density $e^{-f(x)}$, given access to the gradient of $f$. A particular case of interest is that of a $d$-dimensional Gaussian…

Machine Learning · Statistics 2022-09-27 Simon Apers , Sander Gribling , Dániel Szilágyi

We present a Hamiltonian Monte Carlo algorithm to sample from multivariate Gaussian distributions in which the target space is constrained by linear and quadratic inequalities or products thereof. The Hamiltonian equations of motion can be…

Computation · Statistics 2013-06-06 Ari Pakman , Liam Paninski

Sampling-based inference has seen a surge of interest in recent years. Hamiltonian Monte Carlo (HMC) has emerged as a powerful algorithm that leverages concepts from Hamiltonian dynamics to efficiently explore complex target distributions.…

Computation · Statistics 2026-04-07 Arghya Mukherjee , Dootika Vats

Hamiltonian Monte Carlo has emerged as a standard tool for posterior computation. In this article, we present an extension that can efficiently explore target distributions with discontinuous densities. Our extension in particular enables…

Computation · Statistics 2020-06-09 Akihiko Nishimura , David Dunson , Jianfeng Lu

Optimization algorithms and Monte Carlo sampling algorithms have provided the computational foundations for the rapid growth in applications of statistical machine learning in recent years. There is, however, limited theoretical…

Machine Learning · Statistics 2022-06-08 Yi-An Ma , Yuansi Chen , Chi Jin , Nicolas Flammarion , Michael I. Jordan

In this paper we address the widely-experienced difficulty in tuning Hamiltonian-based Monte Carlo samplers. We develop an algorithm that allows for the adaptation of Hamiltonian and Riemann manifold Hamiltonian Monte Carlo samplers using…

Computation · Statistics 2013-02-26 ziyu wang , Shakir Mohamed , Nando de Freitas

Nested sampling is a powerful approach to Bayesian inference ultimately limited by the computationally demanding task of sampling from a heavily constrained probability distribution. An effective algorithm in its own right, Hamiltonian…

Data Analysis, Statistics and Probability · Physics 2015-03-02 M. J. Betancourt

This paper concerns the approximation of smooth, high-dimensional functions from limited samples using polynomials. This task lies at the heart of many applications in computational science and engineering - notably, some of those arising…

Numerical Analysis · Mathematics 2023-11-07 Ben Adcock , Simone Brugiapaglia

The Hamiltonian Monte Carlo (HMC) method has been recognized as a powerful sampling tool in computational statistics. We show that performance of HMC can be significantly improved by incorporating importance sampling and an irreversible…

Computation · Statistics 2019-07-26 Tijana Radivojević , Elena Akhmatskaya

Hamiltonian Monte Carlo (HMC) has been progressively incorporated within the statistician's toolbox as an alternative sampling method in settings when standard Metropolis-Hastings is inefficient. HMC generates a Markov chain on an augmented…

Computation · Statistics 2026-02-09 Julien Stoehr , Alan Benson , Nial Friel

Hamiltonian Monte Carlo (HMC) is a state of the art method for sampling from distributions with differentiable densities, but can converge slowly when applied to challenging multimodal problems. Running HMC with a time varying Hamiltonian,…

Machine Learning · Statistics 2026-02-26 Reuben Cohn-Gordon , Uroš Seljak , Dries Sels
‹ Prev 1 2 3 10 Next ›