English
Related papers

Related papers: Two-scale coupling for preconditioned Hamiltonian …

200 papers

In this article, we analyze Hamiltonian Monte Carlo (HMC) by placing it in the setting of Riemannian geometry using the Jacobi metric, so that each step corresponds to a geodesic on a suitable Riemannian manifold. We then combine the notion…

Probability · Mathematics 2015-05-21 Susan Holmes , Simon Rubinstein-Salzedo , Christof Seiler

We study Hamiltonian Monte Carlo (HMC) samplers based on splitting the Hamiltonian $H$ as $H_0(\theta,p)+U_1(\theta)$, where $H_0$ is quadratic and $U_1$ small. We show that, in general, such samplers suffer from stepsize stability…

Computation · Statistics 2022-07-18 Fernando Casas , Jesús María Sanz-Serna , Luke Shaw

We investigate the properties of the Hybrid Monte-Carlo algorithm (HMC) in high dimensions. HMC develops a Markov chain reversible w.r.t. a given target distribution $\Pi$ by using separable Hamiltonian dynamics with potential $-\log\Pi$.…

We generalize the Hamiltonian Monte Carlo algorithm with a stack of neural network layers and evaluate its ability to sample from different topologies in a two dimensional lattice gauge theory. We demonstrate that our model is able to…

High Energy Physics - Lattice · Physics 2021-05-10 Sam Foreman , Xiao-Yong Jin , James C. Osborn

Hamiltonian Monte Carlo (HMC) is a powerful Markov chain Monte Carlo (MCMC) method for performing approximate inference in complex probabilistic models of continuous variables. In common with many MCMC methods, however, the standard HMC…

Computation · Statistics 2017-04-12 Matthew M. Graham , Amos J. Storkey

Contraction in Wasserstein 1-distance with explicit rates is established for generalized Hamiltonian Monte Carlo with stochastic gradients under possibly nonconvex conditions. The algorithms considered include splitting schemes of kinetic…

Probability · Mathematics 2024-09-16 Martin Chak , Pierre Monmarché

Hamiltonian Monte Carlo (HMC) is a state-of-the-art Markov chain Monte Carlo sampling algorithm for drawing samples from smooth probability densities over continuous spaces. We study the variant most widely used in practice, Metropolized…

Machine Learning · Statistics 2021-01-12 Yuansi Chen , Raaz Dwivedi , Martin J. Wainwright , Bin Yu

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo (MCMC) approach that exhibits favourable exploration properties in high-dimensional models such as neural networks. Unfortunately, HMC has limited use in large-data regimes and…

Machine Learning · Statistics 2020-10-15 Adam D. Cobb , Brian Jalaian

Latent variable models are increasingly used in economics for high-dimensional categorical data like text and surveys. We demonstrate the effectiveness of Hamiltonian Monte Carlo (HMC) with parallelized automatic differentiation for…

Econometrics · Economics 2024-03-04 Szymon Sacher , Laura Battaglia , Stephen Hansen

We establish $L_q$ convergence for Hamiltonian Monte Carlo algorithms. More specifically, under mild conditions for the associated Hamiltonian motion, we show that the outputs of the algorithms converge (strongly for $2\le q<\infty$ and…

Classical Analysis and ODEs · Mathematics 2022-06-07 Soumyadip Ghosh , Yingdong Lu , Tomasz Nowicki

Sampling-based inference has seen a surge of interest in recent years. Hamiltonian Monte Carlo (HMC) has emerged as a powerful algorithm that leverages concepts from Hamiltonian dynamics to efficiently explore complex target distributions.…

Computation · Statistics 2026-04-07 Arghya Mukherjee , Dootika Vats

We address a long standing issue and determine the decorrelation efficiency of the Hybrid Monte Carlo algorithm (HMC), for full QCD with Wilson fermions, with respect to vacuum topology. On the basis of five state-of-the art QCD vacuum…

High Energy Physics - Lattice · Physics 2008-11-26 B. Alles , G. Bali , M. D'Elia , A. Di Giacomo , N. Eicker , S. Guesken , H. Hoeber , Th. Lippert , K. Schilling , A. Spitz , T. Struckmann , P. Ueberholz , J. Viehoff

When properly tuned, Hamiltonian Monte Carlo scales to some of the most challenging high-dimensional problems at the frontiers of applied statistics, but when that tuning is suboptimal the performance leaves much to be desired. In this…

Methodology · Statistics 2016-04-05 Michael Betancourt

We study Hamilton Jacobi Bellman equations in an infinite dimensional Hilbert space, with Lipschitz coefficients, where the Hamiltonian has superquadratic growth with respect to the derivative of the value function, and the final condition…

Probability · Mathematics 2016-11-28 Federica Masiero , Adrien Richou

Hamiltonian Monte Carlo (HMC) is a state of the art method for sampling from distributions with differentiable densities, but can converge slowly when applied to challenging multimodal problems. Running HMC with a time varying Hamiltonian,…

Machine Learning · Statistics 2026-02-26 Reuben Cohn-Gordon , Uroš Seljak , Dries Sels

Hybrid Monte-Carlo (HMC) sampling smoother is a fully non-Gaussian four-dimensional data assimilation algorithm that works by directly sampling the posterior distribution formulated in the Bayesian framework. The smoother in its original…

Numerical Analysis · Computer Science 2016-12-21 Ahmed Attia , Razvan Stefanescu , Adrian Sandu

We apply the Worldvolume Hybrid Monte Carlo (WV-HMC) method [arXiv:2012.08468] to the two-dimensional Hubbard model, which is known to suffer from a severe sign problem when the system is doped (away from half filling). We show that the…

High Energy Physics - Lattice · Physics 2026-05-15 Masafumi Fukuma , Yusuke Namekawa

In the framework of uncertainty quantification, we consider a quantity of interest which depends non-smoothly on the high-dimensional parameter representing the uncertainty. We show that, in this situation, the multilevel Monte Carlo…

Numerical Analysis · Mathematics 2017-06-27 Laura Scarabosio

The Bouncy Particle Sampler is a Markov chain Monte Carlo method based on a nonreversible piecewise deterministic Markov process. In this scheme, a particle explores the state space of interest by evolving according to a linear dynamics…

Computation · Statistics 2020-12-24 George Deligiannidis , Daniel Paulin , Alexandre Bouchard-Côté , Arnaud Doucet

Tuning the durations of the Hamiltonian flow in Hamiltonian Monte Carlo (also called Hybrid Monte Carlo) (HMC) involves a tradeoff between computational cost and sampling quality, which is typically challenging to resolve in a satisfactory…

Probability · Mathematics 2017-09-08 Nawaf Bou-Rabee , Jesus Maria Sanz-Serna