English
Related papers

Related papers: The Physicist's Guide to the HMC

200 papers

Sequential Monte Carlo (SMC) methods are a widely used set of computational tools for inference in non-linear non-Gaussian state-space models. We propose a new SMC algorithm to compute the expectation of additive functionals recursively.…

Methodology · Statistics 2010-12-27 Pierre Del Moral , Arnaud Doucet , Sumeetpal Singh

We consider parallel asynchronous Markov Chain Monte Carlo (MCMC) sampling for problems where we can leverage (stochastic) gradients to define continuous dynamics which explore the target distribution. We outline a solution strategy for…

Machine Learning · Statistics 2016-12-09 Jost Tobias Springenberg , Aaron Klein , Stefan Falkner , Frank Hutter

In many problems, complex non-Gaussian and/or nonlinear models are required to accurately describe a physical system of interest. In such cases, Monte Carlo algorithms are remarkably flexible and extremely powerful approaches to solve such…

Computation · Statistics 2015-04-23 Thi Le Thu Nguyen , Francois Septier , Gareth W. Peters , Yves Delignon

We present a general-purpose method to train Markov chain Monte Carlo kernels, parameterized by deep neural networks, that converge and mix quickly to their target distribution. Our method generalizes Hamiltonian Monte Carlo and is trained…

Machine Learning · Statistics 2018-03-06 Daniel Levy , Matthew D. Hoffman , Jascha Sohl-Dickstein

Multifidelity Monte Carlo methods rely on a hierarchy of possibly less accurate but statistically correlated simplified or reduced models, in order to accelerate the estimation of statistics of high-fidelity models without compromising the…

Numerical Analysis · Mathematics 2020-10-29 Alessio Quaglino , Simone Pezzuto , Rolf Krause

We describe a new Hybrid Monte Carlo (HMC) algorithm for dynamical overlap fermions, which improves the rate of topological index changes by adding an additional (intensive) term to the action for the molecular dynamics part of the…

High Energy Physics - Lattice · Physics 2012-02-28 Nigel Cundy , Weonjong Lee

Hamiltonian Monte Carlo is a powerful algorithm for sampling from difficult-to-normalize posterior distributions. However, when the geometry of the posterior is unfavorable, it may take many expensive evaluations of the target distribution…

Three possibilities to speed up the Hybrid Monte Carlo algorithm are investigated. Changing the step-size adaptively brings no practical gain. On the other hand, substantial improvements result from using an approximate Hamiltonian or a…

High Energy Physics - Lattice · Physics 2009-10-28 Philippe de Forcrand , Tetsuya Takaishi

We present a hybrid method for time-dependent particle transport that combines Monte Carlo (MC) estimation with a deterministic discrete ordinates (\(S_N\)) solve, augmented by quasi-Monte Carlo (QMC) sampling. For spatial discretizations,…

Numerical Analysis · Mathematics 2025-11-24 Johannes Krotz , Ryan G. McClarren

The classical approaches to numerically integrating a function $f$ are Monte Carlo (MC) and quasi-Monte Carlo (QMC) methods. MC methods use random samples to evaluate $f$ and have error $O(\sigma(f)/\sqrt{n})$, where $\sigma(f)$ is the…

Data Structures and Algorithms · Computer Science 2024-08-14 Nikhil Bansal , Haotian Jiang

In this article, we describe a {\tt R} package for sampling from an empirical likelihood-based posterior using a Hamiltonian Monte Carlo method. Empirical likelihood-based methodologies have been used in Bayesian modeling of many problems…

Other Statistics · Statistics 2022-09-07 Dang Trung Kien , Neo Han Wei , Sanjay Chaudhuri

We introduce the Hamming Ball Sampler, a novel Markov Chain Monte Carlo algorithm, for efficient inference in statistical models involving high-dimensional discrete state spaces. The sampling scheme uses an auxiliary variable construction…

Methodology · Statistics 2015-05-05 Michalis K. Titsias , Christopher Yau

The stochastic volatility model is one of volatility models which infer latent volatility of asset returns. The Bayesian inference of the stochastic volatility (SV) model is performed by the hybrid Monte Carlo (HMC) algorithm which is…

Computational Finance · Quantitative Finance 2014-08-06 Tetsuya Takaishi

Particle Markov Chain Monte Carlo (PMCMC) is a general computational approach to Bayesian inference for general state space models. Our article scales up PMCMC in terms of the number of observations and parameters by generating the…

Methodology · Statistics 2023-07-04 David Gunawan , Chris Carter , Robert Kohn

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo (MCMC) algorithm that avoids the random walk behavior and sensitivity to correlated parameters that plague many MCMC methods by taking a series of steps informed by first-order…

Computation · Statistics 2015-03-19 Matthew D. Hoffman , Andrew Gelman

We propose a novel sampling framework for inference in probabilistic models: an active learning approach that converges more quickly (in wall-clock time) than Markov chain Monte Carlo (MCMC) benchmarks. The central challenge in…

Machine Learning · Statistics 2014-11-04 Tom Gunter , Michael A. Osborne , Roman Garnett , Philipp Hennig , Stephen J. Roberts

In this paper, we suggest a novel sampling method for Monte Carlo molecular simulations. In order to perform efficient sampling of molecular systems, it is advantageous to avoid extremely high energy configurations while also retaining the…

Computational Physics · Physics 2019-07-18 Katsuhiro Endo , Daisuke Yuhara , Kenji Yasuoka

This technical report presents pseudo-code for a Riemannian manifold Hamiltonian Monte Carlo (RMHMC) method to efficiently simulate samples from $N$-dimensional posterior distributions $p(x|y)$, where $x \in R^N$ is drawn from a Gaussian…

Machine Learning · Statistics 2018-10-30 Ulrich Paquet , Marco Fraccaro

We consider Metropolis Hastings MCMC in cases where the log of the ratio of target distributions is replaced by an estimator. The estimator is based on m samples from an independent online Monte Carlo simulation. Under some conditions on…

Computation · Statistics 2012-06-01 Geoff K. Nicholls , Colin Fox , Alexis Muir Watt

A sensible application of the Hybrid Monte Carlo (HMC) method is often hindered by the presence of large - or even infinite - potential barriers. These potential barriers separate the configuration space into distinct sectors and can lead…

Strongly Correlated Electrons · Physics 2025-08-06 Finn L. Temmen , Evan Berkowitz , Anthony Kennedy , Thomas Luu , Johann Ostmeyer , Xinhao Yu