English
Related papers

Related papers: Entropy-based adaptive Hamiltonian Monte Carlo

200 papers

The Hamiltonian Monte Carlo method generates samples by introducing a mechanical system that explores the target density. For distributions on manifolds it is not always simple to perform the mechanics as a result of the lack of global…

Computation · Statistics 2019-04-22 Alessandro Barp , Anthony Kennedy , Mark Girolami

We describe a new Hybrid Monte Carlo (HMC) algorithm for dynamical overlap fermions, which improves the rate of topological index changes by adding an additional (intensive) term to the action for the molecular dynamics part of the…

High Energy Physics - Lattice · Physics 2012-02-28 Nigel Cundy , Weonjong Lee

We introduce a recent symplectic integration scheme derived for solving physically motivated systems with non-separable Hamiltonians. We show its relevance to Riemannian manifold Hamiltonian Monte Carlo (RMHMC) and provide an alternative to…

Machine Learning · Statistics 2019-10-15 Adam D. Cobb , Atılım Güneş Baydin , Andrew Markham , Stephen J. Roberts

Bayesian formulation of modern day signal processing problems has called for improved Markov chain Monte Carlo (MCMC) sampling algorithms for inference. The need for efficient sampling techniques has become indispensable for high…

Computation · Statistics 2025-10-28 Apratim Shukla , Dootika Vats , Eric C. Chi

Accept-reject based Markov chain Monte Carlo (MCMC) methods are the workhorse algorithm for Bayesian inference. These algorithms, like Metropolis-Hastings, require choosing a proposal distribution which is typically informed by the desired…

Computation · Statistics 2026-04-21 Dwija Kakkad , Dootika Vats

We propose a splitting Hamiltonian Monte Carlo (SHMC) algorithm, which can be computationally efficient when combined with the random mini-batch strategy. By splitting the potential energy into numerically nonstiff and stiff parts, one…

Numerical Analysis · Mathematics 2022-06-23 Lei Li , Lin Liu , Yuzhou Peng

The hybrid Monte Carlo (HMC) algorithm is used for Bayesian analysis of the generalized autoregressive conditional heteroscedasticity (GARCH) model. The HMC algorithm is one of Markov chain Monte Carlo (MCMC) algorithms and it updates all…

Computational Physics · Physics 2008-12-09 Tetsuya Takaishi

Markov Chain Monte Carlo (MCMC) algorithms are routinely used to draw samples from distributions with intractable normalization constants. However, standard MCMC algorithms do not apply to doubly-intractable distributions in which there are…

Computation · Statistics 2012-07-02 Iain Murray , Zoubin Ghahramani , David MacKay

Generating samples from a continuous probability density is a central algorithmic problem across statistics, engineering, and the sciences. For high-dimensional settings, Hamiltonian Monte Carlo (HMC) is the default algorithm across…

Data Structures and Algorithms · Computer Science 2026-03-25 Matthew S. Zhang , Jason M. Altschuler , Sinho Chewi

Monte Carlo methods represent the "de facto" standard for approximating complicated integrals involving multidimensional target distributions. In order to generate random realizations from the target distribution, Monte Carlo techniques use…

Computation · Statistics 2022-01-21 L. Martino , V. Elvira , D. Luengo , J. Corander

We consider the recently introduced Transformation-based Markov Chain Monte Carlo (TMCMC) (Dutta and Bhattacharya (2014)), a methodology that is designed to update all the parameters simultaneously using some simple deterministic…

Methodology · Statistics 2017-01-24 Kushal Kumar Dey , Sourabh Bhattacharya

Markov chain Monte Carlo (MCMC) methods provide powerful framework for sampling unknown probability measures across a wide range of scientific applications. In some settings, the target distribution is supported on a lower-dimensional…

Numerical Analysis · Mathematics 2026-04-27 Xuyuan Wang , Donglin Han

Bayesian reasoning in linear mixed-effects models (LMMs) is challenging and often requires advanced sampling techniques like Markov chain Monte Carlo (MCMC). A common approach is to write the model in a probabilistic programming language…

Machine Learning · Computer Science 2025-03-25 Jinlin Lai , Justin Domke , Daniel Sheldon

We study the performance of an automated hybrid Monte Carlo (HMC) approach for conditional simulation of a recently proposed, single-parameter Gibbs Markov random field (Gibbs MRF). The MRF is based on a modified version of the planar…

Computational Physics · Physics 2020-07-08 Milan Žukovič , Dionissios T. Hristopulos

We introduce the energy-stepping Monte Carlo (ESMC) method, a Markov chain Monte Carlo (MCMC) algorithm based on the conventional dynamical interpretation of the proposal stage but employing an energy-stepping integrator. The…

Mathematical Physics · Physics 2023-12-13 Ignacio Romero , Michael Ortiz

Probability measures supported on submanifolds can be sampled by adding an extra momentum variable to the state of the system, and discretizing the associated Hamiltonian dynamics with some stochastic perturbation in the extra variable. In…

Numerical Analysis · Mathematics 2019-10-15 Tony Lelièvre , Mathias Rousset , Gabriel Stoltz

Estimating predictive uncertainty is crucial for many computer vision tasks, from image classification to autonomous driving systems. Hamiltonian Monte Carlo (HMC) is an sampling method for performing Bayesian inference. On the other hand,…

Machine Learning · Computer Science 2019-07-03 Diego Vergara , Sergio Hernández , Matias Valdenegro-Toro , Felipe Jorquera

Markov Chain Monte Carlo (MCMC) methods have a drawback when working with a target distribution or likelihood function that is computationally expensive to evaluate, specially when working with big data. This paper focuses on…

Machine Learning · Computer Science 2019-10-22 Asif J. Chowdhury , Gabriel Terejanu

Sampling from high dimensional distributions is a computational bottleneck in many scientific applications. Hamiltonian Monte Carlo (HMC), and in particular the No-U-Turn Sampler (NUTS), are widely used, yet they struggle on problems with a…

Computation · Statistics 2025-05-20 Jakob Robnik , Reuben Cohn-Gordon , Uroš Seljak

The hybrid Monte Carlo (HMC) algorithm is applied for the Bayesian inference of the stochastic volatility (SV) model. We use the HMC algorithm for the Markov chain Monte Carlo updates of volatility variables of the SV model. First we…

Computational Finance · Quantitative Finance 2010-12-30 Tetsuya Takaishi