English
Related papers

Related papers: Identifying the Optimal Integration Time in Hamilt…

200 papers

Hamiltonian Monte Carlo (HMC) and related algorithms have become routinely used in Bayesian computation. In this article, we present a simple and provably accurate method to improve the efficiency of HMC and related algorithms with…

Computation · Statistics 2020-03-10 Akihiko Nishimura , David Dunson

Hamiltonian Monte Carlo (HMC) is an efficient Bayesian sampling method that can make distant proposals in the parameter space by simulating a Hamiltonian dynamical system. Despite its popularity in machine learning and data science, HMC is…

Machine Learning · Statistics 2020-09-02 Ziming Liu , Zheng Zhang

Markov Chain Monte Carlo (MCMC) methods for sampling probability density functions (combined with abundant computational resources) have transformed the sciences, especially in performing probabilistic inferences, or fitting models to data.…

Instrumentation and Methods for Astrophysics · Physics 2018-05-23 David W. Hogg , Daniel Foreman-Mackey

Hamiltonian Monte Carlo provides efficient Markov transitions at the expense of introducing two free parameters: a step size and total integration time. Because the step size controls discretization error it can be readily tuned to achieve…

Methodology · Statistics 2013-04-09 M. J. Betancourt

The Hamiltonian Monte Carlo (HMC) method has been recognized as a powerful sampling tool in computational statistics. We show that performance of HMC can be significantly improved by incorporating importance sampling and an irreversible…

Computation · Statistics 2019-07-26 Tijana Radivojević , Elena Akhmatskaya

We investigate the use of a Hamiltonian Monte Carlo to map out the posterior density function for supermassive black hole binaries. While previous Markov Chain Monte Carlo (MCMC) methods, such as Metropolis-Hastings MCMC, have been…

General Relativity and Quantum Cosmology · Physics 2019-08-19 Edward K. Porter , Jérôme Carré

We perform a comprehensive analysis of the quantum-enhanced Monte Carlo method [Nature, 619, 282-287 (2023)], aimed at identifying the optimal working point of the algorithm. We observe an optimal mixing Hamiltonian strength and analyze the…

Quantum Physics · Physics 2025-07-01 Johannes Christmann , Petr Ivashkov , Mattia Chiurco , Guglielmo Mazzola

Hamiltonian Monte Carlo (HMC) is an efficient method of simulating smooth distributions and has motivated the widely used No-U-turn Sampler (NUTS) and software Stan. We build on NUTS and the technique of "unbiased sampling" to design HMC…

Computation · Statistics 2022-12-26 George M. Leigh , Amanda R. Northrop

Hamiltonian Monte Carlo (HMC) has emerged as a powerful Markov Chain Monte Carlo (MCMC) method to sample from complex continuous distributions. However, a fundamental limitation of HMC is that it can not be applied to distributions with…

Computation · Statistics 2021-12-10 Guangyao Zhou

Owing to their favorable scaling with dimensionality, Monte Carlo (MC) methods have become the tool of choice for numerical integration across the quantitative sciences. Almost invariably, efficient MC integration schemes are strictly…

Statistical Mechanics · Physics 2010-01-29 Artur B. Adib

We propose a methodology to parallelize Hamiltonian Monte Carlo estimators. Our approach constructs a pair of Hamiltonian Monte Carlo chains that are coupled in such a way that they meet exactly after some random number of iterations. These…

Computation · Statistics 2018-08-28 Jeremy Heng , Pierre E. Jacob

In this paper we propose to evaluate and compare Markov chain Monte Carlo (MCMC) methods to estimate the parameters in a generalized extreme value model. We employed the Bayesian approach using traditional Metropolis-Hastings methods,…

Computation · Statistics 2016-11-03 Marcelo Hartmann , Ricardo Ehlers

Traditionally, the field of computational Bayesian statistics has been divided into two main subfields: variational methods and Markov chain Monte Carlo (MCMC). In recent years, however, several methods have been proposed based on combining…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

In this article, we analyze Hamiltonian Monte Carlo (HMC) by placing it in the setting of Riemannian geometry using the Jacobi metric, so that each step corresponds to a geodesic on a suitable Riemannian manifold. We then combine the notion…

Probability · Mathematics 2015-05-21 Susan Holmes , Simon Rubinstein-Salzedo , Christof Seiler

In machine learning and statistics, probabilistic inference involving multimodal distributions is quite difficult. This is especially true in high dimensional problems, where most existing algorithms cannot easily move from one mode to…

Computation · Statistics 2015-06-22 Shiwei Lan , Jeffrey Streets , Babak Shahbaba

With the recently increased interest in probabilistic models, the efficiency of an underlying sampler becomes a crucial consideration. Hamiltonian Monte Carlo (HMC) is one popular option for models of this kind. Performance of the method,…

The main purpose of this paper is to facilitate the communication between the Analytic, Probabilistic and Algorithmic communities. We present a proof of convergence of the Hamiltonian (Hybrid) Monte Carlo algorithm from the point of view of…

Computation · Statistics 2021-02-05 Soumyadip Ghosh , Yingdong Lu , Tomasz Nowicki

Hamiltonian Monte Carlo (HMC) is a powerful algorithm to sample latent variables from Bayesian models. The advent of probabilistic programming languages (PPLs) frees users from writing inference algorithms and lets users focus on modeling.…

Machine Learning · Computer Science 2023-06-05 Jinlin Lai , Javier Burroni , Hui Guan , Daniel Sheldon

We provide quantitative upper bounds on the total variation mixing time of the Markov chain corresponding to the unadjusted Hamiltonian Monte Carlo (uHMC) algorithm. For two general classes of models and fixed time discretization step size…

Probability · Mathematics 2022-10-13 Nawaf Bou-Rabee , Andreas Eberle

We introduce the Hamiltonian Monte Carlo Particle Swarm Optimizer (HMC-PSO), an optimization algorithm that reaps the benefits of both Exponentially Averaged Momentum PSO and HMC sampling. The coupling of the position and velocity of each…

Machine Learning · Computer Science 2022-06-29 Omatharv Bharat Vaidya , Rithvik Terence DSouza , Snehanshu Saha , Soma Dhavala , Swagatam Das
‹ Prev 1 3 4 5 6 7 10 Next ›