English
Related papers

Related papers: Curvature and Concentration of Hamiltonian Monte C…

200 papers

In recent years, the Hamiltonian Monte Carlo (HMC) algorithm has been found to work more efficiently compared to other popular Markov Chain Monte Carlo (MCMC) methods (such as random walk Metropolis-Hastings) in generating samples from a…

Computation · Statistics 2014-02-18 Andrew L. Beam , Sujit K. Ghosh , Jon Doyle

We present a geometrically enhanced Markov chain Monte Carlo sampler for networks based on a discrete curvature measure defined on graphs. Specifically, we incorporate the concept of graph Forman curvature into sampling procedures on both…

Machine Learning · Statistics 2021-10-12 John Sigbeku , Emil Saucan , Anthea Monod

In this paper, we propose Barrier Hamiltonian Monte Carlo (BHMC), a version of the HMC algorithm which aims at sampling from a Gibbs distribution $\pi$ on a manifold $\mathrm{M}$, endowed with a Hessian metric $\mathfrak{g}$ derived from a…

Machine Learning · Statistics 2023-10-31 Maxence Noble , Valentin De Bortoli , Alain Durmus

We introduce a novel definition of curvature for hypergraphs, a natural generalization of graphs, by introducing a multi-marginal optimal transport problem for a naturally defined random walk on the hypergraph. This curvature, termed…

Information Theory · Computer Science 2018-03-26 Shahab Asoodeh , Tingran Gao , James Evans

Tuning the durations of the Hamiltonian flow in Hamiltonian Monte Carlo (also called Hybrid Monte Carlo) (HMC) involves a tradeoff between computational cost and sampling quality, which is typically challenging to resolve in a satisfactory…

Probability · Mathematics 2017-09-08 Nawaf Bou-Rabee , Jesus Maria Sanz-Serna

In this work we present a new and efficient Bayesian method for nonlinear three dimensional large scale structure inference. We employ a Hamiltonian Monte Carlo (HMC) sampler to obtain samples from a multivariate highly non-Gaussian…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-14 J. Jasche , F. S. Kitaura

Hamiltonian Monte Carlo (HMC) is a powerful Markov Chain Monte Carlo (MCMC) method for sampling from complex high-dimensional continuous distributions. However, in many situations it is necessary or desirable to combine HMC with other…

Computation · Statistics 2022-01-24 Guangyao Zhou

We present a Hamiltonian Monte Carlo algorithm to sample from multivariate Gaussian distributions in which the target space is constrained by linear and quadratic inequalities or products thereof. The Hamiltonian equations of motion can be…

Computation · Statistics 2013-06-06 Ari Pakman , Liam Paninski

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo (MCMC) algorithm that avoids the random walk behavior and sensitivity to correlated parameters that plague many MCMC methods by taking a series of steps informed by first-order…

Computation · Statistics 2015-03-19 Matthew D. Hoffman , Andrew Gelman

High-quality random samples of quantum states are needed for a variety of tasks in quantum information and quantum computation. Searching the high-dimensional quantum state space for a global maximum of an objective function with many local…

Quantum Physics · Physics 2015-04-28 Yi-Lin Seah , Jiangwei Shang , Hui Khoon Ng , David John Nott , Berthold-Georg Englert

This paper considers Bayesian parameter estimation of dynamic systems using a Markov Chain Monte Carlo (MCMC) approach. The Metroplis-Hastings (MH) algorithm is employed, and the main contribution of the paper is to examine and illustrate…

Applications · Statistics 2021-10-18 Johannes Hendriks , Adrian Wills , Brett Ninness , Johan Dahlin

Bayesian formulation of modern day signal processing problems has called for improved Markov chain Monte Carlo (MCMC) sampling algorithms for inference. The need for efficient sampling techniques has become indispensable for high…

Computation · Statistics 2025-10-28 Apratim Shukla , Dootika Vats , Eric C. Chi

Markov chain Monte Carlo is a class of algorithms for drawing Markovian samples from high-dimensional target densities to approximate the numerical integration associated with computing statistical expectation, especially in Bayesian…

Computation · Statistics 2018-03-28 Khoa T. Tran

Recent advances in stochastic gradient techniques have made it possible to estimate posterior distributions from large datasets via Markov Chain Monte Carlo (MCMC). However, when the target posterior is multimodal, mixing performance is…

Machine Learning · Statistics 2018-01-12 Yizhe Zhang , Changyou Chen , Zhe Gan , Ricardo Henao , Lawrence Carin

The main purpose of this paper is to facilitate the communication between the Analytic, Probabilistic and Algorithmic communities. We present a proof of convergence of the Hamiltonian (Hybrid) Monte Carlo algorithm from the point of view of…

Computation · Statistics 2021-02-05 Soumyadip Ghosh , Yingdong Lu , Tomasz Nowicki

Hamiltonian Monte Carlo is a powerful algorithm for sampling from difficult-to-normalize posterior distributions. However, when the geometry of the posterior is unfavorable, it may take many expensive evaluations of the target distribution…

We generalise the coarse Ricci curvature method of Ollivier by considering the coarse Ricci curvature of multiple steps in the Markov chain. This implies new spectral bounds and concentration inequalities. We also extend this approach to…

Probability · Mathematics 2015-10-09 Daniel Paulin

We obtain several quantitative bounds on the mixing properties of the Hamiltonian Monte Carlo (HMC) algorithm for a strongly log-concave target distribution $\pi$ on $\mathbb{R}^{d}$, showing that HMC mixes quickly in this setting. One of…

Probability · Mathematics 2017-08-24 Oren Mangoubi , Aaron Smith

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high…

Machine Learning · Statistics 2025-09-11 Ponkrshnan Thiagarajan , Tamer A. Zaki , Michael D. Shields

Hamiltonian Monte Carlo (HMC) algorithms are among the most widely used sampling methods in high dimensional settings, yet their convergence properties are poorly understood in divergences that quantify relative density mismatch, such as…

Machine Learning · Statistics 2026-01-15 Nawaf Bou-Rabee , Siddharth Mitra , Andre Wibisono
‹ Prev 1 4 5 6 7 8 10 Next ›