English
Related papers

Related papers: On $L^q$ Convergence of the Hamiltonian Monte Carl…

200 papers

Although Hamiltonian Monte Carlo has proven an empirical success, the lack of a rigorous theoretical understanding of the algorithm has in many ways impeded both principled developments of the method and use of the algorithm in practice. In…

Methodology · Statistics 2014-10-21 M. J. Betancourt , Simon Byrne , Samuel Livingstone , Mark Girolami

We present a general-purpose method to train Markov chain Monte Carlo kernels, parameterized by deep neural networks, that converge and mix quickly to their target distribution. Our method generalizes Hamiltonian Monte Carlo and is trained…

Machine Learning · Statistics 2018-03-06 Daniel Levy , Matthew D. Hoffman , Jascha Sohl-Dickstein

In this article, we analyze Hamiltonian Monte Carlo (HMC) by placing it in the setting of Riemannian geometry using the Jacobi metric, so that each step corresponds to a geodesic on a suitable Riemannian manifold. We then combine the notion…

Probability · Mathematics 2015-05-21 Susan Holmes , Simon Rubinstein-Salzedo , Christof Seiler

We give two direct, elementary proofs that a Monte Carlo simulation converges to equilibrium provided that appropriate conditions are satisfied. The first proof requires detailed balance while the second is quite general.

Statistical Mechanics · Physics 2009-10-31 Onuttom Narayan , A. P. Young

In particle-based algorithms, the effect of binary collisions is commonly described in a statistical way, using Monte Carlo techniques. It is shown that, in the relativistic regime, stringent constraints should be considered on the sampling…

Plasma Physics · Physics 2009-11-13 F. Peano , M. Marti , L. O. Silva , G. Coppa

Hamiltonian Monte Carlo (HMC) has emerged as a powerful Markov Chain Monte Carlo (MCMC) method to sample from complex continuous distributions. However, a fundamental limitation of HMC is that it can not be applied to distributions with…

Computation · Statistics 2021-12-10 Guangyao Zhou

In this paper we study randomized optimal stopping problems and consider corresponding forward and backward Monte Carlo based optimisation algorithms. In particular we prove the convergence of the proposed algorithms and derive the…

Optimization and Control · Mathematics 2020-02-05 Christian Bayer , Denis Belomestny , Paul Hager , Paolo Pigato , John Schoenmakers

In high dimensions, reflective Hamiltonian Monte Carlo with inexact reflections exhibits slow mixing when the particle ensemble is initialised from a Dirac delta distribution and the uniform distribution is targeted. By quantifying the…

Machine Learning · Statistics 2026-03-20 Namu Kroupa , Gábor Csányi , Will Handley

Hamiltonian Monte Carlo (HMC) is a widely deployed method to sample from high-dimensional distributions in Statistics and Machine learning. HMC is known to run very efficiently in practice and its popular second-order "leapfrog"…

Data Structures and Algorithms · Computer Science 2018-08-13 Oren Mangoubi , Nisheeth K. Vishnoi

We discuss $QCD$ in the Hamiltonian frame work. We treat finite density $QCD$ in the strong coupling regime. We present a parton-model inspired regularisation scheme to treat the spectrum ($\theta$-angles) and distribution functions in…

High Energy Physics - Phenomenology · Physics 2009-10-31 H. Kröger , X. Q. Luo , K. J. M. Moriarty

We consider the problem of estimating the expected outcomes of Monte Carlo processes whose outputs are described by multidimensional random variables. We tightly characterize the quantum query complexity of this problem for various choices…

Quantum Physics · Physics 2021-07-09 Arjan Cornelissen , Sofiene Jerbi

We unify slice sampling and Hamiltonian Monte Carlo (HMC) sampling, demonstrating their connection via the Hamiltonian-Jacobi equation from Hamiltonian mechanics. This insight enables extension of HMC and slice sampling to a broader family…

Machine Learning · Statistics 2018-01-12 Yizhe Zhang , Xiangyu Wang , Changyou Chen , Ricardo Henao , Kai Fan , Lawrence Carin

Bayesian reasoning in linear mixed-effects models (LMMs) is challenging and often requires advanced sampling techniques like Markov chain Monte Carlo (MCMC). A common approach is to write the model in a probabilistic programming language…

Machine Learning · Computer Science 2025-03-25 Jinlin Lai , Justin Domke , Daniel Sheldon

Hamiltonian Monte Carlo (HMC) is a powerful Markov chain Monte Carlo (MCMC) method for performing approximate inference in complex probabilistic models of continuous variables. In common with many MCMC methods, however, the standard HMC…

Computation · Statistics 2017-04-12 Matthew M. Graham , Amos J. Storkey

The paper proposes a Riemannian Manifold Hamiltonian Monte Carlo sampler to resolve the shortcomings of existing Monte Carlo algorithms when sampling from target densities that may be high dimensional and exhibit strong correlations. The…

Computation · Statistics 2019-12-18 Mark Girolami , Ben Calderhead , Siu A. Chin

Quasi-Monte Carlo methods have become the industry standard in computer graphics. For that purpose, efficient algorithms for low discrepancy sequences are discussed. In addition, numerical pitfalls encountered in practice are revealed. We…

Graphics · Computer Science 2023-07-31 Alexander Keller , Carsten Wächter , Nikolaus Binder

In most sampling algorithms, including Hamiltonian Monte Carlo, transition rates between states correspond to the probability of making a transition in a single time step, and are constrained to be less than or equal to 1. We derive a…

Machine Learning · Statistics 2015-10-13 Andrew B. Berger , Mayur Mudigonda , Michael R. DeWeese , Jascha Sohl-Dickstein

Langevin Monte Carlo (LMC) and its stochastic gradient versions are powerful algorithms for sampling from complex high-dimensional distributions. To sample from a distribution with density $\pi(\theta)\propto \exp(-U(\theta)) $, LMC…

Computation · Statistics 2023-09-25 Sifan Liu

In this paper, we study the strong convergence of an algorithm to solve the variational inequality problem which extends(Thong et al, Numerical Algorithms. 78, 1045-1060 (2018)). We have reduced and refined some of their algorithm's…

Numerical Analysis · Mathematics 2021-05-11 Mostafa Ghadampour , Donal O'Regan , Ebrahim Soori , Ravi. p. Agarwal

We study Hamiltonian Monte Carlo (HMC) for sampling from a strongly logconcave density proportional to $e^{-f}$ where $f:\mathbb{R}^d \to \mathbb{R}$ is $\mu$-strongly convex and $L$-smooth (the condition number is $\kappa = L/\mu$). We…

Data Structures and Algorithms · Computer Science 2019-05-08 Zongchen Chen , Santosh S. Vempala