English
Related papers

Related papers: Stochastic Variance-Reduced Hamilton Monte Carlo M…

200 papers

We introduce a variant of the Hybrid Monte Carlo (HMC) algorithm to address large-deviation statistics in stochastic hydrodynamics. Based on the path-integral approach to stochastic (partial) differential equations, our HMC algorithm…

Computational Physics · Physics 2019-10-29 G. Margazoglou , L. Biferale , R. Grauer , K. Jansen , D. Mesterházy , T. Rosenow , R. Tripiccione

Bayesian max-margin models have shown superiority in various practical applications, such as text categorization, collaborative prediction, social network link prediction and crowdsourcing, and they conjoin the flexibility of Bayesian…

Machine Learning · Statistics 2016-10-19 Wenbo Hu , Jun Zhu , Bo Zhang

Hamiltonian Monte Carlo is a prominent Markov Chain Monte Carlo algorithm, which employs symplectic integrators to sample from high dimensional target distributions in many applications, such as statistical mechanics, Bayesian statistics…

Numerical Analysis · Mathematics 2025-02-13 Geoffrey McGregor , Andy T. S. Wan

Hamiltonian Monte Carlo (HMC) samples efficiently from high-dimensional posterior distributions with proposed parameter draws obtained by iterating on a discretized version of the Hamiltonian dynamics. The iterations make HMC…

Computation · Statistics 2019-05-03 Khue-Dung Dang , Matias Quiroz , Robert Kohn , Minh-Ngoc Tran , Mattias Villani

We introduce Reflective Hamiltonian Monte Carlo (ReHMC), an HMC-based algorithm, to sample from a log-concave distribution restricted to a convex body. We prove that, starting from a warm start, the walk mixes to a log-concave target…

Machine Learning · Computer Science 2023-03-30 Apostolos Chalkis , Vissarion Fisikopoulos , Marios Papachristou , Elias Tsigaridas

Hamiltonian Monte Carlo is a widely used algorithm for sampling from posterior distributions of complex Bayesian models. It can efficiently explore high-dimensional parameter spaces guided by simulated Hamiltonian flows. However, the…

Computation · Statistics 2019-04-29 Lingge Li , Andrew Holbrook , Babak Shahbaba , Pierre Baldi

Sampling logconcave functions arising in statistics and machine learning has been a subject of intensive study. Recent developments include analyses for Langevin dynamics and Hamiltonian Monte Carlo (HMC). While both approaches have…

Data Structures and Algorithms · Computer Science 2018-12-18 Yin Tat Lee , Zhao Song , Santosh S. Vempala

We present a new Subset Simulation approach using Hamiltonian neural network-based Monte Carlo sampling for reliability analysis. The proposed strategy combines the superior sampling of the Hamiltonian Monte Carlo method with…

Machine Learning · Statistics 2024-01-11 Denny Thaler , Somayajulu L. N. Dhulipala , Franz Bamer , Bernd Markert , Michael D. Shields

Sampling from log-concave distributions is a well researched problem that has many applications in statistics and machine learning. We study the distributions of the form $p^{*}\propto\exp(-f(x))$, where…

Machine Learning · Computer Science 2019-09-13 Ruoqi Shen , Yin Tat Lee

We present a nonlinear (in the sense of McKean) generalization of Hamiltonian Monte Carlo (HMC) termed nonlinear HMC (nHMC) capable of sampling from nonlinear probability measures of mean-field type. When the underlying confinement…

Probability · Mathematics 2023-09-22 Nawaf Bou-Rabee , Katharina Schuh

We study Hamiltonian Monte Carlo (HMC) for sampling from a strongly logconcave density proportional to $e^{-f}$ where $f:\mathbb{R}^d \to \mathbb{R}$ is $\mu$-strongly convex and $L$-smooth (the condition number is $\kappa = L/\mu$). We…

Data Structures and Algorithms · Computer Science 2019-05-08 Zongchen Chen , Santosh S. Vempala

We propose a new framework for Hamiltonian Monte Carlo (HMC) on truncated probability distributions with smooth underlying density functions. Traditional HMC requires computing the gradient of potential function associated with the target…

Machine Learning · Statistics 2017-09-12 Kexin Yi , Finale Doshi-Velez

Numerous applications in biology, statistics, science, and engineering require generating samples from high-dimensional probability distributions. In recent years, the Hamiltonian Monte Carlo (HMC) method has emerged as a state-of-the-art…

Computational Engineering, Finance, and Science · Computer Science 2024-05-09 Dhruv V. Patel , Jonghyun Lee , Matthew W. Farthing , Peter K. Kitanidis , Eric F. Darve

Sampling from a high-dimensional probability distribution is a fundamental algorithmic task arising in wide-ranging applications across multiple disciplines, including scientific computing, computational statistics and machine learning.…

Statistics Theory · Mathematics 2026-05-11 Bin Yang , Xiaojie Wang

For big data analysis, high computational cost for Bayesian methods often limits their applications in practice. In recent years, there have been many attempts to improve computational efficiency of Bayesian inference. Here we propose an…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

The Hamiltonian Monte Carlo (HMC) method has been recognized as a powerful sampling tool in computational statistics. We show that performance of HMC can be significantly improved by incorporating importance sampling and an irreversible…

Computation · Statistics 2019-07-26 Tijana Radivojević , Elena Akhmatskaya

We propose a hybrid Monte Carlo (HMC) technique applicable to high-dimensional multivariate normal distributions that effectively samples along chaotic trajectories. The method is predicated on the freedom of choice of the HMC momentum…

Data Analysis, Statistics and Probability · Physics 2016-04-26 Nirag Kadakia

We study the problem of sampling from a distribution $\target$ using the Langevin Monte Carlo algorithm and provide rate of convergences for this algorithm in terms of Wasserstein distance of order $2$. Our result holds as long as the…

Computation · Statistics 2016-07-04 Thomas Bonis

Traditional gradient-based sampling methods, like standard Hamiltonian Monte Carlo, require that the desired target distribution is continuous and differentiable. This limits the types of models one can define, although the presented models…

Computation · Statistics 2025-04-28 Jimmy Huy Tran , Tore Selland Kleppe

Hamiltonian Monte Carlo (HMC) is a state-of-the-art Markov chain Monte Carlo sampling algorithm for drawing samples from smooth probability densities over continuous spaces. We study the variant most widely used in practice, Metropolized…

Machine Learning · Statistics 2021-01-12 Yuansi Chen , Raaz Dwivedi , Martin J. Wainwright , Bin Yu