English
Related papers

Related papers: Hamiltonian Monte Carlo in Inverse Problems; Ill-C…

200 papers

Sampling from high dimensional distributions is a computational bottleneck in many scientific applications. Hamiltonian Monte Carlo (HMC), and in particular the No-U-Turn Sampler (NUTS), are widely used, yet they struggle on problems with a…

Computation · Statistics 2025-05-20 Jakob Robnik , Reuben Cohn-Gordon , Uroš Seljak

Hamiltonian Monte Carlo (HMC) and its dynamic extensions, such as the No-U-Turn Sampler (NUTS), are powerful Markov chain Monte Carlo methods for sampling from complex, high-dimensional probability distributions. Riemannian manifold…

Computation · Statistics 2026-04-16 Miika Kailas , Matti Vihola , Jonas Wallin

Modified Hamiltonian Monte Carlo (MHMC) methods combine the ideas behind two popular sampling approaches: Hamiltonian Monte Carlo (HMC) and importance sampling. As in the HMC case, the bulk of the computational cost of MHMC algorithms lies…

Hamiltonian Monte Carlo (HMC) is a powerful tool for Bayesian computation. In comparison with the traditional Metropolis-Hastings algorithm, HMC offers greater computational efficiency, especially in higher dimensional or more complex…

Computation · Statistics 2020-12-21 Samuel Thomas , Wanzhu Tu

We present a new Subset Simulation approach using Hamiltonian neural network-based Monte Carlo sampling for reliability analysis. The proposed strategy combines the superior sampling of the Hamiltonian Monte Carlo method with…

Machine Learning · Statistics 2024-01-11 Denny Thaler , Somayajulu L. N. Dhulipala , Franz Bamer , Bernd Markert , Michael D. Shields

In this article we consider a Bayesian inverse problem associated to elliptic partial differential equations (PDEs) in two and three dimensions. This class of inverse problems is important in applications such as hydrology, but the…

Computation · Statistics 2014-12-16 Alex Beskos , Ajay Jasra , Ege Muzaffer , Andrew Stuart

Dynamically rescaled Hamiltonian Monte Carlo (DRHMC) is introduced as a computationally fast and easily implemented method for performing full Bayesian analysis in hierarchical statistical models. The method relies on introducing a modified…

Computation · Statistics 2018-10-23 Tore Selland Kleppe

In this paper, we propose Barrier Hamiltonian Monte Carlo (BHMC), a version of the HMC algorithm which aims at sampling from a Gibbs distribution $\pi$ on a manifold $\mathrm{M}$, endowed with a Hessian metric $\mathfrak{g}$ derived from a…

Machine Learning · Statistics 2023-10-31 Maxence Noble , Valentin De Bortoli , Alain Durmus

By formulating the inverse problem of partial differential equations (PDEs) as a statistical inference problem, the Bayesian approach provides a general framework for quantifying uncertainties. In the inverse problem of PDEs, parameters are…

Numerical Analysis · Mathematics 2026-02-10 Haoyu Lu , Junxiong Jia , Deyu Meng

HMCF "Hamiltonian Monte Carlo for Fields" is a software add-on for the NIFTy "Numerical Information Field Theory" framework implementing Hamiltonian Monte Carlo (HMC) sampling in Python. HMCF as well as NIFTy are designed to address…

Data Analysis, Statistics and Probability · Physics 2018-12-04 Christoph Lienhard , Torsten A. Enßlin

A new method, based on the simulated annealing algorithm and aimed at the inverse problem in the analysis of intergalactic (interstellar) complex spectra of hydrogen and metal lines, is presented. We consider the process of line formation…

Astrophysics · Physics 2007-05-23 Sergei A. Levshakov , Irina I. Agafonova , Wilhelm H. Kegel

The identification of parameters in mathematical models using noisy observations is a common task in uncertainty quantification. We employ the framework of Bayesian inversion: we combine monitoring and observational data with prior…

Computation · Statistics 2018-05-11 Jonas Latz , Iason Papaioannou , Elisabeth Ullmann

In performing a Bayesian analysis, two difficult problems often emerge. First, in estimating the parameters of some model for the data, the resulting posterior distribution may be multi-modal or exhibit pronounced (curving) degeneracies.…

Instrumentation and Methods for Astrophysics · Physics 2013-12-20 F. Feroz , J. Skilling

The paper proposes a new Monte-Carlo simulator combining the advantages of Sequential Monte Carlo simulators and Hamiltonian Monte Carlo simulators. The result is a method that is robust to multimodality and complex shapes to use for…

Computation · Statistics 2018-12-20 Remi Daviet

Forward modeling approaches in cosmology have made it possible to reconstruct the initial conditions at the beginning of the Universe from the observed survey data. However the high dimensionality of the parameter space still poses a…

Instrumentation and Methods for Astrophysics · Physics 2023-04-05 Chirag Modi , Yin Li , David Blei

This paper considers Bayesian parameter estimation of dynamic systems using a Markov Chain Monte Carlo (MCMC) approach. The Metroplis-Hastings (MH) algorithm is employed, and the main contribution of the paper is to examine and illustrate…

Applications · Statistics 2021-10-18 Johannes Hendriks , Adrian Wills , Brett Ninness , Johan Dahlin

We introduce new affine invariant ensemble Markov chain Monte Carlo (MCMC) samplers that are easy to construct and improve upon existing methods, especially for high-dimensional problems. We first propose a simple derivative-free side move…

Computation · Statistics 2026-01-01 Yifan Chen

A hybrid Monte Carlo (HMC) approach is employed to quantify the influence of inelastic deformation on the microstructural evolution of polycrystalline materials. This approach couples a time explicit material point method (MPM) for…

Materials Science · Physics 2015-05-19 Liangzhe Zhang , Remi Dingreville , Timothy Bartel , Mark T. Lusk

The variational quantum Monte Carlo (VQMC) method received significant attention in the recent past because of its ability to overcome the curse of dimensionality inherent in many-body quantum systems. Close parallels exist between VQMC and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-01 Tianchen Zhao , Saibal De , Brian Chen , James Stokes , Shravan Veerapaneni

In high dimensions, reflective Hamiltonian Monte Carlo with inexact reflections exhibits slow mixing when the particle ensemble is initialised from a Dirac delta distribution and the uniform distribution is targeted. By quantifying the…

Machine Learning · Statistics 2026-03-20 Namu Kroupa , Gábor Csányi , Will Handley