English
Related papers

Related papers: Multi-fidelity Hamiltonian Monte Carlo

200 papers

The use of the probabilistic approach to solve inverse problems is becoming more popular in the geophysical community, thanks to its ability to address nonlinear forward problems and to provide uncertainty quantification. However, such…

Geophysics · Physics 2023-11-13 Andrea Zunino , Lars Gebraad , Alessandro Ghirotto , Andreas Fichtner

Markov chain Monte Carlo (MCMC) algorithms are widely used to sample from complicated distributions, especially to sample from the posterior distribution in Bayesian inference. However, MCMC is not directly applicable when facing the doubly…

Computation · Statistics 2019-03-29 Guanyang Wang

The Hamiltonian Monte Carlo (HMC) algorithm is a powerful Markov Chain Monte Carlo (MCMC) method that uses Hamiltonian dynamics to generate samples from a target distribution. To fully exploit its potential, we must understand how…

Computation · Statistics 2025-01-27 Abraham Granados , Isaías Bañales

Markov chain Monte Carlo (MCMC) algorithms have long been the main workhorses of Bayesian inference. Among them, Hamiltonian Monte Carlo (HMC) has recently become very popular due to its efficiency resulting from effective use of the…

Computation · Statistics 2021-06-18 Ossi Räisä , Antti Koskela , Antti Honkela

We propose a new framework of variance-reduced Hamiltonian Monte Carlo (HMC) methods for sampling from an $L$-smooth and $m$-strongly log-concave distribution, based on a unified formulation of biased and unbiased variance reduction…

Machine Learning · Computer Science 2021-02-10 Zhengmian Hu , Feihu Huang , Heng Huang

Delayed-acceptance is a technique for reducing computational effort for Bayesian models with expensive likelihoods. Using a delayed-acceptance kernel for Markov chain Monte Carlo can reduce the number of expensive likelihoods evaluations…

Computation · Statistics 2026-01-07 Joshua J Bon , Anthony Lee , Christopher Drovandi

Recent advances in stochastic gradient techniques have made it possible to estimate posterior distributions from large datasets via Markov Chain Monte Carlo (MCMC). However, when the target posterior is multimodal, mixing performance is…

Machine Learning · Statistics 2018-01-12 Yizhe Zhang , Changyou Chen , Zhe Gan , Ricardo Henao , Lawrence Carin

Bayesian max-margin models have shown superiority in various practical applications, such as text categorization, collaborative prediction, social network link prediction and crowdsourcing, and they conjoin the flexibility of Bayesian…

Machine Learning · Statistics 2016-10-19 Wenbo Hu , Jun Zhu , Bo Zhang

Traditional gradient-based sampling methods, like standard Hamiltonian Monte Carlo, require that the desired target distribution is continuous and differentiable. This limits the types of models one can define, although the presented models…

Computation · Statistics 2025-04-28 Jimmy Huy Tran , Tore Selland Kleppe

Bayesian inference methods such as Markov Chain Monte Carlo (MCMC) typically require repeated computations of the likelihood function, but in some scenarios this is infeasible and alternative methods are needed. Simulation-based inference…

Machine Learning · Computer Science 2025-12-10 Linnea M Wolniewicz , Peter Sadowski , Claudio Corti

The Hamiltonian Monte Carlo (HMC) method has been recognized as a powerful sampling tool in computational statistics. We show that performance of HMC can be significantly improved by incorporating importance sampling and an irreversible…

Computation · Statistics 2019-07-26 Tijana Radivojević , Elena Akhmatskaya

Deep learning (DL)-based methods have achieved state-of-the-art performance for many medical image segmentation tasks. Nevertheless, recent studies show that deep neural networks (DNNs) can be miscalibrated and overconfident, leading to…

Image and Video Processing · Electrical Eng. & Systems 2024-06-28 Yidong Zhao , Joao Tourais , Iain Pierce , Christian Nitsche , Thomas A. Treibel , Sebastian Weingärtner , Artur M. Schweidtmann , Qian Tao

This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian…

Machine Learning · Statistics 2024-05-21 Sohail Reddy , Hillary Fairbanks

Estimation of patient-specific model parameters is important for personalized modeling, although sparse and noisy clinical data can introduce significant uncertainty in the estimated parameter values. This importance source of uncertainty,…

Machine Learning · Statistics 2020-06-04 Jwala Dhamala , John L. Sapp , B. Milan Horácek , Linwei Wang

We present a multi-fidelity method for uncertainty quantification of parameter estimates in complex systems, leveraging generative models trained to sample the target conditional distribution. In the Bayesian inference setting, traditional…

Machine Learning · Computer Science 2025-04-03 Caroline Tatsuoka , Minglei Yang , Dongbin Xiu , Guannan Zhang

Decision trees have found widespread application within the machine learning community due to their flexibility and interpretability. This paper is directed towards learning decision trees from data using a Bayesian approach, which is…

Machine Learning · Computer Science 2023-12-05 Jodie A. Cochrane , Adrian G. Wills , Sarah J. Johnson

The coalescence of binary neutron stars are one of the main sources of gravitational waves for ground-based gravitational wave detectors. As Bayesian inference for binary neutron stars is computationally expensive, more efficient and faster…

General Relativity and Quantum Cosmology · Physics 2019-11-20 Yann Bouffanais , Edward K. Porter

The number of low-energy constants (LECs) in chiral effective field theory ($\chi$EFT) grows rapidly with increasing chiral order, necessitating the use of Markov chain Monte Carlo techniques for sampling their posterior probability density…

Nuclear Theory · Physics 2024-07-29 Isak Svensson , Andreas Ekström , Christian Forssén

Monte Carlo (MC) sampling is a popular method for estimating the statistics (e.g. expectation and variance) of a random variable. Its slow convergence has led to the emergence of advanced techniques to reduce the variance of the MC…

Statistics Theory · Mathematics 2024-06-21 Mohamed Reda El Amri , Paul Mycek , Sophie Ricci , Matthias De Lozzo

Accurate and efficient estimation of rare events probabilities is of significant importance, since often the occurrences of such events have widespread impacts. The focus in this work is on precisely quantifying these probabilities, often…

Computation · Statistics 2019-09-11 Hamed Nikbakht , Konstantinos G. Papakonstantinou