English
Related papers

Related papers: Bayesian Uncertainty Estimation by Hamiltonian Mon…

200 papers

We develop a novel deep learning method for uncertainty quantification in stochastic partial differential equations based on Bayesian neural network (BNN) and Hamiltonian Monte Carlo (HMC). A BNN efficiently learns the posterior…

Machine Learning · Statistics 2022-10-24 Jeahan Jung , Minseok Choi

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high…

Machine Learning · Statistics 2025-09-11 Ponkrshnan Thiagarajan , Tamer A. Zaki , Michael D. Shields

Federated learning performed by a decentralized networks of agents is becoming increasingly important with the prevalence of embedded software on autonomous devices. Bayesian approaches to learning benefit from offering more information as…

Machine Learning · Computer Science 2021-07-16 Vyacheslav Kungurtsev , Adam Cobb , Tara Javidi , Brian Jalaian

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo (MCMC) approach that exhibits favourable exploration properties in high-dimensional models such as neural networks. Unfortunately, HMC has limited use in large-data regimes and…

Machine Learning · Statistics 2020-10-15 Adam D. Cobb , Brian Jalaian

Sequential Monte Carlo (SMC) methods offer a principled approach to Bayesian uncertainty quantification but are traditionally limited by the need for full-batch gradient evaluations. We introduce a scalable variant by incorporating…

Machine Learning · Statistics 2025-05-20 Andrew Millard , Zheng Zhao , Joshua Murphy , Simon Maskell

Current state-of-the-art deep learning segmentation methods have not yet made a broad entrance into the clinical setting in spite of high demand for such automatic methods. One important reason is the lack of reliability caused by models…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Jörg Sander , Bob D. de Vos , Jelmer M. Wolterink , Ivana Išgum

We present a scalable Bayesian framework for the analysis of confocal fluorescence spectroscopy data, addressing key limitations in traditional fluorescence correlation spectroscopy methods. Our framework captures molecular motion,…

Numerical Analysis · Mathematics 2024-11-07 Daniel McBride , Ioannis Sgouralis

Convolutional neural network (CNN) has achieved unprecedented success in image super-resolution tasks in recent years. However, the network's performance depends on the distribution of the training sets and degrades on out-of-distribution…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Aupendu Kar , Prabir Kumar Biswas

The posterior over Bayesian neural network (BNN) parameters is extremely high-dimensional and non-convex. For computational reasons, researchers approximate this posterior using inexpensive mini-batch methods such as mean-field variational…

Machine Learning · Computer Science 2021-04-30 Pavel Izmailov , Sharad Vikram , Matthew D. Hoffman , Andrew Gordon Wilson

Objective: Convolutional neural networks (CNNs) have demonstrated promise in automated cardiac magnetic resonance image segmentation. However, when using CNNs in a large real-world dataset, it is important to quantify segmentation…

Image and Video Processing · Electrical Eng. & Systems 2023-01-02 Matthew Ng , Fumin Guo , Labonny Biswas , Steffen E. Petersen , Stefan K. Piechnik , Stefan Neubauer , Graham Wright

We explore the use of Hamiltonian Monte Carlo (HMC) sampling as a probabilistic last layer approach for deep neural networks (DNNs). While HMC is widely regarded as a gold standard for uncertainty estimation, the computational demands limit…

Machine Learning · Computer Science 2025-07-15 Koen Vellenga , H. Joe Steinhauer , Göran Falkman , Jonas Andersson , Anders Sjögren

Estimating predictive uncertainty is crucial for many computer vision tasks, from image classification to autonomous driving systems. Hamiltonian Monte Carlo (HMC) is an sampling method for performing Bayesian inference. On the other hand,…

Machine Learning · Computer Science 2019-07-03 Diego Vergara , Sergio Hernández , Matias Valdenegro-Toro , Felipe Jorquera

Emerging deep-learning (DL)-based techniques have significant potential to revolutionize biomedical imaging. However, one outstanding challenge is the lack of reliability assessment in the DL predictions, whose errors are commonly revealed…

Image and Video Processing · Electrical Eng. & Systems 2019-05-07 Yujia Xue , Shiyi Cheng , Yunzhe Li , Lei Tian

Datasets in engineering applications are often limited and contaminated, mainly due to unavoidable measurement noise and signal distortion. Thus, using conventional data-driven approaches to build a reliable discriminative model, and…

Machine Learning · Statistics 2020-04-14 Xihaier Luo , Ahsan Kareem

In recent years, the Hamiltonian Monte Carlo (HMC) algorithm has been found to work more efficiently compared to other popular Markov Chain Monte Carlo (MCMC) methods (such as random walk Metropolis-Hastings) in generating samples from a…

Computation · Statistics 2014-02-18 Andrew L. Beam , Sujit K. Ghosh , Jon Doyle

Decision trees have found widespread application within the machine learning community due to their flexibility and interpretability. This paper is directed towards learning decision trees from data using a Bayesian approach, which is…

Machine Learning · Computer Science 2023-12-05 Jodie A. Cochrane , Adrian G. Wills , Sarah J. Johnson

The performance of deep learning (DL) methods for the analysis of cine cardiovascular magnetic resonance (CMR) is typically assessed in terms of accuracy, overlooking precision. In this work, uncertainty estimation techniques, namely deep…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Dewmini Hasara Wickremasinghe , Michelle Gibogwe , Andrew Bell , Esther Puyol-Antón , Muhummad Sohaib Nazir , Reza Razavi , Bruno Paun , Paul Aljabar , Andrew P. King

The coalescence of binary neutron stars are one of the main sources of gravitational waves for ground-based gravitational wave detectors. As Bayesian inference for binary neutron stars is computationally expensive, more efficient and faster…

General Relativity and Quantum Cosmology · Physics 2019-11-20 Yann Bouffanais , Edward K. Porter

Traditionally, the field of computational Bayesian statistics has been divided into two main subfields: variational methods and Markov chain Monte Carlo (MCMC). In recent years, however, several methods have been proposed based on combining…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

We present a deep neural network (DNN) accelerated Hamiltonian Monte Carlo (HMC) algorithm called DeepHMC for the inference of binary neutron star systems. The HMC is a non-random walk sampler that uses background gradient information to…

General Relativity and Quantum Cosmology · Physics 2025-05-06 Jules Perret , Marc Aréne , Edward K. Porter
‹ Prev 1 2 3 10 Next ›