English
Related papers

Related papers: Bend to Mend: Toward Trustworthy Variational Bayes…

200 papers

Despite the popularity of Convolutional Neural Networks (CNN), the problem of uncertainty quantification (UQ) of CNN has been largely overlooked. Lack of efficient UQ tools severely limits the application of CNN in certain areas, such as…

Machine Learning · Computer Science 2026-04-15 Hongfei Du , Emre Barut , Fang Jin

The accessibility of spatially distributed data, enabled by affordable sensors, field, and numerical experiments, has facilitated the development of data-driven solutions for scientific problems, including climate change, weather…

Machine Learning · Computer Science 2023-11-09 Vardhan Dongre , Gurpreet Singh Hora

We introduce a flexible empirical Bayes approach for fitting Bayesian generalized linear models. Specifically, we adopt a novel mean-field variational inference (VI) method and the prior is estimated within the VI algorithm, making the…

Machine Learning · Statistics 2026-01-30 Dongyue Xie , Wanrong Zhu , Matthew Stephens

For the retrieval of large-scale vegetation biophysical parameters, the inversion of radiative transfer models (RTMs) is the most commonly used approach. In recent years, Artificial Neural Network (ANN)-based methods have become the…

Machine Learning · Computer Science 2024-11-08 Dasheng Fan , Xihan Mu , Yongkang Lai , Donghui Xie , Guangjian Yan

In recent years, machine learning has witnessed extensive adoption across various sectors, yet its application in medical image-based disease detection and diagnosis remains challenging due to distribution shifts in real-world data. In…

Machine Learning · Computer Science 2024-02-13 Masoumeh Javanbakhat , Md Tasnimul Hasan , Cristoph Lippert

In many practices, scientists are particularly interested in detecting which of the predictors are truly associated with a multivariate response. It is more accurate to model multiple responses as one vector rather than separating each…

Methodology · Statistics 2021-11-16 Xiaotian Dai , Guifang Fu , Randall Reese , Shaofei Zhao , Zuofeng Shang

Variational inference is a popular technique to approximate a possibly intractable Bayesian posterior with a more tractable one. Recently, boosting variational inference has been proposed as a new paradigm to approximate the posterior by a…

Machine Learning · Computer Science 2018-03-08 Francesco Locatello , Rajiv Khanna , Joydeep Ghosh , Gunnar Rätsch

Bayesian Neural Networks (BNN) have emerged as a crucial approach for interpreting ML predictions. By sampling from the posterior distribution, data scientists may estimate the uncertainty of an inference. Unfortunately many inference…

Machine Learning · Computer Science 2023-11-23 Thomas D. Ahle , Sahar Karimi , Peter Tak Peter Tang

A natural way to quantify uncertainties in Gaussian mixture models (GMMs) is through Bayesian methods. That said, sampling from the joint posterior distribution of GMMs via standard Markov chain Monte Carlo (MCMC) imposes several…

Methodology · Statistics 2024-05-20 Santiago Marin , Bronwyn Loong , Anton H. Westveld

In inverse problems, distribution-free uncertainty quantification (UQ) aims to obtain error bars with coverage guarantees that are independent of any prior assumptions about the data distribution. In the context of mass mapping,…

Cosmology and Nongalactic Astrophysics · Physics 2025-02-26 Hubert Leterme , Jalal Fadili , Jean-Luc Starck

We conduct non-asymptotic analysis on the mean-field variational inference for approximating posterior distributions in complex Bayesian models that may involve latent variables. We show that the mean-field approximation to the posterior…

Statistics Theory · Mathematics 2019-11-06 Wei Han , Yun Yang

In this paper, we explore adaptive inference based on variational Bayes. Although several studies have been conducted to analyze the contraction properties of variational posteriors, there is still a lack of a general and computationally…

Statistics Theory · Mathematics 2024-03-12 Ilsang Ohn , Lizhen Lin

A framework is presented for fitting inverse problem models via variational Bayes approximations. This methodology guarantees flexibility to statistical model specification for a broad range of applications, good accuracy and reduced model…

Methodology · Statistics 2024-09-05 Luca Maestrini , Robert G. Aykroyd , Matt P. Wand

Many scientific investigations require that the values of a set of model parameters are estimated using recorded data. In Bayesian inference, information from both observed data and prior knowledge is combined to update model parameters…

Methodology · Statistics 2024-09-17 Xuebin Zhao , Andrew Curtis

In this paper, we present an uncertainty-aware INVASE to quantify predictive confidence of healthcare problem. By introducing learnable Gaussian distributions, we lever-age their variances to measure the degree of uncertainty. Based on the…

Machine Learning · Computer Science 2021-05-07 Jia-Xing Zhong , Hongbo Zhang

Variational inference (VI) is a technique to approximate difficult to compute posteriors by optimization. In contrast to MCMC, VI scales to many observations. In the case of complex posteriors, however, state-of-the-art VI approaches often…

Machine Learning · Statistics 2024-02-26 Oliver Dürr , Stephan Hörling , Daniel Dold , Ivonne Kovylov , Beate Sick

Uncertainty quantification (UQ) is important for reliability assessment and enhancement of machine learning models. In deep learning, uncertainties arise not only from data, but also from the training procedure that often injects…

Machine Learning · Statistics 2023-11-13 Ziyi Huang , Henry Lam , Haofeng Zhang

In many inverse problems such as 3D X-ray Computed Tomography (CT), the estimation of an unknown quantity, such as a volume or an image, can be greatly enhanced, compared to maximum-likelihood techniques, by incorporating a prior model on…

Computation · Statistics 2018-09-03 Camille Chapdelaine

Reliable uncertainty quantification (UQ) in machine learning (ML) regression tasks is becoming the focus of many studies in materials and chemical science. It is now well understood that average calibration is insufficient, and most studies…

Machine Learning · Statistics 2024-01-25 Pascal Pernot

Uncertainty quantification (UQ) is vital for ensuring that vision-language models (VLMs) behave safely and reliably. A central challenge is to localize uncertainty to its source, determining whether it arises from the image, the text, or…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Chenyu Wang , Tianle Chen , H. M. Sabbir Ahmad , Kayhan Batmanghelich , Wenchao Li