English
Related papers

Related papers: Quality of Uncertainty Quantification for Bayesian…

200 papers

High-quality estimates of uncertainty and robustness are crucial for numerous real-world applications, especially for deep learning which underlies many deployed ML systems. The ability to compare techniques for improving these estimates is…

Neural networks are powerful function approximators with tremendous potential in learning complex distributions. However, they are prone to overfitting on spurious patterns. Bayesian inference provides a principled way to regularize neural…

Machine Learning · Computer Science 2024-12-02 Yanzhe Bekkemoen , Helge Langseth

Modeling natural phenomena with artificial neural networks (ANNs) often provides highly accurate predictions. However, ANNs often suffer from over-parameterization, complicating interpretation and raising uncertainty issues. Bayesian neural…

Machine Learning · Statistics 2025-03-14 Eirik Høyheim , Lars Skaaret-Lund , Solve Sæbø , Aliaksandr Hubin

Effective quantification of uncertainty is an essential and still missing step towards a greater adoption of deep-learning approaches in different applications, including mission-critical ones. In particular, investigations on the…

Machine Learning · Computer Science 2023-04-14 Marco Forgione , Dario Piga

Uncertainty quantification in image retrieval is crucial for downstream decisions, yet it remains a challenging and largely unexplored problem. Current methods for estimating uncertainties are poorly calibrated, computationally expensive,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Frederik Warburg , Martin Jørgensen , Javier Civera , Søren Hauberg

Exact structured inference with neural network scoring functions is computationally challenging but several methods have been proposed for approximating inference. One approach is to perform gradient descent with respect to the output…

Computation and Language · Computer Science 2019-07-09 Lifu Tu , Kevin Gimpel

We study probabilistic safety for Bayesian Neural Networks (BNNs) under adversarial input perturbations. Given a compact set of input points, $T \subseteq \mathbb{R}^m$, we study the probability w.r.t. the BNN posterior that all the points…

Machine Learning · Computer Science 2020-06-22 Matthew Wicker , Luca Laurenti , Andrea Patane , Marta Kwiatkowska

Data-driven forecasts of air quality have recently achieved more accurate short-term predictions. Despite their success, most of the current data-driven solutions lack proper quantifications of model uncertainty that communicate how much to…

Machine Learning · Computer Science 2021-12-07 Abdulmajid Murad , Frank Alexander Kraemer , Kerstin Bach , Gavin Taylor

Recent performance breakthroughs in Artificial intelligence (AI) and Machine learning (ML), especially advances in Deep learning (DL), the availability of powerful, easy-to-use ML libraries (e.g., scikit-learn, TensorFlow, PyTorch.), and…

Machine Learning · Computer Science 2023-03-24 Mahmoud Yaseen , Xu Wu

Deep neural network (DNN) models have achieved state-of-the-art predictive accuracy in a wide range of supervised learning applications. However, accurately quantifying the uncertainty in DNN predictions remains a challenging task. For…

Machine Learning · Computer Science 2022-06-14 Daiwei Zhang , Tianci Liu , Jian Kang

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than…

Machine Learning · Statistics 2022-09-07 Joel Janek Dabrowski , Daniel Edward Pagendam

We propose a new class of Bayesian neural networks (BNNs) that can be trained using noisy data of variable fidelity, and we apply them to learn function approximations as well as to solve inverse problems based on partial differential…

Machine Learning · Computer Science 2021-06-02 Xuhui Meng , Hessam Babaee , George Em Karniadakis

Deep learning (DL) has shown great potential in medical image enhancement problems, such as super-resolution or image synthesis. However, to date, little consideration has been given to uncertainty quantification over the output image. Here…

Modern convolutional neural networks (CNNs) are known to be overconfident in terms of their calibration on unseen input data. That is to say, they are more confident than they are accurate. This is undesirable if the probabilities predicted…

Machine Learning · Computer Science 2021-12-03 Guoxuan Xia , Sangwon Ha , Tiago Azevedo , Partha Maji

We present extensive empirical evidence showing that current Bayesian simulation-based inference algorithms can produce computationally unfaithful posterior approximations. Our results show that all benchmarked algorithms -- (Sequential)…

Machine Learning · Statistics 2022-12-06 Joeri Hermans , Arnaud Delaunoy , François Rozet , Antoine Wehenkel , Volodimir Begy , Gilles Louppe

Quantifying predictive uncertainty of neural networks has recently attracted increasing attention. In this work, we focus on measuring uncertainty of graph neural networks (GNNs) for the task of node classification. Most existing GNNs model…

Machine Learning · Computer Science 2023-04-04 Zhao Xu , Carolin Lawrence , Ammar Shaker , Raman Siarheyeu

Bayesian estimation is a powerful theoretical paradigm for the operation of quantum sensors. However, the Bayesian method for statistical inference generally suffers from demanding calibration requirements that have so far restricted its…

Quantum Physics · Physics 2021-09-22 Samuel P. Nolan , Augusto Smerzi , Luca Pezzè

Methods based on Deep Learning have recently been applied on astrophysical parameter recovery thanks to their ability to capture information from complex data. One of these methods is the approximate Bayesian Neural Networks (BNNs) which…

Instrumentation and Methods for Astrophysics · Physics 2023-06-21 Héctor J. Hortúa , Luz Ángela García , Leonardo Castañeda C

Inverse problems arise almost everywhere in science and engineering where we need to infer on a quantity from indirect observation. The cases of medical, biomedical, and industrial imaging systems are the typical examples. A very high…

Machine Learning · Computer Science 2025-02-20 Ali Mohammad-Djafari

Bayesian neural networks offer better estimates of model uncertainty compared to frequentist networks. However, inference involving Bayesian models requires multiple instantiations or sampling of the network parameters, requiring…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Prabodh Katti , Anagha Nimbekar , Chen Li , Amit Acharyya , Bashir M. Al-Hashimi , Bipin Rajendran
‹ Prev 1 8 9 10 Next ›