中文
相关论文

相关论文: Reliable Uncertainties for Bayesian Neural Network…

200 篇论文

The inability of artificial neural networks to assess the uncertainty of their predictions is an impediment to their widespread use. We distinguish two types of learnable uncertainty: model uncertainty due to a lack of training data and…

机器学习 · 计算机科学 2022-06-14 Hans Weytjens , Jochen De Weerdt

Reliable uncertainty calibration is essential for safely deploying deep neural networks in high-stakes applications. Deep neural networks are known to exhibit systematic overconfidence, especially under distribution shifts. Although…

机器学习 · 计算机科学 2025-06-12 Achim Hekler , Lukas Kuhn , Florian Buettner

Accurate estimation of predictive uncertainty (model calibration) is essential for the safe application of neural networks. Many instances of miscalibration in modern neural networks have been reported, suggesting a trend that newer, more…

Bayesian Neural Networks (BNNs) place priors over the parameters in a neural network. Inference in BNNs, however, is difficult; all inference methods for BNNs are approximate. In this work, we empirically compare the quality of predictive…

机器学习 · 计算机科学 2019-06-25 Jiayu Yao , Weiwei Pan , Soumya Ghosh , Finale Doshi-Velez

As we move away from the data, the predictive uncertainty should increase, since a great variety of explanations are consistent with the little available information. We introduce Distance-Aware Prior (DAP) calibration, a method to correct…

机器学习 · 统计学 2022-07-19 Gianluca Detommaso , Alberto Gasparin , Andrew Wilson , Cedric Archambeau

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using…

机器学习 · 统计学 2019-05-28 Aliaksandr Hubin , Geir Storvik

Understanding the uncertainty of a neural network's (NN) predictions is essential for many purposes. The Bayesian framework provides a principled approach to this, however applying it to NNs is challenging due to large numbers of parameters…

机器学习 · 统计学 2020-02-27 Tim Pearce , Felix Leibfried , Alexandra Brintrup , Mohamed Zaki , Andy Neely

Bayesian neural networks (BNNs) augment deep networks with uncertainty quantification by Bayesian treatment of the network weights. However, such models face the challenge of Bayesian inference in a high-dimensional and usually…

机器学习 · 计算机科学 2021-03-30 Zhijie Deng , Yucen Luo , Jun Zhu , Bo Zhang

Emerging deep-learning (DL)-based techniques have significant potential to revolutionize biomedical imaging. However, one outstanding challenge is the lack of reliability assessment in the DL predictions, whose errors are commonly revealed…

图像与视频处理 · 电气工程与系统科学 2019-05-07 Yujia Xue , Shiyi Cheng , Yunzhe Li , Lei Tian

Deep Neural Networks (DNN) represent the state of the art in many tasks. However, due to their overparameterization, their generalization capabilities are in doubt and still a field under study. Consequently, DNN can overfit and assign…

机器学习 · 计算机科学 2021-05-19 Juan Maroñas , Daniel Ramos , Roberto Paredes

The willingness to trust predictions formulated by automatic algorithms is key in a vast number of domains. However, a vast number of deep architectures are only able to formulate predictions without an associated uncertainty. In this…

图像与视频处理 · 电气工程与系统科学 2022-09-28 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Uncertainty calibration is crucial for various machine learning applications, yet it remains challenging. Many models exhibit hallucinations - confident yet inaccurate responses - due to miscalibrated confidence. Here, we show that the…

机器学习 · 计算机科学 2025-03-28 Jeonghwan Cheon , Se-Bum Paik

The radio astronomy community is rapidly adopting deep learning techniques to deal with the huge data volumes expected from the next generation of radio observatories. Bayesian neural networks (BNNs) provide a principled way to model…

机器学习 · 计算机科学 2024-05-29 Devina Mohan , Anna M. M. Scaife

Due to the growing adoption of deep neural networks in many fields of science and engineering, modeling and estimating their uncertainties has become of primary importance. Despite the growing literature about uncertainty quantification in…

机器学习 · 计算机科学 2023-02-15 Brian Staber , Sébastien Da Veiga

Accurate probabilistic predictions can be characterized by two properties -- calibration and sharpness. However, standard maximum likelihood training yields models that are poorly calibrated and thus inaccurate -- a 90% confidence interval…

机器学习 · 计算机科学 2025-05-14 Volodymyr Kuleshov , Shachi Deshpande

With model trustworthiness being crucial for sensitive real-world applications, practitioners are putting more and more focus on improving the uncertainty calibration of deep neural networks. Calibration errors are designed to quantify the…

机器学习 · 计算机科学 2024-03-14 Sebastian G. Gruber , Florian Buettner

Deep neural networks have been shown to be highly miscalibrated. often they tend to be overconfident in their predictions. It poses a significant challenge for safety-critical systems to utilise deep neural networks (DNNs), reliably. Many…

机器学习 · 计算机科学 2022-05-05 Aditya Singh , Alessandro Bay , Biswa Sengupta , Andrea Mirabile

Neural networks solving real-world problems are often required not only to make accurate predictions but also to provide a confidence level in the forecast. The calibration of a model indicates how close the estimated confidence is to the…

神经与进化计算 · 计算机科学 2023-03-21 Ruslan Vasilev , Alexander D'yakonov

To obtain uncertainty estimates with real-world Bayesian deep learning models, practical inference approximations are needed. Dropout variational inference (VI) for example has been used for machine vision and medical applications, but VI…

机器学习 · 计算机科学 2017-03-09 Yingzhen Li , Yarin Gal

In this article a novel approach for training deep neural networks using Bayesian techniques is presented. The Bayesian methodology allows for an easy evaluation of model uncertainty and additionally is robust to overfitting. These are…

机器学习 · 计算机科学 2019-04-03 Konstantin Posch , Jürgen Pilz