English
Related papers

Related papers: Towards Reliable Uncertainty Quantification via De…

200 papers

Increasingly high-stakes decisions are made using neural networks in order to make predictions. Specifically, meteorologists and hedge funds apply these techniques to time series data. When it comes to prediction, there are certain…

Machine Learning · Computer Science 2022-11-14 Levente Foldesi , Matias Valdenegro-Toro

When the cost of misclassifying a sample is high, it is useful to have an accurate estimate of uncertainty in the prediction for that sample. There are also multiple types of uncertainty which are best estimated in different ways, for…

Machine Learning · Computer Science 2019-03-18 Richard Harang , Ethan M. Rudd

Characterizing uncertainty is a common issue in nuclear measurement and has important implications for reliable physical discovery. Traditional methods are either insufficient to cope with the heterogeneous nature of uncertainty or…

Data Analysis, Statistics and Probability · Physics 2022-03-01 Pengcheng Ai , Zhi Deng , Yi Wang , Chendi Shen

While deep neural networks have become the go-to approach in computer vision, the vast majority of these models fail to properly capture the uncertainty inherent in their predictions. Estimating this predictive uncertainty can be crucial,…

Machine Learning · Computer Science 2020-04-08 Fredrik K. Gustafsson , Martin Danelljan , Thomas B. Schön

Calibration error is commonly adopted for evaluating the quality of uncertainty estimators in deep neural networks. In this paper, we argue that such a metric is highly beneficial for training predictive models, even when we do not…

Machine Learning · Statistics 2019-11-01 Jayaraman J. Thiagarajan , Bindya Venkatesh , Deepta Rajan

We propose a novel, succinct, and effective approach for distribution prediction to quantify uncertainty in machine learning. It incorporates adaptively flexible distribution prediction of $\mathbb{P}(\mathbf{y}|\mathbf{X}=x)$ in regression…

Machine Learning · Computer Science 2023-06-21 Xing Yan , Yonghua Su , Wenxuan Ma

Machine learning methods for the construction of data-driven reduced order model models are used in an increasing variety of engineering domains, especially as a supplement to expensive computational fluid dynamics for design problems. An…

Machine Learning · Statistics 2023-06-28 Stephen Guth , Alireza Mojahed , Themistoklis P. Sapsis

Bayesian Neural Networks (BNNs) offer a principled and natural framework for proper uncertainty quantification in the context of deep learning. They address the typical challenges associated with conventional deep learning methods, such as…

Computation · Statistics 2024-11-13 Zahra Moslemi , Yang Meng , Shiwei Lan , Babak Shahbaba

Uncertainty quantification plays an important role in achieving trustworthy and reliable learning-based computational imaging. Recent advances in generative modeling and Bayesian neural networks have enabled the development of…

Image and Video Processing · Electrical Eng. & Systems 2025-10-07 Canberk Ekmekci , Mujdat Cetin

Neural network classifiers trained with cross-entropy loss achieve strong predictive accuracy but lack the capability to provide inherent predictive uncertainty estimates, thus requiring external techniques to obtain these estimates. In…

Machine Learning · Statistics 2026-04-08 Courtney Franzen , Farhad Pourkamali-Anaraki

The applications of artificial intelligence (AI) are rapidly evolving, and they are also commonly used in safety-critical domains, such as autonomous driving and medical diagnosis, where functional safety is paramount. In AI-driven systems,…

Machine Learning · Computer Science 2024-05-12 Soyed Tuhin Ahmed , Michael Hefenbrock , Mehdi B. Tahoori

To achieve high performance of a machine learning (ML) task, a deep learning-based model must implicitly capture the entire distribution from data. Thus, it requires a huge amount of training samples, and data are expected to fully present…

Machine Learning · Computer Science 2021-11-17 Hung Nguyen , Morris Chang

Uncertainty quantification is an important and challenging problem in deep learning. Previous methods rely on dropout layers which are not present in modern deep architectures or batch normalization which is sensitive to batch sizes. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Lukasz Wandzik , Raul Vicente Garcia , Jörg Krüger

While deep ensembles are widely considered to be the default method for uncertainty quantification in deep learning, their effectiveness for graph-structured data is often simply assumed based on successes in domains like computer vision.…

Machine Learning · Computer Science 2026-05-22 Pedro C. Vieira , Pedro Ribeiro , Viacheslav Borovitskiy

Uncertainty Quantification (UQ) is essential in probabilistic machine learning models, particularly for assessing the reliability of predictions. In this paper, we present a systematic framework for estimating both epistemic and aleatoric…

Machine Learning · Statistics 2025-09-11 Marzieh Ajirak , Anand Ravishankar , Petar M. Djuric

The proliferation of Deep Neural Networks has resulted in machine learning systems becoming increasingly more present in various real-world applications. Consequently, there is a growing demand for highly reliable models in many domains,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Pedro Conde , Rui L. Lopes , Cristiano Premebida

Data-driven methods based on machine learning have the potential to accelerate computational analysis of atomic structures. In this context, reliable uncertainty estimates are important for assessing confidence in predictions and enabling…

Machine Learning · Computer Science 2021-11-04 Jonas Busk , Peter Bjørn Jørgensen , Arghya Bhowmik , Mikkel N. Schmidt , Ole Winther , Tejs Vegge

Neural networks (NNs) lack measures of "reliability" estimation that would enable reasoning over their predictions. Despite the vital importance, especially in areas of human well-being and health, state-of-the-art uncertainty estimation…

Machine Learning · Computer Science 2021-02-12 Lorena Qendro , Jagmohan Chauhan , Alberto Gil C. P. Ramos , Cecilia Mascolo

Quantifying uncertainty and updating reliability are essential for ensuring the safety and performance of engineering systems. This study develops a hierarchical Bayesian modeling (HBM) framework to quantify uncertainty and update…

Methodology · Statistics 2024-12-31 Xinyu Jia , Weinan Hou , Costas Papadimitriou

We propose a simple method that combines neural networks and Gaussian processes. The proposed method can estimate the uncertainty of outputs and flexibly adjust target functions where training data exist, which are advantages of Gaussian…

Machine Learning · Statistics 2017-07-20 Tomoharu Iwata , Zoubin Ghahramani