English
Related papers

Related papers: Beyond Uncertainty Quantification: Learning Uncert…

200 papers

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with…

Machine Learning · Computer Science 2023-02-08 Apostolos F Psaros , Xuhui Meng , Zongren Zou , Ling Guo , George Em Karniadakis

Uncertainty quantification (UQ) is important for reliability assessment and enhancement of machine learning models. In deep learning, uncertainties arise not only from data, but also from the training procedure that often injects…

Machine Learning · Statistics 2023-11-13 Ziyi Huang , Henry Lam , Haofeng Zhang

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

Popular approaches for quantifying predictive uncertainty in deep neural networks often involve distributions over weights or multiple models, for instance via Markov Chain sampling, ensembling, or Monte Carlo dropout. These techniques…

Machine Learning · Computer Science 2023-03-08 Dennis Ulmer , Christian Hardmeier , Jes Frellsen

Increasingly high-stakes decisions are made using neural networks in order to make predictions. Specifically, meteorologists and hedge funds apply these techniques to time series data. When it comes to prediction, there are certain…

Machine Learning · Computer Science 2022-11-14 Levente Foldesi , Matias Valdenegro-Toro

Deep learning (DL) has recently attracted increasing interest to improve object type classification for automotive radar.In addition to high accuracy, it is crucial for decision making in autonomous vehicles to evaluate the reliability of…

Machine Learning · Computer Science 2021-06-11 Kanil Patel , William Beluch , Kilian Rambach , Adriana-Eliza Cozma , Michael Pfeiffer , Bin Yang

Uncertainty quantification is a key pillar of trustworthy machine learning. It enables safe reactions under unsafe inputs, like predicting only when the machine learning model detects sufficient evidence, discarding anomalous data, or…

Machine Learning · Computer Science 2024-08-27 Michael Kirchhof

Trustworthiness in neural networks is crucial for their deployment in critical applications, where reliability, confidence, and uncertainty play pivotal roles in decision-making. Traditional performance metrics such as accuracy and…

Machine Learning · Computer Science 2025-09-05 Koffi Ismael Ouattara , Ioannis Krontiris , Theo Dimitrakos , Frank Kargl

The opaque nature of transformer-based models, particularly in applications susceptible to unethical practices such as dark-patterns in user interfaces, requires models that integrate uncertainty quantification to enhance trust in…

Machine Learning · Computer Science 2024-12-09 Javier Muñoz , Álvaro Huertas-García , Carlos Martí-González , Enrique De Miguel Ambite

The inability of artificial neural networks to assess the uncertainty of their predictions is an impediment to their widespread use. We distinguish two types of learnable uncertainty: model uncertainty due to a lack of training data and…

Machine Learning · Computer Science 2022-06-14 Hans Weytjens , Jochen De Weerdt

Uncertainty quantification is an important and challenging problem in deep learning. Previous methods rely on dropout layers which are not present in modern deep architectures or batch normalization which is sensitive to batch sizes. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Lukasz Wandzik , Raul Vicente Garcia , Jörg Krüger

Modern convolutional neural networks (CNNs) are known to be overconfident in terms of their calibration on unseen input data. That is to say, they are more confident than they are accurate. This is undesirable if the probabilities predicted…

Machine Learning · Computer Science 2021-12-03 Guoxuan Xia , Sangwon Ha , Tiago Azevedo , Partha Maji

Neural networks (NNs) lack measures of "reliability" estimation that would enable reasoning over their predictions. Despite the vital importance, especially in areas of human well-being and health, state-of-the-art uncertainty estimation…

Machine Learning · Computer Science 2021-02-12 Lorena Qendro , Jagmohan Chauhan , Alberto Gil C. P. Ramos , Cecilia Mascolo

There has been a growing interest in deep learning-based prognostic and health management (PHM) for building end-to-end maintenance decision support systems, especially due to the rapid development of autonomous systems. However, the low…

Machine Learning · Computer Science 2021-11-02 Taotao Zhou , Enrique Lopez Droguett , Ali Mosleh , Felix T. S. Chan

The importance of uncertainty quantification is increasingly recognized in the diverse field of machine learning. Accurately assessing model prediction uncertainty can help provide deeper understanding and confidence for researchers and…

Machine Learning · Computer Science 2024-12-03 Tianyi Chen , Yingzhou Lu , Nan Hao , Yuanyuan Zhang , Capucine Van Rechem , Jintai Chen , Tianfan Fu

Uncertainty quantification for deep learning is a challenging open problem. Bayesian statistics offer a mathematically grounded framework to reason about uncertainties; however, approximate posteriors for modern neural networks still…

Machine Learning · Statistics 2020-01-23 Nicolas Brosse , Carlos Riquelme , Alice Martin , Sylvain Gelly , Éric Moulines

Fair predictive algorithms hinge on both equality and trust, yet inherent uncertainty in real-world data challenges our ability to make consistent, fair, and calibrated decisions. While fairly managing predictive error has been extensively…

Machine Learning · Computer Science 2024-10-04 Lucas Rosenblatt , R. Teal Witter

Deep neural networks have proven to be extremely powerful, however, they are also vulnerable to adversarial attacks which can cause hazardous incorrect predictions in safety-critical applications. Certified robustness via randomized…

Machine Learning · Computer Science 2024-10-29 Sina Däubener , Kira Maag , David Krueger , Asja Fischer

Uncertainty estimation is critical for numerous applications of deep neural networks and draws growing attention from researchers. Here, we demonstrate an uncertainty quantification approach for deep neural networks used in inverse problems…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Luzhe Huang , Jianing Li , Xiaofu Ding , Yijie Zhang , Hanlong Chen , Aydogan Ozcan

Uncertainty estimation in machine learning has traditionally focused on the prediction stage, aiming to quantify confidence in model outputs while treating learned representations as deterministic and reliable by default. In this work, we…

Machine Learning · Statistics 2026-02-20 Yiyao Yang