English
Related papers

Related papers: Which models are innately best at uncertainty esti…

200 papers

Confidence estimation, a task that aims to evaluate the trustworthiness of the model's prediction output during deployment, has received lots of research attention recently, due to its importance for the safe deployment of deep models.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Haoxuan Qu , Yanchao Li , Lin Geng Foo , Jason Kuen , Jiuxiang Gu , Jun Liu

In this paper, we revisit techniques for uncertainty estimation within deep neural networks and consolidate a suite of techniques to enhance their reliability. Our investigation reveals that an integrated application of diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Yuting Li , Yingyi Chen , Xuanlong Yu , Dexiong Chen , Xi Shen

Neural networks are ubiquitous in many tasks, but trusting their predictions is an open issue. Uncertainty quantification is required for many applications, and disentangled aleatoric and epistemic uncertainties are best. In this paper, we…

Machine Learning · Computer Science 2022-04-21 Matias Valdenegro-Toro , Daniel Saromo

Uncertainty estimation is an essential step in the evaluation of the robustness for deep learning models in computer vision, especially when applied in risk-sensitive areas. However, most state-of-the-art deep learning models either fail to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Lu Mi , Hao Wang , Yonglong Tian , Hao He , Nir Shavit

Estimating uncertainty in deep learning models is critical for reliable decision-making in high-stakes applications such as medical imaging. Prior research has established that the difference between an input sample and its reconstructed…

Machine Learning · Computer Science 2026-01-28 Xinran Xu , Li Rong Wang , Xiuyi Fan

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

Improving calibration performance in deep learning (DL) classification models is important when planning the use of DL in a decision-support setting. In such a scenario, a confident wrong prediction could lead to a lack of trust and/or harm…

Machine Learning · Computer Science 2024-05-13 Tareen Dawood , Bram Ruijsink , Reza Razavi , Andrew P. King , Esther Puyol-Antón

Building robust online content recommendation systems requires learning complex interactions between user preferences and content features. The field has evolved rapidly in recent years from traditional multi-arm bandit and collaborative…

Information Retrieval · Computer Science 2018-05-08 Yoel Zeldes , Stavros Theodorakis , Efrat Solodnik , Aviv Rotman , Gil Chamiel , Dan Friedman

Reliable uncertainty quantification is crucial for trustworthy decision-making and the deployment of AI models in medical imaging. While prior work has explored the ability of neural networks to quantify predictive, epistemic, and aleatoric…

Machine Learning · Statistics 2025-08-07 Simon Baur , Wojciech Samek , Jackie Ma

Out-of-distribution (OOD) detection and uncertainty estimation (UE) are critical components for building safe machine learning systems, especially in real-world scenarios where unexpected inputs are inevitable. However the two problems…

Machine Learning · Computer Science 2025-12-01 Pirzada Suhail , Rehna Afroz , Gouranga Bala , Amit Sethi

Deep neural networks tend to make overconfident predictions and often require additional detectors for misclassifications, particularly for safety-critical applications. Existing detection methods usually only focus on adversarial attacks…

Machine Learning · Computer Science 2023-07-07 Julia Lust , Alexandru P. Condurache

With the increasing deployment of machine learning models in many socially sensitive tasks, there is a growing demand for reliable and trustworthy predictions. One way to accomplish these requirements is to allow a model to abstain from…

Machine Learning · Computer Science 2024-09-19 Andrea Pugnana , Lorenzo Perini , Jesse Davis , Salvatore Ruggieri

We present a deep transformation model for probabilistic regression. Deep learning is known for outstandingly accurate predictions on complex data but in regression tasks, it is predominantly used to just predict a single number. This…

Machine Learning · Statistics 2020-04-02 Beate Sick , Torsten Hothorn , Oliver Dürr

Out-of-distribution (OOD) detection is crucial for deploying robust and reliable machine-learning systems in open-world settings. Despite steady advances in OOD detectors, their interplay with modern training pipelines that maximize…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Gerhard Krumpl , Henning Avenhaus , Horst Possegger

Prediction models based on deep neural networks are increasingly gaining attention for fast and accurate virtual screening systems. For decision makings in virtual screening, researchers find it useful to interpret an output of…

Machine Learning · Computer Science 2020-03-18 Soojung Yang , Kyung Hoon Lee , Seongok Ryu

Uncertainty is a key feature of any machine learning model and is particularly important in neural networks, which tend to be overconfident. This overconfidence is worrying under distribution shifts, where the model performance silently…

Machine Learning · Computer Science 2024-03-18 Arthur Thuy , Dries F. Benoit

Deep learning has emerged as a promising paradigm to give access to highly accurate predictions of molecular and materials properties. A common short-coming shared by current approaches, however, is that neural networks only give point…

Computational Physics · Physics 2023-05-10 Albert Zhu , Simon Batzner , Albert Musaelian , Boris Kozinsky

Discriminative self-supervised learning allows training models on any random group of internet images, and possibly recover salient information that helps differentiate between the images. Applied to ImageNet, this leads to object centric…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Priya Goyal , Quentin Duval , Isaac Seessel , Mathilde Caron , Ishan Misra , Levent Sagun , Armand Joulin , Piotr Bojanowski

Adoption of deep learning in safety-critical systems raise the need for understanding what deep neural networks do not understand after models have been deployed. The behaviour of deep neural networks is undefined for so called…

Machine Learning · Computer Science 2021-08-25 Rickard Sjögren , Johan Trygg

Deep neural networks have shown exceptional performance in various tasks, but their lack of robustness, reliability, and tendency to be overconfident pose challenges for their deployment in safety-critical applications like autonomous…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Steven Landgraf , Markus Hillemann , Kira Wursthorn , Markus Ulrich