English
Related papers

Related papers: Revisiting Confidence Estimation: Towards Reliable…

200 papers

Neural networks are often utilised in critical domain applications (e.g. self-driving cars, financial markets, and aerospace engineering), even though they exhibit overconfident predictions for ambiguous inputs. This deficiency demonstrates…

Machine Learning · Computer Science 2023-01-03 John Mitros , Brian Mac Namee

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

Reliable application of machine learning-based decision systems in the wild is one of the major challenges currently investigated by the field. A large portion of established approaches aims to detect erroneous predictions by means of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Paul F. Jaeger , Carsten T. Lüth , Lukas Klein , Till J. Bungert

Out-of-distribution (OOD) detection aims to identify OOD inputs from unknown classes, which is important for the reliable deployment of machine learning models in the open world. Various scoring functions are proposed to distinguish it from…

Machine Learning · Computer Science 2024-10-29 Boxuan Zhang , Jianing Zhu , Zengmao Wang , Tongliang Liu , Bo Du , Bo Han

Deep neural networks achieve superior performance in challenging tasks such as image classification. However, deep classifiers tend to incorrectly classify out-of-distribution (OOD) inputs, which are inputs that do not belong to the…

Machine Learning · Computer Science 2019-10-24 Vahdat Abdelzad , Krzysztof Czarnecki , Rick Salay , Taylor Denounden , Sachin Vernekar , Buu Phan

Detecting and rejecting unknown out-of-distribution (OOD) samples is critical for deployed neural networks to void unreliable predictions. In real-world scenarios, however, the efficacy of existing OOD detection methods is often impeded by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Kai Liu , Zhihang Fu , Sheng Jin , Chao Chen , Ze Chen , Rongxin Jiang , Fan Zhou , Yaowu Chen , Jieping Ye

Improving out-of-distribution (OOD) generalization during in-distribution (ID) adaptation is a primary goal of robust fine-tuning of zero-shot models beyond naive fine-tuning. However, despite decent OOD generalization performance from…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Changdae Oh , Hyesu Lim , Mijoo Kim , Dongyoon Han , Sangdoo Yun , Jaegul Choo , Alexander Hauptmann , Zhi-Qi Cheng , Kyungwoo Song

It is crucial to detect when an instance lies downright too far from the training samples for the machine learning model to be trusted, a challenge known as out-of-distribution (OOD) detection. For neural networks, one approach to this task…

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

Machine Learning · Computer Science 2021-12-03 Peyman Morteza , Yixuan Li

Out-of-distribution (OOD) detection is a critical task for ensuring the reliability and safety of deep neural networks in real-world scenarios. Different from most previous OOD detection methods that focus on designing OOD scores or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yao Zhu , YueFeng Chen , Chuanlong Xie , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , bolun zheng , Yaowu Chen

While the accuracy of modern deep learning models has significantly improved in recent years, the ability of these models to generate uncertainty estimates has not progressed to the same degree. Uncertainty methods are designed to provide…

Machine Learning · Statistics 2020-06-17 Adam M. Oberman , Chris Finlay , Alexander Iannantuono , Tiago Salvador

Uncertainty estimation is critical for cost-sensitive deep-learning applications (i.e. disease diagnosis). It is very challenging partly due to the inaccessibility of uncertainty groundtruth in most datasets. Previous works proposed to…

Machine Learning · Computer Science 2021-10-18 Bolian Li , Zige Zheng , Changqing Zhang

Out-of-distribution detection is an important capability that has long eluded vanilla neural networks. Deep Neural networks (DNNs) tend to generate over-confident predictions when presented with inputs that are significantly…

Machine Learning · Computer Science 2022-02-24 Sumedh A Sontakke , Buvaneswari Ramanan , Laurent Itti , Thomas Woo

Machine learning methods must be trusted to make appropriate decisions in real-world environments, even when faced with out-of-distribution (OOD) samples. Many current approaches simply aim to detect OOD examples and alert the user when an…

Machine Learning · Computer Science 2022-09-13 Randolph Linderman , Jingyang Zhang , Nathan Inkawhich , Hai Li , Yiran Chen

Standard recognition approaches are unable to deal with novel categories at test time. Their overconfidence on the known classes makes the predictions unreliable for safety-critical applications such as healthcare or autonomous driving.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Lorenzo Li Lu , Giulia D'Ascenzi , Francesco Cappio Borlino , Tatiana Tommasi

Detecting deepfakes has become a critical challenge in Computer Vision and Artificial Intelligence. Despite significant progress in detection techniques, generalizing them to open-set scenarios continues to be a persistent difficulty.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Luca Maiano , Fabrizio Casadei , Irene Amerini

The reliable measurement of confidence in classifiers' predictions is very important for many applications and is, therefore, an important part of classifier design. Yet, although deep learning has received tremendous attention in recent…

Artificial Intelligence · Computer Science 2020-07-01 Amit Mandelbaum , Daphna Weinshall

The ability of a deep learning network to distinguish between in-distribution (ID) and out-of-distribution (OOD) inputs is crucial for ensuring the reliability and trustworthiness of AI systems. Existing OOD detection methods often involve…

Machine Learning · Computer Science 2024-12-25 Gagandeep Singh , Ishan Mishra , Deepak Mishra

Modern convolutional neural networks (CNNs) are known to be overconfident in terms of their calibration on unseen input data. That is to say, they are more confident than they are accurate. This is undesirable if the probabilities predicted…

Machine Learning · Computer Science 2021-12-03 Guoxuan Xia , Sangwon Ha , Tiago Azevedo , Partha Maji

We study how the training data distribution affects confidence and performance in image classification models. We introduce Embedding Density, a model-agnostic framework that estimates prediction confidence by measuring the distance of test…

Machine Learning · Computer Science 2026-01-28 Maksim Kazanskii , Artem Kasianov