English
Related papers

Related papers: Calibrating Deep Neural Network Classifiers on Out…

200 papers

In real world scenarios, out-of-distribution (OOD) datasets may have a large distributional shift from training datasets. This phenomena generally occurs when a trained classifier is deployed on varying dynamic environments, which causes a…

Image and Video Processing · Electrical Eng. & Systems 2022-09-08 Harshita Boonlia , Tanmoy Dam , Md Meftahul Ferdaus , Sreenatha G. Anavatti , Ankan Mullick

Reliable uncertainty calibration is essential for safely deploying deep neural networks in high-stakes applications. Deep neural networks are known to exhibit systematic overconfidence, especially under distribution shifts. Although…

Machine Learning · Computer Science 2025-06-12 Achim Hekler , Lukas Kuhn , Florian Buettner

Detecting out-of-distribution (OOD) samples are crucial for machine learning models deployed in open-world environments. Classifier-based scores are a standard approach for OOD detection due to their fine-grained detection capability.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Jaewoo Park , Yoon Gyo Jung , Andrew Beng Jin Teoh

Deep Neural Networks ( DNN s) are known to make overconfident mistakes, which makes their use problematic in safety-critical applications. State-of-the-art ( SOTA ) calibration techniques improve on the confidence of predicted labels alone…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ramya Hebbalaguppe , Jatin Prakash , Neelabh Madan , Chetan Arora

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

Machine Learning · Computer Science 2024-01-17 Soyed Tuhin Ahmed

Unsupervised continual learning aims to learn new tasks incrementally without requiring human annotations. However, most existing methods, especially those targeted on image classification, only work in a simplified scenario by assuming all…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Jiangpeng He , Fengqing Zhu

Out-of-distribution (OOD) detection is crucial for the deployment of machine learning models in the open world. While existing OOD detectors are effective in identifying OOD samples that deviate significantly from in-distribution (ID) data,…

Machine Learning · Computer Science 2024-12-10 Hao Fu , Prashanth Krishnamurthy , Siddharth Garg , Farshad Khorrami

The Monte Carlo dropout method has proved to be a scalable and easy-to-use approach for estimating the uncertainty of deep neural network predictions. This approach was recently applied to Fault Detection and Di-agnosis (FDD) applications…

Machine Learning · Computer Science 2019-09-11 Baihong Jin , Yingshui Tan , Yuxin Chen , Alberto Sangiovanni-Vincentelli

While deep neural networks have made remarkable progress in various vision tasks, their performance typically deteriorates when tested in out-of-distribution (OOD) scenarios. Many OOD methods focus on extracting domain-invariant features…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Qiaowei Miao , Yawei Luo , Yi Yang

Neural networks (NNs) are widely used for object classification in autonomous driving. However, NNs can fail on input data not well represented by the training dataset, known as out-of-distribution (OOD) data. A mechanism to detect OOD…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Julia Nitsch , Masha Itkina , Ransalu Senanayake , Juan Nieto , Max Schmidt , Roland Siegwart , Mykel J. Kochenderfer , Cesar Cadena

Deep Convolutional Neural Networks (DCNN) have established a remarkable performance benchmark in the field of image classification, displacing classical approaches based on hand-tailored aggregations of local descriptors. Yet DCNNs impose…

Computer Vision and Pattern Recognition · Computer Science 2015-03-16 Praveen Kulkarni , Joaquin Zepeda , Frederic Jurie , Patrick Perez , Louis Chevallier

Deep learning methods have boosted the adoption of NLP systems in real-life applications. However, they turn out to be vulnerable to distribution shifts over time which may cause severe dysfunctions in production systems, urging…

Computation and Language · Computer Science 2022-11-28 Pierre Colombo , Eduardo D. C. Gomes , Guillaume Staerman , Nathan Noiry , Pablo Piantanida

The success of Deep Neural Network (DNN) models significantly depends on the quality of provided annotations. In medical image segmentation, for example, having multiple expert annotations for each data point is common to minimize…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Asma Ahmed Hashmi , Aigerim Zhumabayeva , Nikita Kotelevskii , Artem Agafonov , Mohammad Yaqub , Maxim Panov , Martin Takáč

Building reliable classifiers is a fundamental challenge for deploying machine learning in real-world applications. A reliable system should not only detect out-of-distribution (OOD) inputs but also anticipate in-distribution (ID) errors by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Yang Li , Youyang Sha , Yinzhi Wang , Timothy Hospedales , Xi Shen , Shell Xu Hu , Xuanlong Yu

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

Image classification models deployed in the real world may receive inputs outside the intended data distribution. For critical applications such as clinical decision making, it is important that a model can detect such out-of-distribution…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Christoph Berger , Magdalini Paschali , Ben Glocker , Konstantinos Kamnitsas

Deep neural networks (DNNs) have become integral to a wide range of scientific and practical applications due to their flexibility and strong predictive performance. Despite their accuracy, however, DNNs frequently exhibit poor calibration,…

Machine Learning · Computer Science 2026-03-12 Sanne Ruijs , Alina Kosiakova , Farrukh Javed

We propose a deep learning-based solution for the problem of feature learning in one-class classification. The proposed method operates on top of a Convolutional Neural Network (CNN) of choice and produces descriptive features while…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Pramuditha Perera , Vishal M. Patel

We propose an algorithm combining calibrated prediction and generalization bounds from learning theory to construct confidence sets for deep neural networks with PAC guarantees---i.e., the confidence set for a given input contains the true…

Machine Learning · Computer Science 2020-02-18 Sangdon Park , Osbert Bastani , Nikolai Matni , Insup Lee

Real-world data usually present long-tailed distributions. Training on imbalanced data tends to render neural networks perform well on head classes while much worse on tail classes. The severe sparseness of training instances for the tail…

Machine Learning · Computer Science 2021-11-10 Chaozheng Wang , Shuzheng Gao , Cuiyun Gao , Pengyun Wang , Wenjie Pei , Lujia Pan , Zenglin Xu