English
Related papers

Related papers: Open Set Recognition Through Deep Neural Network U…

200 papers

Image classification models deployed in the real world may receive inputs outside the intended data distribution. For critical applications such as clinical decision making, it is important that a model can detect such out-of-distribution…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Christoph Berger , Magdalini Paschali , Ben Glocker , Konstantinos Kamnitsas

Recent work has shown that deep generative models assign higher likelihood to out-of-distribution inputs than to training data. We show that a factor underlying this phenomenon is a mismatch between the nature of the prior distribution and…

Machine Learning · Statistics 2019-11-18 Ryo Kamoi , Kei Kobayashi

In many real-world classification or recognition tasks, it is often difficult to collect training examples that exhaust all possible classes due to, for example, incomplete knowledge during training or ever changing regimes. Therefore,…

Machine Learning · Computer Science 2024-08-07 Guanchao Feng , Dhruv Desai , Stefano Pasquali , Dhagash Mehta

Deep neural networks (DNNs) are often constructed under the closed-world assumption, which may fail to generalize to the out-of-distribution (OOD) data. This leads to DNNs producing overconfident wrong predictions and can result in…

Machine Learning · Statistics 2024-12-31 Yang Chen , Chih-Li Sung , Arpan Kusari , Xiaoyang Song , Wenbo Sun

In most works on deep incremental learning research, it is assumed that novel samples are pre-identified for neural network retraining. However, practical deep classifiers often misidentify these samples, leading to erroneous predictions.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Jiawen Xu , Claas Grohnfeldt , Odej Kao

Supervised learning aims to train a classifier under the assumption that training and test data are from the same distribution. To ease the above assumption, researchers have studied a more realistic setting: out-of-distribution (OOD)…

Machine Learning · Computer Science 2023-02-28 Zhen Fang , Yixuan Li , Jie Lu , Jiahua Dong , Bo Han , Feng Liu

Out-of-distribution (OOD) detection is essential to handle the distribution shifts between training and test scenarios. For a new in-distribution (ID) dataset, existing methods require retraining to capture the dataset-specific feature…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Meng Xing , Zhiyong Feng , Yong Su , Changjae Oh

Robustness to out-of-distribution (OOD) data is an important goal in building reliable machine learning systems. Especially in autonomous systems, wrong predictions for OOD inputs can cause safety critical situations. As a first step…

Machine Learning · Computer Science 2020-04-17 Andreas Sedlmeier , Thomas Gabor , Thomy Phan , Lenz Belzner , Claudia Linnhoff-Popien

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

Detection and rejection of adversarial examples in security sensitive and safety-critical systems using deep CNNs is essential. In this paper, we propose an approach to augment CNNs with out-distribution learning in order to reduce…

Cryptography and Security · Computer Science 2018-05-17 Mahdieh Abbasi , Arezoo Rajabi , Christian Gagné , Rakesh B. Bobba

Deep neural networks often suffer from overconfidence which can be partly remedied by improved out-of-distribution detection. For this purpose, we propose a novel approach that allows for the generation of out-of-distribution datasets based…

Machine Learning · Computer Science 2021-05-10 Felix Möller , Diego Botache , Denis Huseljic , Florian Heidecker , Maarten Bieshaar , Bernhard Sick

Out-of-distribution (OOD) detection and uncertainty estimation (UE) are critical components for building safe machine learning systems, especially in real-world scenarios where unexpected inputs are inevitable. However the two problems…

Machine Learning · Computer Science 2025-12-01 Pirzada Suhail , Rehna Afroz , Gouranga Bala , Amit Sethi

Although deep neural networks are effective on supervised learning tasks, they have been shown to be brittle. They are prone to overfitting on their training distribution and are easily fooled by small adversarial perturbations. In this…

Machine Learning · Computer Science 2020-10-07 Laëtitia Shao , Yang Song , Stefano Ermon

Machine learning models often encounter samples that are diverged from the training distribution. Failure to recognize an out-of-distribution (OOD) sample, and consequently assign that sample to an in-class label significantly compromises…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Mohammadreza Salehi , Hossein Mirzaei , Dan Hendrycks , Yixuan Li , Mohammad Hossein Rohban , Mohammad Sabokrou

Out-Of-Distribution (OOD) detection has received broad attention over the years, aiming to ensure the reliability and safety of deep neural networks (DNNs) in real-world scenarios by rejecting incorrect predictions. However, we notice a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yao Zhu , Yuefeng Chen , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , Rongxin Jiang , Bolun Zheng , Yaowu Chen

There is a significant need for principled uncertainty reasoning in machine learning systems as they are increasingly deployed in safety-critical domains. A new approach with uncertainty-aware regression-based neural networks (NNs), based…

Machine Learning · Computer Science 2023-07-21 Nis Meinert , Jakob Gawlikowski , Alexander Lavin

Uncertainty-based deep learning models have attracted a great deal of interest for their ability to provide accurate and reliable predictions. Evidential deep learning stands out achieving remarkable performance in detecting…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Eduardo Aguilar , Bogdan Raducanu , Petia Radeva , Joost Van de Weijer

Graph learning has been crucial to many real-world tasks, but they are often studied with a closed-world assumption, with all possible labels of data known a priori. To enable effective graph learning in an open and noisy environment, it is…

Machine Learning · Computer Science 2025-08-04 Weijie Guan , Haohui Wang , Jian Kang , Lihui Liu , Dawei Zhou

A fundamental feature of human intelligence is the ability to infer high-level abstractions from low-level sensory data. An essential component of such inference is the ability to discover modularized generative mechanisms. Despite many…

Machine Learning · Computer Science 2023-06-08 Peyman Sheikholharam Mashhadi , Slawomir Nowaczyk

Density-based Out-of-distribution (OOD) detection has recently been shown unreliable for the task of detecting OOD images. Various density ratio based approaches achieve good empirical performance, however methods typically lack a…

Machine Learning · Statistics 2022-06-09 Mingtian Zhang , Andi Zhang , Tim Z. Xiao , Yitong Sun , Steven McDonagh