English
Related papers

Related papers: A framework for benchmarking class-out-of-distribu…

200 papers

Reinforcement Learning (RL) based solutions are being adopted in a variety of domains including robotics, health care and industrial automation. Most focus is given to when these solutions work well, but they fail when presented with out of…

Machine Learning · Computer Science 2021-12-07 Aaqib Parvez Mohammed , Matias Valdenegro-Toro

The inability of deep learning models to handle data drawn from unseen distributions has sparked much interest in unsupervised out-of-distribution (U-OOD) detection, as it is crucial for reliable deep learning models. Despite considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Lars Doorenbos , Raphael Sznitman , Pablo Márquez-Neila

Class incremental learning (CIL) aims to learn a model that can not only incrementally accommodate new classes, but also maintain the learned knowledge of old classes. Out-of-distribution (OOD) detection in CIL is to retain this incremental…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Wenjun Miao , Guansong Pang , Trong-Tung Nguyen , Ruohang Fang , Jin Zheng , Xiao Bai

Out-of-Distribution (OOD) detection is critical to AI reliability and safety, yet in many practical settings, only a limited amount of training data is available. Bayesian Neural Networks (BNNs) are a promising class of model on which to…

Machine Learning · Computer Science 2026-02-12 Kevin Raina , Tanya Schmah

We consider the problem of detecting out-of-distribution images in neural networks. We propose ODIN, a simple and effective method that does not require any change to a pre-trained neural network. Our method is based on the observation that…

Machine Learning · Computer Science 2020-09-01 Shiyu Liang , Yixuan Li , R. Srikant

Detecting out-of-distribution (OOD) data is a fundamental challenge in the deployment of machine learning models. From a security standpoint, this is particularly important because OOD test data can result in misleadingly confident yet…

Machine Learning · Computer Science 2025-02-25 Onat Gungor , Amanda Sofie Rios , Nilesh Ahuja , Tajana Rosing

Out-of-distribution (OOD) detection refers to training the model on an in-distribution (ID) dataset to classify whether the input images come from unknown classes. Considerable effort has been invested in designing various OOD detection…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Hualiang Wang , Yi Li , Huifeng Yao , Xiaomeng Li

Using unlabeled data to regularize the machine learning models has demonstrated promise for improving safety and reliability in detecting out-of-distribution (OOD) data. Harnessing the power of unlabeled in-the-wild data is non-trivial due…

Machine Learning · Computer Science 2024-02-07 Xuefeng Du , Zhen Fang , Ilias Diakonikolas , Yixuan Li

Out-of-distribution (OOD) detection is crucial when deploying deep neural networks in the real world to ensure the reliability and safety of their applications. One main challenge in OOD detection is that neural network models often produce…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jinlun Ye , Zhuohao Sun , Yiqiao Qiu , Qiu Li , Zhijun Tan , Ruixuan Wang

Improving the reliability of deployed machine learning systems often involves developing methods to detect out-of-distribution (OOD) inputs. However, existing research often narrowly focuses on samples from classes that are absent from the…

Machine Learning · Computer Science 2024-12-11 Charles Guille-Escuret , Pierre-André Noël , Ioannis Mitliagkas , David Vazquez , Joao Monteiro

Classifying samples as in-distribution or out-of-distribution (OOD) is a challenging problem of anomaly detection and a strong test of the generalisation power for models of the in-distribution. In this paper, we present a simple and…

Machine Learning · Computer Science 2021-03-29 Nima Rafiee , Rahil Gholamipoor , Markus Kollmann

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

Machine Learning · Statistics 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

The usage of deep neural networks in safety-critical systems is limited by our ability to guarantee their correct behavior. Runtime monitors are components aiming to identify unsafe predictions and discard them before they can lead to…

Machine Learning · Computer Science 2023-01-16 Joris Guérin , Kevin Delmas , Raul Sena Ferreira , Jérémie Guiochet

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

Machine Learning · Computer Science 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

Vanilla CNNs, as uncalibrated classifiers, suffer from classifying out-of-distribution (OOD) samples nearly as confidently as in-distribution samples. To tackle this challenge, some recent works have demonstrated the gains of leveraging…

Machine Learning · Computer Science 2020-11-20 Mahdieh Abbasi , Changjian Shui , Arezoo Rajabi , Christian Gagne , Rakesh Bobba

Machine learning models often encounter samples that are diverged from the training distribution. Failure to recognize an out-of-distribution (OOD) sample, and consequently assign that sample to an in-class label significantly compromises…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Mohammadreza Salehi , Hossein Mirzaei , Dan Hendrycks , Yixuan Li , Mohammad Hossein Rohban , Mohammad Sabokrou

Out-of-distribution (OOD) detection is crucial for ensuring the reliability and safety of machine learning models in real-world applications. While zero-shot OOD detection, which requires no training on in-distribution (ID) data, has become…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Yu Liu , Hao Tang , Haiqi Zhang , Jing Qin , Zechao Li

Most existing out-of-distribution (OOD) detection benchmarks classify samples with novel labels as the OOD data. However, some marginal OOD samples actually have close semantic contents to the in-distribution (ID) sample, which makes…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Xingming Long , Jie Zhang , Shiguang Shan , Xilin Chen

Out-of-distribution (OOD) detection plays a crucial role in ensuring the robustness and reliability of machine learning systems deployed in real-world applications. Recent approaches have explored the use of unlabeled data, showing…

Machine Learning · Computer Science 2025-10-09 Momin Abbas , Ali Falahati , Hossein Goli , Mohammad Mohammadi Amiri

Data outside the problem domain poses significant threats to the security of AI-based intelligent systems. Aiming to investigate the data domain and out-of-distribution (OOD) data in AI quality management (AIQM) study, this paper proposes…

Artificial Intelligence · Computer Science 2023-10-13 Tinghui Ouyang , Isao Echizen , Yoshiki Seo