English
Related papers

Related papers: WAIC, but Why? Generative Ensembles for Robust Ano…

200 papers

Machine learning models often encounter samples that are diverged from the training distribution. Failure to recognize an out-of-distribution (OOD) sample, and consequently assign that sample to an in-class label significantly compromises…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Mohammadreza Salehi , Hossein Mirzaei , Dan Hendrycks , Yixuan Li , Mohammad Hossein Rohban , Mohammad Sabokrou

Out-of-distribution (OOD) detection has recently received much attention from the machine learning community due to its importance in deploying machine learning models in real-world applications. In this paper we propose an uncertainty…

Machine Learning · Computer Science 2022-06-28 Xiongjie Chen , Yunpeng Li , Yongxin Yang

It is crucial to detect when an instance lies downright too far from the training samples for the machine learning model to be trusted, a challenge known as out-of-distribution (OOD) detection. For neural networks, one approach to this task…

Out-of-Distribution detection between dataset pairs has been extensively explored with generative models. We show that likelihood-based Out-of-Distribution detection can be extended to diffusion models by leveraging the fact that they, like…

Machine Learning · Computer Science 2023-10-27 Joseph Goodier , Neill D. F. Campbell

Out-of-distribution (OOD) detection aims to identify test examples that do not belong to the training distribution and are thus unlikely to be predicted reliably. Despite a plethora of existing works, most of them focused only on the…

Machine Learning · Computer Science 2023-11-07 Reza Averly , Wei-Lun Chao

A reliable evaluation method is essential for building a robust out-of-distribution (OOD) detector. Current robustness evaluation protocols for OOD detectors rely on injecting perturbations to outlier data. However, the perturbations are…

Cryptography and Security · Computer Science 2022-08-24 Sangwoong Yoon , Jinwon Choi , Yonghyeon Lee , Yung-Kyun Noh , Frank Chongwoo Park

Predictive machine learning models generally excel on in-distribution data, but their performance degrades on out-of-distribution (OOD) inputs. Reliable deployment therefore requires robust OOD detection, yet this is particularly…

Machine Learning · Computer Science 2026-02-19 David Graber , Victor Armegioiu , Rebecca Buller , Siddhartha Mishra

In this paper, we propose a novel method for irregularity detection. Previous researches solve this problem as a One-Class Classification (OCC) task where they train a reference model on all of the available samples. Then, they consider a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Masoud Pourreza , Bahram Mohammadi , Mostafa Khaki , Samir Bouindour , Hichem Snoussi , Mohammad Sabokrou

To ensure robust and reliable classification results, OoD (out-of-distribution) indicators based on deep generative models are proposed recently and are shown to work well on small datasets. In this paper, we conduct the first large…

Machine Learning · Computer Science 2021-08-13 Wenxiao Chen , Xiaohui Nie , Mingliang Li , Dan Pei

As deep learning methods form a critical part in commercially important applications such as autonomous driving and medical diagnostics, it is important to reliably detect out-of-distribution (OOD) inputs while employing these algorithms.…

Machine Learning · Computer Science 2018-09-12 Apoorv Vyas , Nataraj Jammalamadaka , Xia Zhu , Dipankar Das , Bharat Kaul , Theodore L. Willke

Out-of-distribution detection (OOD) deals with anomalous input to neural networks. In the past, specialized methods have been proposed to reject predictions on anomalous input. Similarly, it was shown that feature extraction models in…

Machine Learning · Computer Science 2022-01-25 Jan Diers , Christian Pigorsch

In this work, we train a network to simultaneously perform segmentation and pixel-wise Out-of-Distribution (OoD) detection, such that the segmentation of unknown regions of scenes can be rejected. This is made possible by leveraging an OoD…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 David Williams , Matthew Gadd , Daniele De Martini , Paul Newman

Density-based Out-of-distribution (OOD) detection has recently been shown unreliable for the task of detecting OOD images. Various density ratio based approaches achieve good empirical performance, however methods typically lack a…

Machine Learning · Statistics 2022-06-09 Mingtian Zhang , Andi Zhang , Tim Z. Xiao , Yitong Sun , Steven McDonagh

Numerous machine learning (ML) models have been developed, including those for software engineering (SE) tasks, under the assumption that training and testing data come from the same distribution. However, training and testing distributions…

Software Engineering · Computer Science 2025-03-04 Yanfu Yan , Viet Duong , Huajie Shao , Denys Poshyvanyk

The unsupervised outlier detection (UOD) problem refers to a task to identify inliers given training data which contain outliers as well as inliers, without any labeled information about inliers and outliers. It has been widely recognized…

Machine Learning · Statistics 2024-07-17 Dongha Kim , Jaesung Hwang , Jongjin Lee , Kunwoong Kim , Yongdai Kim

Deep generative models have been demonstrated as problematic in the unsupervised out-of-distribution (OOD) detection task, where they tend to assign higher likelihoods to OOD samples. Previous studies on this issue are usually not…

Machine Learning · Computer Science 2024-01-04 Zezhen Zeng , Bin Liu

Being able to successfully determine whether the testing samples has similar distribution as the training samples is a fundamental question to address before we can safely deploy most of the machine learning models into practice. In this…

Machine Learning · Computer Science 2024-05-07 Zhaiming Shen , Menglun Wang , Guang Cheng , Ming-Jun Lai , Lin Mu , Ruihao Huang , Qi Liu , Hao Zhu

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Haoyue Bai

Uncertainty estimation is a key component in any deployed machine learning system. One way to evaluate uncertainty estimation is using "out-of-distribution" (OoD) detection, that is, distinguishing between the training data distribution and…

Machine Learning · Computer Science 2021-12-03 Haiwen Huang , Joost van Amersfoort , Yarin Gal

Out-of-distribution (OOD) detection is essential for deploying machine learning models in open-world and safety-critical scenarios, where test inputs may deviate from the training distribution and overconfident predictions on unknown…

Machine Learning · Computer Science 2026-05-28 Fengqiang Wan , Qing-Yuan Jiang , Yang Yang