English
Related papers

Related papers: EntropyStop: Unsupervised Deep Outlier Detection w…

200 papers

In this study, we propose a three-stage training approach of neural networks for both photometric redshift estimation of galaxies and detection of out-of-distribution (OOD) objects. Our approach comprises supervised and unsupervised…

Instrumentation and Methods for Astrophysics · Physics 2022-02-04 Joongoo Lee , Min-Su Shin

Outlier detection (OD) is the task of identifying unusual observations (or outliers) from a given or upcoming data by learning unique patterns of normal observations (or inliers). Recently, a study introduced a powerful unsupervised OD…

Machine Learning · Statistics 2025-01-08 Seoyoung Cho , Jaesung Hwang , Kwan-Young Bak , Dongha Kim

Early stopping methods in deep learning face the challenge of balancing the volume of training and validation data, especially in the presence of label noise. Concretely, sparing more data for validation from training data would limit the…

Machine Learning · Computer Science 2025-02-12 Suqin Yuan , Lei Feng , Tongliang Liu

Machine learning models often encounter samples that are diverged from the training distribution. Failure to recognize an out-of-distribution (OOD) sample, and consequently assign that sample to an in-class label significantly compromises…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Mohammadreza Salehi , Hossein Mirzaei , Dan Hendrycks , Yixuan Li , Mohammad Hossein Rohban , Mohammad Sabokrou

Out-of-distribution (OOD) detection is critical to ensure the safe deployment of deep learning models in critical applications. Deep learning models can often misidentify OOD samples as in-distribution (ID) samples. This vulnerability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Sudarshan Regmi

For classification tasks, deep neural networks are prone to overfitting in the presence of label noise. Although existing methods are able to alleviate this problem at low noise levels, they encounter significant performance reduction at…

Machine Learning · Computer Science 2021-05-31 Jingyi Xu , Tony Q. S. Quek , Kai Fong Ernest Chong

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

Machine Learning · Statistics 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

In this study, a novel idea, Uncertainty Structure Estimation (USE), a lightweight, algorithm-agnostic procedure that emphasizes the often-overlooked role of unlabeled data quality is introduced for Semi-supervised learning (SSL). SSL has…

Machine Learning · Computer Science 2026-03-03 Tsao-Lun Chen , Chien-Liang Liu , Tzu-Ming Harry Hsu , Tai-Hsien Wu , Chi-Cheng Fu , Han-Yi E. Chou , Shun-Feng Su

Improving the reliability of deployed machine learning systems often involves developing methods to detect out-of-distribution (OOD) inputs. However, existing research often narrowly focuses on samples from classes that are absent from the…

Machine Learning · Computer Science 2024-12-11 Charles Guille-Escuret , Pierre-André Noël , Ioannis Mitliagkas , David Vazquez , Joao Monteiro

Deep approaches to anomaly detection have recently shown promising results over shallow methods on large and complex datasets. Typically anomaly detection is treated as an unsupervised learning problem. In practice however, one may…

Recent research underscores the pivotal role of the Out-of-Distribution (OOD) feature representation field scale in determining the efficacy of models in OOD detection. Consequently, the adoption of model ensembles has emerged as a…

Machine Learning · Computer Science 2024-08-19 Chenhui Xu , Fuxun Yu , Zirui Xu , Nathan Inkawhich , Xiang Chen

It is important to detect anomalous inputs when deploying machine learning systems. The use of larger and more complex inputs in deep learning magnifies the difficulty of distinguishing between anomalous and in-distribution examples. At the…

Machine Learning · Computer Science 2019-01-30 Dan Hendrycks , Mantas Mazeika , Thomas Dietterich

In supervised machine learning, the assumption that training data is labelled correctly is not always satisfied. In this paper, we investigate an instance of labelling error for classification tasks in which the dataset is corrupted with…

Sound · Computer Science 2020-02-13 Turab Iqbal , Yin Cao , Qiuqiang Kong , Mark D. Plumbley , Wenwu Wang

This paper deals with uncertainty quantification and out-of-distribution detection in deep learning using Bayesian and ensemble methods. It proposes a practical solution to the lack of prediction diversity observed recently for standard…

Machine Learning · Computer Science 2025-02-03 Antoine de Mathelin , François Deheeger , Mathilde Mougeot , Nicolas Vayatis

Out-of-distribution (OOD) detection and uncertainty estimation (UE) are critical components for building safe machine learning systems, especially in real-world scenarios where unexpected inputs are inevitable. However the two problems…

Machine Learning · Computer Science 2025-12-01 Pirzada Suhail , Rehna Afroz , Gouranga Bala , Amit Sethi

Diagnosing and cleaning data is a crucial step for building robust machine learning systems. However, identifying problems within large-scale datasets with real-world distributions is challenging due to the presence of complex issues such…

Machine Learning · Computer Science 2023-10-31 Jang-Hyun Kim , Sangdoo Yun , Hyun Oh Song

Modern neural networks can assign high confidence to inputs drawn from outside the training distribution, posing threats to models in real-world deployments. While much research attention has been placed on designing new out-of-distribution…

Machine Learning · Computer Science 2022-03-08 Yifei Ming , Hang Yin , Yixuan Li

Out-of-distribution (OOD) detection is critical for preventing deep learning models from making incorrect predictions to ensure the safety of artificial intelligence systems. Especially in safety-critical applications such as medical…

Machine Learning · Computer Science 2023-02-16 Mouxiao Huang , Yu Qiao

Metric learning is an important problem in machine learning. It aims to group similar examples together. Existing state-of-the-art metric learning approaches require class labels to learn a metric. As obtaining class labels in all…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Ujjal Kr Dutta , Mehrtash Harandi , Chellu Chandra Sekhar

How can models effectively detect out-of-distribution (OOD) samples in complex, multi-label settings without extensive retraining? Existing OOD detection methods struggle to capture the intricate semantic relationships and label…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zhendong Liu , Yi Nian , Yuehan Qin , Henry Peng Zou , Li Li , Xiyang Hu , Yue Zhao