English
Related papers

Related papers: EntropyStop: Unsupervised Deep Outlier Detection w…

200 papers

Active learning typically focuses on training a model on few labeled examples alone, while unlabeled ones are only used for acquisition. In this work we depart from this setting by using both labeled and unlabeled data during model training…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Oriane Siméoni , Mateusz Budnik , Yannis Avrithis , Guillaume Gravier

Out-of-Distribution (OOD) detection, i.e., identifying whether an input is sampled from a novel distribution other than the training distribution, is a critical task for safely deploying machine learning systems in the open world. Recently,…

Machine Learning · Computer Science 2023-01-13 Feng Xue , Zi He , Chuanlong Xie , Falong Tan , Zhenguo Li

Detecting out-of-distribution (OOD) samples for trusted medical image segmentation remains a significant challenge. The critical issue here is the lack of a strict definition of abnormal data, which often results in artificial problem…

Image and Video Processing · Electrical Eng. & Systems 2023-08-16 Anton Vasiliuk , Daria Frolova , Mikhail Belyaev , Boris Shirokikh

Memorization in over-parameterized neural networks could severely hurt generalization in the presence of mislabeled examples. However, mislabeled examples are hard to avoid in extremely large datasets collected with weak supervision. We…

Machine Learning · Computer Science 2020-04-10 Jiaming Song , Lunjia Hu , Michael Auli , Yann Dauphin , Tengyu Ma

The amount of manually labeled data is limited in medical applications, so semi-supervised learning and automatic labeling strategies can be an asset for training deep neural networks. However, the quality of the automatically generated…

Machine Learning · Computer Science 2022-03-04 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

Object detection is a pivotal task in computer vision that has received significant attention in previous years. Nonetheless, the capability of a detector to localise objects out of the training distribution remains unexplored. Whilst…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Brian K. S. Isaac-Medina , Yona Falinie A. Gaus , Neelanjan Bhowmik , Toby P. Breckon

Out-of-distribution (OOD) detection aims to identify test examples that do not belong to the training distribution and are thus unlikely to be predicted reliably. Despite a plethora of existing works, most of them focused only on the…

Machine Learning · Computer Science 2023-11-07 Reza Averly , Wei-Lun Chao

Out-of-Distribution (OOD) detection is a crucial problem for the safe deployment of machine learning models identifying samples that fall outside of the training distribution, i.e. in-distribution data (ID). Most OOD works focus on the…

Machine Learning · Computer Science 2023-10-04 Soroush Seifi , Daniel Olmeda Reino , Nikolay Chumerin , Rahaf Aljundi

Even though auto-encoders (AEs) have the desirable property of learning compact representations without labels and have been widely applied to out-of-distribution (OoD) detection, they are generally still poorly understood and are used…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Cosmin I. Bercea , Daniel Rueckert , Julia A. Schnabel

In this paper, we argue that the unsatisfactory out-of-distribution (OOD) detection performance of neural networks is mainly due to the SoftMax loss anisotropy and propensity to produce low entropy probability distributions in disagreement…

Machine Learning · Computer Science 2021-10-05 David Macêdo , Tsang Ing Ren , Cleber Zanchettin , Adriano L. I. Oliveira , Teresa Ludermir

Out-of-distribution (OoD) inputs pose a persistent challenge to deep learning models, often triggering overconfident predictions on non-target objects. While prior work has primarily focused on refining scoring functions and adjusting…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Changshun Wu , Weicheng He , Chih-Hong Cheng , Xiaowei Huang , Saddek Bensalem

The positive-unlabeled (PU) classification is a common scenario in real-world applications such as healthcare, text classification, and bioinformatics, in which we only observe a few samples labeled as "positive" together with a large…

Machine Learning · Computer Science 2018-03-20 Ke Ren , Haichuan Yang , Yu Zhao , Mingshan Xue , Hongyu Miao , Shuai Huang , Ji Liu

Consider a prediction setting with few in-distribution labeled examples and many unlabeled examples both in- and out-of-distribution (OOD). The goal is to learn a model which performs well both in-distribution and OOD. In these settings,…

Machine Learning · Computer Science 2021-04-08 Sang Michael Xie , Ananya Kumar , Robbie Jones , Fereshte Khani , Tengyu Ma , Percy Liang

Recent work has uncovered the interesting (and somewhat surprising) finding that training models to be invariant to adversarial perturbations requires substantially larger datasets than those required for standard classification. This…

Machine Learning · Computer Science 2019-12-06 Jonathan Uesato , Jean-Baptiste Alayrac , Po-Sen Huang , Robert Stanforth , Alhussein Fawzi , Pushmeet Kohli

How can we automatically select an out-of-distribution (OOD) detection model for various underlying tasks? This is crucial for maintaining the reliability of open-world applications by identifying data distribution shifts, particularly in…

Machine Learning · Computer Science 2025-03-03 Yuehan Qin , Yichi Zhang , Yi Nian , Xueying Ding , Yue Zhao

Deep Learning (DL) models tend to perform poorly when the data comes from a distribution different from the training one. In critical applications such as medical imaging, out-of-distribution (OOD) detection helps to identify such data…

Image and Video Processing · Electrical Eng. & Systems 2023-06-26 Daria Frolova , Anton Vasiliuk , Mikhail Belyaev , Boris Shirokikh

Semi-supervised learning (SSL) has been proposed to leverage unlabeled data for training powerful models when only limited labeled data is available. While existing SSL methods assume that samples in the labeled and unlabeled data share the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Qing Yu , Daiki Ikami , Go Irie , Kiyoharu Aizawa

Anomalous sound detection systems must detect unknown, atypical sounds using only normal audio data. Conventional methods use the serial method, a combination of outlier exposure (OE), which classifies normal and pseudo-anomalous data and…

Sound · Computer Science 2022-06-14 Ibuki Kuroyanagi , Tomoki Hayashi , Kazuya Takeda , Tomoki Toda

Outlier detection is a critical task in data mining, aimed at identifying objects that significantly deviate from the norm. Semi-supervised methods improve detection performance by leveraging partially labeled data but typically overlook…

Machine Learning · Computer Science 2025-12-23 Baiyang Chen , Zhong Yuan , Zheng Liu , Dezhong Peng , Yongxiang Li , Chang Liu , Guiduo Duan

Efficiency and trustworthiness are two eternal pursuits when applying deep learning in real-world applications. With regard to efficiency, dataset distillation (DD) endeavors to reduce training costs by distilling the large dataset into a…

Machine Learning · Computer Science 2024-08-13 Shijie Ma , Fei Zhu , Zhen Cheng , Xu-Yao Zhang