中文
相关论文

相关论文: How Out-of-Distribution Data Hurts Semi-Supervised…

200 篇论文

Out-of-distribution (OOD) detection, which aims to distinguish unknown classes from known classes, has received increasing attention recently. A main challenge within is the unavailable of samples from the unknown classes in the training…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Mingle Xu , Jaehwan Lee , Sook Yoon , Dong Sun Park

The paradigm of machine intelligence moves from purely supervised learning to a more practical scenario when many loosely related unlabeled data are available and labeled data is scarce. Most existing algorithms assume that the underlying…

计算机视觉与模式识别 · 计算机科学 2022-09-07 Zhenyi Wang , Li Shen , Le Fang , Qiuling Suo , Donglin Zhan , Tiehang Duan , Mingchen Gao

In this study, a novel idea, Uncertainty Structure Estimation (USE), a lightweight, algorithm-agnostic procedure that emphasizes the often-overlooked role of unlabeled data quality is introduced for Semi-supervised learning (SSL). SSL has…

Semi-Supervised Learning (SSL) under class distribution mismatch aims to tackle a challenging problem wherein unlabeled data contain lots of unknown categories unseen in the labeled ones. In such mismatch scenarios, traditional SSL suffers…

计算机视觉与模式识别 · 计算机科学 2023-08-24 Pan Du , Suyun Zhao , Zisen Sheng , Cuiping Li , Hong Chen

Pseudo-labeling (PL) and Data Augmentation-based Consistency Training (DACT) are two approaches widely used in Semi-Supervised Learning (SSL) methods. These methods exhibit great power in many machine learning tasks by utilizing unlabeled…

计算机视觉与模式识别 · 计算机科学 2021-09-15 Huixiang Luo , Hao Cheng , Fanxu Meng , Yuting Gao , Ke Li , Mengdan Zhang , Xing Sun

Supervised learning datasets may contain multiple cues that explain the training set equally well, i.e., learning any of them would lead to the correct predictions on the training data. However, many of them can be spurious, i.e., lose…

机器学习 · 计算机科学 2024-04-23 Harold Benoit , Liangze Jiang , Andrei Atanov , Oğuzhan Fatih Kar , Mattia Rigotti , Amir Zamir

In open-set semi-supervised learning (OSSL), we consider unlabeled datasets that may contain unknown classes. Existing OSSL methods often use the softmax confidence for classifying data as in-distribution (ID) or out-of-distribution (OOD).…

机器学习 · 计算机科学 2026-01-26 Erik Wallin , Lennart Svensson , Fredrik Kahl , Lars Hammarstrand

The discrepancy between in-distribution (ID) and out-of-distribution (OOD) samples can lead to \textit{distributional vulnerability} in deep neural networks, which can subsequently lead to high-confidence predictions for OOD samples. This…

机器学习 · 计算机科学 2023-10-03 Zhilin Zhao , Longbing Cao , Kun-Yu Lin

Soft labeling becomes a common output regularization for generalization and model compression of deep neural networks. However, the effect of soft labeling on out-of-distribution (OOD) detection, which is an important topic of machine…

机器学习 · 计算机科学 2020-07-08 Doyup Lee , Yeongjae Cheon

Detecting and rejecting unknown out-of-distribution (OOD) samples is critical for deployed neural networks to void unreliable predictions. In real-world scenarios, however, the efficacy of existing OOD detection methods is often impeded by…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Kai Liu , Zhihang Fu , Sheng Jin , Chao Chen , Ze Chen , Rongxin Jiang , Fan Zhou , Yaowu Chen , Jieping Ye

Semi-supervised learning methods have shown promising results in solving many practical problems when only a few labels are available. The existing methods assume that the class distributions of labeled and unlabeled data are equal;…

机器学习 · 计算机科学 2024-08-06 Min Gu Kwak , Hyungu Kahng , Seoung Bum Kim

In real world scenarios, out-of-distribution (OOD) datasets may have a large distributional shift from training datasets. This phenomena generally occurs when a trained classifier is deployed on varying dynamic environments, which causes a…

图像与视频处理 · 电气工程与系统科学 2022-09-08 Harshita Boonlia , Tanmoy Dam , Md Meftahul Ferdaus , Sreenatha G. Anavatti , Ankan Mullick

Recent developments for Semi-Supervised Object Detection (SSOD) have shown the promise of leveraging unlabeled data to improve an object detector. However, thus far these methods have assumed that the unlabeled data does not contain…

计算机视觉与模式识别 · 计算机科学 2022-08-30 Yen-Cheng Liu , Chih-Yao Ma , Xiaoliang Dai , Junjiao Tian , Peter Vajda , Zijian He , Zsolt Kira

Numerous machine learning (ML) models have been developed, including those for software engineering (SE) tasks, under the assumption that training and testing data come from the same distribution. However, training and testing distributions…

软件工程 · 计算机科学 2025-03-04 Yanfu Yan , Viet Duong , Huajie Shao , Denys Poshyvanyk

We ask the following question: what training information is required to design an effective outlier/out-of-distribution (OOD) detector, i.e., detecting samples that lie far away from the training distribution? Since unlabeled data is easily…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Vikash Sehwag , Mung Chiang , Prateek Mittal

Out-of-distribution (OOD) detection is the key to deploying models safely in the open world. For OOD detection, collecting sufficient in-distribution (ID) labeled data is usually more time-consuming and costly than unlabeled data. When ID…

计算机视觉与模式识别 · 计算机科学 2022-09-19 Rundong He , Rongxue Li , Zhongyi Han , Yilong Yin

Deep neural networks (DNNs) have become the de facto learning mechanism in different domains. Their tendency to perform unreliably on out-of-distribution (OOD) inputs hinders their adoption in critical domains. Several approaches have been…

机器学习 · 计算机科学 2020-06-26 Vahdat Abdelzad , Krzysztof Czarnecki , Rick Salay

Prior works have shown that semi-supervised learning algorithms can leverage unlabeled data to improve over the labeled sample complexity of supervised learning (SL) algorithms. However, existing theoretical analyses focus on regimes where…

机器学习 · 计算机科学 2023-12-01 Alexandru Ţifrea , Gizem Yüce , Amartya Sanyal , Fanny Yang

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

机器学习 · 计算机科学 2019-06-18 Avital Oliver , Augustus Odena , Colin Raffel , Ekin D. Cubuk , Ian J. Goodfellow

Out-of-distribution (OOD) detection is critical for safety-sensitive machine learning applications and has been extensively studied, yielding a plethora of methods developed in the literature. However, most studies for OOD detection did not…

计算机视觉与模式识别 · 计算机科学 2023-10-13 Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa