中文
相关论文

相关论文: How Out-of-Distribution Data Hurts Semi-Supervised…

200 篇论文

The existing continual learning methods are mainly focused on fully-supervised scenarios and are still not able to take advantage of unlabeled data available in the environment. Some recent works tried to investigate semi-supervised…

As language models become more general purpose, increased attention needs to be paid to detecting out-of-distribution (OOD) instances, i.e., those not belonging to any of the distributions seen during training. Existing methods for…

机器学习 · 计算机科学 2024-07-19 Aryan Gulati , Xingjian Dong , Carlos Hurtado , Sarath Shekkizhar , Swabha Swayamdipta , Antonio Ortega

Deep learning based semi-supervised learning (SSL) algorithms have led to promising results in recent years. However, they tend to introduce multiple tunable hyper-parameters, making them less practical in real SSL scenarios where the…

机器学习 · 计算机科学 2024-10-30 Yulin Wang , Jiayi Guo , Shiji Song , Gao Huang

The robustness of machine learning algorithms to distributions shift is primarily discussed in the context of supervised learning (SL). As such, there is a lack of insight on the robustness of the representations learned from unsupervised…

机器学习 · 计算机科学 2022-12-19 Yuge Shi , Imant Daunhawer , Julia E. Vogt , Philip H. S. Torr , Amartya Sanyal

Out-of-Distribution (OOD) detection is a crucial problem for the safe deployment of machine learning models identifying samples that fall outside of the training distribution, i.e. in-distribution data (ID). Most OOD works focus on the…

机器学习 · 计算机科学 2023-10-04 Soroush Seifi , Daniel Olmeda Reino , Nikolay Chumerin , Rahaf Aljundi

Open-set semi-supervised learning (OSSL) has attracted growing interest, which investigates a more practical scenario where out-of-distribution (OOD) samples are only contained in unlabeled data. Existing OSSL methods like OpenMatch learn…

计算机视觉与模式识别 · 计算机科学 2022-09-29 Haoran Li , Chun-Mei Feng , Tao Zhou , Yong Xu , Xiaojun Chang

Out-of-distribution (OOD) inputs can compromise the performance and safety of real world machine learning systems. While many methods exist for OOD detection and work well on small scale datasets with lower resolution and few classes, few…

计算机视觉与模式识别 · 计算机科学 2023-03-15 Hong Yang , William Gebhardt , Alexander G. Ororbia , Travis Desell

Existing semi-supervised learning (SSL) algorithms use a single weight to balance the loss of labeled and unlabeled examples, i.e., all unlabeled examples are equally weighted. But not all unlabeled data are equal. In this paper we study…

机器学习 · 计算机科学 2020-10-30 Zhongzheng Ren , Raymond A. Yeh , Alexander G. Schwing

Self-supervised learning (SSL) is a scalable way to learn general visual representations since it learns without labels. However, large-scale unlabeled datasets in the wild often have long-tailed label distributions, where we know little…

机器学习 · 计算机科学 2022-05-24 Hong Liu , Jeff Z. HaoChen , Adrien Gaidon , Tengyu Ma

Out-of-distribution (OOD) detection is crucial for deploying robust machine learning models. However, when training data follows a long-tailed distribution, the model's ability to accurately detect OOD samples is significantly compromised,…

机器学习 · 计算机科学 2025-09-26 Shuai Feng , Yuxin Ge , Yuntao Du , Mingcai Chen , Chongjun Wang , Lei Feng

Out-of-distribution (OOD) detection is a crucial part of deploying machine learning models safely. It has been extensively studied with a plethora of methods developed in the literature. This problem is tackled with an OOD score…

计算机视觉与模式识别 · 计算机科学 2024-01-19 Jingqiu Zhou , Aojun Zhou , Hongsheng Li

Semi-Supervised Learning (SSL) has advanced classification tasks by inputting both labeled and unlabeled data to train a model jointly. However, existing SSL methods only consider the unlabeled data whose predictions are beyond a fixed…

计算机视觉与模式识别 · 计算机科学 2022-05-24 Zechen Liang , Yuan-Gen Wang , Wei Lu , Xiaochun Cao

Semi-Supervised Learning (SSL) can leverage abundant unlabeled data to boost model performance. However, the class-imbalanced data distribution in real-world scenarios poses great challenges to SSL, resulting in performance degradation.…

计算机视觉与模式识别 · 计算机科学 2025-01-13 Yin Wang , Zixuan Wang , Hao Lu , Zhen Qin , Hailiang Zhao , Guanjie Cheng , Ge Su , Li Kuang , Mengchu Zhou , Shuiguang Deng

Robustness to out-of-distribution (OOD) data is an important goal in building reliable machine learning systems. Especially in autonomous systems, wrong predictions for OOD inputs can cause safety critical situations. As a first step…

机器学习 · 计算机科学 2020-04-17 Andreas Sedlmeier , Thomas Gabor , Thomy Phan , Lenz Belzner , Claudia Linnhoff-Popien

Semi-supervised learning (SSL) is a popular setting aiming to effectively utilize unlabelled data to improve model performance in downstream natural language processing (NLP) tasks. Currently, there are two popular approaches to make use of…

计算与语言 · 计算机科学 2023-05-23 Zhengxiang Shi , Francesco Tonolini , Nikolaos Aletras , Emine Yilmaz , Gabriella Kazai , Yunlong Jiao

While semi-supervised learning (SSL) has received tremendous attentions in many machine learning tasks due to its successful use of unlabeled data, existing SSL algorithms use either all unlabeled examples or the unlabeled examples with a…

机器学习 · 计算机科学 2021-09-03 Yi Xu , Lei Shang , Jinxing Ye , Qi Qian , Yu-Feng Li , Baigui Sun , Hao Li , Rong Jin

Out-of-distribution (OOD) generalization has gained increasing attentions for learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation with distribution shifts. The challenge is that distribution shifts on…

机器学习 · 计算机科学 2024-08-19 Qitian Wu , Fan Nie , Chenxiao Yang , Tianyi Bao , Junchi Yan

The ability to detect unfamiliar or unexpected images is essential for safe deployment of computer vision systems. In the context of classification, the task of detecting images outside of a model's training domain is known as…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Galadrielle Humblot-Renaux , Sergio Escalera , Thomas B. Moeslund

The problem of fully supervised classification is that it requires a tremendous amount of annotated data, however, in many datasets a large portion of data is unlabeled. To alleviate this problem semi-supervised learning (SSL) leverages the…

机器学习 · 计算机科学 2022-07-26 Ehsan Kazemi

Detecting test-time distribution shift has emerged as a key capability for safely deployed machine learning models, with the question being tackled under various guises in recent years. In this paper, we aim to provide a consolidated view…

计算机视觉与模式识别 · 计算机科学 2024-09-02 Hongjun Wang , Sagar Vaze , Kai Han