English
Related papers

Related papers: Out-Of-Domain Unlabeled Data Improves Generalizati…

200 papers

A fundamental limitation of applying semi-supervised learning in real-world settings is the assumption that unlabeled test data contains only classes previously encountered in the labeled training data. However, this assumption rarely holds…

Machine Learning · Computer Science 2022-01-27 Kaidi Cao , Maria Brbic , Jure Leskovec

Semi-supervised learning deals with the problem of how, if possible, to take advantage of a huge amount of unclassified data, to perform a classification in situations when, typically, there is little labeled data. Even though this is not…

Machine Learning · Statistics 2020-12-11 Alejandro Cholaquidis , Ricardo Fraiman , Mariela Sued

Recently, Semi-Supervised Learning (SSL) has shown much promise in leveraging unlabeled data while being provided with very few labels. In this paper, we show that ignoring the labels altogether for whole epochs intermittently during…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Boaz Lerner , Guy Shiran , Daphna Weinshall

Out-of-distribution (OOD) detection lies at the heart of robust artificial intelligence (AI), aiming to identify samples from novel distributions beyond the training set. Recent approaches have exploited feature representations as…

Machine Learning · Computer Science 2025-08-06 Tarhib Al Azad , Faizul Rakib Sayem , Shahana Ibrahim

We establish a new model-agnostic optimization framework for out-of-distribution generalization via multicalibration, a criterion that ensures a predictor is calibrated across a family of overlapping groups. Multicalibration is shown to be…

Machine Learning · Computer Science 2024-06-04 Jiayun Wu , Jiashuo Liu , Peng Cui , Zhiwei Steven Wu

Boosting provides a practical and provably effective framework for constructing accurate learning algorithms from inaccurate rules of thumb. It extends the promise of sample-efficient learning to settings where direct Empirical Risk…

Machine Learning · Computer Science 2025-03-07 Udaya Ghai , Karan Singh

Using unlabeled wild data containing both in-distribution (ID) and out-of-distribution (OOD) data to improve the safety and reliability of models has recently received increasing attention. Existing methods either design customized losses…

Machine Learning · Computer Science 2025-05-20 Chuanxing Geng , Qifei Li , Xinrui Wang , Dong Liang , Songcan Chen , Pong C. Yuen

Traditional semi-supervised learning (SSL) assumes that the feature distributions of labeled and unlabeled data are consistent which rarely holds in realistic scenarios. In this paper, we propose a novel SSL setting, where unlabeled samples…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Jiachen Liang , Ruibing Hou , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

Semi-supervised learning, i.e. jointly learning from labeled and unlabeled samples, is an active research topic due to its key role on relaxing human supervision. In the context of image classification, recent advances to learn from…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Eric Arazo , Diego Ortego , Paul Albert , Noel E. O'Connor , Kevin McGuinness

This paper explores a multimodal co-training framework designed to enhance model generalization in situations where labeled data is limited and distribution shifts occur. We thoroughly examine the theoretical foundations of this framework,…

Machine Learning · Computer Science 2025-10-10 Tianyu Bell Pan , Damon L. Woodard

Generalizing knowledge to unseen domains, where data and labels are unavailable, is crucial for machine learning models. We tackle the domain generalization problem to learn from multiple source domains and generalize to a target domain…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Fan Zhou , Zhuqing Jiang , Changjian Shui , Boyu Wang , Brahim Chaib-draa

Improving a semi-supervised image segmentation task has the option of adding more unlabelled images, labelling the unlabelled images or combining both, as neither image acquisition nor expert labelling can be considered trivial in most…

Image and Video Processing · Electrical Eng. & Systems 2019-08-23 Yunguan Fu , Maria R. Robu , Bongjin Koo , Crispin Schneider , Stijn van Laarhoven , Danail Stoyanov , Brian Davidson , Matthew J. Clarkson , Yipeng Hu

Semi-supervised learning (SSL) aims to improve performance by exploiting unlabeled data when labels are scarce. Conventional SSL studies typically assume close environments where important factors (e.g., label, feature, distribution)…

Machine Learning · Computer Science 2024-12-25 Lan-Zhe Guo , Lin-Han Jia , Jie-Jing Shao , Yu-Feng Li

Semi-supervised anomaly detection is a common problem, as often the datasets containing anomalies are partially labeled. We propose a canonical framework: Semi-supervised Pseudo-labeler Anomaly Detection with Ensembling (SPADE) that isn't…

Machine Learning · Computer Science 2022-12-02 Jinsung Yoon , Kihyuk Sohn , Chun-Liang Li , Sercan O. Arik , Tomas Pfister

While a broad range of techniques have been proposed to tackle distribution shift, the simple baseline of training on an $\textit{undersampled}$ balanced dataset often achieves close to state-of-the-art-accuracy across several popular…

Machine Learning · Computer Science 2023-06-21 Niladri S. Chatterji , Saminul Haque , Tatsunori Hashimoto

Unsupervised domain adaptation aims to transfer knowledge from a source domain to a target domain so that the target domain data can be recognized without any explicit labelling information for this domain. One limitation of the problem…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Qian Wang , Penghui Bu , Toby P. Breckon

Distributionally robust optimization (DRO) and invariant risk minimization (IRM) are two popular methods proposed to improve out-of-distribution (OOD) generalization performance of machine learning models. While effective for small models,…

Machine Learning · Computer Science 2023-01-25 Xiao Zhou , Yong Lin , Renjie Pi , Weizhong Zhang , Renzhe Xu , Peng Cui , Tong Zhang

Unsupervised models can provide supplementary soft constraints to help classify new target data under the assumption that similar objects in the target set are more likely to share the same class label. Such models can also help detect…

Machine Learning · Computer Science 2015-03-13 Ayan Acharya , Eduardo R. Hruschka , Joydeep Ghosh , Badrul Sarwar , Jean-David Ruvini

Unlabeled data learning has attracted considerable attention recently. However, it is still elusive to extract the expected high-level semantic feature with mere unsupervised learning. In the meantime, semi-supervised learning (SSL)…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Tao Han , Junyu Gao , Yuan Yuan , Qi Wang

Recent advancements in unsupervised domain adaptation (UDA) and semi-supervised learning (SSL), particularly incorporating causality, have led to significant methodological improvements in these learning problems. However, a formal theory…

Machine Learning · Computer Science 2024-09-17 Xuetong Wu , Mingming Gong , Jonathan H. Manton , Uwe Aickelin , Jingge Zhu