English
Related papers

Related papers: SAT: Improving Semi-Supervised Text Classification…

200 papers

Task-adaptive pre-training (TAPT) and Self-training (ST) have emerged as the major semi-supervised approaches to improve natural language understanding (NLU) tasks with massive amount of unlabeled data. However, it's unclear whether they…

Computation and Language · Computer Science 2023-02-21 Shiyang Li , Semih Yavuz , Wenhu Chen , Xifeng Yan

One paradigm for learning from few labeled examples while making best use of a large amount of unlabeled data is unsupervised pretraining followed by supervised fine-tuning. Although this paradigm uses unlabeled data in a task-agnostic way,…

Machine Learning · Computer Science 2020-10-27 Ting Chen , Simon Kornblith , Kevin Swersky , Mohammad Norouzi , Geoffrey Hinton

We present SelfPrompt, a novel prompt-tuning approach for vision-language models (VLMs) in a semi-supervised learning setup. Existing methods for tuning VLMs in semi-supervised setups struggle with the negative impact of the miscalibrated…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Shuvendu Roy , Ali Etemad

Semi-supervised Learning (SSL) has witnessed great success owing to the impressive performances brought by various methods based on pseudo labeling and consistency regularization. However, we argue that existing methods might fail to…

Small sample instance segmentation is a very challenging task, and many existing methods follow the training strategy of meta-learning which pre-train models on support set and fine-tune on query set. The pre-training phase, which is highly…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ruting Chi , Zhiyi Huang , Yuexing Han

Semi-supervised learning (SSL) has achieved significant progress by leveraging both labeled data and unlabeled data. Existing SSL methods overlook a common real-world scenario when labeled data is extremely scarce, potentially as limited as…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Hezhao Liu , Yang Lu , Mengke Li , Yiqun Zhang , Shreyank N Gowda , Chen Gong , Hanzi Wang

Semi-supervised text classification (SSTC) has gained increasing attention due to its ability to leverage unlabeled data. However, existing approaches based on pseudo-labeling suffer from the issues of pseudo-label bias and error…

Computation and Language · Computer Science 2023-10-24 Henry Peng Zou , Cornelia Caragea

Due to the advantages of leveraging unlabeled data and learning meaningful representations, semi-supervised learning and contrastive learning have been progressively combined to achieve better performances in popular applications with few…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Bowen Tao , Lan Li , Xin-Chun Li , De-Chuan Zhan

Large pre-trained vision-language models (VLMs), such as CLIP, have shown unprecedented zero-shot performance across a wide range of tasks. Nevertheless, these models may be unreliable under distributional shifts, as their performance is…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Shambhavi Mishra , Julio Silva-Rodriguez , Ismail Ben Ayed , Marco Pedersoli , Jose Dolz

This work describes a self-supervised data augmentation approach used to improve learning models' performances when only a moderate amount of labeled data is available. Multiple copies of the original model are initially trained on the…

Computation and Language · Computer Science 2020-12-18 Gabriele Sarti

Recent domain adaptation methods have demonstrated impressive improvement on unsupervised domain adaptation problems. However, in the semi-supervised domain adaptation (SSDA) setting where the target domain has a few labeled instances…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Bingyu Liu , Yuhong Guo , Jieping Ye , Weihong Deng

Recently, the self-supervised pre-training paradigm has shown great potential in leveraging large-scale unlabeled data to improve downstream task performance. However, increasing the scale of unlabeled pre-training data in real-world…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Yiqi Lin , Huabin Zheng , Huaping Zhong , Jinjing Zhu , Weijia Li , Conghui He , Lin Wang

This study delves into semi-supervised object detection (SSOD) to improve detector performance with additional unlabeled data. State-of-the-art SSOD performance has been achieved recently by self-training, in which training supervision…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Fangyuan Zhang , Tianxiang Pan , Bin Wang

We propose a novel and simple method for semi-supervised text classification. The method stems from the hypothesis that a classifier with pretrained word embeddings always outperforms the same classifier with randomly initialized word…

Computation and Language · Computer Science 2019-10-01 Hwiyeol Jo , Ceyda Cinarel

Self-training methods have proven to be effective in exploiting abundant unlabeled data in semi-supervised learning, particularly when labeled data is scarce. While many of these approaches rely on a cross-entropy loss function (CE), recent…

Machine Learning · Computer Science 2024-09-12 Aurelien Gauffre , Julien Horvat , Massih-Reza Amini

It is well known that for some tasks, labeled data sets may be hard to gather. Therefore, we wished to tackle here the problem of having insufficient training data. We examined learning methods from unlabeled data after an initial training…

Machine Learning · Computer Science 2018-04-06 Gal Hyams , Daniel Greenfeld , Dor Bank

Test-time adaptation (TTA) aims to boost the generalization capability of a trained model by conducting self-/unsupervised learning during the testing phase. While most existing TTA methods for video primarily utilize visual supervisory…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Runhao Zeng , Qi Deng , Ronghao Zhang , Shuaicheng Niu , Jian Chen , Xiping Hu , Victor C. M. Leung

Recent semi-supervised learning methods have shown to achieve comparable results to their supervised counterparts while using only a small portion of labels in image classification tasks thanks to their regularization strategies. In this…

Machine Learning · Computer Science 2020-09-25 Wei-Hong Li , Chuan-Sheng Foo , Hakan Bilen

Automatic target recognition (ATR) is an important use case for synthetic aperture radar (SAR) image interpretation. Recent years have seen significant advancements in SAR ATR technology based on semi-supervised learning. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Xinzheng Zhang , Yuqing Luo , Guopeng Li

Deep learning perception models require a massive amount of labeled training data to achieve good performance. While unlabeled data is easy to acquire, the cost of labeling is prohibitive and could create a tremendous burden on companies or…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Xinnan Du , William Zhang , Jose M. Alvarez