English
Related papers

Related papers: Revisiting Pretraining for Semi-Supervised Learnin…

200 papers

Semi-supervised multi-label learning (SSMLL) is a powerful framework for leveraging unlabeled data to reduce the expensive cost of collecting precise multi-label annotations. Unlike semi-supervised learning, one cannot select the most…

Machine Learning · Computer Science 2024-12-30 Jia-Hao Xiao , Ming-Kun Xie , Heng-Bo Fan , Gang Niu , Masashi Sugiyama , Sheng-Jun Huang

Semi-supervised learning (SSL) has been proposed to leverage unlabeled data for training powerful models when only limited labeled data is available. While existing SSL methods assume that samples in the labeled and unlabeled data share the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Qing Yu , Daiki Ikami , Go Irie , Kiyoharu Aizawa

Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Ke Zhu , Minghao Fu , Jianxin Wu

The cost of head pose labeling is the main challenge of improving the fine-grained Head Pose Estimation (HPE). Although Self-Supervised Learning (SSL) can be a solution to the lack of huge amounts of labeled data, its efficacy for…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Mahdi Pourmirzaei , Farzaneh Esmaili , Ebrahim Mousavi , Sasan Karamizadeh , Seyedehsamaneh Shojaeilangari

Semi-supervised learning techniques are gaining popularity due to their capability of building models that are effective, even when scarce amounts of labeled data are available. In this paper, we present a framework and specific tasks for…

Image and Video Processing · Electrical Eng. & Systems 2022-10-05 Antonio Montanaro , Diego Valsesia , Giulia Fracastoro , Enrico Magli

Semi-supervised learning (SSL) has proven to be effective at leveraging large-scale unlabeled data to mitigate the dependency on labeled data in order to learn better models for visual recognition and classification tasks. However, recent…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Hasib Zunair , Yan Gobeil , Samuel Mercier , A. Ben Hamza

Semi-Supervised Learning (SSL) approaches have been an influential framework for the usage of unlabeled data when there is not a sufficient amount of labeled data available over the course of training. SSL methods based on Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Fariborz Taherkhani , Hadi Kazemi , Ali Dabouei , Jeremy Dawson , Nasser M. Nasrabadi

Given a small set of labeled data and a large set of unlabeled data, semi-supervised learning (SSL) attempts to leverage the location of the unlabeled datapoints in order to create a better classifier than could be obtained from supervised…

Machine Learning · Computer Science 2022-05-25 Michael C. Burkhart , Kyle Shan

We present a neural semi-supervised learning model termed Self-Pretraining. Our model is inspired by the classic self-training algorithm. However, as opposed to self-training, Self-Pretraining is threshold-free, it can potentially update…

Computation and Language · Computer Science 2021-10-01 Payam Karisani , Negin Karisani

While much of recent study in semi-supervised learning (SSL) has achieved strong performance on single-label classification problems, an equally important yet underexplored problem is how to leverage the advantage of unlabeled data in…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Junxiang Huang , Alexander Huang , Beatriz C. Guerra , Yen-Yun Yu

Semi-supervised learning (SSL) is a class of supervised learning tasks and techniques that also exploits the unlabeled data for training. SSL significantly reduces labeling related costs and is able to handle large data sets. The primary…

Machine Learning · Computer Science 2016-06-30 Eftychios Protopapadakis

The lack of labeled data is a major obstacle in many music information retrieval tasks such as melody extraction, where labeling is extremely laborious or costly. Semi-supervised learning (SSL) provides a solution to alleviate the issue by…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-17 Sangeun Kum , Jing-Hua Lin , Li Su , Juhan Nam

Semi-supervised learning (SSL) is a common approach to learning predictive models using not only labeled examples, but also unlabeled examples. While SSL for the simple tasks of classification and regression has received a lot of attention…

Machine Learning · Computer Science 2024-04-02 Jurica Levatić , Michelangelo Ceci , Dragi Kocev , Sašo Džeroski

To alleviate human efforts from obtaining large-scale annotations, Semi-Supervised Relation Extraction methods aim to leverage unlabeled data in addition to learning from limited samples. Existing self-training methods suffer from the…

Computation and Language · Computer Science 2021-09-13 Xuming Hu , Chenwei Zhang , Fukun Ma , Chenyao Liu , Lijie Wen , Philip S. Yu

Few-shot learning has been extensively explored to address problems where the amount of labeled samples is very limited for some classes. In the semi-supervised few-shot learning setting, substantial quantities of unlabeled samples are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Souvik Maji , Rhythm Baghel , Pratik Mazumder

In recent years, deep neural networks (DNNs) have been found very successful for multi-label classification (MLC) of remote sensing (RS) images. Self-supervised pre-training combined with fine-tuning on a randomly selected small training…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Lars Möllenbrok , Begüm Demir

Semantic understanding of 3D point cloud relies on learning models with massively annotated data, which, in many cases, are expensive or difficult to collect. This has led to an emerging research interest in semi-supervised learning (SSL)…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Xian Shi , Xun Xu , Wanyue Zhang , Xiatian Zhu , Chuan Sheng Foo , Kui Jia

Establishing dense correspondences across semantically similar images remains a challenging task due to the significant intra-class variations and background clutters. Traditionally, a supervised learning was used for training the models,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Jiwon Kim , Kwangrok Ryoo , Junyoung Seo , Gyuseong Lee , Daehwan Kim , Hansang Cho , Seungryong Kim

Self-supervised learning (SSL) enables label efficient training for machine learning models. This is essential for domains such as medical imaging, where labels are costly and time-consuming to curate. However, the most effective supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Cara Van Uden , Jeremy Irvin , Mars Huang , Nathan Dean , Jason Carr , Andrew Ng , Curtis Langlotz

State-of-the-art (SOTA) semi-supervised learning (SSL) methods have been highly successful in leveraging a mix of labeled and unlabeled data by combining techniques of consistency regularization and pseudo-labeling. During pseudo-labeling,…