English
Related papers

Related papers: DoubleMatch: Improving Semi-Supervised Learning wi…

200 papers

Semi-supervised learning (SSL) constructs classifiers using both labelled and unlabelled data. It leverages information from labelled samples, whose acquisition is often costly or labour-intensive, together with unlabelled data to enhance…

Machine Learning · Statistics 2025-12-29 Jinran Wu , You-Gan Wang , Geoffrey J. McLachlan

State-of-the-art deep learning models are often trained with a large amount of costly labeled training data. However, requiring exhaustive manual annotations may degrade the model's generalizability in the limited-label regime.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yanbei Chen , Massimiliano Mancini , Xiatian Zhu , Zeynep Akata

Ideally, visual learning algorithms should be generalizable, for dealing with any unseen domain shift when deployed in a new target environment; and data-efficient, for reducing development costs by using as little labels as possible. To…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Kaiyang Zhou , Chen Change Loy , Ziwei Liu

This paper introduces RankMatch, an innovative approach for Semi-Supervised Label Distribution Learning (SSLDL). Addressing the challenge of limited labeled data, RankMatch effectively utilizes a small number of labeled examples in…

Machine Learning · Computer Science 2023-12-12 Kouzhiqiang Yucheng Xie , Jing Wang , Yuheng Jia , Boyu Shi , Xin Geng

Domain generalization (DG) aims at learning a model on source domains to well generalize on the unseen target domain. Although it has achieved great success, most of existing methods require the label information for all training samples in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Lei Qi , Hongpeng Yang , Yinghuan Shi , Xin Geng

Semi-supervised learning for medical image segmentation presents a unique challenge of efficiently using limited labeled data while leveraging abundant unlabeled data. Despite advancements, existing methods often do not fully exploit the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Bin Zhao , Chunshi Wang , Shuxue Ding

When there are unlabeled Out-Of-Distribution (OOD) data from other classes, Semi-Supervised Learning (SSL) methods suffer from severe performance degradation and even get worse than merely training on labeled data. In this paper, we…

Machine Learning · Computer Science 2023-01-18 Lu Han , Han-Jia Ye , De-Chuan Zhan

Self-supervised learning (SSL) has become the de facto training paradigm of large models, where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Despite demonstrating comparable performance with…

Machine Learning · Computer Science 2024-06-05 Sofia Yfantidou , Dimitris Spathis , Marios Constantinides , Athena Vakali , Daniele Quercia , Fahim Kawsar

Semi-supervised learning (SSL) is a promising machine learning paradigm to address the issue of label scarcity in medical imaging. SSL methods were originally developed in image classification. The state-of-the-art SSL methods in image…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Mou-Cheng Xu , Yukun Zhou , Chen Jin , Marius De Groot , Neil P. Oxtoby , Daniel C. Alexander , Joseph Jacob

The lack of labeled data is a major obstacle in many music information retrieval tasks such as melody extraction, where labeling is extremely laborious or costly. Semi-supervised learning (SSL) provides a solution to alleviate the issue by…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-17 Sangeun Kum , Jing-Hua Lin , Li Su , Juhan Nam

The capability of the traditional semi-supervised learning (SSL) methods is far from real-world application due to severely biased pseudo-labels caused by (1) class imbalance and (2) class distribution mismatch between labeled and unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Youngtaek Oh , Dong-Jin Kim , In So Kweon

The recent proposed self-supervised learning (SSL) approaches successfully demonstrate the great potential of supplementing learning algorithms with additional unlabeled data. However, it is still unclear whether the existing SSL algorithms…

Machine Learning · Statistics 2022-02-16 Yue Xing , Qifan Song , Guang Cheng

Semi-supervised learning (SSL) has proven to be effective at leveraging large-scale unlabeled data to mitigate the dependency on labeled data in order to learn better models for visual recognition and classification tasks. However, recent…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Hasib Zunair , Yan Gobeil , Samuel Mercier , A. Ben Hamza

Federated semi-supervised learning (FSSL) has emerged as a powerful paradigm for collaboratively training machine learning models using distributed data with label deficiency. Advanced FSSL methods predominantly focus on training a single…

Machine Learning · Computer Science 2024-02-23 Yonggang Zhang , Zhiqin Yang , Xinmei Tian , Nannan Wang , Tongliang Liu , Bo Han

Pretraining has become a standard technique in computer vision and natural language processing, which usually helps to improve performance substantially. Previously, the most dominant pretraining method is transfer learning (TL), which uses…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Xingyi Yang , Xuehai He , Yuxiao Liang , Yue Yang , Shanghang Zhang , Pengtao Xie

Open-set semi-supervised learning (OSSL) leverages practical open-set unlabeled data, comprising both in-distribution (ID) samples from seen classes and out-of-distribution (OOD) samples from unseen classes, for semi-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Zerun Wang , Liuyu Xiang , Lang Huang , Jiafeng Mao , Ling Xiao , Toshihiko Yamasaki

In semi-supervised learning, student-teacher distribution matching has been successful in improving performance of models using unlabeled data in conjunction with few labeled samples. In this paper, we aim to replicate that success in the…

Machine Learning · Computer Science 2023-02-24 Thomas Mulc , Debidatta Dwibedi

Deep learning methodologies have been employed in several different fields, with an outstanding success in image recognition applications, such as material quality control, medical imaging, autonomous driving, etc. Deep learning models rely…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Saul Calderon-Ramirez , Shengxiang Yang , David Elizondo

Recent semi-supervised learning (SSL) methods typically include a filtering strategy to improve the quality of pseudo labels. However, these filtering strategies are usually hand-crafted and do not change as the model is updated, resulting…

Machine Learning · Computer Science 2023-09-19 Lei Zhu , Zhanghan Ke , Rynson Lau

In typical medical image classification problems, labeled data is scarce while unlabeled data is more available. Semi-supervised learning and self-supervised learning are two different research directions that can improve accuracy by…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Zhe Huang , Ruijie Jiang , Shuchin Aeron , Michael C. Hughes