English
Related papers

Related papers: Revisiting Deep Semi-supervised Learning: An Empir…

200 papers

Semi-supervised regression (SSR), which aims to predict continuous scores for samples while reducing the reliance on large-scale labeled data, has recently attracted considerable attention across various applications, including computer…

Machine Learning · Computer Science 2026-05-28 Ye Su , Hezhe Qiao , Wei Huang , Lin Chen

As data volumes continue to grow, the labelling process increasingly becomes a bottleneck, creating demand for methods that leverage information from unlabelled data. Impressive results have been achieved in semi-supervised learning (SSL)…

Machine Learning · Computer Science 2020-07-07 Ivana Balažević , Carl Allen , Timothy Hospedales

We approach the challenge of addressing semi-supervised domain generalization (SSDG). Specifically, our aim is to obtain a model that learns domain-generalizable features by leveraging a limited subset of labelled data alongside a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Chamuditha Jayanga Galappaththige , Sanoojan Baliah , Malitha Gunawardhana , Muhammad Haris Khan

A common assumption in semi-supervised learning is that the labeled, unlabeled, and test data are drawn from the same distribution. However, this assumption is not satisfied in many applications. In many scenarios, the data is collected…

Information Theory · Computer Science 2022-02-25 Gholamali Aminian , Mahed Abroshan , Mohammad Mahdi Khalili , Laura Toni , Miguel R. D. Rodrigues

Training deep neural networks with only a few labeled samples can lead to overfitting. This is problematic in semi-supervised learning where only a few labeled samples are available. In this paper, we show that a consequence of overfitting…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Christoph Mayer , Matthieu Paul , Radu Timofte

Recent deep networks achieved state of the art performance on a variety of semantic segmentation tasks. Despite such progress, these models often face challenges in real world `wild tasks' where large difference between labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-10-26 Yang Zou , Zhiding Yu , B. V. K. Vijaya Kumar , Jinsong Wang

It is well known that the success of deep neural networks is greatly attributed to large-scale labeled datasets. However, it can be extremely time-consuming and laborious to collect sufficient high-quality labeled data in most practical…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Yao Yao , Junyi Shen , Jin Xu , Bin Zhong , Li Xiao

In semi-supervised domain adaptation (SSDA), a few labeled target samples of each class help the model to transfer knowledge representation from the fully labeled source domain to the target domain. Many existing methods ignore the benefits…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Xinyang Huang , Chuang Zhu , Wenkai Chen

We extend semi-supervised learning to the problem of domain adaptation to learn significantly higher-accuracy models that train on one data distribution and test on a different one. With the goal of generality, we introduce AdaMatch, a…

Machine Learning · Computer Science 2022-03-16 David Berthelot , Rebecca Roelofs , Kihyuk Sohn , Nicholas Carlini , Alex Kurakin

Semi-supervised learning provides an expressive framework for exploiting unlabeled data when labels are insufficient. Previous semi-supervised learning methods typically match model predictions of different data-augmented views in a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Cong Wang , Xiaofeng Cao , Lanzhe Guo2 , Zenglin Shi

Domain adaptation (DA) is a representation learning methodology that transfers knowledge from a label-sufficient source domain to a label-scarce target domain. While most of early methods are focused on unsupervised DA (UDA), several…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Yoonhyung Kim , Changick Kim

The development of semi-supervised learning (SSL) has in recent years largely focused on the development of new consistency regularization or entropy minimization approaches, often resulting in models with complex training strategies to…

Machine Learning · Computer Science 2025-07-01 Durgesh Singh , Ahcene Boubekki , Robert Jenssen , Michael C. Kampffmeyer

A significant issue in training deep neural networks to solve supervised learning tasks is the need for large numbers of labelled datapoints. The goal of semi-supervised learning is to leverage ubiquitous unlabelled data, together with…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Chengxu Zhuang , Xuehao Ding , Divyanshu Murli , Daniel Yamins

The lack of labeled data is a common challenge in speech classification tasks, particularly those requiring extensive subjective assessment, such as cognitive state classification. In this work, we propose a Semi-Supervised Learning (SSL)…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Yuanchao Li , Zixing Zhang , Jing Han , Peter Bell , Catherine Lai

The goal of domain generalization is to learn from multiple source domains to generalize to unseen target domains under distribution discrepancy. Current state-of-the-art methods in this area are fully supervised, but for many real-world…

Machine Learning · Computer Science 2020-10-01 Hossein Sharifi-Noghabi , Hossein Asghari , Nazanin Mehrasa , Martin Ester

Semi-supervised domain adaptation (SSDA) presents a critical hurdle in computer vision, especially given the frequent scarcity of labeled data in real-world settings. This scarcity often causes foundation models, trained on extensive…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Ali Mottaghi , Mohammad Abdullah Jamal , Serena Yeung , Omid Mohareri

The scarcity of labeled data is a critical obstacle to deep learning. Semi-supervised learning (SSL) provides a promising way to leverage unlabeled data by pseudo labels. However, when the size of labeled data is very small (say a few…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Yi Xu , Jiandong Ding , Lu Zhang , Shuigeng Zhou

Compared to supervised learning, semi-supervised learning reduces the dependence of deep learning on a large number of labeled samples. In this work, we use a small number of labeled samples and perform data augmentation on unlabeled…

Machine Learning · Computer Science 2020-01-14 Qiuyu Zhu , Tiantian Li

What is the role of unlabeled data in an inference problem, when the presumed underlying distribution is adversarially perturbed? To provide a concrete answer to this question, this paper unifies two major learning frameworks:…

Machine Learning · Statistics 2019-05-31 Amir Najafi , Shin-ichi Maeda , Masanori Koyama , Takeru Miyato

Semi-supervised learning (SSL) commonly exhibits confirmation bias, where models disproportionately favor certain classes, leading to errors in predicted pseudo labels that accumulate under a self-training paradigm. Unlike supervised…

Machine Learning · Computer Science 2024-09-30 Yu Wang , Yuxuan Yin , Peng Li