English
Related papers

Related papers: Split Batch Normalization: Improving Semi-Supervis…

200 papers

Semi-supervised learning (SSL) has been widely explored in recent years, and it is an effective way of leveraging unlabeled data to reduce the reliance on labeled data. In this work, we adjust neural processes (NPs) to the semi-supervised…

Machine Learning · Computer Science 2022-07-05 Jianfeng Wang , Thomas Lukasiewicz , Daniela Massiceti , Xiaolin Hu , Vladimir Pavlovic , Alexandros Neophytou

The current success of deep neural networks (DNNs) in an increasingly broad range of tasks involving artificial intelligence strongly depends on the quality and quantity of labeled training data. In general, the scarcity of labeled data,…

Computation and Language · Computer Science 2018-11-21 Shun Kiyono , Jun Suzuki , Kentaro Inui

Both limited annotation and domain shift are significant challenges frequently encountered in medical image segmentation, leading to derivative scenarios like semi-supervised medical (SSMIS), semi-supervised medical domain generalization…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Wei Li , Pengcheng Zhou , Linye Ma , Wenyi Zhao , Huihua Yang , Yuchen Guo

Semi-supervised learning (SSL) is one of the dominant approaches to address the annotation bottleneck of supervised learning. Recent SSL methods can effectively leverage a large repository of unlabeled data to improve performance while…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Mamshad Nayeem Rizve , Navid Kardan , Salman Khan , Fahad Shahbaz Khan , Mubarak Shah

Pseudo-labeling (PL) and Data Augmentation-based Consistency Training (DACT) are two approaches widely used in Semi-Supervised Learning (SSL) methods. These methods exhibit great power in many machine learning tasks by utilizing unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Huixiang Luo , Hao Cheng , Fanxu Meng , Yuting Gao , Ke Li , Mengdan Zhang , Xing Sun

Consistency training, which exploits both supervised and unsupervised learning with different augmentations on image, is an effective method of utilizing unlabeled data in semi-supervised learning (SSL) manner. Here, we present another…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Juyong Lee , Seunghyuk Cho

Unarguably, deep learning models capable of generalizing to unseen domain data while leveraging a few labels are of great practical significance due to low developmental costs. In search of this endeavor, we study the challenging problem of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Chamuditha Jayanaga Galappaththige , Zachary Izzo , Xilin He , Honglu Zhou , Muhammad Haris Khan

Semi-supervised learning (SSL) effectively leverages unlabeled data and has been proven successful across various fields. Current safe SSL methods believe that unseen classes in unlabeled data harm the performance of SSL models. However,…

Machine Learning · Computer Science 2025-03-04 Rundong He , Yicong Dong , Lanzhe Guo , Yilong Yin , Tailin Wu

In this work we examine how fine-tuning impacts the fairness of contrastive Self-Supervised Learning (SSL) models. Our findings indicate that Batch Normalization (BN) statistics play a crucial role, and that updating only the BN statistics…

Machine Learning · Computer Science 2021-10-04 Jason Ramapuram , Dan Busbridge , Russ Webb

Semi-supervised learning (SSL) has garnered significant attention due to its ability to leverage limited labeled data and a large amount of unlabeled data to improve model generalization performance. Recent approaches achieve impressive…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Bo Cheng , Jueqing Lu , Yuan Tian , Haifeng Zhao , Yi Chang , Lan Du

Semi-supervised learning (SSL) uses unlabeled data to improve the performance of machine learning models when labeled data is scarce. However, its real-world applications often face the label distribution mismatch problem, in which the…

Machine Learning · Computer Science 2025-08-05 Jinsoo Bae , Seoung Bum Kim , Hyungrok Do

Following the success of supervised learning, semi-supervised learning (SSL) is now becoming increasingly popular. SSL is a family of methods, which in addition to a labeled training set, also use a sizable collection of unlabeled data for…

Machine Learning · Computer Science 2022-05-12 Erik Wallin , Lennart Svensson , Fredrik Kahl , Lars Hammarstrand

State-of-the-art (SOTA) semi-supervised learning (SSL) methods have been highly successful in leveraging a mix of labeled and unlabeled data by combining techniques of consistency regularization and pseudo-labeling. During pseudo-labeling,…

Recently, significant progress has been made on semantic segmentation. However, the success of supervised semantic segmentation typically relies on a large amount of labelled data, which is time-consuming and costly to obtain. Inspired by…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Jianlong Yuan , Yifan Liu , Chunhua Shen , Zhibin Wang , Hao Li

As an effective way to alleviate the burden of data annotation, semi-supervised learning (SSL) provides an attractive solution due to its ability to leverage both labeled and unlabeled data to build a predictive model. While significant…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hai-Ming Xu , Lingqiao Liu , Hao Chen , Ehsan Abbasnejad , Rafael Felix

In this work, we revisit the semi-supervised learning (SSL) problem from a new perspective of explicitly reducing empirical distribution mismatch between labeled and unlabeled samples. Benefited from this new perspective, we first propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Feiyu Wang , Qin Wang , Wen Li , Dong Xu , Luc Van Gool

Recent advances in semi-supervised learning have shown tremendous potential in overcoming a major barrier to the success of modern machine learning algorithms: access to vast amounts of human-labeled training data. Previous algorithms based…

Machine Learning · Computer Science 2019-11-22 Phi Vu Tran

Semi-supervised learning has the potential to improve the data-efficiency of training data-hungry deep neural networks, which is especially important for medical image analysis tasks where labeled data is scarce. In this work, we present a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Boon Peng Yap , Beng Koon Ng

Semi-Supervised Learning (SSL) has advanced classification tasks by inputting both labeled and unlabeled data to train a model jointly. However, existing SSL methods only consider the unlabeled data whose predictions are beyond a fixed…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Zechen Liang , Yuan-Gen Wang , Wei Lu , Xiaochun Cao

Effective convolutional neural networks are trained on large sets of labeled data. However, creating large labeled datasets is a very costly and time-consuming task. Semi-supervised learning uses unlabeled data to train a model with higher…

Computer Vision and Pattern Recognition · Computer Science 2016-06-16 Mehdi Sajjadi , Mehran Javanmardi , Tolga Tasdizen