中文
相关论文

相关论文: Revisiting Pretraining for Semi-Supervised Learnin…

200 篇论文

Training deep neural networks requires massive amounts of training data, but for many tasks only limited labeled data is available. This makes weak supervision attractive, using weak or noisy signals like the output of heuristic methods or…

机器学习 · 计算机科学 2017-12-08 Mostafa Dehghani , Aliaksei Severyn , Sascha Rothe , Jaap Kamps

The goal of semi-supervised learning is to utilize the unlabeled, in-domain dataset U to improve models trained on the labeled dataset D. Under the context of large-scale language-model (LM) pretraining, how we can make the best use of U is…

计算与语言 · 计算机科学 2020-11-20 Zijun Sun , Chun Fan , Xiaofei Sun , Yuxian Meng , Fei Wu , Jiwei Li

Deep learning based semi-supervised learning (SSL) algorithms have led to promising results in recent years. However, they tend to introduce multiple tunable hyper-parameters, making them less practical in real SSL scenarios where the…

机器学习 · 计算机科学 2024-10-30 Yulin Wang , Jiayi Guo , Shiji Song , Gao Huang

Recently, pseudo label based semi-supervised learning has achieved great success in many fields. The core idea of the pseudo label based semi-supervised learning algorithm is to use the model trained on the labeled data to generate pseudo…

机器学习 · 计算机科学 2023-01-26 Zeping Min , Qian Ge , Cheng Tai

Semi-Supervised Learning (SSL) has shown its strong ability in utilizing unlabeled data when labeled data is scarce. However, most SSL algorithms work under the assumption that the class distributions are balanced in both training and test…

计算机视觉与模式识别 · 计算机科学 2021-12-14 Ju He , Adam Kortylewski , Shaokang Yang , Shuai Liu , Cheng Yang , Changhu Wang , Alan Yuille

Semi-supervised learning (SSL) commonly exhibits confirmation bias, where models disproportionately favor certain classes, leading to errors in predicted pseudo labels that accumulate under a self-training paradigm. Unlike supervised…

机器学习 · 计算机科学 2024-09-30 Yu Wang , Yuxuan Yin , Peng Li

Semi-supervised learning holds great promise for many real-world applications, due to its ability to leverage both unlabeled and expensive labeled data. However, most semi-supervised learning algorithms still heavily rely on the limited…

机器学习 · 计算机科学 2023-12-29 Huiling Qin , Xianyuan Zhan , Yuanxun Li , Yu Zheng

Semi-supervised learning (SSL) is a practical challenge in computer vision. Pseudo-label (PL) methods, e.g., FixMatch and FreeMatch, obtain the State Of The Art (SOTA) performances in SSL. These approaches employ a threshold-to-pseudo-label…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Jiaqi Wu , Junbiao Pang , Baochang Zhang , Qingming Huang

Pseudo-labeling has proven to be a promising semi-supervised learning (SSL) paradigm. Existing pseudo-labeling methods commonly assume that the class distributions of training data are balanced. However, such an assumption is far from…

机器学习 · 计算机科学 2023-03-03 Renzhen Wang , Xixi Jia , Quanziang Wang , Yichen Wu , Deyu Meng

We investigate the utility of in-domain self-supervised pre-training of vision models in the analysis of remote sensing imagery. Self-supervised learning (SSL) has emerged as a promising approach for remote sensing image classification due…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Ivica Dimitrovski , Ivan Kitanovski , Nikola Simidjievski , Dragi Kocev

We evaluate the effectiveness of semi-supervised learning (SSL) on a realistic benchmark where data exhibits considerable class imbalance and contains images from novel classes. Our benchmark consists of two fine-grained classification…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Jong-Chyi Su , Zezhou Cheng , Subhransu Maji

Semi-supervised learning (SSL) has achieved significant progress by leveraging both labeled data and unlabeled data. Existing SSL methods overlook a common real-world scenario when labeled data is extremely scarce, potentially as limited as…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Hezhao Liu , Yang Lu , Mengke Li , Yiqun Zhang , Shreyank N Gowda , Chen Gong , Hanzi Wang

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

信号处理 · 电气工程与系统科学 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan

Partial Label (PL) learning refers to the task of learning from the partially labeled data, where each training instance is ambiguously equipped with a set of candidate labels but only one is valid. Advances in the recent deep PL learning…

机器学习 · 计算机科学 2022-12-01 Ximing Li , Yuanzhi Jiang , Changchun Li , Yiyuan Wang , Jihong Ouyang

The amount of manually labeled data is limited in medical applications, so semi-supervised learning and automatic labeling strategies can be an asset for training deep neural networks. However, the quality of the automatically generated…

机器学习 · 计算机科学 2022-03-04 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

Pseudo-labeling is a key component in semi-supervised learning (SSL). It relies on iteratively using the model to generate artificial labels for the unlabeled data to train against. A common property among its various methods is that they…

计算机视觉与模式识别 · 计算机科学 2021-04-13 Islam Nassar , Samitha Herath , Ehsan Abbasnejad , Wray Buntine , Gholamreza Haffari

Semi-Supervised Learning (SSL) has been an effective way to leverage abundant unlabeled data with extremely scarce labeled data. However, most SSL methods are commonly based on instance-wise consistency between different data…

机器学习 · 计算机科学 2023-10-26 Zhuo Huang , Li Shen , Jun Yu , Bo Han , Tongliang Liu

Semi-supervised learning provides a solution to reduce the dependency of machine learning on labeled data. As one of the efficient semi-supervised techniques, self-training (ST) has received increasing attention. Several advancements have…

机器学习 · 计算机科学 2024-04-22 Jifeng Guo , Zhulin Liu , Tong Zhang , C. L. Philip Chen

Semi-supervised learning (SSL) uses unlabeled data during training to learn better models. Previous studies on SSL for medical image segmentation focused mostly on improving model generalization to unseen data. In some applications,…

Long-Tailed Semi-Supervised Learning (LTSSL) aims to learn from class-imbalanced data where only a few samples are annotated. Existing solutions typically require substantial cost to solve complex optimization problems, or class-balanced…

机器学习 · 计算机科学 2022-05-27 Tong Wei , Qian-Yu Liu , Jiang-Xin Shi , Wei-Wei Tu , Lan-Zhe Guo