中文
相关论文

相关论文: A Probabilistic Model for Non-Contrastive Learning

200 篇论文

We propose a novel semi-supervised learning (SSL) method that adopts selective training with pseudo labels. In our method, we generate hard pseudo-labels and also estimate their confidence, which represents how likely each pseudo-label is…

机器学习 · 计算机科学 2021-03-16 Masato Ishii

Self-supervised learning (SSL) has become the de facto training paradigm of large models where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Hypothesizing that SSL models would learn more generic,…

Semi-supervised learning (SSL) alleviates the cost of data labeling process by exploiting unlabeled data and has achieved promising results. Meanwhile, with the development of large foundation models, exploiting pre-trained models becomes a…

机器学习 · 计算机科学 2025-10-28 Song-Lin Lv , Rui Zhu , Tong Wei , Yu-Feng Li , Lan-Zhe Guo

Self-Supervised Learning (SSL) is crucial for real-world applications, especially in data-hungry domains such as healthcare and self-driving cars. In addition to a lack of labeled data, these applications also suffer from distributional…

计算机视觉与模式识别 · 计算机科学 2022-12-26 Ha Manh Bui , Iliana Maifeld-Carucci

Semi-supervised learning (SSL) aims to improve performance by exploiting unlabeled data when labels are scarce. Conventional SSL studies typically assume close environments where important factors (e.g., label, feature, distribution)…

机器学习 · 计算机科学 2024-12-25 Lan-Zhe Guo , Lin-Han Jia , Jie-Jing Shao , Yu-Feng Li

This paper looks at semi-supervised learning (SSL) for image-based text recognition. One of the most popular SSL approaches is pseudo-labeling (PL). PL approaches assign labels to unlabeled data before re-training the model with a…

计算机视觉与模式识别 · 计算机科学 2022-10-10 Gaurav Patel , Jan Allebach , Qiang Qiu

Recent analyses of self-supervised learning (SSL) find the following data-centric properties to be critical for learning good representations: invariance to task-irrelevant semantics, separability of classes in some latent space, and…

机器学习 · 计算机科学 2023-01-24 Puja Trivedi , Ekdeep Singh Lubana , Mark Heimann , Danai Koutra , Jayaraman J. Thiagarajan

Semi-supervised learning (SSL) is a promising approach for training deep classification models using labeled and unlabeled datasets. However, existing SSL methods rely on a large unlabeled dataset, which may not always be available in many…

机器学习 · 计算机科学 2023-09-29 Shin'ya Yamaguchi

The success of deep learning in medical imaging is mostly achieved at the cost of a large labeled data set. Semi-supervised learning (SSL) provides a promising solution by leveraging the structure of unlabeled data to improve learning from…

机器学习 · 计算机科学 2019-07-24 Prashnna Kumar Gyawali , Zhiyuan Li , Sandesh Ghimire , Linwei Wang

Semi-supervised learning (SSL) has achieved great success in leveraging a large amount of unlabeled data to learn a promising classifier. A popular approach is pseudo-labeling that generates pseudo labels only for those unlabeled data with…

计算机视觉与模式识别 · 计算机科学 2022-12-29 Qinyi Deng , Yong Guo , Zhibang Yang , Haolin Pan , Jian Chen

Self-supervised learning (SSL) is a machine learning approach where the data itself provides supervision, eliminating the need for external labels. The model is forced to learn about the data structure or context by solving a pretext task.…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Markus Marks , Manuel Knott , Neehar Kondapaneni , Elijah Cole , Thijs Defraeye , Fernando Perez-Cruz , Pietro Perona

The problem of fully supervised classification is that it requires a tremendous amount of annotated data, however, in many datasets a large portion of data is unlabeled. To alleviate this problem semi-supervised learning (SSL) leverages the…

机器学习 · 计算机科学 2022-07-26 Ehsan Kazemi

Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Ke Zhu , Minghao Fu , Jianxin Wu

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

计算机视觉与模式识别 · 计算机科学 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most methods mainly focus on the instance level information (\ie,…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

As an effective way to alleviate the burden of data annotation, semi-supervised learning (SSL) provides an attractive solution due to its ability to leverage both labeled and unlabeled data to build a predictive model. While significant…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Hai-Ming Xu , Lingqiao Liu , Hao Chen , Ehsan Abbasnejad , Rafael Felix

The rapid advancement in self-supervised representation learning has highlighted its potential to leverage unlabeled data for learning rich visual representations. However, the existing techniques, particularly those employing different…

计算机视觉与模式识别 · 计算机科学 2024-12-18 Sana Ayromlou , Vahid Reza Khazaie , Fereshteh Forghani , Arash Afkanpour

Data augmentations play an important role in the recent success of self-supervised learning (SSL). While augmentations are commonly understood to encode invariances between different views into the learned representations, this…

机器学习 · 计算机科学 2025-06-10 Shlomo Libo Feigin , Maximilian Fleissner , Debarghya Ghoshdastidar

Semi-supervised learning (SSL) is a widely used technique in scenarios where labeled data is scarce and unlabeled data is abundant. While SSL is popular for image and text classification, it is relatively underexplored for the task of…

计算与语言 · 计算机科学 2024-07-03 Gaurav Sahu , Olga Vechtomova , Issam H. Laradji

A major limitation in applying deep learning to artificial intelligence (AI) systems is the scarcity of high-quality curated datasets. We investigate strong augmentation based self-supervised learning (SSL) techniques to address this…

图像与视频处理 · 电气工程与系统科学 2022-03-18 John D. Miller , Vignesh A. Arasu , Albert X. Pu , Laurie R. Margolies , Weiva Sieh , Li Shen