中文
相关论文

相关论文: Rethinking Self-Supervised Learning Within the Fra…

200 篇论文

When there are unlabeled Out-Of-Distribution (OOD) data from other classes, Semi-Supervised Learning (SSL) methods suffer from severe performance degradation and even get worse than merely training on labeled data. In this paper, we…

机器学习 · 计算机科学 2023-01-18 Lu Han , Han-Jia Ye , De-Chuan Zhan

Self-supervised learning (SSL) conventionally relies on the instance consistency paradigm, assuming that different views of the same image can be treated as positive pairs. However, this assumption breaks down for non-iconic data, where…

计算机视觉与模式识别 · 计算机科学 2025-09-16 Huaiyuan Qin , Muli Yang , Siyuan Hu , Peng Hu , Yu Zhang , Chen Gong , Hongyuan Zhu

Self-supervised learning (SSL), which can automatically generate ground-truth samples from raw data, holds vast potential to improve recommender systems. Most existing SSL-based methods perturb the raw data graph with uniform node/edge…

信息检索 · 计算机科学 2021-08-27 Junliang Yu , Hongzhi Yin , Min Gao , Xin Xia , Xiangliang Zhang , Nguyen Quoc Viet Hung

Semi-supervised learning (SSL) is the branch of machine learning that aims to improve learning performance by leveraging unlabeled data when labels are insufficient. Recently, SSL with deep models has proven to be successful on standard…

机器学习 · 计算机科学 2022-11-15 Lan-Zhe Guo , Zhi Zhou , Yu-Feng Li

Self-supervised learning (SSL) methods aim to exploit the abundance of unlabelled data for machine learning (ML), however the underlying principles are often method-specific. An SSL framework derived from biological first principles of…

机器学习 · 计算机科学 2023-08-03 Franz Scherr , Qinghai Guo , Timoleon Moraitis

Remote sensing data has been widely used for various Earth Observation (EO) missions such as land use and cover classification, weather forecasting, agricultural management, and environmental monitoring. Most existing remote sensing…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Xin Zhang , Liangxiu Han

Self-supervised learning (SSL) can be used to solve complex visual tasks without human labels. Self-supervised representations encode useful semantic information about images, and as a result, they have already been used for tasks such as…

计算机视觉与模式识别 · 计算机科学 2023-11-27 Paul Engstler , Luke Melas-Kyriazi , Christian Rupprecht , Iro Laina

Recent advancements in self-supervised learning (SSL) made it possible to learn generalizable visual representations from unlabeled data. The performance of Deep Learning models fine-tuned on pretrained SSL representations is on par with…

机器学习 · 计算机科学 2021-09-21 Atharva Tendle , Mohammad Rashedul Hasan

Semi-supervised learning (SSL) methods effectively leverage unlabeled data to improve model generalization. However, SSL models often underperform in open-set scenarios, where unlabeled data contain outliers from novel categories that do…

计算机视觉与模式识别 · 计算机科学 2023-11-20 Yue Fan , Anna Kukleva , Dengxin Dai , Bernt Schiele

Self-supervised learning (SSL), which utilizes the input data itself for representation learning, has achieved state-of-the-art results for various downstream speech tasks. However, most of the previous studies focused on offline…

音频与语音处理 · 电气工程与系统科学 2022-11-11 Zili Huang , Zhuo Chen , Naoyuki Kanda , Jian Wu , Yiming Wang , Jinyu Li , Takuya Yoshioka , Xiaofei Wang , Peidong Wang

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Huijie Guo , Ying Ba , Jie Hu , Lingyu Si , Wenwen Qiang , Lei Shi

Semi-Supervised Learning (SSL) and Unsupervised Domain Adaptation (UDA) enhance the model performance by exploiting information from labeled and unlabeled data. The clustering assumption has proven advantageous for learning with limited…

计算机视觉与模式识别 · 计算机科学 2025-07-21 Durgesh Singh , Ahcène Boubekki , Robert Jenssen , Michael Kampffmeyer

We investigate the utility of in-domain self-supervised pre-training of vision models in the analysis of remote sensing imagery. Self-supervised learning (SSL) has emerged as a promising approach for remote sensing image classification due…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Ivica Dimitrovski , Ivan Kitanovski , Nikola Simidjievski , Dragi Kocev

Semi-supervised learning (SSL) has tremendous value in practice due to its ability to utilize both labeled data and unlabelled data. An important class of SSL methods is to naturally represent data as graphs such that the label information…

机器学习 · 计算机科学 2021-03-01 Zixing Song , Xiangli Yang , Zenglin Xu , Irwin King

RUL estimation suffers from a server data imbalance where data from machines near their end of life is rare. Additionally, the data produced by a machine can only be labeled after the machine failed. Semi-Supervised Learning (SSL) can…

机器学习 · 计算机科学 2021-08-27 Tilman Krokotsch , Mirko Knaak , Clemens Gühmann

In recent years, semi-supervised learning (SSL) has shown tremendous success in leveraging unlabeled data to improve the performance of deep learning models, which significantly reduces the demand for large amounts of labeled data. Many SSL…

机器学习 · 计算机科学 2020-06-02 Song-Bo Yang , Tian-li Yu

Semi-Supervised Learning (SSL) is important for reducing the annotation cost for medical image segmentation models. State-of-the-art SSL methods such as Mean Teacher, FixMatch and Cross Pseudo Supervision (CPS) are mainly based on…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Weiren Zhao , Lanfeng Zhong , Xin Liao , Wenjun Liao , Sichuan Zhang , Shaoting Zhang , Guotai Wang

Semi-Supervised Learning (SSL) has achieved great success in overcoming the difficulties of labeling and making full use of unlabeled data. However, SSL has a limited assumption that the numbers of samples in different classes are balanced,…

机器学习 · 计算机科学 2020-02-18 Minsung Hyun , Jisoo Jeong , Nojun Kwak

Foundation models (FMs), powered by self-supervised learning (SSL), have redefined the capabilities of artificial intelligence, demonstrating exceptional performance in domains like natural language processing and computer vision. These…

机器学习 · 计算机科学 2025-06-23 Hamdi Altaheri , Fakhri Karray , Md. Milon Islam , S M Taslim Uddin Raju , Amir-Hossein Karimi

Semi-supervised learning (SSL) is a popular setting aiming to effectively utilize unlabelled data to improve model performance in downstream natural language processing (NLP) tasks. Currently, there are two popular approaches to make use of…

计算与语言 · 计算机科学 2023-05-23 Zhengxiang Shi , Francesco Tonolini , Nikolaos Aletras , Emine Yilmaz , Gabriella Kazai , Yunlong Jiao