中文
相关论文

相关论文: The SSL Interplay: Augmentations, Inductive Bias, …

200 篇论文

Self-Supervised Learning (SSL) has shown great promise in learning representations from unlabeled data. The power of learning representations without the need for human annotations has made SSL a widely used technique in real-world…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Aryan Satpathy , Nilaksh Singh , Dhruva Rajwade , Somesh Kumar

Self-supervised learning (SSL) is an efficient approach that addresses the issue of limited training data and annotation shortage. The key part in SSL is its proxy task that defines the supervisory signals and drives the learning toward…

计算机视觉与模式识别 · 计算机科学 2021-03-26 Jiuwen Zhu , Yuexiang Li , S. Kevin Zhou

The sequential recommendation aims at predicting the next items in user behaviors, which can be solved by characterizing item relationships in sequences. Due to the data sparsity and noise issues in sequences, a new self-supervised learning…

机器学习 · 计算机科学 2022-03-30 Zhiwei Liu , Yongjun Chen , Jia Li , Man Luo , Philip S. Yu , Caiming Xiong

Semi-supervised learning (SSL) aims to improve performance by exploiting unlabeled data when labels are scarce. Conventional SSL studies typically assume close environments where important factors (e.g., label, feature, distribution)…

机器学习 · 计算机科学 2024-12-25 Lan-Zhe Guo , Lin-Han Jia , Jie-Jing Shao , Yu-Feng Li

Self-supervised representation learning~(SSRL) has advanced considerably by exploiting the transformation invariance assumption under artificially designed data augmentations. While augmentation-based SSRL algorithms push the boundaries of…

机器学习 · 计算机科学 2024-03-22 Yi Sui , Tongzi Wu , Jesse C. Cresswell , Ga Wu , George Stein , Xiao Shi Huang , Xiaochen Zhang , Maksims Volkovs

Semi-supervised learning (SSL) provides an effective means of leveraging unlabelled data to improve a model performance. Even though the domain has received a considerable amount of attention in the past years, most methods present the…

机器学习 · 统计学 2023-03-06 Hugo Schmutz , Olivier Humbert , Pierre-Alexandre Mattei

Inspired by the humans' cognitive ability to generalise knowledge and skills, Self-Supervised Learning (SSL) targets at discovering general representations from large-scale data without requiring human annotations, which is an expensive and…

Advances in deep learning are re-defining how visual data is processed and understand by the machines. Vision Transformers (ViTs) have recently demonstrated prominent performance in computer vision related tasks. However, their performance…

The success of self-supervised learning (SSL) has mostly been attributed to the availability of unlabeled yet large-scale datasets. However, in a specialized domain such as medical imaging which is a lot different from natural images, the…

计算机视觉与模式识别 · 计算机科学 2023-06-30 Soumitri Chattopadhyay , Soham Ganguly , Sreejit Chaudhury , Sayan Nag , Samiran Chattopadhyay

Semi-supervised learning (SSL) seeks to enhance task performance by training on both labeled and unlabeled data. Mainstream SSL image classification methods mostly optimize a loss that additively combines a supervised classification…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Zhe Huang , Xiaowei Yu , Dajiang Zhu , Michael C. Hughes

Following the success of supervised learning, semi-supervised learning (SSL) is now becoming increasingly popular. SSL is a family of methods, which in addition to a labeled training set, also use a sizable collection of unlabeled data for…

机器学习 · 计算机科学 2022-05-12 Erik Wallin , Lennart Svensson , Fredrik Kahl , Lars Hammarstrand

Self-supervised learning (SSL) has emerged as a promising paradigm that presents supervisory signals to real-world problems, bypassing the extensive cost of manual labeling. Consequently, self-supervised anomaly detection (SSAD) has seen a…

机器学习 · 计算机科学 2025-07-22 Jaemin Yoo , Lingxiao Zhao , Leman Akoglu

Prevention of complete and dimensional collapse of representations has recently become a design principle for self-supervised learning (SSL). However, questions remain in our theoretical understanding: When do those collapses occur? What…

机器学习 · 计算机科学 2023-03-14 Liu Ziyin , Ekdeep Singh Lubana , Masahito Ueda , Hidenori Tanaka

Self-supervised learning (SSL) has proven vital in speech and audio-related applications. The paradigm trains a general model on unlabeled data that can later be used to solve specific downstream tasks. This type of model is costly to train…

The development of semi-supervised learning (SSL) has in recent years largely focused on the development of new consistency regularization or entropy minimization approaches, often resulting in models with complex training strategies to…

机器学习 · 计算机科学 2025-07-01 Durgesh Singh , Ahcene Boubekki , Robert Jenssen , Michael C. Kampffmeyer

Self supervised learning (SSL) is a machine learning paradigm where models learn to understand the underlying structure of data without explicit supervision from labeled samples. The acquired representations from SSL have demonstrated…

机器学习 · 计算机科学 2025-12-11 Yunshan Duan , Sinead Williamson

Semi-supervised learning (SSL) uses unlabeled data during training to learn better models. Previous studies on SSL for medical image segmentation focused mostly on improving model generalization to unseen data. In some applications,…

Self-supervised learning (SSL) has recently shown notable success in various visual tasks. However, in terms of discriminability, SSL is still not on par with supervised learning (SL). This paper identifies a key issue, the ``crowding…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Zeen Song , Wenwen Qiang , Changwen Zheng , Fuchun Sun , Hui Xiong

Speech representation learning plays a vital role in speech processing. Among them, self-supervised learning (SSL) has become an important research direction. It has been shown that an SSL pretraining model can achieve excellent performance…

音频与语音处理 · 电气工程与系统科学 2021-10-20 Yi-Chen Chen , Shu-wen Yang , Cheng-Kuang Lee , Simon See , Hung-yi Lee

Semi-supervised learning (SSL) aims to train a machine learning model using both labelled and unlabelled data. While the unlabelled data have been used in various ways to improve the prediction accuracy, the reason why unlabelled data could…

机器学习 · 统计学 2025-10-28 Archer Moore , Heejung Shim , Jingge Zhu , Mingming Gong