English
Related papers

Related papers: Understanding Representation Learnability of Nonli…

200 papers

Semi-Supervised Learning (SSL) is a framework that utilizes both labeled and unlabeled data to enhance model performance. Conventional SSL methods operate under the assumption that labeled and unlabeled data share the same label space.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Noam Fluss , Guy Hacohen , Daphna Weinshall

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jiale Chen

Self-supervised learning (SSL), which aims to learn meaningful prior representations from unlabeled data, has been proven effective for skeleton-based action understanding. Different from the image domain, skeleton data possesses sparser…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Jiahang Zhang , Lilang Lin , Shuai Yang , Jiaying Liu

Decentralized learning has been advocated and widely deployed to make efficient use of distributed datasets, with an extensive focus on supervised learning (SL) problems. Unfortunately, the majority of real-world data are unlabeled and can…

Machine Learning · Computer Science 2023-03-01 Lirui Wang , Kaiqing Zhang , Yunzhu Li , Yonglong Tian , Russ Tedrake

Self supervised learning (SSL) is a machine learning paradigm where models learn to understand the underlying structure of data without explicit supervision from labeled samples. The acquired representations from SSL have demonstrated…

Machine Learning · Computer Science 2025-12-11 Yunshan Duan , Sinead Williamson

Self-supervised learning (SSL), as a newly emerging unsupervised representation learning paradigm, generally follows a two-stage learning pipeline: 1) learning invariant and discriminative representations with auto-annotation pretext(s),…

Machine Learning · Computer Science 2022-08-23 Jiayu Yao , Qingyuan Wu , Quan Feng , Songcan Chen

Self-supervised learning (SSL) aims to find meaningful representations from unlabeled data by encoding semantic similarities through data augmentations. Despite its current popularity, theoretical insights about SSL are still scarce. For…

Machine Learning · Computer Science 2025-05-27 Maximilian Fleissner , Pascal Esser , Debarghya Ghoshdastidar

Self-supervised learning (SSL) has improved empirical performance by unleashing the power of unlabeled data for practical applications. Specifically, SSL extracts the representation from massive unlabeled data, which will be transferred to…

Machine Learning · Computer Science 2026-02-16 Bo Dai , Na Li , Dale Schuurmans

Unsupervised and self-supervised representation learning has become popular in recent years for learning useful features from unlabelled data. Representation learning has been mostly developed in the neural network literature, and other…

Machine Learning · Computer Science 2023-09-06 Pascal Esser , Maximilian Fleissner , Debarghya Ghoshdastidar

In recent years, self-supervised learning (SSL) frameworks have been extensively applied to sensor-based Human Activity Recognition (HAR) in order to learn deep representations without data annotations. While SSL frameworks reach…

Machine Learning · Computer Science 2023-08-01 Bulat Khaertdinov , Stylianos Asteriadis

Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Ke Zhu , Minghao Fu , Jianxin Wu

The success of self-supervised learning (SSL) has mostly been attributed to the availability of unlabeled yet large-scale datasets. However, in a specialized domain such as medical imaging which is a lot different from natural images, the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Soumitri Chattopadhyay , Soham Ganguly , Sreejit Chaudhury , Sayan Nag , Samiran Chattopadhyay

We investigate the utility of in-domain self-supervised pre-training of vision models in the analysis of remote sensing imagery. Self-supervised learning (SSL) has emerged as a promising approach for remote sensing image classification due…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Ivica Dimitrovski , Ivan Kitanovski , Nikola Simidjievski , Dragi Kocev

In self-supervised learning (SSL), representations are learned via an auxiliary task without annotated labels. A common task is to classify augmentations or different modalities of the data, which share semantic content (e.g. an object in…

Machine Learning · Computer Science 2024-10-16 Alice Bizeul , Bernhard Schölkopf , Carl Allen

Most of the current self-supervised representation learning (SSL) methods are based on the contrastive loss and the instance-discrimination task, where augmented versions of the same image instance ("positives") are contrasted with…

Machine Learning · Computer Science 2021-05-17 Aleksandr Ermolov , Aliaksandr Siarohin , Enver Sangineto , Nicu Sebe

Self-Supervised Learning (SSL) is a paradigm that leverages unlabeled data for model training. Empirical studies show that SSL can achieve promising performance in distribution shift scenarios, where the downstream and training…

Machine Learning · Computer Science 2023-12-13 Xuyang Zhao , Tianqi Du , Yisen Wang , Jun Yao , Weiran Huang

We address the problem of evaluating the quality of self-supervised learning (SSL) models without access to supervised labels, while being agnostic to the architecture, learning algorithm or data manipulation used during training. We argue…

Machine Learning · Computer Science 2023-11-16 Yuchen Lu , Zhen Liu , Aristide Baratin , Romain Laroche , Aaron Courville , Alessandro Sordoni

Nowadays, supervised deep learning techniques yield the best state-of-the-art prediction performances for a wide variety of computer vision tasks. However, such supervised techniques generally require a large amount of manually labeled…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Florent Chiaroni , Mohamed-Cherif Rahal , Nicolas Hueber , Frederic Dufaux

Self-supervised learning (SSL) has great potential for molecular representation learning given the complexity of molecular graphs, the large amounts of unlabelled data available, the considerable cost of obtaining labels experimentally, and…

Machine Learning · Computer Science 2023-11-30 Yuankai Luo , Lei Shi , Veronika Thost

Semi-supervised learning (SSL) uses unlabeled data during training to learn better models. Previous studies on SSL for medical image segmentation focused mostly on improving model generalization to unseen data. In some applications,…