English
Related papers

Related papers: Does Self-supervised Learning Really Improve Reinf…

200 papers

Self-supervised learning (SSL) has had great success in both computer vision. Most of the current mainstream computer vision SSL frameworks are based on Siamese network architecture. These approaches often rely on cleverly crafted loss…

Machine Learning · Computer Science 2024-01-30 Daesoo Lee , Erlend Aune

Self-supervised learning (SSL) has demonstrated significant potential in pre-training robust models with limited labeled data, making it particularly valuable for remote sensing (RS) tasks. A common assumption is that pre-training on…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Saad Lahrichi , Zion Sheng , Shufan Xia , Kyle Bradbury , Jordan Malof

Self-supervised learning (SSL) has emerged as a powerful technique for learning visual representations. While recent SSL approaches achieve strong results in global image understanding, they are limited in capturing the structured…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Oussama Hadjerci , Antoine Letienne , Mohamed Abbas Hedjazi , Adel Hafiane

Self-supervised Learning (SSL) aims to learn transferable feature representations for downstream applications without relying on labeled data. The Barlow Twins algorithm, renowned for its widespread adoption and straightforward…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Wele Gedara Chaminda Bandara , Celso M. De Melo , Vishal M. Patel

Self-supervised learning (SSL) has proven to be a powerful approach for extracting biologically meaningful representations from single-cell data. To advance our understanding of SSL methods applied to single-cell data, we present…

Quantitative Methods · Quantitative Biology 2025-06-13 Olga Ovcharenko , Florian Barkmann , Philip Toma , Imant Daunhawer , Julia Vogt , Sebastian Schelter , Valentina Boeva

Self-Supervised Learning (SSL) is a reliable learning mechanism in which a robot uses an original, trusted sensor cue for training to recognize an additional, complementary sensor cue. We study for the first time in SSL how a robot's…

Robotics · Computer Science 2016-03-29 Kevin van Hecke , Guido de Croon , Laurens van der Maaten , Daniel Hennes , Dario Izzo

Self-supervised learning (SSL) has recently achieved tremendous empirical advancements in learning image representation. However, our understanding of the principle behind learning such a representation is still limited. This work shows…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Yubei Chen , Adrien Bardes , Zengyi Li , Yann LeCun

With the progress of sensor technology in wearables, the collection and analysis of PPG signals are gaining more interest. Using Machine Learning, the cardiac rhythm corresponding to PPG signals can be used to predict different tasks such…

Signal Processing · Electrical Eng. & Systems 2022-12-20 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax

Semi-supervised learning (SSL) is a promising approach for training deep classification models using labeled and unlabeled datasets. However, existing SSL methods rely on a large unlabeled dataset, which may not always be available in many…

Machine Learning · Computer Science 2023-09-29 Shin'ya Yamaguchi

Deep neural networks need huge amount of training data, while in real world there is a scarcity of data available for training purposes. To resolve these issues, self-supervised learning (SSL) methods are used. SSL using geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-02-18 Muhammad Ali , Sayed Hashim

Last couple of years have witnessed a tremendous progress in self-supervised learning (SSL), the success of which can be attributed to the introduction of useful inductive biases in the learning process to learn meaningful visual…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Abhishek Jha , Matthew B. Blaschko , Yuki M. Asano , Tinne Tuytelaars

Self-supervised learning (SSL) has become a popular method for generating invariant representations without the need for human annotations. Nonetheless, the desired invariant representation is achieved by utilising prior online…

Machine Learning · Computer Science 2024-09-30 Foivos Ntelemis , Yaochu Jin , Spencer A. Thomas

Self-supervised learning (SSL) is able to build latent representations that generalize well to unseen data. However, only a few SSL techniques exist for the online CL setting, where data arrives in small minibatches, the model must comply…

Machine Learning · Computer Science 2025-07-16 Giacomo Cignoni , Andrea Cossu , Alexandra Gomez-Villa , Joost van de Weijer , Antonio Carta

Self-supervised learning (SSL) techniques have been widely used to learn compact and informative representations from high-dimensional complex data. In many computer vision tasks, such as image classification, such methods achieve…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Chintan Trivedi , Konstantinos Makantasis , Antonios Liapis , Georgios N. Yannakakis

Sentence Representation Learning (SRL) is a crucial task in Natural Language Processing (NLP), where contrastive Self-Supervised Learning (SSL) is currently a mainstream approach. However, the reasons behind its remarkable effectiveness…

Computation and Language · Computer Science 2024-06-06 Mingxin Li , Richong Zhang , Zhijie Nie

Self-Supervised Learning (SSL) has emerged as the solution of choice to learn transferable representations from unlabeled data. However, SSL requires to build samples that are known to be semantically akin, i.e. positive views. Requiring…

Machine Learning · Computer Science 2023-10-02 Vivien Cabannes , Leon Bottou , Yann Lecun , Randall Balestriero

The advancement of deep learning has greatly improved supervised image classification. However, labeling data is costly, prompting research into unsupervised learning methods such as contrastive learning. In real-world scenarios, fully…

Artificial Intelligence · Computer Science 2026-01-09 Shogo Nakayama , Masahiro Okuda

Self-Supervised Learning (SSL) enables us to pre-train foundation models without costly labeled data. Among SSL methods, Contrastive Learning (CL) methods are better at obtaining accurate semantic representations in noise interference.…

Image and Video Processing · Electrical Eng. & Systems 2026-02-06 Hengtong Shen , Haiyan Gu , Haitao Li , Yi Yang , Agen Qiu

Dense Self-Supervised Learning (SSL) methods address the limitations of using image-level feature representations when handling images with multiple objects. Although the dense features extracted by employing segmentation maps and bounding…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Congpei Qiu , Tong Zhang , Wei Ke , Mathieu Salzmann , Sabine Süsstrunk

Self-supervised learning (SSL) is a growing torrent that has recently transformed machine learning and its many real world applications, by learning on massive amounts of unlabeled data via self-generated supervisory signals. Unsupervised…

Machine Learning · Computer Science 2023-08-29 Leman Akoglu , Jaemin Yoo