English
Related papers

Related papers: Visual Self-supervised Learning Scheme for Dense P…

200 papers

For medical image segmentation, contrastive learning is the dominant practice to improve the quality of visual representations by contrasting semantically similar and dissimilar pairs of samples. This is enabled by the observation that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Chenyu You , Weicheng Dai , Yifei Min , Fenglin Liu , David A. Clifton , S Kevin Zhou , Lawrence Hamilton Staib , James S Duncan

Learning visual representations through self-supervision is an extremely challenging task as the network needs to sieve relevant patterns from spurious distractors without the active guidance provided by supervision. This is achieved…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Fatemeh Saleh , Fuwen Tan , Adrian Bulat , Georgios Tzimiropoulos , Brais Martinez

Deep learning on graphs has recently achieved remarkable success on a variety of tasks, while such success relies heavily on the massive and carefully labeled data. However, precise annotations are generally very expensive and…

Machine Learning · Computer Science 2021-09-30 Lirong Wu , Haitao Lin , Zhangyang Gao , Cheng Tan , Stan. Z. Li

Learning from large amounts of unsupervised data and a small amount of supervision is an important open problem in computer vision. We propose a new semi-supervised learning method, Semantic Positives via Pseudo-Labels (SemPPL), that…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Matko Bošnjak , Pierre H. Richemond , Nenad Tomasev , Florian Strub , Jacob C. Walker , Felix Hill , Lars Holger Buesing , Razvan Pascanu , Charles Blundell , Jovana Mitrovic

Recently, self-supervised learning (SSL) methods have been used in pre-training the segmentation models for 2D and 3D medical images. Most of these methods are based on reconstruction, contrastive learning and consistency regularization.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Haofeng Li , Yiming Ouyang , Xiang Wan

This work addresses the task of self-supervised learning (SSL) on a long-tailed dataset that aims to learn balanced and well-separated representations for downstream tasks such as image classification. This task is crucial because the real…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Cuong Manh Hoang , Yeejin Lee , Byeongkeun Kang

We consider the problem of semi-supervised 3D action recognition which has been rarely explored before. Its major challenge lies in how to effectively learn motion representations from unlabeled data. Self-supervised learning (SSL) has been…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Chenyang Si , Xuecheng Nie , Wei Wang , Liang Wang , Tieniu Tan , Jiashi Feng

Inspired by the success of Self-supervised learning (SSL) in learning visual representations from unlabeled data, a few recent works have studied SSL in the context of continual learning (CL), where multiple tasks are learned sequentially,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Li Yang , Sen Lin , Fan Zhang , Junshan Zhang , Deliang Fan

Self-Supervised Learning (SSL) enables us to pre-train foundation models without costly labeled data. Among SSL methods, Contrastive Learning (CL) methods are better at obtaining accurate semantic representations in noise interference.…

Image and Video Processing · Electrical Eng. & Systems 2026-02-06 Hengtong Shen , Haiyan Gu , Haitao Li , Yi Yang , Agen Qiu

In this work, we observe a counterintuitive phenomenon in self-supervised learning (SSL): longer training may impair the performance of dense prediction tasks (e.g., semantic segmentation). We refer to this phenomenon as Self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Siran Dai , Qianqian Xu , Peisong Wen , Yang Liu , Qingming Huang

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Gustav Larsson

Self-supervised learning (SSL) has emerged as a powerful strategy for representation learning under limited annotation regimes, yet its effectiveness remains highly sensitive to many factors, especially the nature of the target task. In…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jorge Quesada , Ghassan AlRegib

Mid-level vision capabilities - such as generic object localization and 3D geometric understanding - are not only fundamental to human vision but are also crucial for many real-world applications of computer vision. These abilities emerge…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Xuweiyi Chen , Markus Marks , Zezhou Cheng

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

While contrastive approaches of self-supervised learning (SSL) learn representations by minimizing the distance between two augmented views of the same data point (positive pairs) and maximizing views from different data points (negative…

Machine Learning · Computer Science 2021-10-11 Yuandong Tian , Xinlei Chen , Surya Ganguli

In Computer Vision, self-supervised contrastive learning enforces similar representations between different views of the same image. The pre-training is most often performed on image classification datasets, like ImageNet, where images…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Benjamin Missaoui , Chongbin Yuan

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

Semi-supervised object detection (SSOD) aims to facilitate the training and deployment of object detectors with the help of a large amount of unlabeled data. Though various self-training based and consistency-regularization based SSOD…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Binghui Chen , Pengyu Li , Xiang Chen , Biao Wang , Lei Zhang , Xian-Sheng Hua

Deep learning has become a valuable tool for the automation of certain medical image segmentation tasks, significantly relieving the workload of medical specialists. Some of these tasks require segmentation to be performed on a subset of…

Image and Video Processing · Electrical Eng. & Systems 2024-02-06 José Morano , Guilherme Aresta , Dmitrii Lachinov , Julia Mai , Ursula Schmidt-Erfurth , Hrvoje Bogunović

Last couple of years have witnessed a tremendous progress in self-supervised learning (SSL), the success of which can be attributed to the introduction of useful inductive biases in the learning process to learn meaningful visual…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Abhishek Jha , Matthew B. Blaschko , Yuki M. Asano , Tinne Tuytelaars