English
Related papers

Related papers: Visual Self-supervised Learning Scheme for Dense P…

200 papers

Contrastive learning methods in self-supervised settings have primarily focused on pre-training encoders, while decoders are typically introduced and trained separately for downstream dense prediction tasks. However, this conventional…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Sébastien Quetin , Tapotosh Ghosh , Farhad Maleki

Despite their effectiveness, current deep learning models face challenges with images coming from different domains with varying appearance and content. We introduce SegCLR, a versatile framework designed to segment images across different…

Image and Video Processing · Electrical Eng. & Systems 2025-04-15 Alvaro Gomariz , Yusuke Kikuchi , Yun Yvonna Li , Thomas Albrecht , Andreas Maunz , Daniela Ferrara , Huanxiang Lu , Orcun Goksel

Recently, deep learning has experienced rapid expansion, contributing significantly to the progress of supervised learning methodologies. However, acquiring labeled data in real-world settings can be costly, labor-intensive, and sometimes…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Jicheng Yuan , Anh Le-Tuan , Ali Ganbarov , Manfred Hauswirth , Danh Le-Phuoc

Self-supervised learning algorithms (SSL) based on instance discrimination have shown promising results, performing competitively or even outperforming supervised learning counterparts in some downstream tasks. Such approaches employ data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Mohammad Alkhalefi , Georgios Leontidis , Mingjun Zhong

Semi-supervised learning (SSL) has a potential to improve the predictive performance of machine learning models using unlabeled data. Although there has been remarkable recent progress, the scope of demonstration in SSL has mainly been on…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Kihyuk Sohn , Zizhao Zhang , Chun-Liang Li , Han Zhang , Chen-Yu Lee , Tomas Pfister

Supervised deep learning models depend on massive labeled data. Unfortunately, it is time-consuming and labor-intensive to collect and annotate bitemporal samples containing desired changes. Transfer learning from pre-trained models is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Hao Chen , Wenyuan Li , Song Chen , Zhenwei Shi

Semi-supervised learning (SSL) has been a powerful strategy to incorporate few labels in learning better representations. In this paper, we focus on a practical scenario that one aims to apply SSL when unlabeled data may contain…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Jongjin Park , Sukmin Yun , Jongheon Jeong , Jinwoo Shin

Over the last decade, supervised deep learning on manually annotated big data has been progressing significantly on computer vision tasks. But the application of deep learning in medical image analysis was limited by the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Wei-Chien Wang , Euijoon Ahn , Dagan Feng , Jinman Kim

Whilst contrastive learning has recently brought notable benefits to deep clustering of unlabelled images by learning sample-specific discriminative visual features, its potential for explicitly inferring class decision boundaries is less…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Jiabo Huang , Shaogang Gong

Self-supervised learning (SSL) is a machine learning approach where the data itself provides supervision, eliminating the need for external labels. The model is forced to learn about the data structure or context by solving a pretext task.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Markus Marks , Manuel Knott , Neehar Kondapaneni , Elijah Cole , Thijs Defraeye , Fernando Perez-Cruz , Pietro Perona

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao

Self-supervised representation learning for visual pre-training has achieved remarkable success with sample (instance or pixel) discrimination and semantics discovery of instance, whereas there still exists a non-negligible gap between…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Xiaoni Li , Yu Zhou , Yifei Zhang , Aoting Zhang , Wei Wang , Ning Jiang , Haiying Wu , Weiping Wang

Self-supervised learning (SSL), in particular contrastive learning, has made great progress in recent years. However, a common theme in these methods is that they inherit the learning paradigm from the supervised deep learning scenario.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Yun-Hao Cao , Jianxin Wu

Early cancer detection is crucial for prognosis, but many cancer types lack large labelled datasets required for developing deep learning models. This paper investigates self-supervised learning (SSL) as an alternative to the standard…

Image and Video Processing · Electrical Eng. & Systems 2024-11-27 Hamish Haggerty , Rohitash Chandra

Deep learning has revolutionized medical image segmentation, but it relies heavily on high-quality annotations. The time, cost and expertise required to label images at the pixel-level for each new task has slowed down widespread adoption…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Maxime Seince , Loic Le Folgoc , Luiz Augusto Facury de Souza , Elsa Angelini

Self-supervised learning has been widely used to obtain transferrable representations from unlabeled images. Especially, recent contrastive learning methods have shown impressive performances on downstream image classification tasks. While…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Byungseok Roh , Wuhyun Shin , Ildoo Kim , Sungwoong Kim

Self-Supervised Learning (SSL) is a valuable and robust training methodology for contemporary Deep Neural Networks (DNNs), enabling unsupervised pretraining on a 'pretext task' that does not require ground-truth labels/annotation. This…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sotirios Konstantakos , Jorgen Cani , Ioannis Mademlis , Despina Ioanna Chalkiadaki , Yuki M. Asano , Efstratios Gavves , Georgios Th. Papadopoulos

Self-supervised learning (SSL) has emerged as a powerful technique for learning visual representations. While recent SSL approaches achieve strong results in global image understanding, they are limited in capturing the structured…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Oussama Hadjerci , Antoine Letienne , Mohamed Abbas Hedjazi , Adel Hafiane

Self-supervised learning (SSL) approaches have brought tremendous success across many tasks and domains. It has been argued that these successes can be attributed to a link between SSL and identifiable representation learning: Temporal…

Machine Learning · Statistics 2025-06-03 Rodrigo González Laiz , Tobias Schmidt , Steffen Schneider

Semi-supervised learning (SSL) can reduce the need for large labelled datasets by incorporating unlabelled data into the training. This is particularly interesting for semantic segmentation, where labelling data is very costly and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Sebastian Scherer , Robin Schön , Rainer Lienhart