English
Related papers

Related papers: Self-supervised Learning with Local Contrastive Lo…

200 papers

Most of the current self-supervised representation learning (SSL) methods are based on the contrastive loss and the instance-discrimination task, where augmented versions of the same image instance ("positives") are contrasted with…

Machine Learning · Computer Science 2021-05-17 Aleksandr Ermolov , Aliaksandr Siarohin , Enver Sangineto , Nicu Sebe

We present a novel semi-supervised semantic segmentation method which jointly achieves two desiderata of segmentation model regularities: the label-space consistency property between image augmentations and the feature-space contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Yuanyi Zhong , Bodi Yuan , Hong Wu , Zhiqiang Yuan , Jian Peng , Yu-Xiong Wang

Self-supervised learning (SSL) has emerged as a powerful technique for learning rich representations from unlabeled data. The data representations are able to capture many underlying attributes of data, and be useful in downstream…

Machine Learning · Computer Science 2023-12-01 Weicheng Zhu , Sheng Liu , Carlos Fernandez-Granda , Narges Razavian

Due to the scarcity of labeled data, Contrastive Self-Supervised Learning (SSL) frameworks have lately shown great potential in several medical image analysis tasks. However, the existing contrastive mechanisms are sub-optimal for dense…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Hritam Basak , Soumitri Chattopadhyay , Rohit Kundu , Sayan Nag , Rammohan Mallipeddi

This work considers supervised contrastive learning for semantic segmentation. We apply contrastive learning to enhance the discriminative power of the multi-scale features extracted by semantic segmentation networks. Our key methodological…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Theodoros Pissas , Claudio S. Ravasio , Lyndon Da Cruz , Christos Bergeles

Contrastive Self-supervised Learning (CSL) is a practical solution that learns meaningful visual representations from massive data in an unsupervised approach. The ordinary CSL embeds the features extracted from neural networks onto…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Shentong Mo , Zhun Sun , Chao Li

Self-supervised learning (SSL) methods have achieved remarkable success in learning image representations allowing invariances in them - but therefore discarding transformation information that some computer vision tasks actually require.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Qin Wang , Alessio Quercia , Benjamin Bruns , Abigail Morrison , Hanno Scharr , Kai Krajsek

Although supervised learning has been highly successful in improving the state-of-the-art in the domain of image-based computer vision in the past, the margin of improvement has diminished significantly in recent years, indicating that a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Utku Ozbulak , Hyun Jung Lee , Beril Boga , Esla Timothy Anzaku , Homin Park , Arnout Van Messem , Wesley De Neve , Joris Vankerschaver

This study explores the application of self-supervised learning (SSL) for improved target recognition in synthetic aperture sonar (SAS) imagery. The unique challenges of underwater environments make traditional computer vision techniques,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 BW Sheffield

Self-supervised learning (SSL) methods aim to exploit the abundance of unlabelled data for machine learning (ML), however the underlying principles are often method-specific. An SSL framework derived from biological first principles of…

Machine Learning · Computer Science 2023-08-03 Franz Scherr , Qinghai Guo , Timoleon Moraitis

Self-supervised learning (SSL) has gained widespread attention in the remote sensing (RS) and earth observation (EO) communities owing to its ability to learn task-agnostic representations without human-annotated labels. Nevertheless, most…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Dilxat Muhtar , Xueliang Zhang , Pengfeng Xiao , Zhenshi Li , Feng Gu

Supervised contour detection methods usually require many labeled training images to obtain satisfactory performance. However, a large set of annotated data might be unavailable or extremely labor intensive. In this paper, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2016-05-18 Zizhao Zhang , Fuyong Xing , Xiaoshuang Shi , Lin Yang

Recently, self-supervised learning (SSL) methods have been used in pre-training the segmentation models for 2D and 3D medical images. Most of these methods are based on reconstruction, contrastive learning and consistency regularization.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Haofeng Li , Yiming Ouyang , Xiang Wan

Recent advances in semi-supervised object detection (SSOD) are largely driven by consistency-based pseudo-labeling methods for image classification tasks, producing pseudo labels as supervisory signals. However, when using pseudo labels,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Hengduo Li , Zuxuan Wu , Abhinav Shrivastava , Larry S. Davis

Current 3D semi-supervised segmentation methods face significant challenges such as limited consideration of contextual information and the inability to generate reliable pseudo-labels for effective unsupervised data use. To address these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Sanaz Karimijafarbigloo , Reza Azad , Yury Velichko , Ulas Bagci , Dorit Merhof

Progress in self-supervised learning has brought strong general image representation learning methods. Yet so far, it has mostly focused on image-level learning. In turn, tasks such as unsupervised image segmentation have not benefited from…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Adrian Ziegler , Yuki M. Asano

Self-supervised learning (SSL) methods have shown promise for medical imaging applications by learning meaningful visual representations, even when the amount of labeled data is limited. Here, we extend state-of-the-art contrastive learning…

Semi-supervised learning (SSL) has been a powerful strategy to incorporate few labels in learning better representations. In this paper, we focus on a practical scenario that one aims to apply SSL when unlabeled data may contain…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Jongjin Park , Sukmin Yun , Jongheon Jeong , Jinwoo Shin

The ability to understand visual information from limited labeled data is an important aspect of machine learning. While image-level classification has been extensively studied in a semi-supervised setting, dense pixel-level classification…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Sudhanshu Mittal , Maxim Tatarchenko , Thomas Brox

To overcome the data-hungry challenge, we have proposed a semi-supervised contrastive learning framework for the task of class-imbalanced semantic segmentation. First and foremost, to make the model operate in a semi-supervised manner, we…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Kangcheng Liu