English
Related papers

Related papers: Self-Supervised Learning for Improved Synthetic Ap…

200 papers

We propose a novel semi-supervised learning (SSL) method that adopts selective training with pseudo labels. In our method, we generate hard pseudo-labels and also estimate their confidence, which represents how likely each pseudo-label is…

Machine Learning · Computer Science 2021-03-16 Masato Ishii

Semi-supervised learning (SSL) algorithm is a setup built upon a realistic assumption that access to a large amount of labeled data is tough. In this study, we present a generalized framework, named SCAR, standing for Selecting Clean…

Machine Learning · Computer Science 2023-08-09 Dongyoon Yang , Kunwoong Kim , Yongdai Kim

Pseudo-label-based semi-supervised learning (SSL) has achieved great success on raw data utilization. However, its training procedure suffers from confirmation bias due to the noise contained in self-generated artificial labels. Moreover,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-12 Fan Yang , Kai Wu , Shuyi Zhang , Guannan Jiang , Yong Liu , Feng Zheng , Wei Zhang , Chengjie Wang , Long Zeng

Self-supervised learning (SSL) algorithms have emerged as powerful tools that can leverage large quantities of unlabeled audio data to pre-train robust representations that support strong performance on diverse downstream tasks. Up to now…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-05 Mattson Ogg

Self-supervised learning algorithms (SSL) based on instance discrimination have shown promising results, performing competitively or even outperforming supervised learning counterparts in some downstream tasks. Such approaches employ data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Mohammad Alkhalefi , Georgios Leontidis , Mingjun Zhong

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most methods mainly focus on the instance level information (\ie,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

The image reconstruction process in medical imaging can be treated as solving an inverse problem. The inverse problem is usually solved using time-consuming iterative algorithms with sparsity or other constraints. Recently, deep neural…

Medical Physics · Physics 2021-10-29 Jingke Zhang , Qiong He , Congzhi Wang , Hongen Liao , Jianwen Luo

As an effective way to alleviate the burden of data annotation, semi-supervised learning (SSL) provides an attractive solution due to its ability to leverage both labeled and unlabeled data to build a predictive model. While significant…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hai-Ming Xu , Lingqiao Liu , Hao Chen , Ehsan Abbasnejad , Rafael Felix

Self-Supervised Learning (SSL) presents an exciting opportunity to unlock the potential of vast, untapped clinical datasets, for various downstream applications that suffer from the scarcity of labeled data. While SSL has revolutionized…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Tassilo Wald , Constantin Ulrich , Stanislav Lukyanenko , Andrei Goncharov , Alberto Paderno , Maximilian Miller , Leander Maerkisch , Paul F. Jäger , Klaus Maier-Hein

Semi-supervised learning (SSL) has emerged as a promising paradigm for breast ultrasound (BUS) image segmentation, but it often suffers from unstable pseudo labels under extremely limited annotations, leading to inaccurate supervision and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ruili Li , Jiayi Ding , Ruiyu Li , Yilun Jin , Shiwen Ge , Yuwen Zeng , Xiaoyong Zhang , Eichi Takaya , Jan Vrba , Noriyasu Homma

Self-supervised learning (SSL) has the potential to benefit many applications, particularly those where manually annotating data is cumbersome. One such situation is the semantic segmentation of point clouds. In this context, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Yanhao Wu , Tong Zhang , Wei Ke , Sabine Süsstrunk , Mathieu Salzmann

Given a small set of labeled data and a large set of unlabeled data, semi-supervised learning (SSL) attempts to leverage the location of the unlabeled datapoints in order to create a better classifier than could be obtained from supervised…

Machine Learning · Computer Science 2022-05-25 Michael C. Burkhart , Kyle Shan

Self-supervised learning (SSL) has been incorporated into many state-of-the-art models in various domains, where SSL defines pretext tasks based on unlabeled datasets to learn contextualized and robust representations. Recently, SSL has…

Machine Learning · Computer Science 2024-09-11 Wei-Yao Wang , Wei-Wei Du , Derek Xu , Wei Wang , Wen-Chih Peng

Self-supervised learning (SSL) has become the de facto training paradigm of large models where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Hypothesizing that SSL models would learn more generic,…

Machine Learning · Computer Science 2024-01-04 Sofia Yfantidou , Dimitris Spathis , Marios Constantinides , Athena Vakali , Daniele Quercia , Fahim Kawsar

Despite the impressive progress of self-supervised learning (SSL), its applicability to low-compute networks has received limited attention. Reported performance has trailed behind standard supervised pre-training by a large margin, barring…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Fuwen Tan , Fatemeh Saleh , Brais Martinez

Collecting large-scale medical datasets with fully annotated samples for training of deep networks is prohibitively expensive, especially for 3D volume data. Recent breakthroughs in self-supervised learning (SSL) offer the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Duy M. H. Nguyen , Hoang Nguyen , Mai T. N. Truong , Tri Cao , Binh T. Nguyen , Nhat Ho , Paul Swoboda , Shadi Albarqouni , Pengtao Xie , Daniel Sonntag

Self-supervised learning (SSL) on 3D point clouds has the potential to learn feature representations that can transfer to diverse sensors and multiple downstream perception tasks. However, recent SSL approaches fail to define pretext tasks…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Barza Nisar , Steven L. Waslander

Self-Supervised Learning (SSL) has emerged as the solution of choice to learn transferable representations from unlabeled data. However, SSL requires to build samples that are known to be semantically akin, i.e. positive views. Requiring…

Machine Learning · Computer Science 2023-10-02 Vivien Cabannes , Leon Bottou , Yann Lecun , Randall Balestriero

Self-supervised learning (SSL) has rapidly emerged as a transformative approach in computer vision, enabling the extraction of rich feature representations from vast amounts of unlabeled data and reducing reliance on costly manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Nikolaos Giakoumoglou , Tania Stathaki , Athanasios Gkelias

Self-supervised learning (SSL) has attracted much interest in remote sensing and earth observation due to its ability to learn task-agnostic representations without human annotation. While most of the existing SSL works in remote sensing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Yi Wang , Conrad M Albrecht , Xiao Xiang Zhu