English
Related papers

Related papers: scSSL-Bench: Benchmarking Self-Supervised Learning…

200 papers

Semi-supervised learning (SSL) commonly exhibits confirmation bias, where models disproportionately favor certain classes, leading to errors in predicted pseudo labels that accumulate under a self-training paradigm. Unlike supervised…

Machine Learning · Computer Science 2024-09-30 Yu Wang , Yuxuan Yin , Peng Li

Collecting large-scale medical datasets with fully annotated samples for training of deep networks is prohibitively expensive, especially for 3D volume data. Recent breakthroughs in self-supervised learning (SSL) offer the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Duy M. H. Nguyen , Hoang Nguyen , Mai T. N. Truong , Tri Cao , Binh T. Nguyen , Nhat Ho , Paul Swoboda , Shadi Albarqouni , Pengtao Xie , Daniel Sonntag

As a new paradigm in machine learning, self-supervised learning (SSL) is capable of learning high-quality representations of complex data without relying on labels. In addition to eliminating the need for labeled data, research has found…

Cryptography and Security · Computer Science 2023-08-15 Changjiang Li , Ren Pang , Zhaohan Xi , Tianyu Du , Shouling Ji , Yuan Yao , Ting Wang

Advances in deep learning are re-defining how visual data is processed and understand by the machines. Vision Transformers (ViTs) have recently demonstrated prominent performance in computer vision related tasks. However, their performance…

Semi-supervised learning (SSL) has been widely explored in recent years, and it is an effective way of leveraging unlabeled data to reduce the reliance on labeled data. In this work, we adjust neural processes (NPs) to the semi-supervised…

Machine Learning · Computer Science 2022-07-05 Jianfeng Wang , Thomas Lukasiewicz , Daniela Massiceti , Xiaolin Hu , Vladimir Pavlovic , Alexandros Neophytou

Self-Supervised Learning (SSL) has emerged as a powerful paradigm to mitigate the reliance on large, annotated datasets, a common bottleneck in medical image analysis. However, standard SSL methods, which rely on simple geometric and color…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Joao Batista Florindo

We consider the task of self-supervised representation learning (SSL) for tabular data: tabular-SSL. Typical contrastive learning based SSL methods require instance-wise data augmentations which are difficult to design for unstructured…

Machine Learning · Computer Science 2022-06-20 Kushal Majmundar , Sachin Goyal , Praneeth Netrapalli , Prateek Jain

Since its selection as the method of the year in 2013, single-cell technologies have become mature enough to provide answers to complex research questions. With the growth of single-cell profiling technologies, there has also been a…

We introduce MultiMatch, a novel semi-supervised learning (SSL) algorithm combining the paradigms of co-training and consistency regularization with pseudo-labeling. At its core, MultiMatch features a pseudo-label weighting module designed…

Computation and Language · Computer Science 2025-11-04 Iustin Sirbu , Robert-Adrian Popovici , Cornelia Caragea , Stefan Trausan-Matu , Traian Rebedea

Semi-supervised learning (SSL) is an active area of research which aims to utilize unlabelled data in order to improve the accuracy of speech recognition systems. The current study proposes a methodology for integration of two key ideas: 1)…

Computation and Language · Computer Science 2020-08-11 Prakhar Swarup , Debmalya Chakrabarty , Ashtosh Sapru , Hitesh Tulsiani , Harish Arsikere , Sri Garimella

Effective suppression of surface-related multiples is essential to prevent imaging artifacts and erroneous structural interpretations. While conventional approaches rely on accurate priors or subsurface model knowledge, and supervised…

Geophysics · Physics 2026-05-01 Huan Song , Shijun Cheng , Huanhuan Tang , Wei Ouyang , Weijian Mao

Semi-supervised learning (SSL) has recently proven to be an effective paradigm for leveraging a huge amount of unlabeled data while mitigating the reliance on large labeled data. Conventional methods focused on extracting a pseudo label…

Machine Learning · Computer Science 2022-01-26 Jiwon Kim , Kwangrok Ryoo , Gyuseong Lee , Seokju Cho , Junyoung Seo , Daehwan Kim , Hansang Cho , Seungryong Kim

We investigate the utility of in-domain self-supervised pre-training of vision models in the analysis of remote sensing imagery. Self-supervised learning (SSL) has emerged as a promising approach for remote sensing image classification due…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Ivica Dimitrovski , Ivan Kitanovski , Nikola Simidjievski , Dragi Kocev

Semi-Supervised Learning (SSL) has been an effective way to leverage abundant unlabeled data with extremely scarce labeled data. However, most SSL methods are commonly based on instance-wise consistency between different data…

Machine Learning · Computer Science 2023-10-26 Zhuo Huang , Li Shen , Jun Yu , Bo Han , Tongliang Liu

Semi-supervised learning (SSL) is a class of supervised learning tasks and techniques that also exploits the unlabeled data for training. SSL significantly reduces labeling related costs and is able to handle large data sets. The primary…

Machine Learning · Computer Science 2016-06-30 Eftychios Protopapadakis

Semi-supervised learning (SSL) leverages limited labeled and abundant unlabeled data but often faces challenges with data imbalance, especially in 3D contexts. This study investigates class-level confidence as an indicator of learning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Zhimin Chen , Bing Li

Single-cell RNA sequencing (scRNA-seq) offers detailed insights into cellular heterogeneity. Recent advancements leverage single-cell large language models (scLLMs) for effective representation learning. These models focus exclusively on…

Machine Learning · Computer Science 2025-06-05 Yaorui Shi , Jiaqi Yang , Changhao Nai , Sihang Li , Junfeng Fang , Xiang Wang , Zhiyuan Liu , Yang Zhang

In this work, we observe a counterintuitive phenomenon in self-supervised learning (SSL): longer training may impair the performance of dense prediction tasks (e.g., semantic segmentation). We refer to this phenomenon as Self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Siran Dai , Qianqian Xu , Peisong Wen , Yang Liu , Qingming Huang

Semi-supervised learning (SSL) has witnessed great progress with various improvements in the self-training framework with pseudo labeling. The main challenge is how to distinguish high-quality pseudo labels against the confirmation bias.…

Machine Learning · Computer Science 2024-02-21 Siyuan Li , Weiyang Jin , Zedong Wang , Fang Wu , Zicheng Liu , Cheng Tan , Stan Z. Li

Neural networks have demonstrated exceptional performance in supervised learning, benefiting from abundant high-quality annotated data. However, obtaining such data in real-world scenarios is costly and labor-intensive. Semi-supervised…

Machine Learning · Computer Science 2025-06-03 Shuai Zhao , Heyan Huang , Xinge Li , Xiaokang Chen , Rui Wang