English
Related papers

Related papers: Measuring Self-Supervised Representation Quality f…

200 papers

Writer independent offline signature verification is one of the most challenging tasks in pattern recognition as there is often a scarcity of training data. To handle such data scarcity problem, in this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Siladittya Manna , Soumitri Chattopadhyay , Saumik Bhattacharya , Umapada Pal

Deep semi-supervised learning (SSL) has experienced significant attention in recent years, to leverage a huge amount of unlabeled data to improve the performance of deep learning with limited labeled data. Pseudo-labeling is a popular…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Xiaopeng Yan , Riquan Chen , Litong Feng , Jingkang Yang , Huabin Zheng , Wayne Zhang

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-06-18 Avital Oliver , Augustus Odena , Colin Raffel , Ekin D. Cubuk , Ian J. Goodfellow

With the success of self-supervised learning (SSL), it has become a mainstream paradigm to fine-tune from self-supervised pretrained models to boost the performance on downstream tasks. However, we find that current SSL models suffer severe…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Yun-Hao Cao , Peiqin Sun , Yechang Huang , Jianxin Wu , Shuchang Zhou

Recent developments in Self-Supervised Learning (SSL) have demonstrated significant potential for Speaker Verification (SV), but closing the performance gap with supervised systems remains an ongoing challenge. SSL frameworks rely on…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-28 Theo Lepage , Reda Dehak

Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised…

Machine Learning · Computer Science 2024-07-16 Jie Gui , Tuo Chen , Jing Zhang , Qiong Cao , Zhenan Sun , Hao Luo , Dacheng Tao

RUL estimation suffers from a server data imbalance where data from machines near their end of life is rare. Additionally, the data produced by a machine can only be labeled after the machine failed. Semi-Supervised Learning (SSL) can…

Machine Learning · Computer Science 2021-08-27 Tilman Krokotsch , Mirko Knaak , Clemens Gühmann

Self-supervised learning (SSL) models have achieved considerable improvements in automatic speech recognition (ASR). In addition, ASR performance could be further improved if the model is dedicated to audio content information learning…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-08 Genshun Wan , Tan Liu , Hang Chen , Jia Pan , Cong Liu , Zhongfu Ye

In recent years, much work has been done on processing of wireless spectrum data involving machine learning techniques in domain-related problems for cognitive radio networks, such as anomaly detection, modulation classification, technology…

Networking and Internet Architecture · Computer Science 2024-08-23 Ljupcho Milosheski , Gregor Cerar , Blaž Bertalanič , Carolina Fortuna , Mihael Mohorčič

Breast cancer is one of the leading causes of female mortality in the world. This can be reduced when diagnoses are performed at the early stages of progression. Further, the efficiency of the process can be significantly improved with…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Aravind Ravi

Learning transferable data representations from abundant unlabeled data remains a central challenge in machine learning. Although numerous self-supervised learning methods have been proposed to address this challenge, a significant class of…

Machine Learning · Statistics 2025-10-21 Chenguang Duan , Yuling Jiao , Huazhen Lin , Wensen Ma , Jerry Zhijian Yang

Decentralized learning has been advocated and widely deployed to make efficient use of distributed datasets, with an extensive focus on supervised learning (SL) problems. Unfortunately, the majority of real-world data are unlabeled and can…

Machine Learning · Computer Science 2023-03-01 Lirui Wang , Kaiqing Zhang , Yunzhu Li , Yonglong Tian , Russ Tedrake

Accurate anomaly detection is critical in vision-based infrastructure inspection, where it helps prevent costly failures and enhances safety. Self-Supervised Learning (SSL) offers a promising approach by learning robust representations from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Daniel Otero , Rafael Mateus , Randall Balestriero

Sign language recognition (SLR) is a machine learning task aiming to identify signs in videos. Due to the scarcity of annotated data, unsupervised methods like contrastive learning have become promising in this field. They learn meaningful…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ariel Basso Madjoukeng , Jérôme Fink , Pierre Poitier , Edith Belise Kenmogne , Benoit Frenay

Many self-supervised learning (SSL) methods have been successful in learning semantically meaningful visual representations by solving pretext tasks. However, prior work in SSL focuses on tasks like object recognition or detection, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Donghyun Kim , Kuniaki Saito , Samarth Mishra , Stan Sclaroff , Kate Saenko , Bryan A Plummer

This paper introduces MixDiff, a new self-supervised learning (SSL) pre-training framework that combines real and synthetic images. Unlike traditional SSL methods that predominantly use real images, MixDiff uses a variant of Stable…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Reza Akbarian Bafghi , Nidhin Harilal , Claire Monteleoni , Maziar Raissi

Semi-supervised learning (SSL) leverages limited labeled and abundant unlabeled data but often faces challenges with data imbalance, especially in 3D contexts. This study investigates class-level confidence as an indicator of learning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Zhimin Chen , Bing Li

Given an unlabeled dataset and an annotation budget, we study how to selectively label a fixed number of instances so that semi-supervised learning (SSL) on such a partially labeled dataset is most effective. We focus on selecting the right…

Machine Learning · Computer Science 2023-08-24 Xudong Wang , Long Lian , Stella X. Yu

Self-supervised learning (SSL) has recently emerged as a powerful approach to learning representations from large-scale unlabeled data, showing promising results in time series analysis. The self-supervised representation learning can be…

Machine Learning · Computer Science 2024-03-18 Ziyu Liu , Azadeh Alavi , Minyi Li , Xiang Zhang

Recently, significant advancements in artificial intelligence have been attributed to the integration of self-supervised learning (SSL) scheme. While SSL has shown impressive achievements in natural language processing (NLP), its progress…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Shervin Halat , Mohammad Rahmati , Ehsan Nazerfard