English
Related papers

Related papers: A Backbone Benchmarking Study on Self-supervised L…

200 papers

Long-tailed semi-supervised learning (LTSSL) presents a formidable challenge where models must overcome the scarcity of tail samples while mitigating the noise from unreliable pseudo-labels. Most prior LTSSL methods are designed to train…

Machine Learning · Computer Science 2026-04-09 Zhiyuan Huang , Jiahao Chen , Bing Su

It is commonly recognized that color variations caused by differences in stains is a critical issue for histopathology image analysis. Existing methods adopt color matching, stain separation, stain transfer or the combination of them to…

Image and Video Processing · Electrical Eng. & Systems 2022-08-09 Hai-Li Ye , Da-Han Wang

Recent research in self-supervised learning (SSL) has shown its capability in learning useful semantic representations from images for classification tasks. Through our work, we study the usefulness of SSL for Fine-Grained Visual…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Muhammad Maaz , Hanoona Abdul Rasheed , Dhanalaxmi Gaddam

Self-Supervised Learning (SSL) models rely on a pretext task to learn representations. Because this pretext task differs from the downstream tasks used to evaluate the performance of these models, there is an inherent misalignment or…

Machine Learning · Computer Science 2023-04-12 Florian Bordes , Samuel Lavoie , Randall Balestriero , Nicolas Ballas , Pascal Vincent

Automatic facial action unit (AU) recognition is a challenging task due to the scarcity of manual annotations. To alleviate this problem, a large amount of efforts has been dedicated to exploiting various weakly supervised methods which…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Jingwei Yan , Jingjing Wang , Qiang Li , Chunmao Wang , Shiliang Pu

The success of self-supervised learning (SSL) has mostly been attributed to the availability of unlabeled yet large-scale datasets. However, in a specialized domain such as medical imaging which is a lot different from natural images, the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Soumitri Chattopadhyay , Soham Ganguly , Sreejit Chaudhury , Sayan Nag , Samiran Chattopadhyay

In self-supervised learning, a model is trained to solve a pretext task, using a data set whose annotations are created by a machine. The objective is to transfer the trained weights to perform a downstream task in the target domain. We…

Machine Learning · Computer Science 2021-10-22 Prathamesh Sonawane , Sparsh Drolia , Saqib Shamsi , Bhargav Jain

Panoramic X-ray is a simple and effective tool for diagnosing dental diseases in clinical practice. When deep learning models are developed to assist dentist in interpreting panoramic X-rays, most of their performance suffers from the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Zijian Cai , Xinquan Yang , Xuguang Li , Xiaoling Luo , Xuechen Li , Linlin Shen , He Meng , Yongqiang Deng

Recently, a few self-supervised representation learning (SSL) methods have outperformed the ImageNet classification pre-training for vision tasks such as object detection. However, its effects on 3D human body pose and shape estimation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Hongsuk Choi , Hyeongjin Nam , Taeryung Lee , Gyeongsik Moon , Kyoung Mu Lee

We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding image locations of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Ashraful Islam , Ben Lundell , Harpreet Sawhney , Sudipta Sinha , Peter Morales , Richard J. Radke

Self-supervised learning (SSL) learns high-quality representations from large pools of unlabeled training data. As datasets grow larger, it becomes crucial to identify the examples that contribute the most to learning such representations.…

Machine Learning · Computer Science 2024-03-14 Siddharth Joshi , Baharan Mirzasoleiman

Masked autoencoders are scalable vision learners, as the title of MAE \cite{he2022masked}, which suggests that self-supervised learning (SSL) in vision might undertake a similar trajectory as in NLP. Specifically, generative pretext tasks…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Chaoning Zhang , Chenshuang Zhang , Junha Song , John Seon Keun Yi , Kang Zhang , In So Kweon

Automatic singing voice understanding tasks, such as singer identification, singing voice transcription, and singing technique classification, benefit from data-driven approaches that utilize deep learning techniques. These approaches work…

Sound · Computer Science 2023-09-06 Yuya Yamamoto

Painting classification plays a vital role in organizing, finding, and suggesting artwork for digital and classic art galleries. Existing methods struggle with adapting knowledge from the real world to artistic images during training,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Mridula Vijendran , Frederick W. B. Li , Jingjing Deng , Hubert P. H. Shum

Self-supervised learning (SSL) methods such as masked language modeling have shown massive performance gains by pretraining transformer models for a variety of natural language processing tasks. The follow-up research adapted similar…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Gokul Karthik Kumar , Sahal Shaji Mullappilly , Abhishek Singh Gehlot

Self-supervised learning (SSL) based models have been shown to generate powerful representations that can be used to improve the performance of downstream speech tasks. Several state-of-the-art SSL models are available, and each of these…

Computation and Language · Computer Science 2023-02-21 A Arunkumar , Vrunda N Sukhadia , S. Umesh

Self-supervised learning (SSL) has become a popular method for generating invariant representations without the need for human annotations. Nonetheless, the desired invariant representation is achieved by utilising prior online…

Machine Learning · Computer Science 2024-09-30 Foivos Ntelemis , Yaochu Jin , Spencer A. Thomas

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

The self-supervised pretraining paradigm has achieved great success in learning 3D action representations for skeleton-based action recognition using contrastive learning. However, learning effective representations for skeleton-based…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Qiushuo Cheng , Jingjing Liu , Catherine Morgan , Alan Whone , Majid Mirmehdi

At present, deep neural network methods have played a dominant role in face alignment field. However, they generally use predefined network structures to predict landmarks, which tends to learn general features and leads to mediocre…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Jun Wan , He Liu , Yujia Wu , Zhihui Lai , Wenwen Min , Jun Liu