English
Related papers

Related papers: MultiSiam: Self-supervised Multi-instance Siamese …

200 papers

Self-Supervised Learning (SSL) has become a very active area of Deep Learning research where it is heavily used as a pre-training method for classification and other tasks. However, the rapid pace of advancements in this area comes at a…

Machine Learning · Computer Science 2022-07-19 Diane Wagner , Fabio Ferreira , Danny Stoll , Robin Tibor Schirrmeister , Samuel Müller , Frank Hutter

Self-supervised learning (SSL) techniques have recently produced outstanding results in learning visual representations from unlabeled videos. Despite the importance of motion in supervised learning techniques for action recognition, SSL…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Mona Ahmadian , Frank Guerin , Andrew Gilbert

Recently, significant advancements in artificial intelligence have been attributed to the integration of self-supervised learning (SSL) scheme. While SSL has shown impressive achievements in natural language processing (NLP), its progress…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Shervin Halat , Mohammad Rahmati , Ehsan Nazerfard

Writer independent offline signature verification is one of the most challenging tasks in pattern recognition as there is often a scarcity of training data. To handle such data scarcity problem, in this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Siladittya Manna , Soumitri Chattopadhyay , Saumik Bhattacharya , Umapada Pal

Semi-Supervised Learning (SSL) has become a preferred paradigm in many deep learning tasks, which reduces the need for human labor. Previous studies primarily focus on effectively utilising the labelled and unlabeled data to improve…

Machine Learning · Computer Science 2024-10-29 Qian Shao , Jiangrui Kang , Qiyuan Chen , Zepeng Li , Hongxia Xu , Yiwen Cao , Jiajuan Liang , Jian Wu

Self-supervised pre-trained audio networks have seen widespread adoption in real-world systems, particularly in multi-modal large language models. These networks are often employed in a frozen state, under the assumption that the SSL…

Sound · Computer Science 2025-06-17 Tony Alex , Sara Ahmed , Armin Mustafa , Muhammad Awais , Philip JB Jackson

This paper investigates the impact of sampling and pretraining using datasets with different image characteristics on the performance of self-supervised learning (SSL) models for object classification. To do this, we sample two apartment…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Raynor Kirkson E. Chavez , Kyle Gabriel M. Reynoso

Unsupervised learning has been popular in various computer vision tasks, including visual object tracking. However, prior unsupervised tracking approaches rely heavily on spatial supervision from template-search pairs and are still unable…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Qiuhong Shen , Lei Qiao , Jinyang Guo , Peixia Li , Xin Li , Bo Li , Weitao Feng , Weihao Gan , Wei Wu , Wanli Ouyang

Robust prediction of citywide traffic flows at different time periods plays a crucial role in intelligent transportation systems. While previous work has made great efforts to model spatio-temporal correlations, existing methods still…

Machine Learning · Computer Science 2024-03-07 Jiahao Ji , Jingyuan Wang , Chao Huang , Junjie Wu , Boren Xu , Zhenhe Wu , Junbo Zhang , Yu Zheng

Traditional semi-supervised learning (SSL) assumes that the feature distributions of labeled and unlabeled data are consistent which rarely holds in realistic scenarios. In this paper, we propose a novel SSL setting, where unlabeled samples…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Jiachen Liang , Ruibing Hou , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

Semi-supervised learning (SSL) commonly exhibits confirmation bias, where models disproportionately favor certain classes, leading to errors in predicted pseudo labels that accumulate under a self-training paradigm. Unlike supervised…

Machine Learning · Computer Science 2024-09-30 Yu Wang , Yuxuan Yin , Peng Li

Deep neural networks are efficient at learning the data distribution if it is sufficiently sampled. However, they can be strongly biased by non-relevant factors implicitly incorporated in the training data. These include operational biases,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Kirill Sirotkin , Pablo Carballeira , Marcos Escudero-Viñolo

We consider the problem of semi-supervised 3D action recognition which has been rarely explored before. Its major challenge lies in how to effectively learn motion representations from unlabeled data. Self-supervised learning (SSL) has been…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Chenyang Si , Xuecheng Nie , Wei Wang , Liang Wang , Tieniu Tan , Jiashi Feng

As perception models continue to develop, the need for large-scale datasets increases. However, data annotation remains far too expensive to effectively scale and meet the demand. Synthetic datasets provide a solution to boost model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Arpit Jadon , Haoran Wang , Phillip Thomas , Michael Stanley , S. Nathaniel Cibik , Rachel Laurat , Omar Maher , Lukas Hoyer , Ozan Unal , Dengxin Dai

Self-Supervised Learning (SSL) has emerged as a powerful paradigm to mitigate the reliance on large, annotated datasets, a common bottleneck in medical image analysis. However, standard SSL methods, which rely on simple geometric and color…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Joao Batista Florindo

Pseudo-labeling is a key component in semi-supervised learning (SSL). It relies on iteratively using the model to generate artificial labels for the unlabeled data to train against. A common property among its various methods is that they…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Islam Nassar , Samitha Herath , Ehsan Abbasnejad , Wray Buntine , Gholamreza Haffari

Semi-supervised learning (SSL) has made significant strides in the field of remote sensing. Finding a large number of labeled datasets for SSL methods is uncommon, and manually labeling datasets is expensive and time-consuming. Furthermore,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Fahmida Tasnim Lisa , Md. Zarif Hossain , Sharmin Naj Mou , Shahriar Ivan , Md. Hasanul Kabir

Self-Supervised Learning (SSL) is a new paradigm for learning discriminative representations without labelled data and has reached comparable or even state-of-the-art results in comparison to supervised counterparts. Contrastive Learning…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Shohreh Deldari , Hao Xue , Aaqib Saeed , Daniel V. Smith , Flora D. Salim

To avoid collapse in self-supervised learning (SSL), a contrastive loss is widely used but often requires a large number of negative samples. Without negative samples yet achieving competitive performance, a recent work has attracted…

Machine Learning · Computer Science 2022-03-31 Chaoning Zhang , Kang Zhang , Chenshuang Zhang , Trung X. Pham , Chang D. Yoo , In So Kweon

Semi-Supervised Learning (SSL) has been proved to be an effective way to leverage both labeled and unlabeled data at the same time. Recent semi-supervised approaches focus on deep neural networks and have achieved promising results on…

Computer Vision and Pattern Recognition · Computer Science 2018-12-14 Hong-Yu Zhou , Avital Oliver , Jianxin Wu , Yefeng Zheng