English
Related papers

Related papers: Trip-ROMA: Self-Supervised Learning with Triplets …

200 papers

Semi-supervised learning (SSL) can reduce the need for large labelled datasets by incorporating unlabelled data into the training. This is particularly interesting for semantic segmentation, where labelling data is very costly and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Sebastian Scherer , Robin Schön , Rainer Lienhart

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-05-28 Jiaxing Wang , Yin Zheng , Xiaoshuang Chen , Junzhou Huang , Jian Cheng

Self-supervised learning (SSL) is one strategy for addressing the paucity of labelled data in medical imaging by learning representations from unlabelled images. Contrastive and non-contrastive SSL methods produce learned representations…

Image and Video Processing · Electrical Eng. & Systems 2024-03-13 Blake VanBerlo , Alexander Wong , Jesse Hoey , Robert Arntfield

Network intrusion detection remains a critical challenge in cybersecurity. While supervised machine learning models achieve state-of-the-art performance, their reliance on large labelled datasets makes them impractical for many real-world…

Machine Learning · Computer Science 2025-09-09 Jack Wilkie , Hanan Hindy , Christos Tachtatzis , Robert Atkinson

Self-supervised learning (SSL) has emerged as a powerful technique for learning rich representations from unlabeled data. The data representations are able to capture many underlying attributes of data, and be useful in downstream…

Machine Learning · Computer Science 2023-12-01 Weicheng Zhu , Sheng Liu , Carlos Fernandez-Granda , Narges Razavian

Semi-supervised learning (SSL) has shown its effectiveness in learning effective 3D representation from a small amount of labelled data while utilizing large unlabelled data. Traditional semi-supervised approaches rely on the fundamental…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Sneha Paul , Zachary Patterson , Nizar Bouguila

Contrastive learning has emerged as a powerful method in deep learning, excelling at learning effective representations through contrasting samples from different distributions. However, dimensional collapse, where embeddings converge into…

Machine Learning · Computer Science 2025-12-10 Huanran Li , Manh Nguyen , Daniel Pimentel-Alarcón

Sign language recognition (SLR) is a machine learning task aiming to identify signs in videos. Due to the scarcity of annotated data, unsupervised methods like contrastive learning have become promising in this field. They learn meaningful…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ariel Basso Madjoukeng , Jérôme Fink , Pierre Poitier , Edith Belise Kenmogne , Benoit Frenay

In the literature, most existing graph-based semi-supervised learning (SSL) methods only use the label information of observed samples in the label propagation stage, while ignoring such valuable information when learning the graph. In this…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Liansheng Zhuang , Zihan Zhou , Jingwen Yin , Shenghua Gao , Zhouchen Lin , Yi Ma , Nenghai Yu

Accurate and stable feature matching is critical for computer vision tasks, particularly in applications such as Simultaneous Localization and Mapping (SLAM). While recent learning-based feature matching methods have demonstrated promising…

Robotics · Computer Science 2025-04-08 Yuqing Wang , Yan Wang , Hailiang Tang , Xiaoji Niu

Self-supervised learning (SSL) has shown impressive results in downstream classification tasks. However, there is limited work in understanding their failure modes and interpreting their learned representations. In this paper, we study the…

Machine Learning · Computer Science 2023-12-14 Neha Kalibhat , Kanika Narang , Hamed Firooz , Maziar Sanjabi , Soheil Feizi

Semi-supervised learning (SSL) leverages limited labeled and abundant unlabeled data but often faces challenges with data imbalance, especially in 3D contexts. This study investigates class-level confidence as an indicator of learning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Zhimin Chen , Bing Li

Self-Supervised Learning (SSL) frameworks became the standard for learning robust class representations by benefiting from large unlabeled datasets. For Speaker Verification (SV), most SSL systems rely on contrastive-based loss functions.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Theo Lepage , Reda Dehak

Contrastive learning with the nearest neighbor has proved to be one of the most efficient self-supervised learning (SSL) techniques by utilizing the similarity of multiple instances within the same class. However, its efficacy is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Dewen Zeng , Yawen Wu , Xinrong Hu , Xiaowei Xu , Yiyu Shi

Supervised contrastive learning (SupCL) has emerged as a prominent approach in representation learning, leveraging both supervised and self-supervised losses. However, achieving an optimal balance between these losses is challenging;…

Machine Learning · Computer Science 2025-03-12 Chungpa Lee , Jeongheon Oh , Kibok Lee , Jy-yong Sohn

Self-supervised learning (SSL), which can automatically generate ground-truth samples from raw data, holds vast potential to improve recommender systems. Most existing SSL-based methods perturb the raw data graph with uniform node/edge…

Information Retrieval · Computer Science 2021-08-27 Junliang Yu , Hongzhi Yin , Min Gao , Xin Xia , Xiangliang Zhang , Nguyen Quoc Viet Hung

While semi-supervised learning (SSL) has received tremendous attentions in many machine learning tasks due to its successful use of unlabeled data, existing SSL algorithms use either all unlabeled examples or the unlabeled examples with a…

Machine Learning · Computer Science 2021-09-03 Yi Xu , Lei Shang , Jinxing Ye , Qi Qian , Yu-Feng Li , Baigui Sun , Hao Li , Rong Jin

The maximum entropy encoding framework provides a unified perspective for many non-contrastive learning methods like SimSiam, Barlow Twins, and MEC. Inspired by this framework, we introduce Matrix-SSL, a novel approach that leverages matrix…

Machine Learning · Computer Science 2024-09-17 Yifan Zhang , Zhiquan Tan , Jingqin Yang , Weiran Huang , Yang Yuan

Self-supervised learning (SSL) methods via joint embedding architectures have proven remarkably effective at capturing semantically rich representations with strong clustering properties, magically in the absence of label supervision.…

Machine Learning · Computer Science 2025-05-13 Xi Weng , Jianing An , Xudong Ma , Binhang Qi , Jie Luo , Xi Yang , Jin Song Dong , Lei Huang

Semi-supervised learning (SSL) algorithms have had great success in recent years in limited labeled data regimes. However, the current state-of-the-art SSL algorithms are computationally expensive and entail significant compute time and…

Machine Learning · Computer Science 2021-10-29 Krishnateja Killamsetty , Xujiang Zhao , Feng Chen , Rishabh Iyer