中文
相关论文

相关论文: Rethinking Self-Supervised Learning Within the Fra…

200 篇论文

This paper introduces a novel approach to improving the training stability of self-supervised learning (SSL) methods by leveraging a non-parametric memory of seen concepts. The proposed method involves augmenting a neural network with a…

计算机视觉与模式识别 · 计算机科学 2024-07-26 Thalles Silva , Helio Pedrini , Adín Ramírez Rivera

Self-supervised learning (SSL) is capable of learning remarkable representations from centrally available data. Recent works further implement federated learning with SSL to learn from rapidly growing decentralized unlabeled images (e.g.,…

机器学习 · 计算机科学 2022-04-12 Weiming Zhuang , Yonggang Wen , Shuai Zhang

Self-supervised learning (SSL) has produced a diverse landscape of vision transformers (ViTs) whose pretrained representations support a wide range of downstream tasks. Towards a better understanding of these models, a body of work has…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Xiaoyan Yu , Lisa Mais , Jannik Franzen , Peter Hirsch , Nick Lechtenbörger , Andreas Mardt , Dagmar Kainmüller

This work addresses the task of self-supervised learning (SSL) on a long-tailed dataset that aims to learn balanced and well-separated representations for downstream tasks such as image classification. This task is crucial because the real…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Cuong Manh Hoang , Yeejin Lee , Byeongkeun Kang

Self-supervised learning (SSL) is a technique for learning useful representations from unlabeled data. It has been applied effectively to domain adaptation (DA) on images and videos. It is still unknown if and how it can be leveraged for…

计算机视觉与模式识别 · 计算机科学 2022-05-16 Idan Achituve , Haggai Maron , Gal Chechik

Joint Embedding Self-Supervised Learning (JE-SSL) has seen rapid developments in recent years, due to its promise to effectively leverage large unlabeled data. The development of JE-SSL methods was driven primarily by the search for ever…

机器学习 · 计算机科学 2023-03-06 Florian Bordes , Randall Balestriero , Pascal Vincent

Semi-supervised learning (SSL) has witnessed remarkable progress, resulting in the emergence of numerous method variations. However, practitioners often encounter challenges when attempting to deploy these methods due to their subpar…

机器学习 · 计算机科学 2024-05-21 Kai Gan , Tong Wei

While self-supervised learning has been shown to benefit a number of vision tasks, existing techniques mainly focus on image-level manipulation, which may not generalize well to downstream tasks at patch or pixel levels. Moreover, existing…

计算机视觉与模式识别 · 计算机科学 2022-08-31 Cheng-Yen Hsieh , Chih-Jung Chang , Fu-En Yang , Yu-Chiang Frank Wang

Self-supervised learning (SSL) has the potential to benefit many applications, particularly those where manually annotating data is cumbersome. One such situation is the semantic segmentation of point clouds. In this context, existing…

计算机视觉与模式识别 · 计算机科学 2023-03-30 Yanhao Wu , Tong Zhang , Wei Ke , Sabine Süsstrunk , Mathieu Salzmann

Large scale recommender models find most relevant items from huge catalogs, and they play a critical role in modern search and recommendation systems. To model the input space with large-vocab categorical features, a typical recommender…

Self-supervised learning (SSL) has emerged as a promising paradigm in medical imaging, addressing the chronic challenge of limited labeled data in healthcare settings. While SSL has shown impressive results, existing studies in the medical…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Valay Bundele , Karahan Sarıtaş , Bora Kargi , Oğuz Ata Çal , Kıvanç Tezören , Zohreh Ghaderi , Hendrik Lensch

Recent advances in whole-slide image (WSI) scanners and computational capabilities have significantly propelled the application of artificial intelligence in histopathology slide analysis. While these strides are promising, current…

计算机视觉与模式识别 · 计算机科学 2023-11-15 Weiyi Wu , Chongyang Gao , Joseph DiPalma , Soroush Vosoughi , Saeed Hassanpour

Densely annotating LiDAR point clouds is costly, which restrains the scalability of fully-supervised learning methods. In this work, we study the underexplored semi-supervised learning (SSL) in LiDAR segmentation. Our core idea is to…

计算机视觉与模式识别 · 计算机科学 2023-09-04 Lingdong Kong , Jiawei Ren , Liang Pan , Ziwei Liu

Self-Supervised Learning (SSL) powers many current AI systems. As research interest and investment grow, the SSL design space continues to expand. The Platonic view of SSL, following the Platonic Representation Hypothesis (PRH), suggests…

机器学习 · 计算机科学 2025-07-25 Patrik Reizinger , Randall Balestriero , David Klindt , Wieland Brendel

State-of-the-art semi-supervised learning (SSL) approaches rely on highly confident predictions to serve as pseudo-labels that guide the training on unlabeled samples. An inherent drawback of this strategy stems from the quality of the…

机器学习 · 计算机科学 2024-03-26 Shambhavi Mishra , Balamurali Murugesan , Ismail Ben Ayed , Marco Pedersoli , Jose Dolz

We approach self-supervised learning of image representations from a statistical dependence perspective, proposing Self-Supervised Learning with the Hilbert-Schmidt Independence Criterion (SSL-HSIC). SSL-HSIC maximizes dependence between…

机器学习 · 统计学 2021-12-06 Yazhe Li , Roman Pogodin , Danica J. Sutherland , Arthur Gretton

We approach the challenge of addressing semi-supervised domain generalization (SSDG). Specifically, our aim is to obtain a model that learns domain-generalizable features by leveraging a limited subset of labelled data alongside a…

计算机视觉与模式识别 · 计算机科学 2024-05-08 Chamuditha Jayanga Galappaththige , Sanoojan Baliah , Malitha Gunawardhana , Muhammad Haris Khan

Semi-Supervised Learning (SSL) is implemented when algorithms are trained on both labeled and unlabeled data. This is a very common application of ML as it is unrealistic to obtain a fully labeled dataset. Researchers have tackled three…

机器学习 · 计算机科学 2023-08-16 Jason Lu , Michael Ma , Huaze Xu , Zixi Xu

The current success of deep neural networks (DNNs) in an increasingly broad range of tasks involving artificial intelligence strongly depends on the quality and quantity of labeled training data. In general, the scarcity of labeled data,…

计算与语言 · 计算机科学 2018-11-21 Shun Kiyono , Jun Suzuki , Kentaro Inui

Writer independent offline signature verification is one of the most challenging tasks in pattern recognition as there is often a scarcity of training data. To handle such data scarcity problem, in this paper, we propose a novel…

计算机视觉与模式识别 · 计算机科学 2022-07-13 Siladittya Manna , Soumitri Chattopadhyay , Saumik Bhattacharya , Umapada Pal