中文
相关论文

相关论文: Measuring Self-Supervised Representation Quality f…

200 篇论文

Self-Supervised Learning (SSL) is a paradigm that leverages unlabeled data for model training. Empirical studies show that SSL can achieve promising performance in distribution shift scenarios, where the downstream and training…

机器学习 · 计算机科学 2023-12-13 Xuyang Zhao , Tianqi Du , Yisen Wang , Jun Yao , Weiran Huang

Self-supervised learning (SSL) has advanced significantly in visual representation learning, yet comprehensive evaluations of its adversarial robustness remain limited. In this study, we evaluate the adversarial robustness of seven…

计算机视觉与模式识别 · 计算机科学 2025-09-25 Ömer Veysel Çağatan , Ömer Faruk Tal , M. Emre Gürsoy

Published research highlights the presence of demographic bias in automated facial attribute classification. The proposed bias mitigation techniques are mostly based on supervised learning, which requires a large amount of labeled training…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Sreeraj Ramachandran , Ajita Rattani

In this work, we observe a counterintuitive phenomenon in self-supervised learning (SSL): longer training may impair the performance of dense prediction tasks (e.g., semantic segmentation). We refer to this phenomenon as Self-supervised…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Siran Dai , Qianqian Xu , Peisong Wen , Yang Liu , Qingming Huang

This study explores the application of self-supervised learning (SSL) for improved target recognition in synthetic aperture sonar (SAS) imagery. The unique challenges of underwater environments make traditional computer vision techniques,…

计算机视觉与模式识别 · 计算机科学 2023-07-31 BW Sheffield

Linear probing (LP) (and $k$-NN) on the upstream dataset with labels (e.g., ImageNet) and transfer learning (TL) to various downstream datasets are commonly employed to evaluate the quality of visual representations learned via…

计算机视觉与模式识别 · 计算机科学 2023-04-10 Jae-Hun Lee , Doyoung Yoon , ByeongMoon Ji , Kyungyul Kim , Sangheum Hwang

Although supervised learning has been highly successful in improving the state-of-the-art in the domain of image-based computer vision in the past, the margin of improvement has diminished significantly in recent years, indicating that a…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Utku Ozbulak , Hyun Jung Lee , Beril Boga , Esla Timothy Anzaku , Homin Park , Arnout Van Messem , Wesley De Neve , Joris Vankerschaver

Deep learning has proven to be a very effective approach for Hyperspectral Image (HSI) classification. However, deep neural networks require large annotated datasets to generalize well. This limits the applicability of deep learning for HSI…

计算机视觉与模式识别 · 计算机科学 2022-06-27 Nassim Ait Ali Braham , Lichao Mou , Jocelyn Chanussot , Julien Mairal , Xiao Xiang Zhu

Self-supervised learning has been widely used to obtain transferrable representations from unlabeled images. Especially, recent contrastive learning methods have shown impressive performances on downstream image classification tasks. While…

计算机视觉与模式识别 · 计算机科学 2021-04-29 Byungseok Roh , Wuhyun Shin , Ildoo Kim , Sungwoong Kim

Self-supervised learning (SSL) has recently shown remarkable results in closing the gap between supervised and unsupervised learning. The idea is to learn robust features that are invariant to distortions of the input data. Despite its…

声音 · 计算机科学 2023-03-08 Bac Nguyen , Stefan Uhlich , Fabien Cardinaux

We address the problem of evaluating the quality of self-supervised learning (SSL) models without access to supervised labels, while being agnostic to the architecture, learning algorithm or data manipulation used during training. We argue…

机器学习 · 计算机科学 2023-11-16 Yuchen Lu , Zhen Liu , Aristide Baratin , Romain Laroche , Aaron Courville , Alessandro Sordoni

Self-supervised learning (SSL) based models have been shown to generate powerful representations that can be used to improve the performance of downstream speech tasks. Several state-of-the-art SSL models are available, and each of these…

计算与语言 · 计算机科学 2023-02-21 A Arunkumar , Vrunda N Sukhadia , S. Umesh

Deep Learning is often depicted as a trio of data-architecture-loss. Yet, recent Self Supervised Learning (SSL) solutions have introduced numerous additional design choices, e.g., a projector network, positive views, or teacher-student…

机器学习 · 计算机科学 2024-06-18 Mark Ibrahim , David Klindt , Randall Balestriero

State-of-the-art frameworks in self-supervised learning have recently shown that fully utilizing transformer-based models can lead to performance boost compared to conventional CNN models. Striving to maximize the mutual information of two…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Jiho Jang , Seonhoon Kim , Kiyoon Yoo , Chaerin Kong , Jangho Kim , Nojun Kwak

Self-Supervised learning (SSL) has become the new state-of-art in several domain classification and segmentation tasks. Of these, one popular category in SSL is distillation networks such as BYOL. This work proposes RSDnet, which applies…

计算机视觉与模式识别 · 计算机科学 2022-09-09 Pallavi Jain , Bianca Schoen-Phelan , Robert Ross

Self-supervised learning (SSL) has emerged as a powerful strategy for representation learning under limited annotation regimes, yet its effectiveness remains highly sensitive to many factors, especially the nature of the target task. In…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Jorge Quesada , Ghassan AlRegib

Recent advances in self-supervised learning (SSL) using large models to learn visual representations from natural images are rapidly closing the gap between the results produced by fully supervised learning and those produced by SSL on…

计算机视觉与模式识别 · 计算机科学 2022-11-03 Weiyao Wang , Byung-Hak Kim , Varun Ganapathi

Designing learning-based no-reference (NR) video quality assessment (VQA) algorithms for camera-captured videos is cumbersome due to the requirement of a large number of human annotations of quality. In this work, we propose a…

图像与视频处理 · 电气工程与系统科学 2022-12-01 Shankhanil Mitra , Saiyam Jogani , Rajiv Soundararajan

Recent research in self-supervised learning (SSL) has shown its capability in learning useful semantic representations from images for classification tasks. Through our work, we study the usefulness of SSL for Fine-Grained Visual…

计算机视觉与模式识别 · 计算机科学 2021-05-20 Muhammad Maaz , Hanoona Abdul Rasheed , Dhanalaxmi Gaddam

Fine-grained image classification involves identifying different subcategories of a class which possess very subtle discriminatory features. Fine-grained datasets usually provide bounding box annotations along with class labels to aid the…

计算机视觉与模式识别 · 计算机科学 2021-07-30 Farha Al Breiki , Muhammad Ridzuan , Rushali Grandhe