中文
相关论文

相关论文: Evaluating Self-Supervised Learning via Risk Decom…

200 篇论文

Self-supervised learning (SSL) has developed rapidly in recent years. However, most of the mainstream methods are computationally expensive and rely on two (or more) augmentations for each image to construct positive pairs. Moreover, they…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Yun-Hao Cao , Jianxin Wu

The current literature on self-supervised learning (SSL) focuses on developing learning objectives to train neural networks more effectively on unlabeled data. The typical development process involves taking well-established architectures,…

计算机视觉与模式识别 · 计算机科学 2022-03-16 Sharath Girish , Debadeepta Dey , Neel Joshi , Vibhav Vineet , Shital Shah , Caio Cesar Teodoro Mendes , Abhinav Shrivastava , Yale Song

Self-Supervised Learning (SSL) has emerged as a promising approach in computer vision, enabling networks to learn meaningful representations from large unlabeled datasets. SSL methods fall into two main categories: instance discrimination…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Alina Ciocarlan , Sidonie Lefebvre , Sylvie Le Hégarat-Mascle , Arnaud Woiselle

This paper investigates the impact of sampling and pretraining using datasets with different image characteristics on the performance of self-supervised learning (SSL) models for object classification. To do this, we sample two apartment…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Raynor Kirkson E. Chavez , Kyle Gabriel M. Reynoso

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

机器学习 · 计算机科学 2019-06-18 Avital Oliver , Augustus Odena , Colin Raffel , Ekin D. Cubuk , Ian J. Goodfellow

Unsupervised learning has recently significantly gained in popularity, especially with deep learning-based approaches. Despite numerous successes and approaching supervised-level performance on a variety of academic benchmarks, it is still…

机器学习 · 计算机科学 2023-07-19 Anton Tsitsulin , Marina Munkhoeva , Bryan Perozzi

Consensus amongst researchers and industry points to a lack of large, representative annotated datasets as the biggest obstacle to progress in the field of surgical data science. Advances in Self-Supervised Learning (SSL) represent a…

计算机视觉与模式识别 · 计算机科学 2025-07-17 Deepak Alapatt , Aditya Murali , Vinkle Srivastav , Pietro Mascagni , AI4SafeChole Consortium , Nicolas Padoy

Accurate anomaly detection is critical in vision-based infrastructure inspection, where it helps prevent costly failures and enhances safety. Self-Supervised Learning (SSL) offers a promising approach by learning robust representations from…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Daniel Otero , Rafael Mateus , Randall Balestriero

Self-supervised learning (SSL) is an emerging paradigm that exploits supervisory signals generated from the data itself, and many recent studies have leveraged SSL to conduct graph anomaly detection. However, we empirically found that three…

机器学习 · 计算机科学 2025-07-01 Zhong Li , Yuhang Wang , Matthijs van Leeuwen

We introduce S$^2$VS, a video similarity learning approach with self-supervision. Self-Supervised Learning (SSL) is typically used to train deep models on a proxy task so as to have strong transferability on target tasks after fine-tuning.…

计算机视觉与模式识别 · 计算机科学 2023-06-19 Giorgos Kordopatis-Zilos , Giorgos Tolias , Christos Tzelepis , Ioannis Kompatsiaris , Ioannis Patras , Symeon Papadopoulos

Prevention of complete and dimensional collapse of representations has recently become a design principle for self-supervised learning (SSL). However, questions remain in our theoretical understanding: When do those collapses occur? What…

机器学习 · 计算机科学 2023-03-14 Liu Ziyin , Ekdeep Singh Lubana , Masahito Ueda , Hidenori Tanaka

With the progress of sensor technology in wearables, the collection and analysis of PPG signals are gaining more interest. Using Machine Learning, the cardiac rhythm corresponding to PPG signals can be used to predict different tasks such…

信号处理 · 电气工程与系统科学 2022-12-20 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax

We investigate the role of self-supervised learning (SSL) in the context of few-shot learning. Although recent research has shown the benefits of SSL on large unlabeled datasets, its utility on small datasets is relatively unexplored. We…

计算机视觉与模式识别 · 计算机科学 2020-07-31 Jong-Chyi Su , Subhransu Maji , Bharath Hariharan

We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding image locations of…

计算机视觉与模式识别 · 计算机科学 2022-12-09 Ashraful Islam , Ben Lundell , Harpreet Sawhney , Sudipta Sinha , Peter Morales , Richard J. Radke

Self-supervised learning (SSL) is a growing torrent that has recently transformed machine learning and its many real world applications, by learning on massive amounts of unlabeled data via self-generated supervisory signals. Unsupervised…

机器学习 · 计算机科学 2023-08-29 Leman Akoglu , Jaemin Yoo

Prior works on self-supervised pre-training focus on the joint training scenario, where massive unlabeled data are assumed to be given as input all at once, and only then is a learner trained. Unfortunately, such a problem setting is often…

机器学习 · 计算机科学 2022-07-22 Dapeng Hu , Shipeng Yan , Qizhengqiu Lu , Lanqing Hong , Hailin Hu , Yifan Zhang , Zhenguo Li , Xinchao Wang , Jiashi Feng

Semi-supervised learning (SSL) has witnessed remarkable progress, resulting in the emergence of numerous method variations. However, practitioners often encounter challenges when attempting to deploy these methods due to their subpar…

机器学习 · 计算机科学 2024-05-21 Kai Gan , Tong Wei

Semi-supervised learning (SSL) commonly exhibits confirmation bias, where models disproportionately favor certain classes, leading to errors in predicted pseudo labels that accumulate under a self-training paradigm. Unlike supervised…

机器学习 · 计算机科学 2024-09-30 Yu Wang , Yuxuan Yin , Peng Li

It is well known that the success of deep neural networks is greatly attributed to large-scale labeled datasets. However, it can be extremely time-consuming and laborious to collect sufficient high-quality labeled data in most practical…

计算机视觉与模式识别 · 计算机科学 2022-02-18 Yao Yao , Junyi Shen , Jin Xu , Bin Zhong , Li Xiao

Self-supervised learning has gained significant attention in contemporary applications, particularly due to the scarcity of labeled data. While existing SSL methodologies primarily address feature variance and linear correlations, they…

机器学习 · 计算机科学 2025-11-18 M. Hadi Sepanj , Benyamin Ghojogh , Paul Fieguth