中文
相关论文

相关论文: Measuring Self-Supervised Representation Quality f…

200 篇论文

Self-supervised learning (SSL) algorithms have emerged as powerful tools that can leverage large quantities of unlabeled audio data to pre-train robust representations that support strong performance on diverse downstream tasks. Up to now…

音频与语音处理 · 电气工程与系统科学 2025-02-05 Mattson Ogg

Semi-supervised learning (SSL) has been a powerful strategy to incorporate few labels in learning better representations. In this paper, we focus on a practical scenario that one aims to apply SSL when unlabeled data may contain…

计算机视觉与模式识别 · 计算机科学 2022-08-22 Jongjin Park , Sukmin Yun , Jongheon Jeong , Jinwoo Shin

Self-supervised learning (SSL) approaches have brought tremendous success across many tasks and domains. It has been argued that these successes can be attributed to a link between SSL and identifiable representation learning: Temporal…

机器学习 · 统计学 2025-06-03 Rodrigo González Laiz , Tobias Schmidt , Steffen Schneider

In this work, we examine the robustness of state-of-the-art semi-supervised learning (SSL) algorithms when applied to morphological classification in modern radio astronomy. We test whether SSL can achieve performance comparable to the…

星系天体物理 · 物理学 2022-02-02 Inigo V. Slijepcevic , Anna M. M. Scaife

Image-based cell profiling aims to create informative representations of cell images. This technique is critical in drug discovery and has greatly advanced with recent improvements in computer vision. Inspired by recent developments in…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Siran Dai , Qianqian Xu , Peisong Wen , Yang Liu , Qingming Huang

With the progress of sensor technology in wearables, the collection and analysis of PPG signals are gaining more interest. Using Machine Learning, the cardiac rhythm corresponding to PPG signals can be used to predict different tasks such…

信号处理 · 电气工程与系统科学 2022-12-20 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax

While contrastive approaches of self-supervised learning (SSL) learn representations by minimizing the distance between two augmented views of the same data point (positive pairs) and maximizing views from different data points (negative…

机器学习 · 计算机科学 2021-10-11 Yuandong Tian , Xinlei Chen , Surya Ganguli

Semi-supervised learning (SSL) aims to train a machine learning model using both labelled and unlabelled data. While the unlabelled data have been used in various ways to improve the prediction accuracy, the reason why unlabelled data could…

机器学习 · 统计学 2025-10-28 Archer Moore , Heejung Shim , Jingge Zhu , Mingming Gong

Despite impressive empirical advances of SSL in solving various tasks, the problem of understanding and characterizing SSL representations learned from input data remains relatively under-explored. We provide a comparative analysis of how…

计算机视觉与模式识别 · 计算机科学 2023-06-05 Xavier F. Cadet , Ranya Aloufi , Alain Miranville , Sara Ahmadi-Abhari , Hamed Haddadi

Is self-supervised deep learning (DL) for medical image analysis already a serious alternative to the de facto standard of end-to-end trained supervised DL? We tackle this question for medical image classification, with a particular focus…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Maximilian Nielsen , Laura Wenderoth , Thilo Sentker , René Werner

In Self-Supervised Learning (SSL), various pretext tasks are designed for learning feature representations through contrastive loss. However, previous studies have shown that this loss is less tolerant to semantically similar samples due to…

音频与语音处理 · 电气工程与系统科学 2023-03-07 Shanshan Wang , Soumya Tripathy , Annamaria Mesaros

Self-supervised learning (SSL) is an effective method for exploiting unlabelled data to learn a high-level embedding space that can be used for various downstream tasks. However, existing methods to monitor the quality of the encoder --…

机器学习 · 计算机科学 2024-09-11 Isaac Xu , Scott Lowe , Thomas Trappenberg

With the development of deep learning, supervised learning methods perform well in remote sensing images (RSIs) scene classification. However, supervised learning requires a huge number of annotated data for training. When labeled samples…

计算机视觉与模式识别 · 计算机科学 2020-10-05 Chao Tao , Ji Qi , Weipeng Lu , Hao Wang , Haifeng Li

Contrastive learning (CL) approaches have gained great recognition as a very successful subset of self-supervised learning (SSL) methods. SSL enables learning from unlabeled data, a crucial step in the advancement of deep learning,…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Mohamed Hassan , Mohammad Wasil , Sebastian Houben

As advanced image manipulation techniques emerge, detecting the manipulation becomes increasingly important. Despite the success of recent learning-based approaches for image manipulation detection, they typically require expensive…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Yuanhao Zhai , Tianyu Luan , David Doermann , Junsong Yuan

Self-Supervised Learning (SSL) frameworks became the standard for learning robust class representations by benefiting from large unlabeled datasets. For Speaker Verification (SV), most SSL systems rely on contrastive-based loss functions.…

音频与语音处理 · 电气工程与系统科学 2025-06-25 Theo Lepage , Reda Dehak

State-of-the-art semi-supervised learning (SSL) approaches rely on highly confident predictions to serve as pseudo-labels that guide the training on unlabeled samples. An inherent drawback of this strategy stems from the quality of the…

机器学习 · 计算机科学 2024-03-26 Shambhavi Mishra , Balamurali Murugesan , Ismail Ben Ayed , Marco Pedersoli , Jose Dolz

Semi-supervised learning (SSL) can improve model performance by leveraging unlabeled images, which can be collected from public image sources with low costs. In recent years, synthetic images have become increasingly common in public image…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Zerun Wang , Jiafeng Mao , Liuyu Xiang , Toshihiko Yamasaki

Self-supervised learning (SSL) has emerged as a powerful paradigm for Chest X-ray (CXR) analysis under limited annotations. Yet, existing SSL strategies remain suboptimal for medical imaging. Masked image modeling allocates substantial…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Wangyu Feng , Shawn Young , Lijian Xu

Recently, self-supervised learning methods like MoCo, SimCLR, BYOL and SwAV have reduced the gap with supervised methods. These results have been achieved in a control environment, that is the highly curated ImageNet dataset. However, the…