中文
相关论文

相关论文: Evaluating The Robustness of Self-Supervised Repre…

200 篇论文

Ice-containing clouds strongly impact climate, but they are hard to model due to ice crystal habit (i.e., shape) diversity. We use self-supervised learning (SSL) to learn latent representations of crystals from ice crystal imagery. By…

Recent progress in self-supervised (SSL) visual representation learning has led to the development of several different proposed frameworks that rely on augmentations of images but use different loss functions. However, there are few…

机器学习 · 计算机科学 2025-01-20 Kumar Krishna Agrawal , Arna Ghosh , Shagun Sodhani , Adam Oberman , Blake Richards

Recent progress in contrastive learning has revolutionized unsupervised representation learning. Concretely, multiple views (augmentations) from the same image are encouraged to map to the similar embeddings, while views from different…

计算机视觉与模式识别 · 计算机科学 2021-01-20 Nanxuan Zhao , Zhirong Wu , Rynson W. H. Lau , Stephen Lin

The proliferation of various data sources in urban and territorial environments has significantly facilitated the development of geospatial artificial intelligence (GeoAI) across a wide range of geospatial applications. However, geospatial…

人工智能 · 计算机科学 2025-04-28 Yile Chen , Weiming Huang , Kaiqi Zhao , Yue Jiang , Gao Cong

Semi-supervised learning (SSL) can improve model performance by leveraging unlabeled images, which can be collected from public image sources with low costs. In recent years, synthetic images have become increasingly common in public image…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Zerun Wang , Jiafeng Mao , Liuyu Xiang , Toshihiko Yamasaki

Deep Learning is often depicted as a trio of data-architecture-loss. Yet, recent Self Supervised Learning (SSL) solutions have introduced numerous additional design choices, e.g., a projector network, positive views, or teacher-student…

机器学习 · 计算机科学 2024-06-18 Mark Ibrahim , David Klindt , Randall Balestriero

Computational pathology can lead to saving human lives, but models are annotation hungry and pathology images are notoriously expensive to annotate. Self-supervised learning has shown to be an effective method for utilizing unlabeled data,…

计算机视觉与模式识别 · 计算机科学 2023-04-19 Mingu Kang , Heon Song , Seonwook Park , Donggeun Yoo , Sérgio Pereira

Self-supervised learning (SSL) has great potential for molecular representation learning given the complexity of molecular graphs, the large amounts of unlabelled data available, the considerable cost of obtaining labels experimentally, and…

机器学习 · 计算机科学 2023-11-30 Yuankai Luo , Lei Shi , Veronika Thost

Self-Supervised Learning (SSL) presents an exciting opportunity to unlock the potential of vast, untapped clinical datasets, for various downstream applications that suffer from the scarcity of labeled data. While SSL has revolutionized…

Recent Self-Supervised Learning (SSL) methods are able to learn feature representations that are invariant to different data augmentations, which can then be transferred to downstream tasks of interest. However, different downstream tasks…

机器学习 · 计算机科学 2023-03-08 Chen Huang , Hanlin Goh , Jiatao Gu , Josh Susskind

Self-Supervised Learning (SSL) has emerged as a promising approach in computer vision, enabling networks to learn meaningful representations from large unlabeled datasets. SSL methods fall into two main categories: instance discrimination…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Alina Ciocarlan , Sidonie Lefebvre , Sylvie Le Hégarat-Mascle , Arnaud Woiselle

Self-supervised learning (SSL) has emerged as a promising paradigm for addressing the annotation bottleneck in medical imaging by learning representations from unlabeled data. However, its effectiveness depends heavily on the design of the…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Chathura Wimalasiri

Self-supervised learning (SSL) pipelines differ in many design choices such as the architecture, augmentations, or pretraining data. Yet SSL is typically evaluated using a single metric: linear probing on ImageNet. This does not provide…

机器学习 · 计算机科学 2024-01-09 Yann Dubois , Tatsunori Hashimoto , Percy Liang

Automated medical diagnosis through image-based neural networks has increased in popularity and matured over years. Nevertheless, it is confined by the scarcity of medical images and the expensive labor annotation costs. Self-Supervised…

计算机视觉与模式识别 · 计算机科学 2024-04-17 Luffina C. Huang , Darren J. Chiu , Manish Mehta

Self-supervised learning (SSL) techniques have been widely used to learn compact and informative representations from high-dimensional complex data. In many computer vision tasks, such as image classification, such methods achieve…

计算机视觉与模式识别 · 计算机科学 2022-06-15 Chintan Trivedi , Konstantinos Makantasis , Antonios Liapis , Georgios N. Yannakakis

Self-supervised learning (SSL) aims to learn intrinsic features without labels. Despite the diverse architectures of SSL methods, the projection head always plays an important role in improving the performance of the downstream task. In…

机器学习 · 计算机科学 2023-01-31 Jiajun Ma , Tianyang Hu , Wenjia Wang

Though self-supervised learning (SSL) has demonstrated incredible ability to learn robust representations from unlabeled data, the choice of optimal SSL strategy can lead to vastly different performance outcomes in specialized domains.…

Self supervised learning (SSL) is a machine learning paradigm where models learn to understand the underlying structure of data without explicit supervision from labeled samples. The acquired representations from SSL have demonstrated…

机器学习 · 计算机科学 2025-12-11 Yunshan Duan , Sinead Williamson

Self-Supervised Learning (SSL) has been shown to learn useful and information-preserving representations. Neural Networks (NNs) are widely applied, yet their weight space is still not fully understood. Therefore, we propose to use SSL to…

机器学习 · 计算机科学 2022-12-15 Konstantin Schürholt , Dimche Kostadinov , Damian Borth

Despite the rapid progress in self-supervised learning (SSL), end-to-end fine-tuning still remains the dominant fine-tuning strategy for medical imaging analysis. However, it remains unclear whether this approach is truly optimal for…

计算机视觉与模式识别 · 计算机科学 2023-11-17 Muhammad Osama Khan , Yi Fang