English
Related papers

Related papers: Generalization of Self-Supervised Vision Transform…

200 papers

Self-supervised learning (SSL) has emerged as a key technique for training networks that can generalize well to diverse tasks without task-specific supervision. This property makes SSL desirable for computational pathology, the study of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Eric Zimmermann , Neil Tenenholtz , James Hall , George Shaikovski , Michal Zelechowski , Adam Casson , Fausto Milletari , Julian Viret , Eugene Vorontsov , Siqi Liu , Kristen Severson

Pathology foundation models learn morphological representations through self-supervised pretraining on large-scale whole-slide images, yet they do not explicitly capture the underlying molecular state of the tissue. Spatial transcriptomics…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Minsoo Lee , Jonghyun Kim , Juseung Yun , Sunwoo Yu , Jongseong Jang

The growing demand for accurate and equitable AI models in digital dermatology faces a significant challenge: the lack of diverse, high-quality labeled data. In this work, we investigate the potential of domain-specific foundation models…

Consensus amongst researchers and industry points to a lack of large, representative annotated datasets as the biggest obstacle to progress in the field of surgical data science. Advances in Self-Supervised Learning (SSL) represent a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Deepak Alapatt , Aditya Murali , Vinkle Srivastav , Pietro Mascagni , AI4SafeChole Consortium , Nicolas Padoy

This study explores the application of self-supervised learning (SSL) for improved target recognition in synthetic aperture sonar (SAS) imagery. The unique challenges of underwater environments make traditional computer vision techniques,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 BW Sheffield

A major limitation in applying deep learning to artificial intelligence (AI) systems is the scarcity of high-quality curated datasets. We investigate strong augmentation based self-supervised learning (SSL) techniques to address this…

Image and Video Processing · Electrical Eng. & Systems 2022-03-18 John D. Miller , Vignesh A. Arasu , Albert X. Pu , Laurie R. Margolies , Weiva Sieh , Li Shen

Although supervised learning has enabled high performance for image segmentation, it requires a large amount of labeled training data, which can be difficult to obtain in the medical imaging field. Self-supervised learning (SSL) methods…

Breast cancer is one of the leading causes of female mortality in the world. This can be reduced when diagnoses are performed at the early stages of progression. Further, the efficiency of the process can be significantly improved with…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Aravind Ravi

Self-supervised learning (SSL) plays a central role in molecular representation learning. Yet, many recent innovations in masking-based pretraining are introduced as heuristics and lack principled evaluation, obscuring which design choices…

Machine Learning · Computer Science 2025-12-09 Jiannan Yang , Veronika Thost , Tengfei Ma

This work presents a novel domain adaption paradigm for studying contrastive self-supervised representation learning and knowledge transfer using remote sensing satellite data. Major state-of-the-art remote sensing visual domain efforts…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Muskaan Chopra , Prakash Chandra Chhipa , Gopal Mengi , Varun Gupta , Marcus Liwicki

Deep learning has raised hopes and expectations as a general solution for many applications; indeed it has proven effective, but it also showed a strong dependence on large quantities of data. Luckily, it has been shown that, even when data…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Fabio Maria Carlucci

Semi-supervised learning (SSL) uses unlabeled data during training to learn better models. Previous studies on SSL for medical image segmentation focused mostly on improving model generalization to unseen data. In some applications,…

Advances in deep learning are re-defining how visual data is processed and understand by the machines. Vision Transformers (ViTs) have recently demonstrated prominent performance in computer vision related tasks. However, their performance…

Self-Supervised Learning (SSL) models rely on a pretext task to learn representations. Because this pretext task differs from the downstream tasks used to evaluate the performance of these models, there is an inherent misalignment or…

Machine Learning · Computer Science 2023-04-12 Florian Bordes , Samuel Lavoie , Randall Balestriero , Nicolas Ballas , Pascal Vincent

The collection and curation of large-scale medical datasets from multiple institutions is essential for training accurate deep learning models, but privacy concerns often hinder data sharing. Federated learning (FL) is a promising solution…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Rui Yan , Liangqiong Qu , Qingyue Wei , Shih-Cheng Huang , Liyue Shen , Daniel Rubin , Lei Xing , Yuyin Zhou

Annotating medical imaging datasets is costly, so fine-tuning (or transfer learning) is the most effective method for digital pathology vision applications such as disease classification and semantic segmentation. However, due to texture…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Tushar Kataria , Beatrice Knudsen , Shireen Elhabian

Self-supervised learning (SSL) has transformed vision encoder training in general domains but remains underutilized in medical imaging due to limited data and domain specific biases. We present MammoDINO, a novel SSL framework for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Sicheng Zhou , Lei Wu , Cao Xiao , Parminder Bhatia , Taha Kass-Hout

In defense-related remote sensing applications, such as vehicle detection on satellite imagery, supervised learning requires a huge number of labeled examples to reach operational performances. Such data are challenging to obtain as it…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Jules BOURCIER , Thomas Floquet , Gohar Dashyan , Tugdual Ceillier , Karteek Alahari , Jocelyn Chanussot

Automated medical diagnosis through image-based neural networks has increased in popularity and matured over years. Nevertheless, it is confined by the scarcity of medical images and the expensive labor annotation costs. Self-Supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Luffina C. Huang , Darren J. Chiu , Manish Mehta

Weakly-supervised learning under image-level labels supervision has been widely applied to semantic segmentation of medical lesions regions. However, 1) most existing models rely on effective constraints to explore the internal…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Jiahua Dong , Yang Cong , Gan Sun , Dongdong Hou