English
Related papers

Related papers: Self-Supervised Pre-Training with Contrastive and …

200 papers

A key challenge in training neural networks for a given medical imaging task is often the difficulty of obtaining a sufficient number of manually labeled examples. In contrast, textual imaging reports, which are often readily available in…

Machine Learning · Computer Science 2022-01-31 Gongbo Liang , Connor Greenwell , Yu Zhang , Xiaoqin Wang , Ramakanth Kavuluru , Nathan Jacobs

Self-supervised learning has emerged as a powerful approach for leveraging large-scale unlabeled data to improve model performance in various domains. In this paper, we explore masked self-supervised pre-training for text recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Martin Kišš , Michal Hradiš

There is an increasing number of medical use-cases where classification algorithms based on deep neural networks reach performance levels that are competitive with human medical experts. To alleviate the challenges of small dataset sizes,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Vignesh Srinivasan , Nils Strodthoff , Jackie Ma , Alexander Binder , Klaus-Robert Müller , Wojciech Samek

Deep learning has transformed computer vision but relies heavily on large labeled datasets and computational resources. Transfer learning, particularly fine-tuning pretrained models, offers a practical alternative; however, models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Iván Matas , Carmen Serrano , Miguel Nogales , David Moreno , Lara Ferrándiz , Teresa Ojeda , Begoña Acha

Accurate and robust medical image classification is paramount for early disease diagnosis and treatment planning. However, challenges such as limited annotated data, high intra-class variability, and subtle inter-class differences often…

Image and Video Processing · Electrical Eng. & Systems 2026-05-22 Joao Florindo , Viviane Moura

Medical image interpretation using deep learning has shown promise but often requires extensive expert-annotated datasets. To reduce this annotation burden, we develop an Image-Graph Contrastive Learning framework that pairs chest X-rays…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 Sameer Khanna , Daniel Michael , Marinka Zitnik , Pranav Rajpurkar

In the recent years, convolutional neural networks have transformed the field of medical image analysis due to their capacity to learn discriminative image features for a variety of classification and regression tasks. However, successfully…

Computer Vision and Pattern Recognition · Computer Science 2019-07-08 Wenjia Bai , Chen Chen , Giacomo Tarroni , Jinming Duan , Florian Guitton , Steffen E. Petersen , Yike Guo , Paul M. Matthews , Daniel Rueckert

The accuracy and robustness of image classification with supervised deep learning are dependent on the availability of large-scale, annotated training data. However, there is a paucity of annotated data available due to the complexity of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Euijoon Ahn , Ashnil Kumar , Dagan Feng , Michael Fulham , Jinman Kim

Large-scale volumetric medical images with annotation are rare, costly, and time prohibitive to acquire. Self-supervised learning (SSL) offers a promising pre-training and feature extraction solution for many downstream tasks, as it only…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Ke Yu , Li Sun , Junxiang Chen , Max Reynolds , Tigmanshu Chaudhary , Kayhan Batmanghelich

Reducing the quantity of annotations required for supervised training is vital when labels are scarce and costly. This reduction is particularly important for semantic segmentation tasks involving 3D datasets, which are often significantly…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Andrej Janda , Brandon Wagstaff , Edwin G. Ng , Jonathan Kelly

In this paper, we propose a new progressive pre-training method for image understanding tasks which leverages RGB-D datasets. The method utilizes Multi-Modal Contrastive Masked Autoencoder and Denoising techniques. Our proposed approach…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Muhammad Abdullah Jamal , Omid Mohareri

To realize the full potential of deep learning for medical imaging, large annotated datasets are required for training. Such datasets are difficult to acquire because labeled medical images are not usually available due to privacy issues,…

Computer Vision and Pattern Recognition · Computer Science 2018-06-29 Faisal Mahmood , Richard Chen , Nicholas J. Durr

There are not many large medical image datasets available. For these datasets, too small deep learning models can't learn useful features, so they don't work well due to underfitting, and too big models tend to overfit the limited data. As…

Image and Video Processing · Electrical Eng. & Systems 2023-11-02 Pervaiz Iqbal Khan , Andreas Dengel , Sheraz Ahmed

We investigate the effectiveness of a simple solution to the common problem of deep learning in medical image analysis with limited quantities of labeled training data. The underlying idea is to assign artificial labels to abundantly…

Computer Vision and Pattern Recognition · Computer Science 2019-01-28 Nima Tajbakhsh , Yufei Hu , Junli Cao , Xingjian Yan , Yi Xiao , Yong Lu , Jianming Liang , Demetri Terzopoulos , Xiaowei Ding

The coronavirus pandemic has been going on since the year 2019, and the trend is still not abating. Therefore, it is particularly important to classify medical CT scans to assist in medical diagnosis. At present, Supervised Deep Learning…

Image and Video Processing · Electrical Eng. & Systems 2022-10-12 Jiashu Xu , Sergii Stirenko

Deep neural network models can learn clinically relevant features from millions of histopathology images. However generating high-quality annotations to train such models for each hospital, each cancer type, and each diagnostic task is…

Recent breakthroughs in self-supervised learning have enabled the use of large unlabeled datasets to train visual foundation models that can generalize to a variety of downstream tasks. While this training paradigm is well suited for the…

Unsupervised learning has been a long-standing goal of machine learning and is especially important for medical image analysis, where the learning can compensate for the scarcity of labeled datasets. A promising subclass of unsupervised…

Image and Video Processing · Electrical Eng. & Systems 2021-09-09 Ozan Ciga , Tony Xu , Anne L. Martel

Unsupervised pre-training was a critical technique for training deep neural networks years ago. With sufficient labeled data and modern training techniques, it is possible to train very deep neural networks from scratch in a purely…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Jianfeng Dong , Xiao-Jiao Mao , Chunhua Shen , Yu-Bin Yang

Supervised fine-tuning methods (SFT) perform great efficiency on artificial intelligence interpretation in SAR images, leveraging the powerful representation knowledge from pre-training models. Due to the lack of domain-specific pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Xinyang Pu , Feng Xu