English
Related papers

Related papers: Contrastive learning-based pretraining improves re…

200 papers

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

There is an increasing number of medical use-cases where classification algorithms based on deep neural networks reach performance levels that are competitive with human medical experts. To alleviate the challenges of small dataset sizes,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Vignesh Srinivasan , Nils Strodthoff , Jackie Ma , Alexander Binder , Klaus-Robert Müller , Wojciech Samek

Manually annotating medical images is extremely expensive, especially for large-scale datasets. Self-supervised contrastive learning has been explored to learn feature representations from unlabeled images. However, unlike natural images,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Yijin Huang , Li Lin , Pujin Cheng , Junyan Lyu , Xiaoying Tang

This work presents a novel label-efficient selfsupervised representation learning-based approach for classifying diabetic retinopathy (DR) images in cross-domain settings. Most of the existing DR image classification methods are based on…

Image and Video Processing · Electrical Eng. & Systems 2023-04-25 Ekta Gupta , Varun Gupta , Muskaan Chopra , Prakash Chandra Chhipa , Marcus Liwicki

With the prevalence of Diabetes, the Diabetes Mellitus Retinopathy (DR) is becoming a major health problem across the world. The long-term medical complications arising due to DR have a significant impact on the patient as well as the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Shreyas Rajesh Labhsetwar , Raj Sunil Salvi , Piyush Arvind Kolte , Veerasai Subramaniam venkatesh , Alistair Michael Baretto

Much effort is being made by the researchers in order to detect and diagnose diabetic retinopathy (DR) accurately automatically. The disease is very dangerous as it can cause blindness suddenly if it is not continuously screened. Therefore,…

Image and Video Processing · Electrical Eng. & Systems 2020-12-24 Eman AbdelMaksoud , Sherif Barakat , Mohammed Elmogy

Fundus photography is the primary method for retinal imaging and essential for diabetic retinopathy prevention. Automated segmentation of fundus photographs would improve the quality, capacity, and cost-effectiveness of eye care screening…

Image and Video Processing · Electrical Eng. & Systems 2021-08-29 Jan Kukačka , Anja Zenz , Marcel Kollovieh , Dominik Jüstel , Vasilis Ntziachristos

Longitudinal imaging is able to capture both static anatomical structures and dynamic changes in disease progression towards earlier and better patient-specific pathology management. However, conventional approaches for detecting diabetic…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Rachid Zeghlache , Pierre-Henri Conze , Mostafa El Habib Daho , Ramin Tadayoni , Pascal Massin , Béatrice Cochener , Gwenolé Quellec , Mathieu Lamard

Deep learning models have been deployed in an increasing number of edge and mobile devices to provide healthcare. These models rely on training with a tremendous amount of labeled data to achieve high accuracy. However, for medical…

Machine Learning · Computer Science 2022-02-16 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yi Sheng , Lei Yang , Alaina J. James , Yiyu Shi , Jingtong Hu

The emergence of Large Language Models (LLMs) presents unprecedented opportunities to revolutionize medical contrastive vision-language pre-training. In this paper, we show how LLMs can facilitate large-scale supervised pre-training,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Yingtai Li , Haoran Lai , Xiaoqian Zhou , Shuai Ming , Wenxin Ma , Wei Wei , Shaohua Kevin Zhou

Most deep neural networks (DNNs) based ultrasound (US) medical image analysis models use pretrained backbones (e.g., ImageNet) for better model generalization. However, the domain gap between natural and medical images causes an inevitable…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yixiong Chen , Chunhui Zhang , Li Liu , Cheng Feng , Changfeng Dong , Yongfang Luo , Xiang Wan

Purpose: To test the feasibility of using deep learning for optical coherence tomography angiography (OCTA) detection of diabetic retinopathy (DR). Methods: A deep learning convolutional neural network (CNN) architecture VGG16 was employed…

Quantitative Methods · Quantitative Biology 2021-12-16 David Le , Minhaj Alam , Cham Yao , Jennifer I. Lim , R. V. P. Chan , Devrim Toslak , Xincheng Yao

We explore the value of weak labels in learning transferable representations for medical images. Compared to hand-labeled datasets, weak or inexact labels can be acquired in large quantities at significantly lower cost and can provide…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Boon Peng Yap , Beng Koon Ng

Self-supervised Contrastive Learning (CL) has been recently shown to be very effective in preventing deep networks from overfitting noisy labels. Despite its empirical success, the theoretical understanding of the effect of contrastive…

Machine Learning · Computer Science 2022-07-06 Yihao Xue , Kyle Whitecross , Baharan Mirzasoleiman

Most Neural Networks (NNs) for classification are trained using Cross-Entropy as a loss function. This approach requires the model to have an explicit classification layer. However, there exist alternative approaches, such as Contrastive…

Machine Learning · Computer Science 2026-04-27 Leonardo Arrighi , Julia Eva Belloni , Aurélie Gallet , Ivan Gentile , Matteo Lippi , Marco Zullich

Analysis of cardiac ultrasound images is commonly performed in routine clinical practice for quantification of cardiac function. Its increasing automation frequently employs deep learning networks that are trained to predict disease or…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Agisilaos Chartsias , Shan Gao , Angela Mumith , Jorge Oliveira , Kanwal Bhatia , Bernhard Kainz , Arian Beqiri

Collecting labeled data for the task of semantic segmentation is expensive and time-consuming, as it requires dense pixel-level annotations. While recent Convolutional Neural Network (CNN) based semantic segmentation approaches have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Xiangyun Zhao , Raviteja Vemulapalli , Philip Mansfield , Boqing Gong , Bradley Green , Lior Shapira , Ying Wu

Deep learning is currently the state-of-the-art for automated detection of referable diabetic retinopathy (DR) from color fundus photographs (CFP). While the general interest is put on improving results through methodological innovations,…

Image and Video Processing · Electrical Eng. & Systems 2022-10-10 Tomás Castilla , Marcela S. Martínez , Mercedes Leguía , Ignacio Larrabide , José Ignacio Orlando

This paper is concerned with contrastive learning (CL) for low-level image restoration and enhancement tasks. We propose a new label-efficient learning paradigm based on residuals, residual contrastive learning (RCL), and derive an…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Nanqing Dong , Matteo Maggioni , Yongxin Yang , Eduardo Pérez-Pellitero , Ales Leonardis , Steven McDonagh

Recent work has shown that, when integrated with adversarial training, self-supervised pre-training can lead to state-of-the-art robustness In this work, we improve robustness-aware self-supervised pre-training by learning representations…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Ziyu Jiang , Tianlong Chen , Ting Chen , Zhangyang Wang
‹ Prev 1 2 3 10 Next ›