English
Related papers

Related papers: Contrastive learning-based pretraining improves re…

200 papers

State-of-the-art pre-trained image models predominantly adopt a two-stage approach: initial unsupervised pre-training on large-scale datasets followed by task-specific fine-tuning using Cross-Entropy loss~(CE). However, it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Zijun Long , George Killick , Lipeng Zhuang , Gerardo Aragon-Camarasa , Zaiqiao Meng , Richard Mccreadie

Medical image classification is one of the most important tasks for computer-aided diagnosis. Deep learning models, particularly convolutional neural networks, have been successfully used for disease classification from medical images,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Md. Atik Ahamed , Jin Chen , Abdullah-Al-Zubaer Imran

Deep learning has potential to automate screening, monitoring and grading of disease in medical images. Pretraining with contrastive learning enables models to extract robust and generalisable features from natural image datasets,…

Predicting whether a treatment leads to meaningful improvement is a central challenge in personalized medicine, particularly when disease progression manifests as subtle visual changes over time. While data-driven deep learning (DL) offers…

Image and Video Processing · Electrical Eng. & Systems 2025-11-21 Jana Armouti , Nikhil Madaan , Rohan Panda , Tom Fox , Laura Hutchins , Amita Krishnan , Ricardo Rodriguez , Bennett DeBoisblanc , Deva Ramanan , John Galeotti , Gautam Gare

Cases of diabetes and related diabetic retinopathy (DR) have been increasing at an alarming rate in modern times. Early detection of DR is an important problem since it may cause permanent blindness in the late stages. In the last two…

Image and Video Processing · Electrical Eng. & Systems 2021-05-31 Burcu Oltu , Büşra Kübra Karaca , Hamit Erdem , Atilla Özgür

Convolutional neural networks (CNNs) are extensively beneficial for medical image processing. Medical images are plentiful, but there is a lack of annotated data. Transfer learning is used to solve the problem of lack of labeled data and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Sajjad Abbasi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi , Shahram Shirani

We propose a framework using contrastive learning as a pre-training task to perform image classification in the presence of noisy labels. Recent strategies such as pseudo-labeling, sample selection with Gaussian Mixture models, weighted…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Madalina Ciortan , Romain Dupuis , Thomas Peel

Diabetic retinopathy (DR) screening is instrumental in preventing blindness, but faces a scaling challenge as the number of diabetic patients rises. Risk stratification for the development of DR may help optimize screening intervals to…

The self-supervised ultrasound (US) video model pretraining can use a small amount of labeled data to achieve one of the most promising results on US diagnosis. However, it does not take full advantage of multi-level knowledge for learning…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Chunhui Zhang , Yixiong Chen , Li Liu , Qiong Liu , Xi Zhou

Deep learning based medical imaging classification models usually suffer from the domain shift problem, where the classification performance drops when training data and real-world data differ in imaging equipment manufacturer, image…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Wenshuo Zhou , Dalu Yang , Binghong Wu , Yehui Yang , Junde Wu , Xiaorong Wang , Lei Wang , Haifeng Huang , Yanwu Xu

Diabetic Retinopathy (DR) stands as the leading cause of blindness globally, particularly affecting individuals between the ages of 20 and 70. This paper presents a Computer-Aided Diagnosis (CAD) system designed for the automatic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-31 Inas Al-Kamachy , Reza Hassanpour , Roya Choupani

Diabetic retinopathy (DR) is one of the leading causes of blindness in the working-age population of developed countries, caused by a side effect of diabetes that reduces the blood supply to the retina. Deep neural networks have been widely…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Jose Miguel Arrieta Ramos , Oscar Perdómo , Fabio A. González

Diabetic Retinopathy (DR) is a serious and common complication of diabetes, caused by prolonged high blood sugar levels that damage the small retinal blood vessels. If left untreated, DR can progress to retinal vein occlusion and stimulate…

Image and Video Processing · Electrical Eng. & Systems 2025-04-07 Mohammad Reza Yousefi , Ali Bakrani , Amin Dehghani

This paper presents a novel positive and negative set selection strategy for contrastive learning of medical images based on labels that can be extracted from clinical data. In the medical field, there exists a variety of labels for data…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Kiran Kokilepersaud , Stephanie Trejo Corona , Mohit Prabhushankar , Ghassan AlRegib , Charles Wykoff

Diabetic Retinopathy DR is a severe complication of diabetes. Damaged or abnormal blood vessels can cause loss of vision. The need for massive screening of a large population of diabetic patients has generated an interest in a…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Ameya Uppina , S Navaneetha Krishnan , Talluri Krishna Sai Teja , Nikhil N Iyer , Joe Dhanith P R

A key requirement for the success of supervised deep learning is a large labeled dataset - a condition that is difficult to meet in medical image analysis. Self-supervised learning (SSL) can help in this regard by providing a strategy to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

Few-shot learning is an established topic in natural images for years, but few work is attended to histology images, which is of high clinical value since well-labeled datasets and rare abnormal samples are expensive to collect. Here, we…

Image and Video Processing · Electrical Eng. & Systems 2022-02-21 Jiawei Yang , Hanbo Chen , Jiangpeng Yan , Xiaoyu Chen , Jianhua Yao

The prevalence of diabetic retinopathy (DR) has reached 34.6% worldwide and is a major cause of blindness among middle-aged diabetic patients. Regular DR screening using fundus photography helps detect its complications and prevent its…

Image and Video Processing · Electrical Eng. & Systems 2022-11-09 Fahman Saeed , Muhammad Hussain , Hatim A Aboalsamh , Fadwa Al Adel , Adi Mohammed Al Owaifeer

Despite its success in self-supervised learning, contrastive learning is less studied in the supervised setting. In this work, we first use a set of pilot experiments to show that in the supervised setting, the cross-entropy loss objective…

Computation and Language · Computer Science 2026-02-13 Liz Li , Wei Zhu

Unsupervised domain adaptation (UDA) aims to transfer knowledge learned from a labeled source domain to an unlabeled target domain. Contrastive learning (CL) in the context of UDA can help to better separate classes in feature space.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Mingxuan Gu , Sulaiman Vesal , Mareike Thies , Zhaoya Pan , Fabian Wagner , Mirabela Rusu , Andreas Maier , Ronak Kosti