English
Related papers

Related papers: Enhancing zero-shot learning in medical imaging: i…

200 papers

Deep neural networks are increasingly used in medical imaging for tasks such as pathological classification, but they face challenges due to the scarcity of high-quality, expert-labeled training data. Recent efforts have utilized…

Machine Learning · Computer Science 2024-10-14 Jongseong Jang , Daeun Kyung , Seung Hwan Kim , Honglak Lee , Kyunghoon Bae , Edward Choi

Medical image classification plays a crucial role in clinical decision-making, yet most models are constrained to a fixed set of predefined classes, limiting their adaptability to new conditions. Contrastive Language-Image Pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Stefan Denner , Markus Bujotzek , Dimitrios Bounias , David Zimmerer , Raphael Stock , Klaus Maier-Hein

Chest radiography (CXR) plays a crucial role in the diagnosis of various diseases. However, the inherent class imbalance in the distribution of clinical findings presents a significant challenge for current self-supervised deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Rajesh Madhipati , Sheethal Bhat , Lukas Buess , Andreas Maier

Zero-shot vision-language models (VLMs) have shown promise for chest radiograph classification, but their performance is often limited by confounding label co-occurrence, long-tail class imbalance, and transfer instability under domain…

Machine Learning · Computer Science 2026-04-21 Florian Kittler , Sheethal Bhat , Andreas Maier

Existing vision-text contrastive learning like CLIP aims to match the paired image and caption embeddings while pushing others apart, which improves representation transferability and supports zero-shot prediction. However, medical…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Zifeng Wang , Zhenbang Wu , Dinesh Agarwal , Jimeng Sun

A large-scale image-text pair dataset has greatly contributed to the development of vision-language pre-training (VLP) models, which enable zero-shot or few-shot classification without costly annotation. However, in the medical domain, the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Kihyun You , Jawook Gu , Jiyeon Ham , Beomhee Park , Jiho Kim , Eun Kyoung Hong , Woonhyunk Baek , Byungseok Roh

Modern deep learning implementations for medical imaging usually rely on large labeled datasets. These datasets are often difficult to obtain due to privacy concerns, high costs, and even scarcity of cases. In this paper, a label-efficient…

Image and Video Processing · Electrical Eng. & Systems 2025-07-11 Heet Nitinkumar Dalsania

Contrastive Language-Image Pre-training (CLIP) has demonstrated outstanding performance in global image understanding and zero-shot transfer through large-scale text-image alignment. However, the core of medical image analysis often lies in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jiahui Peng , He Yao , Jingwen Li , Yanzhou Su , Sibo Ju , Yujie Lu , Jin Ye , Hongchun Lu , Xue Li , Lincheng Jiang , Min Zhu , Junlong Cheng

Within the domain of medical analysis, extensive research has explored the potential of mutual learning between Masked Autoencoders(MAEs) and multimodal data. However, the impact of MAEs on intermodality remains a key challenge. We…

Image and Video Processing · Electrical Eng. & Systems 2024-06-03 Lei Li , Tianfang Zhang , Xinglin Zhang , Jiaqi Liu , Bingqi Ma , Yan Luo , Tao Chen

We introduce eCLIP, an enhanced version of the CLIP model that integrates expert annotations in the form of radiologist eye-gaze heatmaps. It tackles key challenges in contrastive multi-modal medical imaging analysis, notably data scarcity…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yogesh Kumar , Pekka Marttinen

Interstitial lung diseases (ILD) present diagnostic challenges due to their varied manifestations and overlapping imaging features. To address this, we propose a machine learning approach that utilizes CLIP, a multimodal (image and text)…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Cara Van Uden , Christian Bluethgen , Maayane Attias , Malgorzata Polacin , Haiwei Henry Guo , Neha Simha , Rishi Raj , Curtis Langlotz

Contrastive learning is a form of self-supervision that can leverage unlabeled data to produce pretrained models. While contrastive learning has demonstrated promising results on natural image classification tasks, its application to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Hari Sowrirajan , Jingbo Yang , Andrew Y. Ng , Pranav Rajpurkar

Contrastive Language-Image Pre-training (CLIP) has made a remarkable breakthrough in open-vocabulary zero-shot image recognition. Many recent studies leverage the pre-trained CLIP models for image-level classification and manipulation. In…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Chong Zhou , Chen Change Loy , Bo Dai

Although fusion of information from multiple views of mammograms plays an important role to increase accuracy of breast cancer detection, developing multi-view mammograms-based computer-aided diagnosis (CAD) schemes still faces challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Xuxin Chen , Yuheng Li , Mingzhe Hu , Ella Salari , Xiaoqian Chen , Richard L. J. Qiu , Bin Zheng , Xiaofeng Yang

Recent advances in zero-shot learning have enabled the use of paired image-text data to replace structured labels, replacing the need for expert annotated datasets. Models such as CLIP-based CheXzero utilize these advancements in the domain…

Medical Physics · Physics 2023-06-16 Aakash Mishra , Rajat Mittal , Christy Jestin , Kostas Tingos , Pranav Rajpurkar

Zero-shot medical image classification is a critical process in real-world scenarios where we have limited access to all possible diseases or large-scale annotated data. It involves computing similarity scores between a query medical image…

Image and Video Processing · Electrical Eng. & Systems 2023-07-06 Jiaxiang Liu , Tianxiang Hu , Yan Zhang , Xiaotang Gai , Yang Feng , Zuozhu Liu

The integration of artificial intelligence in medical imaging has shown tremendous potential, yet the relationship between pre-trained knowledge and performance in cross-modality learning remains unclear. This study investigates how…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Yang Yan , Bingqing Yue , Qiaxuan Li , Man Huang , Jingyu Chen , Zhenzhong Lan

In the field of medical decision-making, precise anomaly detection in medical imaging plays a pivotal role in aiding clinicians. However, previous work is reliant on large-scale datasets for training anomaly detection models, which…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Ximiao Zhang , Min Xu , Dehui Qiu , Ruixin Yan , Ning Lang , Xiuzhuang Zhou

Contrastive Language-Image Pre-training (CLIP) models have demonstrated superior performance across various visual tasks including medical image classification. However, fairness concerns, including demographic biases, have received limited…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Chenlang Yi , Zizhan Xiong , Qi Qi , Xiyuan Wei , Girish Bathla , Ching-Long Lin , Bobak Jack Mortazavi , Tianbao Yang

CLIP has achieved impressive zero-shot performance after pre-training on a large-scale dataset consisting of paired image-text data. Previous works have utilized CLIP by incorporating manually designed visual prompts like colored circles…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Jiedong Zhuang , Jiaqi Hu , Lianrui Mu , Rui Hu , Xiaoyu Liang , Jiangnan Ye , Haoji Hu
‹ Prev 1 2 3 10 Next ›