English
Related papers

Related papers: Context-Aware Vision Language Foundation Models fo…

200 papers

Using deep learning models pre-trained on Imagenet is the traditional solution for medical image classification to deal with data scarcity. Nevertheless, relevant literature supports that this strategy may offer limited gains due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Julio Silva-Rodriguez , Jihed Chelbi , Waziha Kabir , Hadi Chakor , Jose Dolz , Ismail Ben Ayed , Riadh Kobbi

The integration of artificial intelligence in healthcare has opened new horizons for improving medical diagnostics and patient care. However, challenges persist in developing systems capable of generating accurate and contextually relevant…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Marco Salmè , Rosa Sicilia , Paolo Soda , Valerio Guarrasi

Diabetic retinopathy (DR) is a leading cause of vision loss, requiring early and accurate assessment to prevent irreversible damage. Spectral Domain Optical Coherence Tomography (SD-OCT) enables high-resolution retinal imaging, but…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 S. Chen , D. Ma , M. Raviselvan , S. Sundaramoorthy , K. Popuri , M. J. Ju , M. V. Sarunic , D. Ratra , M. F. Beg

Diabetic retinopathy (DR) is one of the leading causes of vision loss worldwide, making early and accurate DR grading critical for timely intervention. Recent clinical practices leverage multi-view fundus images for DR detection with a wide…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Haoran Li , Yuxin Lin , Huan Wang , Xiaoling Luo , Qi Zhu , Jiahua Shi , Huaming Chen , Bo Du , Johan Barthelemy , Zongyan Xue , Jun Shen , Yong Xu

Foundation models or pre-trained models have substantially improved the performance of various language, vision, and vision-language understanding tasks. However, existing foundation models can only perform the best in one type of tasks,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Xinsong Zhang , Yan Zeng , Jipeng Zhang , Hang Li

Retinal image analysis is crucial for diagnosing and treating eye diseases, yet generating accurate medical reports from images remains challenging due to variability in image quality and pathology, especially with limited labeled data.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Teja Krishna Cherukuri , Nagur Shareef Shaik , Jyostna Devi Bodapati , Dong Hye Ye

Longitudinal imaging is able to capture both static anatomical structures and dynamic changes in disease progression toward earlier and better patient-specific pathology management. However, conventional approaches rarely take advantage of…

Medical foundation models, pre-trained with large-scale clinical data, demonstrate strong performance in diverse clinically relevant applications. RETFound, trained on nearly one million retinal images, exemplifies this approach in…

Fundus imaging such as CFP, OCT and UWF is crucial for the early detection of retinal anomalies and diseases. Fundus image understanding, due to its knowledge-intensive nature, poses a challenging vision-language task. An emerging approach…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Yuchuan Deng , Qijie Wei , Kaiheng Qian , Jiazhen Liu , Zijie Xin , Bangxiang Lan , Jingyu Liu , Jianfeng Dong , Xirong Li

This study introduces a novel framework for enhancing domain generalization in medical imaging, specifically focusing on utilizing unlabelled multi-view colour fundus photographs. Unlike traditional approaches that rely on single-view…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Ze Chen , Gongyu Zhang , Jiayu Huo , Joan Nunez do Rio , Charalampos Komninos , Yang Liu , Rachel Sparks , Sebastien Ourselin , Christos Bergeles , Timothy Jackson

The prevalence of ocular illnesses is growing globally, presenting a substantial public health challenge. Early detection and timely intervention are crucial for averting visual impairment and enhancing patient prognosis. This research…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Shramana Dey , Pallabi Dutta , Riddhasree Bhattacharyya , Surochita Pal , Sushmita Mitra , Rajiv Raman

State-of-the-art vision and vision-and-language models rely on large-scale visio-linguistic pretraining for obtaining good performance on a variety of downstream tasks. Generally, such models are often either cross-modal (contrastive) or…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Amanpreet Singh , Ronghang Hu , Vedanuj Goswami , Guillaume Couairon , Wojciech Galuba , Marcus Rohrbach , Douwe Kiela

Medical vision-language models (VLMs) offer promise for clinical decision support, yet their reliability under distribution shifts remains a major concern for safe deployment. These models often learn task-agnostic correlations due to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Umaima Rahman , Raza Imam , Mohammad Yaqub , Dwarikanath Mahapatra

Traditionally, AI research in medical diagnosis has largely centered on image analysis. While this has led to notable advancements, the absence of patient-reported symptoms continues to hinder diagnostic accuracy. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 K Lokesh , Abhirama Subramanyam Penamakuri , Uday Agarwal , Apoorva Challa , Shreya K Gowda , Somesh Gupta , Anand Mishra

Medical vision-language models (VLMs) show strong performance on radiology tasks but often produce fluent yet weakly grounded conclusions due to over-reliance on a dominant modality. We introduce a context-aligned reasoning framework that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Sumra Khan , Sagar Chhabriya , Aizan Zafar , Sheeraz Arif , Amgad Muneer , Anas Zafar , Shaina Raza , Rizwan Qureshi

Artificial intelligence (AI) is vital in ophthalmology, tackling tasks like diagnosis, classification, and visual question answering (VQA). However, existing AI models in this domain often require extensive annotation and are task-specific,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Danli Shi , Weiyi Zhang , Xiaolan Chen , Yexin Liu , Jiancheng Yang , Siyu Huang , Yih Chung Tham , Yingfeng Zheng , Mingguang He

Effectively representing medical images, especially retinal images, presents a considerable challenge due to variations in appearance, size, and contextual information of pathological signs called lesions. Precise discrimination of these…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Teja Krishna Cherukuri , Nagur Shareef Shaik , Dong Hye Ye

Diabetic retinopathy (DR) is a leading cause of blindness worldwide, necessitating early detection to prevent vision loss. Current automated DR detection systems often struggle with poor-quality images, lack interpretability, and…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Idowu Paul Okuwobi , Jingyuan Liu , Jifeng Wan , Jiaojiao Jiang

Diabetic Retinopathy (DR) is a leading cause of vision loss globally. Yet despite its prevalence, the majority of affected people lack access to the specialized ophthalmologists and equipment required for assessing their condition. This can…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Alexandros Papadopoulos , Fotis Topouzis , Anastasios Delopoulos

Inevitable domain and task discrepancies in real-world scenarios can impair the generalization performance of the pre-trained deep models for medical data. Therefore, we audaciously propose that we should build a general-purpose medical AI…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Huahui Yi , Ziyuan Qin , Qicheng Lao , Wei Xu , Zekun Jiang , Dequan Wang , Shaoting Zhang , Kang Li