English
Related papers

Related papers: Fine-tuning Vision Language Models with Graph-base…

200 papers

Longitudinal imaging is able to capture both static anatomical structures and dynamic changes in disease progression toward earlier and better patient-specific pathology management. However, conventional approaches rarely take advantage of…

Medical vision language pre-training (VLP) has emerged as a frontier of research, enabling zero-shot pathological recognition by comparing the query image with the textual descriptions for each disease. Due to the complex semantics of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Vu Minh Hieu Phan , Yutong Xie , Yuankai Qi , Lingqiao Liu , Liyang Liu , Bowen Zhang , Zhibin Liao , Qi Wu , Minh-Son To , Johan W. Verjans

The recent advancements in Vision Language Models (VLMs) have demonstrated progress toward true intelligence requiring robust reasoning capabilities. Beyond pattern recognition, linguistic reasoning must integrate with visual comprehension,…

Artificial Intelligence · Computer Science 2026-04-06 Yunfei Bai , Amit Dhanda , Shekhar Jain

Recently, there has been a growing interest in Multimodal Large Language Models (MLLMs) due to their remarkable potential in various tasks integrating different modalities, such as image and text, as well as applications such as image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Jihen Amara , Birgitta König-Ries , Sheeba Samuel

Vision-Language Models (VLMs) have demonstrated remarkable success in natural language generation, excelling at instruction following and structured output generation. Knowledge graphs play a crucial role in radiology, serving as valuable…

Computation and Language · Computer Science 2025-05-26 Abdullah Abdullah , Seong Tae Kim

Foundation models are large-scale versatile systems trained on vast quantities of diverse data to learn generalizable representations. Their adaptability with minimal fine-tuning makes them particularly promising for medical imaging, where…

Image and Video Processing · Electrical Eng. & Systems 2025-03-20 Lucie Berger , Mathieu Lamard , Philippe Zhang , Laurent Borderie , Alexandre Le Guilcher , Pascale Massin , Béatrice Cochener , Gwenolé Quellec , Sarah Matta

Pathology context and expert experience play significant roles in clinical ocular disease diagnosis. Although deep neural networks (DNNs) have good ocular disease recognition results, they often ignore exploring the clinical pathology…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Zunjie Xiao , Xiaoqing Zhang , Risa Higashita , Jiang Liu

Diabetic Retinopathy DR is a popular disease for many people as a result of age or the diabetic, as a result, it can cause blindness. therefore, diagnosis of this disease especially in the early time can prevent its effect for a lot of…

Image and Video Processing · Electrical Eng. & Systems 2020-08-04 Mohammed hamzah abed , Lamia Abed Noor Muhammed , Sarah Hussein Toman

Recent advancements in Vision-Language (VL) research have sparked new benchmarks for complex visual reasoning, challenging models' advanced reasoning ability. Traditional Vision-Language Models (VLMs) perform well in visual perception tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zhiyuan Li , Dongnan Liu , Chaoyi Zhang , Heng Wang , Tengfei Xue , Weidong Cai

Accurate yet interpretable image-based diagnosis remains a central challenge in medical AI, particularly in settings characterized by limited data, subtle visual cues, and high-stakes clinical decision-making. Most existing vision models…

Artificial Intelligence · Computer Science 2025-12-23 Midhat Urooj , Ayan Banerjee , Sandeep Gupta

In medical image classification, supervised learning is challenging due to the scarcity of labeled medical images. To address this, we leverage the visual-textual alignment within Vision-Language Models (VLMs) to enable unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Umaima Rahman , Raza Imam , Mohammad Yaqub , Boulbaba Ben Amor , Dwarikanath Mahapatra

In this report, we applied integrated gradients to explaining a neural network for diabetic retinopathy detection. The integrated gradient is an attribution method which measures the contributions of input to the quantity of interest. We…

Artificial Intelligence · Computer Science 2017-10-19 Linyi Li , Matt Fredrikson , Shayak Sen , Anupam Datta

Deep learning brought boosts to auto diabetic retinopathy (DR) diagnosis, thus, greatly helping ophthalmologists for early disease detection, which contributes to preventing disease deterioration that may eventually lead to blindness. It…

Image and Video Processing · Electrical Eng. & Systems 2024-08-15 Xue Xia , Kun Zhan , Yuming Fang , Wenhui Jiang , Fei Shen

Vision-Language Pretraining (VLP) has demonstrated remarkable capabilities in learning visual representations from textual descriptions of images without annotations. Yet, effective VLP demands large-scale image-text pairs, a resource that…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Yinda Chen , Che Liu , Wei Huang , Sibo Cheng , Rossella Arcucci , Zhiwei Xiong

Diabetic retinopathy (DR) is caused by long-standing diabetes and is among the fifth leading cause for visual impairments. The process of early diagnosis and treatments could be helpful in curing the disease, however, the detection…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Chamuditha Jayanga Galappaththige , Gayal Kuruppu , Muhammad Haris Khan

Vision Language Models (VLMs) are becoming increasingly integral to multimedia understanding; however, they often struggle with domain-specific video classification tasks, particularly in cases with limited data. This stems from a critical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Meilong Xu , Di Fu , Jiaxing Zhang , Gong Yu , Jiayu Zheng , Xiaoling Hu , Dongdi Zhao , Feiyang Li , Chao Chen , Yong Cao

Diabetic Retinopathy (DR), a vision-threatening complication of Dia-betes Mellitus (DM), is a major global concern, particularly in India, which has one of the highest diabetic populations. Prolonged hyperglycemia damages reti-nal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Arpan Maity , Aviroop Pal , MD. Samiul Islam , Tamal Ghosh

Retinal optical coherence tomography (OCT) images provide crucial insights into the health of the posterior ocular segment. Therefore, the advancement of automated image analysis methods is imperative to equip clinicians and researchers…

Image and Video Processing · Electrical Eng. & Systems 2024-02-16 Jiahao Wang , Hong Peng , Shengchao Chen , Sufen Ren

Diabetic retinopathy (DR) grading from fundus images has attracted increasing interest in both academic and industrial communities. Most convolutional neural network (CNN) based algorithms treat DR grading as a classification task via…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Yehui Yang , Fangxin Shang , Binghong Wu , Dalu Yang , Lei Wang , Yanwu Xu , Wensheng Zhang , Tianzhu Zhang

Recently, Vision Language Models (VLMs) have increasingly emphasized document visual grounding to achieve better human-computer interaction, accessibility, and detailed understanding. However, its application to visualizations such as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Alexander Vogel , Omar Moured , Yufan Chen , Jiaming Zhang , Rainer Stiefelhagen