English
Related papers

Related papers: Fine-tuning Vision Language Models with Graph-base…

200 papers

Accurate diagnosis of skin diseases remains a significant challenge due to the complex and diverse visual features present in dermatoscopic images, often compounded by a lack of interpretability in existing purely visual diagnostic models.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Kexin Yu , Zihan Xu , Jialei Xie , Carter Adams

Diabetic Retinopathy (DR) is a serious and common complication of diabetes, caused by prolonged high blood sugar levels that damage the small retinal blood vessels. If left untreated, DR can progress to retinal vein occlusion and stimulate…

Image and Video Processing · Electrical Eng. & Systems 2025-04-07 Mohammad Reza Yousefi , Ali Bakrani , Amin Dehghani

The significant portion of diabetic patients was affected due to major blindness caused by Diabetic retinopathy (DR). For diabetic retinopathy, lesion segmentation, and detection the comprehensive examination is delved into the deep…

Artificial Intelligence · Computer Science 2024-11-20 Syed Mohd Faisal Malik , Md Tabrez Nafis , Mohd Abdul Ahad , Safdar Tanweer

Diabetic retinopathy (DR) is a complication of diabetes and usually takes decades to reach sight-threatening levels. Accurate and robust detection of DR severity is critical for the timely management and treatment of diabetes. However, most…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Qinkai Yu , Jianyang Xie , Anh Nguyen , He Zhao , Jiong Zhang , Huazhu Fu , Yitian Zhao , Yalin Zheng , Yanda Meng

Eye diseases are common in older Americans and can lead to decreased vision and blindness. Recent advancements in imaging technologies allow clinicians to capture high-quality images of the retinal blood vessels via Optical Coherence…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jacob Thrasher , Annahita Amireskandari , Prashnna Gyawali

Accurate disease interpretation from radiology remains challenging due to imaging heterogeneity. Achieving expert-level diagnostic decisions requires integration of subtle image features with clinical knowledge. Yet major vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Difei Gu , Yunhe Gao , Mu Zhou , Dimitris Metaxas

Optical Coherence Tomography (OCT) is essential for diagnosing conditions such as glaucoma, diabetic retinopathy, and age-related macular degeneration. Accurate retinal layer segmentation enables quantitative biomarkers critical for…

Image and Video Processing · Electrical Eng. & Systems 2025-09-10 S M Asiful Islam Saky , Ugyen Tshering

Large Language Models (LLMs) are increasingly used for various tasks with graph structures. Though LLMs can process graph information in a textual format, they overlook the rich vision modality, which is an intuitive way for humans to…

Computation and Language · Computer Science 2024-11-01 Yanbin Wei , Shuai Fu , Weisen Jiang , Zejian Zhang , Zhixiong Zeng , Qi Wu , James T. Kwok , Yu Zhang

Diabetic Retinopathy (DR) is a serious microvascular complication of diabetes, and one of the leading causes of vision loss worldwide. Although automated detection and grading, with Deep Learning (DL), can reduce the burden on…

Image and Video Processing · Electrical Eng. & Systems 2026-04-06 Shramana Dey , Zahir Khan , T. A. PramodKumar , B. Uma Shankar , Ashis K. Dhara , Ramachandran Rajalakshmi , Rajiv Raman , Sushmita Mitra

Clinicians spend a significant amount of time reviewing medical images and transcribing their findings regarding patient diagnosis, referral and treatment in text form. Vision-language models (VLMs), which automatically interpret images and…

Osteoarthritis (OA) poses a global health challenge, demanding precise diagnostic methods. Current radiographic assessments are time consuming and prone to variability, prompting the need for automated solutions. The existing deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Banafshe Felfeliyan , Yuyue Zhou , Shrimanti Ghosh , Jessica Kupper , Shaobo Liu , Abhilash Hareendranathan , Jacob L. Jaremko

Diabetic Retinopathy (DR) is a non-negligible eye disease among patients with Diabetes Mellitus, and automatic retinal image analysis algorithm for the DR screening is in high demand. Considering the resolution of retinal image is very…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Kang Zhou , Zaiwang Gu , Wen Liu , Weixin Luo , Jun Cheng , Shenghua Gao , Jiang Liu

Vision-language models (VLMs) have shown considerable potential in digital pathology, yet their effectiveness remains limited for fine-grained, disease-specific classification tasks such as distinguishing between glomerular subtypes. The…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhenhao Guo , Rachit Saluja , Tianyuan Yao , Quan Liu , Yuankai Huo , Benjamin Liechty , David J. Pisapia , Kenji Ikemura , Mert R. Sabuncu , Yihe Yang , Ruining Deng

This research paper addresses the critical challenge of diabetic retinopathy (DR), a severe complication of diabetes leading to potential blindness. The proposed methodology leverages transfer learning with convolutional neural networks…

Image and Video Processing · Electrical Eng. & Systems 2024-01-08 Manoj S H , Arya A Bosale

Automated grading of diabetic retinopathy (DR) faces several critical challenges: subtle inter-grade visual distinctions in fine-grained lesion patterns, distributional discrepancies induced by heterogeneous imaging devices and acquisition…

Image and Video Processing · Electrical Eng. & Systems 2026-05-12 Yiqun Wang

We investigate fine-tuning Vision-Language Models (VLMs) for multi-task medical image understanding, focusing on detection, localization, and counting of findings in medical images. Our objective is to evaluate whether instruction-tuned…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Sushant Gautam , Michael A. Riegler , Pål Halvorsen

Deep neural network models have been proven to be very successful in image classification tasks, also for medical diagnosis, but their main concern is its lack of interpretability. They use to work as intuition machines with high…

Machine Learning · Computer Science 2019-04-26 Jordi de la Torre , Aida Valls , Domenec Puig

All people with diabetes have the risk of developing diabetic retinopathy (DR), a vision-threatening complication. Early detection and timely treatment can reduce the occurrence of blindness due to DR. Computer-aided diagnosis has the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-06 Ragav Venkatesan , Parag S. Chandakkar , Baoxin Li

Vision-and-Language Navigation (VLN) requires an embodied agent to traverse complex environments by following natural language instructions, demanding accurate alignment between visual observations and linguistic guidance. Despite recent…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Yaohua Liu , Xinyuan Song , Yunfu Deng , Yifan Xie , Binkai Ou , Yan Zhong

Accurate classification of focal liver lesions is crucial for diagnosis and treatment in hepatology. However, traditional supervised deep learning models depend on large-scale annotated datasets, which are often limited in medical imaging.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Song Jian , Hu Yuchang , Wang Hui , Chen Yen-Wei