English
Related papers

Related papers: Fine-tuning Vision Language Models with Graph-base…

200 papers

Retinal neovascularization (RNV) is a vision threatening development in diabetic retinopathy (DR). Vision loss associated with RNV is preventable with timely intervention, making RNV clinical screening and monitoring a priority. Optical…

Image and Video Processing · Electrical Eng. & Systems 2026-04-01 Jinyi Hao , Jie Wang , Liqin Gao , Tristan T. Hormel , Yukun Guo , An-Lun Wu , Christina J. Flaxel , Steven T. Bailey , Kotaro Tsuboi , Thomas S. Hwang , Yali Jia

Diabetic Retinopathy (DR), a prevalent and severe complication of diabetes, affects millions of individuals globally, underscoring the need for accurate and timely diagnosis. Recent advancements in imaging technologies, such as…

Deep learning methods exhibit promising performance for predictive modeling in healthcare, but two important challenges remain: -Data insufficiency:Often in healthcare predictive modeling, the sample size is insufficient for deep learning…

Machine Learning · Computer Science 2017-04-04 Edward Choi , Mohammad Taha Bahadori , Le Song , Walter F. Stewart , Jimeng Sun

The emergence of vision-language models (VLMs) has opened new possibilities for clinical reasoning and has shown promising performance in dermatological diagnosis. However, their trustworthiness and clinical utility are often limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Zehao Liu , Wejieying Ren , Jipeng Zhang , Tianxiang Zhao , Jingxi Zhu , Xiaoting Li , Vasant G. Honavar

Diagrams play a crucial role in visually conveying complex relationships and processes within business documentation. Despite recent advances in Vision-Language Models (VLMs) for various image understanding tasks, accurately identifying and…

Software Engineering · Computer Science 2025-02-10 Shue Shiinoki , Ryo Koshihara , Hayato Motegi , Masumi Morishige

Diabetic retinopathy is a common complication of diabetes, and monitoring the progression of retinal abnormalities using fundus imaging is crucial. Because the images must be interpreted by a medical expert, it is infeasible to screen all…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Andrea M. Storås , Josefine V. Sundgaard

Diabetic retinopathy (DR) is a leading cause of preventable blindness worldwide, demanding accurate automated diagnostic systems. While general-domain vision-language models like Contrastive Language-Image Pre-Training (CLIP) perform well…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Argha Kamal Samanta , Harshika Goyal , Vasudha Joshi , Tushar Mungle , Pabitra Mitra

The differential diagnosis of neurodegenerative dementias is a challenging clinical task, mainly because of the overlap in symptom presentation and the similarity of patterns observed in structural neuroimaging. To improve diagnostic…

Machine Learning · Computer Science 2025-05-27 Andrew Zamai , Nathanael Fijalkow , Boris Mansencal , Laurent Simon , Eloi Navet , Pierrick Coupe

Large language models (LLMs) show promise in medical diagnosis, but real-world deployment remains challenging due to high-stakes clinical decisions and imperfect reasoning reliability. As a result, careful inspection of model behavior is…

Computation and Language · Computer Science 2026-04-28 Yurui Xiang , Xingyi Mao , Rui Sheng , Zixin Chen , Zelin Zang , Yuyang Wu , Haipeng Zeng , Huamin Qu , Yushi Sun , Yanna Lin

General-purpose large Vision-Language Models (VLMs) demonstrate strong capabilities in generating detailed descriptions for natural images. However, their performance in the medical domain remains suboptimal, even for relatively…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Yifan Li , Fenghe Tang , Yingtai Li , Shaohua Kevin Zhou

We propose an automatic diabetic retinopathy (DR) analysis algorithm based on two-stages deep convolutional neural networks (DCNN). Compared to existing DCNN-based DR detection methods, the proposed algorithm have the following advantages:…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Yehui Yang , Tao Li , Wensi Li , Haishan Wu , Wei Fan , Wensheng Zhang

The rapid advancement of vision-language models (VLMs) has established a new paradigm in video anomaly detection (VAD): leveraging VLMs to simultaneously detect anomalies and provide comprehendible explanations for the decisions. Existing…

Artificial Intelligence · Computer Science 2025-04-02 Muchao Ye , Weiyang Liu , Pan He

Explainable Artificial Intelligence (AI) in the form of an interpretable and semiautomatic approach to stage grading ocular pathologies such as Diabetic retinopathy, Hypertensive retinopathy, and other retinopathies on the backdrop of major…

Image and Video Processing · Electrical Eng. & Systems 2022-12-15 Ayushi Raj Bhatt , Rajkumar Vaghashiya , Meghna Kulkarni , Dr Prakash Kamaraj

Medical vision-language models (Med-VLMs) have shown impressive results in tasks such as report generation and visual question answering, but they still face several limitations. Most notably, they underutilize patient metadata and lack…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Fangqi Cheng , Surajit Ray , Xiaochen Yang

Medical image classifiers detect gastrointestinal diseases well, but they do not explain their decisions. Large language models can generate clinical text, yet they struggle with visual reasoning and often produce unstable or incorrect…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Md. Najib Hasan , Imran Ahmad , Sourav Basak Shuvo , Md. Mahadi Hasan Ankon , Sunanda Das , Nazmul Siddique , Hui Wang

Diabetic retinopathy (DR) is a growing health problem worldwide and is a leading cause of visual impairment and blindness, especially among working people aged 20-65. Its incidence is increasing along with the number of diabetes cases, and…

Image and Video Processing · Electrical Eng. & Systems 2023-12-04 Agnieszka Cisek , Karolina Korycinska , Leszek Pyziak , Marzena Malicka , Tomasz Wiecek , Grzegorz Gruzel , Kamil Szmuc , Jozef Cebulski , Mariusz Spyra

Diabetic Retinopathy (DR) refers to a barrier that takes place in diabetes mellitus damaging the blood vessel network present in the retina. This may endanger the subjects' vision if they have diabetes. It can take some time to perform a DR…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 V. Banupriya , S. Anusuya

Vision-Language Models (VLMs) have emerged as versatile solutions for zero-shot question answering (QA) across various domains. However, enabling VLMs to effectively comprehend structured graphs and perform accurate, efficient QA remains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Yanbin Wei , Jiangyue Yan , Chun Kang , Yang Chen , Hua Liu , James Kwok , Yu Zhang

Diabetic retinopathy (DR) is a retinal microvascular condition that emerges in diabetic patients. DR will continue to be a leading cause of blindness worldwide, with a predicted 191.0 million globally diagnosed patients in 2030.…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Mihir Rao , Michelle Zhu , Tianyang Wang

Purpose: This study explores the feasibility of using generative machine learning (ML) to translate Optical Coherence Tomography (OCT) images into Optical Coherence Tomography Angiography (OCTA) images, potentially bypassing the need for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Rashadul Hasan Badhon , Atalie Carina Thompson , Jennifer I. Lim , Theodore Leng , Minhaj Nur Alam