English
Related papers

Related papers: Diagnostic Accuracy of Open-Source Vision-Language…

200 papers

Recent advances in instruction-tuned Large Vision-Language Models (LVLMs) have imbued the models with the ability to generate high-level, image-grounded explanations with ease. While such capability is largely attributed to the rich world…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Jeonghwan Kim , Heng Ji

In this work, deep learning algorithms are used to classify fundus images in terms of diabetic retinopathy severity. Six different combinations of two model architectures, the Dense Convolutional Network-121 and the Residual Neural…

Image and Video Processing · Electrical Eng. & Systems 2021-08-20 Jonathan Zhang , Bowen Xie , Xin Wu , Rahul Ram , David Liang

This study evaluates the capabilities of Multimodal Large Language Models (LLMs) and Vision Language Models (VLMs) in the task of single-label classification of Christian Iconography. The goal was to assess whether general-purpose VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Gianmarco Spinaci , Lukas Klic , Giovanni Colavizza

Convolutional Neural Networks (CNNs) are propelling advances in a range of different computer vision tasks such as object detection and object segmentation. Their success has motivated research in applications of such models for medical…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Kristoffer Wickstrøm , Michael Kampffmeyer , Robert Jenssen

With the rapid rise of large language models (LLMs) in medicine, a key question is whether they can function as competent pediatricians in real-world clinical settings. We developed PEDIASBench, a systematic evaluation framework centered on…

Computation and Language · Computer Science 2025-11-18 Siyu Zhu , Mouxiao Bian , Yue Xie , Yongyu Tang , Zhikang Yu , Tianbin Li , Pengcheng Chen , Bing Han , Jie Xu , Xiaoyan Dong

Contrastive Language-Image Pretraining (CLIP) has demonstrated strong generalization for vision-language tasks in computer vision and medical domains, yet its text encoder accepts only up to 77 tokens, which limits its ability to represent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Xiaoyang Wei , Camille Kurtz , Florence Cloppet

This work presents a comparative analysis of embedding-based and generative models for classifying geoscience technical documents. Using a multi-disciplinary benchmark dataset, we evaluated the trade-offs between model accuracy, stability,…

Information Retrieval · Computer Science 2026-04-08 Rong Lu , Hao Liu , Song Hou

Background: Deep learning has great potential to assist with detecting and triaging critical findings such as pneumoperitoneum on medical images. To be clinically useful, the performance of this technology still needs to be validated for…

Image and Video Processing · Electrical Eng. & Systems 2020-10-26 Manu Goyal , Judith Austin-Strohbehn , Sean J. Sun , Karen Rodriguez , Jessica M. Sin , Yvonne Y. Cheung , Saeed Hassanpour

Purpose: This study aims to evaluate the effectiveness of large language models (LLMs) in automating disease annotation of CT radiology reports. We compare a rule-based algorithm (RBA), RadBERT, and three lightweight open-weight LLMs for…

Vision-language models (VLMs) are increasingly adapted through domain-specific fine-tuning, yet it remains unclear whether this improves reasoning beyond superficial visual cues, particularly in high-stakes domains like medicine. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Oliver McLaughlin , Daniel Shubin , Carsten Eickhoff , Ritambhara Singh , William Rudman , Michal Golovanevsky

Corneal Confocal Microscopy (CCM) is a sensitive tool for assessing small-fiber damage in Diabetic Peripheral Neuropathy (DPN), yet the development of robust, automated deep learning-based diagnostic models is limited by scarce labelled…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Xin Zhang , Liangxiu Han , Tam Sobeih , Yue Shi , Yalin Zheng , Uazman Alam , Maryam Ferdousi , Rayaz Malik

Hypertensive retinopathy (HR) is a severe eye disease that may cause permanent vision loss if not diagnosed early. Traditional diagnostic methods are time-consuming and subjective, highlighting the need for an automated, reliable system.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Suleyman Burcin Suyun , Mustafa Yurdakul , Sakir Tasdemir , Serkan Bilic

Recent advancements in Large Language Models (LLMs) and Large Vision Language Models (LVLMs) have enabled general-purpose systems to demonstrate promising capabilities in complex reasoning tasks, including those in the medical domain.…

Computation and Language · Computer Science 2026-05-19 Rafid Ahmed , Intesar Tahmid , Mir Sazzat Hossain , Tasnimul Hossain Tomal , Md Fahim , Md Farhad Alam Bhuiyan

We study fine-grained referring image segmentation via a decoupled reason-then-segment pipeline. A vision-language model (VLM) receives an image and a natural-language query, reasons about the scene, and emits structured spatial prompts: a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Sandesh Hegde , Jaison Saji Chacko , Debarshi Banerjee , Uma Mahesh

While deep learning has exhibited remarkable predictive capabilities in various medical image tasks, its inherent black-box nature has hindered its widespread implementation in real-world healthcare settings. Our objective is to unveil the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Han Yuan , Lican Kang , Yong Li

Artificially intelligent (AI) co-scientists must be able to sift through research literature cost-efficiently while applying nuanced scientific reasoning. We evaluate Small Language Models (SLMs, <= 8B parameters) for classifying medical…

Computational Engineering, Finance, and Science · Computer Science 2025-12-09 Muhammed Muaaz Dawood , Mohammad Zaid Moonsamy , Kaela Kokkas , Hairong Wang , Robert F. Breiman , Richard Klein , Emmanuel K. Sekyi , Bruce A. Bassett

Vision-language models (VLMs) are increasingly used in settings where sensitivity to low-level image degradations matters, including content moderation, image restoration, and quality monitoring. Yet their ability to recognize distortion…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Divyanshu Goyal , Akhil Eppa , Vanya Bannihatti Kumar

The scarcity of high-quality, labelled retinal imaging data, which presents a significant challenge in the development of machine learning models for ophthalmology, hinders progress in the field. Existing methods for synthesising Colour…

Image and Video Processing · Electrical Eng. & Systems 2025-07-18 Junzhi Ning , Cheng Tang , Kaijing Zhou , Diping Song , Lihao Liu , Ming Hu , Wei Li , Huihui Xu , Yanzhou Su , Tianbin Li , Jiyao Liu , Jin Ye , Sheng Zhang , Yuanfeng Ji , Junjun He

Skin cancer is a common and fast rising malignancy worldwide. Early detection is critical for improving outcomes. Deep learning models trained on dermoscopic and clinical images can support automated and fast triage. However, many studies…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Durjoy Dey , Yuhong Yan , Hassan Hajjdiab

The rapid advancements in Large Language Models (LLMs) and Vision-Language Models (VLMs) have shown great potential in medical diagnostics, particularly in radiology, where datasets such as X-rays are paired with human-generated diagnostic…

Artificial Intelligence · Computer Science 2024-11-13 Francesco Chiumento , Mingming Liu