English
Related papers

Related papers: Evaluating Vision Language Models (VLMs) for Radio…

200 papers

Foundation models leveraging vision-language pretraining have shown promise in chest X-ray (CXR) interpretation, yet their real-world performance across diverse populations and diagnostic tasks remains insufficiently evaluated. This study…

The advent of foundation models, particularly Vision-Language Models (VLMs) and Multi-modal Large Language Models (MLLMs), has redefined the frontiers of artificial intelligence, enabling remarkable generalization across diverse tasks with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Redwan Sony , Parisa Farmanifard , Hamzeh Alzwairy , Nitish Shukla , Arun Ross

Radiation therapy (RT) is one of the most effective treatments for cancer, and its success relies on the accurate delineation of targets. However, target delineation is a comprehensive medical decision that currently relies purely on manual…

Vision-language models (VLMs) are increasingly proposed as general-purpose tools for scientific data interpretation, yet their reliability on real astronomical observations across diverse modalities remains untested. We present…

Artificial Intelligence · Computer Science 2026-04-28 Wenke Ren , Hengxiao Guo , Wenwen Zuo , Xiaoman Zhang

Vision-language pretraining has driven significant progress in medical image analysis. However, current methods typically supervise visual encoders using one-hot labels or free-form text, neither of which effectively captures the complex…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Xiyao Wang , Xiaoyu Tan , Yang Dai , Yuxuan Fu , Shuo Li , Xihe Qiu

Foundation vision models are increasingly adopted in medical image analysis. Due to domain shift, these pretrained models misalign with medical image segmentation needs without being fully fine-tuned or lightly adapted. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhuonan Liang , Wei Guo , Jie Gan , Yaxuan Song , Runnan Chen , Hang Chang , Weidong Cai

Using massive datasets, foundation models are large-scale, pre-trained models that perform a wide range of tasks. These models have shown consistently improved results with the introduction of new methods. It is crucial to analyze how these…

Image and Video Processing · Electrical Eng. & Systems 2025-05-27 Mobina Mansoori , Sajjad Shahabodini , Farnoush Bayatmakou , Jamshid Abouei , Konstantinos N. Plataniotis , Arash Mohammadi

Advancements in artificial intelligence have driven the development of numerous pathology foundation models capable of extracting clinically relevant information. However, there is currently limited literature independently evaluating these…

Early detection of eye diseases like glaucoma, macular degeneration, and diabetic retinopathy is crucial for preventing vision loss. While artificial intelligence (AI) foundation models hold significant promise for addressing these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Danli Shi , Weiyi Zhang , Jiancheng Yang , Siyu Huang , Xiaolan Chen , Mayinuer Yusufu , Kai Jin , Shan Lin , Shunming Liu , Qing Zhang , Mingguang He

Large Vision-Language Models offer a new paradigm for AI-driven image understanding, enabling models to perform tasks without task-specific training. This flexibility holds particular promise across medicine, where expert-annotated data is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Anita Rau , Mark Endo , Josiah Aklilu , Jaewoo Heo , Khaled Saab , Alberto Paderno , Jeffrey Jopling , F. Christopher Holsinger , Serena Yeung-Levy

Current deep learning models are mostly task specific and lack a user-friendly interface to operate. We present Meta-EyeFM, a multi-function foundation model that integrates a large language model (LLM) with vision foundation models (VFMs)…

Vision-Language Foundation Models (VLMs), trained on large-scale multimodal datasets, have driven significant advances in Artificial Intelligence (AI) by enabling rich cross-modal reasoning. Despite their success in general domains,…

Medical image segmentation is crucial for disease diagnosis and treatment planning, yet developing robust segmentation models often requires substantial computational resources and large datasets. Existing research shows that pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Paul Zaha , Lars Böcking , Simeon Allmendinger , Leopold Müller , Niklas Kühl

Recent advances in vision language models (VLMs) have enabled broad progress in the general medical field. However, pathology still remains a more challenging subdomain, with current pathology specific VLMs exhibiting limitations in both…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wenchuan Zhang , Penghao Zhang , Jingru Guo , Tao Cheng , Jie Chen , Shuwan Zhang , Zhang Zhang , Yuhao Yi , Hong Bu

The rapid advancements in large language models (LLMs) have unlocked their potential for multimodal tasks, where text and visual data are processed jointly. However, applying LLMs to medical imaging, particularly for chest X-rays (CXR),…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Nicholas Evans , Stephen Baker , Miles Reed

Vision-language models (VLMs) show strong potential for complex diagnostic tasks in medical imaging. However, applying VLMs to multi-organ medical imaging introduces two principal challenges: (1) modality-specific vision-language alignment…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Haowen Zhu , Ning Yin , Xiaogen Zhou

Foundation models have demonstrated remarkable potential in medical domain. However, their application to complex cardiovascular diagnostics remains underexplored. In this paper, we present Cardiac-CLIP, a multi-modal foundation model…

This retrospective study evaluated five VLMs (Qwen2.5, Phi-4, Gemma3, Llama3.2, and Mistral3.1) using the MedFMC dataset. This dataset includes 22,349 images from 7,461 patients encompassing chest radiography (19 disease multi-label…

Image and Video Processing · Electrical Eng. & Systems 2025-08-05 Gustav Müller-Franzes , Debora Jutz , Jakob Nikolas Kather , Christiane Kuhl , Sven Nebelung , Daniel Truhn

Recent advances in multimodal large language models enable new possibilities for image-based decision support. However, their reliability and operational trade-offs in neuroimaging remain insufficiently understood. We present a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Katarina Trojachanec Dineva , Stefan Andonov , Ilinka Ivanoska , Ivan Kitanovski , Sasho Gramatikov , Tamara Kostova , Monika Simjanoska Misheva , Kostadin Mishev

Medical vision-language models (VLMs) show strong performance on radiology tasks but often produce fluent yet weakly grounded conclusions due to over-reliance on a dominant modality. We introduce a context-aligned reasoning framework that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Sumra Khan , Sagar Chhabriya , Aizan Zafar , Sheeraz Arif , Amgad Muneer , Anas Zafar , Shaina Raza , Rizwan Qureshi
‹ Prev 1 4 5 6 7 8 10 Next ›