English
Related papers

Related papers: EVLF-FM: Explainable Vision Language Foundation Mo…

200 papers

Vision-Language Models (VLMs) trained on web-scale corpora excel at natural image tasks and are increasingly repurposed for healthcare; however, their competence in medical tasks remains underexplored. We present a comprehensive evaluation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Che Liu , Jiazhen Pan , Weixiang Shen , Wenjia Bai , Daniel Rueckert , Rossella Arcucci

Medical vision-language models (VLMs) show strong performance on radiology tasks but often produce fluent yet weakly grounded conclusions due to over-reliance on a dominant modality. We introduce a context-aligned reasoning framework that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Sumra Khan , Sagar Chhabriya , Aizan Zafar , Sheeraz Arif , Amgad Muneer , Anas Zafar , Shaina Raza , Rizwan Qureshi

The diagnosis of pathological images is often limited by expert availability and regional disparities, highlighting the importance of automated diagnosis using Vision-Language Models (VLMs). Traditional multimodal models typically emphasize…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Jianyu Wu , Hao Yang , Xinhua Zeng , Guibing He , Zhiyu Chen , Zihui Li , Xiaochuan Zhang , Yangyang Ma , Run Fang , Yang Liu

Visual Language Models (VLMs) have demonstrated impressive capabilities in visual grounding tasks. However, their effectiveness in the medical domain, particularly for abnormality detection and localization within medical images, remains…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Jun Li , Che Liu , Wenjia Bai , Rossella Arcucci , Cosmin I. Bercea , Julia A. Schnabel

With the rapid growth of large language models (LLMs) and vision-language models (VLMs) in medicine, simply integrating clinical text and medical imaging does not guarantee reliable reasoning. Existing multimodal models often produce…

Artificial Intelligence · Computer Science 2025-12-29 Zelin Zang , Wenyi Gu , Siqi Ma , Dan Yang , Yue Shen , Zhu Zhang , Guohui Fan , Wing-Kuen Ling , Fuji Yang

Accurate disease interpretation from radiology remains challenging due to imaging heterogeneity. Achieving expert-level diagnostic decisions requires integration of subtle image features with clinical knowledge. Yet major vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Difei Gu , Yunhe Gao , Mu Zhou , Dimitris Metaxas

Medical vision-language models (VLMs) combine computer vision (CV) and natural language processing (NLP) to analyze visual and textual medical data. Our paper reviews recent advancements in developing VLMs specialized for healthcare,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Iryna Hartsock , Ghulam Rasool

Medical foundation models have shown promise in controlled benchmarks, yet widespread deployment remains hindered by reliance on task-specific fine-tuning. Here, we introduce DermFM-Zero, a dermatology vision-language foundation model…

Multimodal Large Language Models (MLLMs) have achieved remarkable progress in domains such as visual understanding and mathematical reasoning. However, their application in the medical domain is constrained by two key challenges: (1)…

Computation and Language · Computer Science 2025-10-09 Zeyu Liu , Zhitian Hou , Guanghao Zhu , Zhijie Sang , Congkai Xie , Hongxia Yang

Large Vision-Language Models (LVLMs) are capable of handling diverse data types such as imaging, text, and physiological signals, and can be applied in various fields. In the medical field, LVLMs have a high potential to offer substantial…

While Multimodal Large Language Models (MLLMs) show promising performance in automated electrocardiogram interpretation, it remains unclear whether they genuinely perform actual step-by-step reasoning or just rely on superficial visual…

Machine Learning · Computer Science 2026-03-17 Jungwoo Oh , Hyunseung Chung , Junhee Lee , Min-Gyu Kim , Hangyul Yoon , Ki Seong Lee , Youngchae Lee , Muhan Yeo , Edward Choi

MLLMs MLLMs are beginning to appear in clinical workflows, but their ability to perform complex medical reasoning remains unclear. We present Med-CMR, a fine-grained Medical Complex Multimodal Reasoning benchmark. Med-CMR distinguishes from…

The rapid advancements in Vision Language Models (VLMs) have prompted the development of multi-modal medical assistant systems. Despite this progress, current models still have inherent probabilistic uncertainties, often producing erroneous…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Xiao Liang , Di Wang , Zhicheng Jiao , Ronghan Li , Pengfei Yang , Quan Wang , Tat-Seng Chua

Vision-language models (VLMs) have recently shown remarkable zero-shot performance in medical image understanding, yet their grounding ability, the extent to which textual concepts align with visual evidence, remains underexplored. In the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Haozhe Luo , Shelley Zixin Shu , Ziyu Zhou , Sebastian Otalora , Mauricio Reyes

Foundation models, first introduced in 2021, refer to large-scale pretrained models (e.g., large language models (LLMs) and vision-language models (VLMs)) that learn from extensive unlabeled datasets through unsupervised methods, enabling…

The advent of Large Language Models (LLMs) has significantly reshaped the trajectory of the AI revolution. Nevertheless, these LLMs exhibit a notable limitation, as they are primarily adept at processing textual information. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Akash Ghosh , Arkadeep Acharya , Sriparna Saha , Vinija Jain , Aman Chadha

Recently, histopathology vision-language foundation models (VLMs) have gained popularity due to their enhanced performance and generalizability across different downstream tasks. However, most existing histopathology benchmarks are either…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Roba Al Majzoub , Hashmat Malik , Muzammal Naseer , Zaigham Zaheer , Tariq Mahmood , Salman Khan , Fahad Khan

Recent advances in vision-language models (VLMs) have greatly improved cross-modal semantic understanding, yet significant limitations remain in fine-grained discrimination and deep causal reasoning tasks. Existing VLMs often rely on…

Machine Learning · Computer Science 2025-06-24 Jusheng Zhang , Kaitong Cai , Yijia Fan , Jian Wang , Keze Wang

The prevalence of vision-threatening eye diseases is a significant global burden, with many cases remaining undiagnosed or diagnosed too late for effective treatment. Large vision-language models (LVLMs) have the potential to assist in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Zhenyue Qin , Yu Yin , Dylan Campbell , Xuansheng Wu , Ke Zou , Yih-Chung Tham , Ninghao Liu , Xiuzhen Zhang , Qingyu Chen

Vision-language models (VLMs) are increasingly adapted through domain-specific fine-tuning, yet it remains unclear whether this improves reasoning beyond superficial visual cues, particularly in high-stakes domains like medicine. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Oliver McLaughlin , Daniel Shubin , Carsten Eickhoff , Ritambhara Singh , William Rudman , Michal Golovanevsky