English
Related papers

Related papers: MedScribe: Clinically Grounded CT Reporting throug…

200 papers

Medical vision--language models (VLMs) have shown strong potential for medical visual question answering (VQA), yet their reasoning remains largely text-centric: images are encoded once as static context, and subsequent inference is…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Suyang Xi , Songtao Hu , Yuxiang Lai , Wangyun Dan , Yaqi Liu , Shansong Wang , Xiaofeng Yang

Vision-and-language models (VLMs) have been increasingly explored in the medical domain, particularly following the success of CLIP in general domain. However, unlike the relatively straightforward pairing of 2D images and text, curating…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Ziyang Zhang , Yang Yu , Xulei Yang , Si Yong Yeo

Reasoning is a critical frontier for advancing medical image analysis, where transparency and trustworthiness play a central role in both clinician trust and regulatory approval. Although Medical Visual Language Models (VLMs) show promise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Jiazhen Pan , Che Liu , Junde Wu , Fenglin Liu , Jiayuan Zhu , Hongwei Bran Li , Chen Chen , Cheng Ouyang , Daniel Rueckert

Computed tomography (CT) report generation is crucial to assist radiologists in interpreting CT volumes, which can be time-consuming and labor-intensive. Existing methods primarily only consider the global features of the entire volume,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Zhixuan Chen , Yequan Bie , Haibo Jin , Hao Chen

Explaining Deep Learning models is becoming increasingly important in the face of daily emerging multimodal models, particularly in safety-critical domains like medical imaging. However, the lack of detailed investigations into the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Anees Ur Rehman Hashmi , Dwarikanath Mahapatra , Mohammad Yaqub

3D medical vision-language (VL) pretraining has shown potential in radiology by leveraging large-scale multimodal datasets with CT-report pairs. However, existing methods primarily rely on a global VL alignment directly adapted from 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Jingyang Lin , Yingda Xia , Jianpeng Zhang , Ke Yan , Kai Cao , Le Lu , Jiebo Luo , Ling Zhang

Recent progress in medical vision-language models (VLMs) has achieved strong performance on image-level text-centric tasks such as report generation and visual question answering (VQA). However, achieving fine-grained visual grounding and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Yang Xing , Jiong Wu , Savas Ozdemir , Ying Zhang , Yang Yang , Wei Shao , Kuang Gong

As artificial intelligence (AI) becomes increasingly central to healthcare, the demand for explainable and trustworthy models is paramount. Current report generation systems for chest X-rays (CXR) often lack mechanisms for validating…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Sayeh Gholipour Picha , Dawood Al Chanti , Alice Caplier

The scarcity of high-quality, logically annotated video datasets remains a primary bottleneck in advancing Multi-Modal Large Language Models (MLLMs) for the medical domain. Traditional manual annotation is prohibitively expensive and…

Artificial Intelligence · Computer Science 2025-12-02 Shenxi Liu , Kan Li , Mingyang Zhao , Yuhang Tian , Shoujun Zhou , Bin Li

Vision language models (VLMs) achieve strong performance on general image understanding but struggle to think with medical images, especially when performing multi-step reasoning through iterative visual interaction. Medical VLMs often rely…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Meng Lu , Yuxing Lu , Yuchen Zhuang , Megan Mullins , Yang Xie , Guanghua Xiao , Charles Fleming , Wenqi Shi , Xuan Wang

Recent advancements in Large Language Models (LLMs) have demonstrated significant promise in clinical diagnosis. However, current models struggle to emulate the iterative, diagnostic hypothesis-driven reasoning of real clinical scenarios.…

Computation and Language · Computer Science 2026-01-06 Qipeng Wang , Rui Sheng , Yafei Li , Huamin Qu , Yushi Sun , Min Zhu

Vision-Language Models (VLMs) have enabled interpretable medical diagnosis by integrating visual perception with linguistic reasoning. Yet, existing medical chain-of-thought (CoT) models lack explicit mechanisms to represent and enforce…

Artificial Intelligence · Computer Science 2026-05-29 Jianxin Lin , Chunzheng Zhu , Peter J. Kneuertz , Yunfei Bai , Yuan Xue

Developing 3D vision-language models with robust clinical reasoning remains a challenge due to the inherent complexity of volumetric medical imaging, the tendency of models to overfit superficial report patterns, and the lack of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Haoran Lai , Zihang Jiang , Kun Zhang , Qingsong Yao , Rongsheng Wang , Zhiyang He , Xiaodong Tao , Wei Wei , Shaohua Kevin Zhou

Vision-language foundation models have emerged as powerful general-purpose representation learners with strong potential for multimodal understanding, but their deterministic embeddings often fail to provide the reliability required for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ahmad Elallaf , Yu Zhang , Yuktha Priya Masupalli , Jeong Yang , Young Lee , Zechun Cao , Gongbo Liang

Multiple Instance Learning (MIL) is the leading approach for whole slide image (WSI) classification, enabling efficient analysis of gigapixel pathology slides. Recent work has introduced vision-language models (VLMs) into MIL pipelines to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ngoc Bui Lam Quang , Nam Le Nguyen Binh , Thanh-Huy Nguyen , Le Thien Phuc Nguyen , Quan Nguyen , Ulas Bagci

Recent progress in multimodal large language models (MLLMs) has demonstrated promising performance on medical benchmarks and in preliminary trials as clinical assistants. Yet, our pilot audit of diagnostic cases uncovers a critical failure…

Artificial Intelligence · Computer Science 2025-09-30 Hongjun Liu , Yinghao Zhu , Yuhui Wang , Yitao Long , Zeyu Lai , Lequan Yu , Chen Zhao

Radiology Report Generation (RRG) is a critical step toward automating healthcare workflows, facilitating accurate patient assessments, and reducing the workload of medical professionals. Despite recent progress in Large Medical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Sarosij Bose , Ravi K. Rajendran , Biplob Debnath , Konstantinos Karydis , Amit K. Roy-Chowdhury , Srimat Chakradhar

Large language models (LLMs) have shown promise in clinical diagnosis but remain limited by unreliable report generation, weak evidence grounding, and opaque reasoning. We propose MedCollab, an IBIS-guided multi-agent framework for…

Multiagent Systems · Computer Science 2026-05-27 Yuqi Zhan , Xinyue Wu , Tianyu Lin , Yutong Bao , Xiaoyu Wang , Weihao Cheng , Huangwei Chen , Feiwei Qin , Zhu Zhu

Vision-language models (VLMs) show promise in drafting radiology reports, yet they frequently suffer from logical inconsistencies, generating diagnostic impressions unsupported by their own perceptual findings or missing logically entailed…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Vikash Singh , Debargha Ganguly , Haotian Yu , Chengwei Zhou , Prerna Singh , Brandon Lee , Vipin Chaudhary , Gourav Datta

Medical image grounding aims to align natural language phrases with specific regions in medical images, serving as a foundational task for intelligent diagnosis, visual question answering (VQA), and automated report generation (MRG).…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Ziye Deng , Ruihan He , Jiaxiang Liu , Yuan Wang , Zijie Meng , Songtao Jiang , Yong Xie , Zuozhu Liu