English
Related papers

Related papers: MedSG-Bench: A Benchmark for Medical Image Sequenc…

200 papers

Accurately grounding regions of interest (ROIs) is critical for diagnosis and treatment planning in medical imaging. While multimodal large language models (MLLMs) combine visual perception with natural language, current medical-grounding…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Zhonghao Yan , Muxi Diao , Yuxuan Yang , Ruoyan Jing , Jiayuan Xu , Kaizhou Zhang , Lele Yang , Yanxi Liu , Kongming Liang , Zhanyu Ma

Medical Image Quality Assessment (IQA) serves as the first-mile safety gate for clinical AI, yet existing approaches remain constrained by scalar, score-based metrics and fail to reflect the descriptive, human-like reasoning process central…

Vision-language models (VLMs) have recently shown remarkable zero-shot performance in medical image understanding, yet their grounding ability, the extent to which textual concepts align with visual evidence, remains underexplored. In the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Haozhe Luo , Shelley Zixin Shu , Ziyu Zhou , Sebastian Otalora , Mauricio Reyes

Multimodal language models (MLMs) show promise for clinical decision support and diagnostic reasoning, raising the prospect of end-to-end automated medical image interpretation. However, clinicians are highly selective in adopting AI tools;…

Artificial Intelligence · Computer Science 2025-08-06 Mahtab Bigverdi , Wisdom Ikezogwo , Kevin Zhang , Hyewon Jeong , Mingyu Lu , Sungjae Cho , Linda Shapiro , Ranjay Krishna

Spatial intelligence is essential for multimodal large language models (MLLMs) operating in the complex physical world. Existing benchmarks, however, probe only single-image relations and thus fail to assess the multi-image spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Sihan Yang , Runsen Xu , Yiman Xie , Sizhe Yang , Mo Li , Jingli Lin , Chenming Zhu , Xiaochen Chen , Haodong Duan , Xiangyu Yue , Dahua Lin , Tai Wang , Jiangmiao Pang

With the rapid development of MLLMs, evaluating their visual capabilities has become increasingly crucial. Current benchmarks primarily fall into two main types: basic perception benchmarks, which focus on local details but lack deep…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Chenhui Qiang , Zhaoyang Wei , Xumeng Han , Zipeng Wang , Siyao Li , Xiangyuan Lan , Jianbin Jiao , Zhenjun Han

Vision-language models have demonstrated impressive capabilities in general medical visual question answering, yet due to limited interpretability, it remains unclear whether their predictions reflect evidence-grounded clinical reasoning or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Wen Ma , Fucheng Niu , Zhiting Fan , Zikai Xiao , Jiaxiang Liu , Zuozhu Liu

Multimodal large language models (MLLMs) have demonstrated powerful capabilities in general spatial understanding and reasoning. However, their fine-grained spatial understanding and reasoning capabilities in complex urban scenarios have…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Jun Zhang , Jie Feng , Long Chen , Junhui Wang , Zhicheng Liu , Depeng Jin , Yong Li

Vision language models (VLMs) have shown significant promise in visual grounding for images as well as videos. In medical imaging research, VLMs represent a bridge between object detection and segmentation, and report understanding and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Andrew Seohwan Yu , Mohsen Hariri , Kunio Nakamura , Mingrui Yang , Xiaojuan Li , Vipin Chaudhary

Benchmarking spatial reasoning in multimodal large language models (MLLMs) has attracted growing interest in computer vision due to its importance for embodied AI and other agentic systems that require precise interaction with the physical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Zelin Xu , Yupu Zhang , Saugat Adhikari , Saiful Islam , Tingsong Xiao , Zibo Liu , Shigang Chen , Da Yan , Zhe Jiang

Existing medical reasoning benchmarks for vision-language models primarily focus on analyzing a patient's condition based on an image from a single visit. However, this setting deviates significantly from real-world clinical practice, where…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Junyi Zhang , Jia-Chen Gu , Wenbo Hu , Yu Zhou , Robinson Piramuthu , Nanyun Peng

Multimodal large language models have advanced rapidly, but their adoption in medicine is constrained by limited domain coverage, imperfect modality alignment, and insufficient grounded reasoning. We introduce MedMO, a medical multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Ankan Deria , Komal Kumar , Adinath Madhavrao Dukre , Eran Segal , Salman Khan , Imran Razzak

While recent multimodal large language models (MLLMs) have advanced automated ECG interpretation, they still face two key limitations: (1) insufficient multimodal synergy between time series signals and visual ECG representations, and (2)…

Computation and Language · Computer Science 2025-10-21 Xiang Lan , Feng Wu , Kai He , Qinghao Zhao , Shenda Hong , Mengling Feng

In this paper, we introduce the task of visual grounding for remote sensing data (RSVG). RSVG aims to localize the referred objects in remote sensing (RS) images with the guidance of natural language. To retrieve rich information from RS…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Yang Zhan , Zhitong Xiong , Yuan Yuan

Understanding multi-image, multi-turn scenarios is a critical yet underexplored capability for Large Vision-Language Models (LVLMs). Existing benchmarks predominantly focus on static or horizontal comparisons -- e.g., spotting visual…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Wenbo Lyu , Yingjun Du , Jinglin Zhao , Xianton Zhen , Ling Shao

Endoscopic procedures are essential for diagnosing and treating internal diseases, and multi-modal large language models (MLLMs) are increasingly applied to assist in endoscopy analysis. However, current benchmarks are limited, as they…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Shengyuan Liu , Boyun Zheng , Wenting Chen , Zhihao Peng , Zhenfei Yin , Jing Shao , Jiancong Hu , Yixuan Yuan

The rapid development of Multi-modality Large Language Models (MLLMs) has navigated a paradigm shift in computer vision, moving towards versatile foundational models. However, evaluating MLLMs in low-level visual perception and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Zicheng Zhang , Haoning Wu , Erli Zhang , Guangtao Zhai , Weisi Lin

Large Vision-Language Models (LVLMs) have achieved remarkable performance in many vision-language tasks, yet their capabilities in fine-grained visual understanding remain insufficiently evaluated. Existing benchmarks either contain limited…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Fengbin Zhu , Ziyang Liu , Xiang Yao Ng , Haohui Wu , Wenjie Wang , Fuli Feng , Chao Wang , Huanbo Luan , Tat Seng Chua

Large Vision-Language Models (LVLMs) are capable of handling diverse data types such as imaging, text, and physiological signals, and can be applied in various fields. In the medical field, LVLMs have a high potential to offer substantial…

Background: The rapid integration of foundation models into clinical practice and public health necessitates a rigorous evaluation of their true clinical reasoning capabilities beyond narrow examination success. Current benchmarks,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Dingyu Wang , Zimu Yuan , Jiajun Liu , Shanggui Liu , Nan Zhou , Tianxing Xu , Di Huang , Dong Jiang