English
Related papers

Related papers: Medical thinking with multiple images

200 papers

Unified multimodal models integrate the reasoning capacity of large language models with both image understanding and generation, showing great promise for advanced multimodal intelligence. However, the community still lacks a rigorous…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Hongxiang Li , Yaowei Li , Bin Lin , Yuwei Niu , Yuhang Yang , Xiaoshuang Huang , Jiayin Cai , Xiaolong Jiang , Yao Hu , Long Chen

Vision-language models (VLMs) have achieved impressive progress in natural image reasoning, yet their potential in medical imaging remains underexplored. Medical vision-language tasks demand precise understanding and clinically coherent…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yuxiang Lai , Jike Zhong , Ming Li , Shitian Zhao , Yuheng Li , Konstantinos Psounis , Xiaofeng Yang

Text-Centric Visual Question Answering (TEC-VQA) in its proper format not only facilitates human-machine interaction in text-centric visual environments but also serves as a de facto gold proxy to evaluate AI models in the domain of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Jingqun Tang , Qi Liu , Yongjie Ye , Jinghui Lu , Shu Wei , Chunhui Lin , Wanqing Li , Mohamad Fitri Faiz Bin Mahmood , Hao Feng , Zhen Zhao , Yangfan He , Kuan Lu , Yanjie Wang , Yuliang Liu , Hao Liu , Xiang Bai , Can Huang

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance in complex multimodal tasks. However, these models still suffer from hallucinations, particularly when required to implicitly recognize or infer diverse visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ashish Seth , Dinesh Manocha , Chirag Agarwal

Accurate and interpretable multi-disease diagnosis remains a critical challenge in medical research, particularly when leveraging heterogeneous multimodal medical data. Current approaches often rely on single-modal data, limiting their…

Image and Video Processing · Electrical Eng. & Systems 2025-06-25 Yuting Zhang , Kaishen Yuan , Hao Lu , Yutao Yue , Jintai Chen , Kaishun Wu

Vision-language models (VLMs) are increasingly adapted through domain-specific fine-tuning, yet it remains unclear whether this improves reasoning beyond superficial visual cues, particularly in high-stakes domains like medicine. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Oliver McLaughlin , Daniel Shubin , Carsten Eickhoff , Ritambhara Singh , William Rudman , Michal Golovanevsky

Medical visual question answering aims to support clinical decision-making by enabling models to answer natural language questions based on medical images. While recent advances in multi-modal learning have significantly improved…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Bo Liu , Xiangyu Zhao , Along He , Yidi Chen , Huazhu Fu , Xiao-Ming Wu

Knowledge editing (KE) provides a scalable approach for updating factual knowledge in large language models without full retraining. While previous studies have demonstrated effectiveness in general domains and medical QA tasks, little…

Artificial Intelligence · Computer Science 2025-08-12 Shengtao Wen , Haodong Chen , Yadong Wang , Zhongying Pan , Xiang Chen , Yu Tian , Bo Qian , Dong Liang , Sheng-Jun Huang

The global shortage of healthcare workers has demanded the development of smart healthcare assistants, which can help monitor and alert healthcare workers when necessary. We examine the healthcare knowledge of existing Large Vision Language…

Computation and Language · Computer Science 2024-10-10 Sourjyadip Ray , Kushal Gupta , Soumi Kundu , Payal Arvind Kasat , Somak Aditya , Pawan Goyal

Medical tasks such as diagnosis and treatment planning require precise and complex reasoning, particularly in life-critical domains. Unlike mathematical reasoning, medical reasoning demands meticulous, verifiable thought processes to ensure…

Computation and Language · Computer Science 2025-04-08 Juncheng Wu , Wenlong Deng , Xingxuan Li , Sheng Liu , Taomian Mi , Yifan Peng , Ziyang Xu , Yi Liu , Hyunjin Cho , Chang-In Choi , Yihan Cao , Hui Ren , Xiang Li , Xiaoxiao Li , Yuyin Zhou

Visual Question Answering (VQA) is increasingly used in diverse applications ranging from general visual reasoning to safety-critical domains such as medical imaging and autonomous systems, where models must provide not only accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Xingjian Diao , Weiyi Wu , Keyi Kong , Peijun Qing , Xinwen Xu , Ming Cheng , Soroush Vosoughi , Jiang Gui

We introduce MMCRICBENCH-3K, a benchmark for Visual Question Answering (VQA) on cricket scorecards, designed to evaluate large vision-language models (LVLMs) on complex numerical and cross-lingual reasoning over semi-structured tabular…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Somraj Gautam , Abhirama Subramanyam Penamakuri , Abhishek Bhandari , Gaurav Harit

We introduce TableVista, a comprehensive benchmark for evaluating foundation models in multimodal table reasoning under visual and structural complexity. TableVista consists of 3,000 high-quality table reasoning problems, where each…

Computation and Language · Computer Science 2026-05-08 Zheyuan Yang , Liqiang Shang , Junjie Chen , Xun Yang , Chenglong Xu , Bo Yuan , Chenyuan Jiao , Yaoru Sun , Yilun Zhao

Vision-Language Models (VLMs) have achieved strong performance on standard vision-language benchmarks, yet often rely on surface-level recognition rather than deeper reasoning. We propose visual word puzzles as a challenging alternative, as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Ali Najar , Alireza Mirrokni , Arshia Izadyari , Sadegh Mohammadian , Amir Homayoon Sharifizade , Asal Meskin , Mobin Bagherian , Ehsaneddin Asgari

This paper introduces MedExQA, a novel benchmark in medical question-answering, to evaluate large language models' (LLMs) understanding of medical knowledge through explanations. By constructing datasets across five distinct medical…

Computation and Language · Computer Science 2024-07-04 Yunsoo Kim , Jinge Wu , Yusuf Abdulle , Honghan Wu

The rapid development of Multi-modality Large Language Models (MLLMs) has navigated a paradigm shift in computer vision, moving towards versatile foundational models. However, evaluating MLLMs in low-level visual perception and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Zicheng Zhang , Haoning Wu , Erli Zhang , Guangtao Zhai , Weisi Lin

Multimodal large language models (MLLMs) have advanced clinical tasks for common conditions, but their performance on rare diseases remains largely untested. In rare-disease scenarios, clinicians often lack prior clinical knowledge, forcing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Junzhi Ning , Jiashi Lin , Yingying Fang , Wei Li , Jiyao Liu , Cheng Tang , Chenglong Ma , Wenhao Tang , Tianbin Li , Ziyan Huang , Guang Yang , Junjun He

Evaluating large language models (LLMs) in the biomedical domain requires benchmarks that can distinguish reasoning from pattern matching and remain discriminative as model capabilities improve. Existing biomedical question answering (QA)…

NLP models today strive for supporting multiple languages and modalities, improving accessibility for diverse users. In this paper, we evaluate their multilingual, multimodal capabilities by testing on a visual reasoning task. We observe…

Computation and Language · Computer Science 2025-02-11 Yueqi Song , Simran Khanuja , Graham Neubig

Scientific visual question answering poses significant challenges for vision-language models due to the complexity of scientific figures and their multimodal context. Traditional approaches treat the figure and accompanying text (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Belal Shoer , Yova Kementchedjhieva