English
Related papers

Related papers: MedEyes: Learning Dynamic Visual Focus for Medical…

200 papers

Visual reasoning abilities play a crucial role in understanding complex multimodal data, advancing both domain-specific applications and artificial general intelligence (AGI). Existing methods enhance Vision-Language Models (VLMs) through…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Huajie Tan , Yuheng Ji , Xiaoshuai Hao , Xiansheng Chen , Pengwei Wang , Zhongyuan Wang , Shanghang Zhang

Medical problem-solving demands expert knowledge and intricate reasoning. Recent studies of large language models (LLMs) attempt to ease this complexity by introducing external knowledge verification through retrieval-augmented generation…

Computation and Language · Computer Science 2026-01-19 Yue Huang , Yanyuan Chen , Dexuan Xu , Chenzhuo Zhao , Weihua Yue , Yu Huang

Large language models have achieved strong performance on medical reasoning benchmarks, yet their deployment in clinical settings demands rigorous verification to ensure factual accuracy. While reward models offer a scalable approach for…

Artificial Intelligence · Computer Science 2026-01-29 Hang Zhang , Ruheng Wang , Yuelyu Ji , Mingu Kwak , Xizhi Wu , Chenyu Li , Li Zhang , Wenqi Shi , Yifan Peng , Yanshan Wang

Video reasoning has emerged as a critical capability for multimodal large language models (MLLMs), requiring models to move beyond static perception toward coherent understanding of temporal dynamics in complex scenes. Yet existing MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Sicheng Tao , Jungang Li , Yibo Yan , Junyan Zhang , Yubo Gao , Hanqian Li , ShuHang Xun , Yuxuan Fan , Hong Chen , Jianxiang He , Xuming Hu

Explainability is critical for the clinical adoption of medical visual question answering (VQA) systems, as physicians require transparent reasoning to trust AI-generated diagnoses. We present MedXplain-VQA, a comprehensive framework…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hai-Dang Nguyen , Minh-Anh Dang , Minh-Tan Le , Minh-Tuan Le

Agentic multimodal models should not only comprehend text and images, but also actively invoke external tools, such as code execution environments and web search, and integrate these operations into reasoning. In this work, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Jack Hong , Chenxiao Zhao , ChengLin Zhu , Weiheng Lu , Guohai Xu , Xing Yu

Multimodal large language models via reinforcement learning (RL) have demonstrated remarkable capabilities in complex visual reasoning tasks, yet they remain limited in long-horizon multimodal scenarios, often suffering from visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Chenghao Li , Fusheng Hao , Xikai Zhang , Likang Xiao , Yanwei Ren , Fuxiang Wu , Quan Chen , Liu Liu

Reinforcement learning with verifiable rewards (RLVR) is a promising approach for improving the complex reasoning abilities of large language models (LLMs). However, current RLVR methods face two significant challenges: the near-miss reward…

Artificial Intelligence · Computer Science 2025-07-04 Kaiyi Zhang , Ang Lv , Jinpeng Li , Yongbo Wang , Feng Wang , Haoyuan Hu , Rui Yan

Medical Vision-Language Models have shown promising potential in clinical decision support, yet they remain prone to factual hallucinations due to insufficient grounding in localized pathological evidence. Existing medical alignment methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xiwei Liu , Yulong Li , Xinlin Zhuang , Xuhui Li , Jianxu Chen , Haolin Yang , Imran Razzak , Yutong Xie

Vision-Language Models (VLMs) have enabled interpretable medical diagnosis by integrating visual perception with linguistic reasoning. Yet, existing medical chain-of-thought (CoT) models lack explicit mechanisms to represent and enforce…

Artificial Intelligence · Computer Science 2026-05-29 Jianxin Lin , Chunzheng Zhu , Peter J. Kneuertz , Yunfei Bai , Yuan Xue

Multimodal large language models have advanced rapidly, but their adoption in medicine is constrained by limited domain coverage, imperfect modality alignment, and insufficient grounded reasoning. We introduce MedMO, a medical multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Ankan Deria , Komal Kumar , Adinath Madhavrao Dukre , Eran Segal , Salman Khan , Imran Razzak

Large Language Models (LLMs) have shown impressive capabilities in generating human-like responses. However, their lack of domain-specific knowledge limits their applicability in healthcare settings, where contextual and comprehensive…

Computation and Language · Computer Science 2024-03-14 Subash Neupane , Shaswata Mitra , Sudip Mittal , Noorbakhsh Amiri Golilarz , Shahram Rahimi , Amin Amirlatifi

Vision-language models (VLMs) have shown remarkable abilities by integrating large language models with visual inputs. However, they often fail to utilize visual evidence adequately, either depending on linguistic priors in vision-centric…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xiaojun Guo , Runyu Zhou , Yifei Wang , Qi Zhang , Chenheng Zhang , Stefanie Jegelka , Xiaohan Wang , Jiajun Chai , Guojun Yin , Wei Lin , Yisen Wang

The inability to interpret the model prediction in semantically and visually meaningful ways is a well-known shortcoming of most existing computer-aided diagnosis methods. In this paper, we propose MDNet to establish a direct multimodal…

Computer Vision and Pattern Recognition · Computer Science 2017-07-11 Zizhao Zhang , Yuanpu Xie , Fuyong Xing , Mason McGough , Lin Yang

Text-guided image editors can now manipulate authentic medical scans with high fidelity, enabling lesion implantation/removal that threatens clinical trust and safety. Existing defenses are inadequate for healthcare. Medical detectors are…

Artificial Intelligence · Computer Science 2026-03-20 Zhihui Chen , Kai He , Qingyuan Lei , Bin Pu , Jian Zhang , Yuling Xu , Mengling Feng

Recent advancements in reasoning-enhanced large language models (LLMs), such as DeepSeek-R1 and OpenAI-o3, have demonstrated significant progress. However, their application in professional medical contexts remains underexplored,…

Computation and Language · Computer Science 2025-03-11 Pengcheng Qiu , Chaoyi Wu , Shuyu Liu , Weike Zhao , Zhuoxia Chen , Hongfei Gu , Chuanjin Peng , Ya Zhang , Yanfeng Wang , Weidi Xie

Different medical imaging modalities capture diagnostic information at varying spatial resolutions, from coarse global patterns to fine-grained localized structures. However, most existing vision-language frameworks in the medical domain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Shivang Chopra , Gabriela Sanchez-Rodriguez , Lingchao Mao , Andrew J Feola , Jing Li , Zsolt Kira

Large Language Models (LLMs) are increasingly applied to medicine, yet their adoption is limited by concerns over reliability and safety. Existing evaluations either test factual medical knowledge in isolation or assess patient-level…

Computation and Language · Computer Science 2026-05-08 Zhan Qu , Michael Färber

Embodied planning requires agents to make coherent multi-step decisions based on dynamic visual observations and natural language goals. While recent vision-language models (VLMs) excel at static perception tasks, they struggle with the…

Artificial Intelligence · Computer Science 2025-07-15 Di Wu , Jiaxin Fan , Junzhe Zang , Guanbo Wang , Wei Yin , Wenhao Li , Bo Jin

Medical Visual Question Answering (MedVQA) presents a significant opportunity to enhance diagnostic accuracy and healthcare delivery by leveraging artificial intelligence to interpret and answer questions based on medical images. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Xiaoman Zhang , Chaoyi Wu , Ziheng Zhao , Weixiong Lin , Ya Zhang , Yanfeng Wang , Weidi Xie