English
Related papers

Related papers: MedEyes: Learning Dynamic Visual Focus for Medical…

200 papers

Incentivizing the reasoning ability of Multimodal Large Language Models (MLLMs) is essential for medical applications to transparently analyze medical scans and provide reliable diagnosis. However, existing medical MLLMs rely solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Lehan Wang , Yi Qin , Honglong Yang , Xiaomeng Li

Accurate and interpretable image-based diagnosis remains a fundamental challenge in medical AI, particularly under domain shifts and rare-class conditions. Deep learning models often struggle with real-world distribution changes, exhibit…

Machine Learning · Computer Science 2025-12-13 Midhat Urooj , Ayan Banerjee , Farhat Shaikh , Kuntal Thakur , Sandeep Gupta

The clinical adoption of artificial intelligence (AI) in medical diagnostics is critically hampered by its black-box nature, which prevents clinicians from verifying the rationale behind automated decisions. To overcome this fundamental…

Recent advances in general medical AI have made significant strides, but existing models often lack the reasoning capabilities needed for complex medical decision-making. This paper presents GMAI-VL-R1, a multimodal medical reasoning model…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yanzhou Su , Tianbin Li , Jiyao Liu , Chenglong Ma , Junzhi Ning , Cheng Tang , Sibo Ju , Jin Ye , Pengcheng Chen , Ming Hu , Shixiang Tang , Lihao Liu , Bin Fu , Wenqi Shao , Xiaowei Hu , Xiangwen Liao , Yuanfeng Ji , Junjun He

While mainstream vision-language models (VLMs) have advanced rapidly in understanding image level information, they still lack the ability to focus on specific areas designated by humans. Rather, they typically rely on large volumes of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Kangyu Zhu , Ziyuan Qin , Huahui Yi , Zekun Jiang , Qicheng Lao , Shaoting Zhang , Kang Li

Large language models (LLMs) have demonstrated strong performance and rapid progress in a wide range of medical reasoning tasks. However, their sequential autoregressive decoding forces inherently parallel clinical reasoning, such as…

Machine Learning · Computer Science 2026-04-17 Jianwen Chen , Xinyu Yang , Peng Xia , Arian Azarang , Yueh Z Lee , Gang Li , Hongtu Zhu , Yun Li , Beidi Chen , Huaxiu Yao

Reinforcement learning from verifiable rewards (RLVR) has recently gained attention for its ability to elicit self-evolved reasoning capabilitie from base language models without explicit reasoning supervisions, as demonstrated by…

Computation and Language · Computer Science 2025-02-28 Sheng Zhang , Qianchu Liu , Guanghui Qin , Tristan Naumann , Hoifung Poon

Medical visual grounding serves as a crucial foundation for fine-grained multimodal reasoning and interpretable clinical decision support. Despite recent advances in reinforcement learning (RL) for grounding tasks, existing approaches such…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Guangjing Yang , Ziyuan Qin , Chaoran Zhang , Chenlin Du , Jinlin Wang , Wanran Sun , Zhenyu Zhang , Bing Ji , Qicheng Lao

Despite remarkable advancements in pixel-level medical image perception, existing methods are either limited to specific tasks or heavily rely on accurate bounding boxes or text labels as input prompts. However, the medical knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Qinyue Tong , Ziqian Lu , Jun Liu , Yangming Zheng , Zheming Lu

Existing multimodal search agents process target entities sequentially, issuing one tool call per entity and accumulating redundant interaction rounds whenever a query decomposes into independent sub-retrievals. We argue that effective…

Machine Learning · Computer Science 2026-05-12 Guankai Li , Jiabin Chen , Yi Xu , Xichen Zhang , Yuan Lu

Artificial intelligence has advanced in Medical Visual Question Answering (Med-VQA), but prevalent research tends to focus on the accuracy of the answers, often overlooking the reasoning paths and interpretability, which are crucial in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Jiaxiang Liu , Yuan Wang , Jiawei Du , Joey Tianyi Zhou , Zuozhu Liu

Medical Visual Question Answering (MedVQA), which offers language responses to image-based medical inquiries, represents a challenging task and significant advancement in healthcare. It assists medical experts to swiftly interpret medical…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Xiaotang Gai , Chenyi Zhou , Jiaxiang Liu , Yang Feng , Jian Wu , Zuozhu Liu

Volumetric Reasoning Segmentation (VRS) aims to segment a target region in a 3D medical scan from a free-form clinical query, where the referent is often implicit and requires both medical knowledge and volume-grounded reasoning. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Zichun Wang , Hairong Shi , Bingzheng Wei , Yan Xu , Zihua Wang

Recently, large models have shown significant potential for smart healthcare. However, the deployment of Large Vision-Language Models (LVLMs) for clinical services is currently hindered by three critical challenges: a tendency to…

Artificial Intelligence · Computer Science 2025-10-27 Siyong Chen , Jinbo Wen , Jiawen Kang , Tenghui Huang , Xumin Huang , Yuanjia Su , Hudan Pan , Zishao Zhong , Dusit Niyato , Shengli Xie , Dong In Kim

With the rapid growth of large language models (LLMs) and vision-language models (VLMs) in medicine, simply integrating clinical text and medical imaging does not guarantee reliable reasoning. Existing multimodal models often produce…

Artificial Intelligence · Computer Science 2025-12-29 Zelin Zang , Wenyi Gu , Siqi Ma , Dan Yang , Yue Shen , Zhu Zhang , Guohui Fan , Wing-Kuen Ling , Fuji Yang

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced reasoning capabilities in Large Language Models. However, adapting RLVR to multimodal domains suffers from a critical \textit{perception-reasoning decoupling}.…

Artificial Intelligence · Computer Science 2026-01-13 Shujian Gao , Yuan Wang , Jiangtao Yan , Zuxuan Wu , Yu-Gang Jiang

The "thinking-with-images" paradigm enables multimodal large language models (MLLMs) to actively explore visual scenes via zoom-in tools. This is essential for ultra-high-resolution (UHR) remote sensing VQA, where task-relevant cues are…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Fengxiang Wang , Mingshuo Chen , Yueying Li , Yajie Yang , Yifan Zhang , Long Lan , Xue Yang , Hongda Sun , Yulin Wang , Di Wang , Jun Song , Jing Zhang , Bo Du

While large language models hold promise for complex medical applications, their development is hindered by the scarcity of high-quality reasoning data. To address this issue, existing approaches typically distill chain-of-thought reasoning…

Machine Learning · Computer Science 2026-04-14 Haolin Li , Shuyang Jiang , Ruipeng Zhang , Jiangchao Yao , Ya Zhang , Yanfeng Wang

We introduce SeePhys Pro, a fine-grained modality transfer benchmark that studies whether models preserve the same reasoning capability when critical information is progressively transferred from text to image. Unlike standard…

Continuous Medical Education (CME) plays a vital role in physicians' ongoing professional development. Beyond immediate diagnoses, physicians utilize multimodal diagnostic data for retrospective learning, engaging in self-directed analysis…

Human-Computer Interaction · Computer Science 2024-11-26 Yuansong Xu , Jiahe Dong , Yijie Fan , Yuheng Shao , Chang Jiang , Lixia Jin , Yuanwu Cao , Quan Li