中文
相关论文

相关论文: Med3D-R1: Incentivizing Clinical Reasoning in 3D M…

200 篇论文

Reinforcement learning from verifiable rewards (RLVR) has recently gained attention for its ability to elicit self-evolved reasoning capabilitie from base language models without explicit reasoning supervisions, as demonstrated by…

计算与语言 · 计算机科学 2025-02-28 Sheng Zhang , Qianchu Liu , Guanghui Qin , Tristan Naumann , Hoifung Poon

Medical Vision-Language Models (MedVLMs) excel at perception tasks but struggle with complex clinical reasoning required in real-world scenarios. While reinforcement learning (RL) has been explored to enhance reasoning capabilities,…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Meidan Ding , Jipeng Zhang , Wenxuan Wang , Haiqin Zhong , Xiaoling Luo , Wenting Chen , Linlin Shen

Large vision-language models (VLMs) have made significant strides in 2D visual understanding tasks, sparking interest in extending these capabilities to 3D scene understanding. However, current 3D VLMs often struggle with robust reasoning…

计算机视觉与模式识别 · 计算机科学 2025-08-01 Ting Huang , Zeyu Zhang , Hao Tang

The diagnosis of pathological images is often limited by expert availability and regional disparities, highlighting the importance of automated diagnosis using Vision-Language Models (VLMs). Traditional multimodal models typically emphasize…

计算机视觉与模式识别 · 计算机科学 2025-04-21 Jianyu Wu , Hao Yang , Xinhua Zeng , Guibing He , Zhiyu Chen , Zihui Li , Xiaochuan Zhang , Yangyang Ma , Run Fang , Yang Liu

Recent advances in vision-language models (VLMs) have improved Chest X-ray (CXR) interpretation in multiple aspects. However, many medical VLMs rely solely on supervised fine-tuning (SFT), which optimizes next-token prediction without…

Reinforcement Learning (RL) has shown promise in improving the reasoning abilities of Large Language Models (LLMs). However, the specific challenges of adapting RL to multimodal data and formats remain relatively unexplored. In this work,…

机器学习 · 计算机科学 2025-05-20 Zirun Guo , Minjie Hong , Tao Jin

While recent advances in Reinforcement Fine-Tuning (RFT) have shown that rule-based reward schemes can enable effective post-training for large language models, their extension to cross-modal, vision-centric domains remains largely…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Guangjing Yang , ZhangYuan Yu , Ziyuan Qin , Xinyuan Song , Huahui Yi , Qingbo Kang , Jun Gao , Yiyue Li , Chenlin Du , Qicheng Lao

Multimodal large language models via reinforcement learning (RL) have demonstrated remarkable capabilities in complex visual reasoning tasks, yet they remain limited in long-horizon multimodal scenarios, often suffering from visual…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Chenghao Li , Fusheng Hao , Xikai Zhang , Likang Xiao , Yanwei Ren , Fuxiang Wu , Quan Chen , Liu Liu

Vision--Language Models (VLMs) show significant promise for Medical Visual Question Answering (VQA), yet their deployment in clinical settings is hindered by severe vulnerability to adversarial attacks. Standard adversarial training, while…

人工智能 · 计算机科学 2025-12-23 A. A. Gde Yogi Pramana , Jason Ray , Anthony Jaya , Michael Wijaya

Multimodal Reward Models (MRMs) play a crucial role in enhancing the performance of Multimodal Large Language Models (MLLMs). While recent advancements have primarily focused on improving the model structure and training data of MRMs, there…

Medical imaging has revolutionized diagnosis, yet unnecessary procedures are rising, exposing patients to radiation and stress, limiting equitable access, and straining healthcare systems. The American College of Radiology Appropriateness…

定量方法 · 定量生物学 2025-10-08 Anni Tziakouri , Filippo Menolascina

Reinforcement learning (RL) is increasingly used to post-train medical Vision-Language Models (VLMs), yet it remains unclear whether RL improves medical visual reasoning or mainly sharpens behaviors already induced by supervised fine-tuning…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Ahmadreza Jeddi , Kimia Shaban , Negin Baghbanzadeh , Natasha Sharan , Abhishek Moturu , Elham Dolatabadi , Babak Taati

Radiologic diagnostic errors-under-reading errors, inattentional blindness, and communication failures-remain prevalent in clinical practice. These issues often stem from missed localized abnormalities, limited global context, and…

计算机视觉与模式识别 · 计算机科学 2025-09-05 Yuheng Li , Yenho Chen , Yuxiang Lai , Jike Zhong , Vanessa Wildman , Xiaofeng Yang

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across diverse tasks, yet they lag significantly behind humans in spatial reasoning. We investigate this gap through Transformation-Driven Visual Reasoning…

计算机视觉与模式识别 · 计算机科学 2025-07-11 Zongzhao Li , Zongyang Ma , Mingze Li , Songyou Li , Yu Rong , Tingyang Xu , Ziqi Zhang , Deli Zhao , Wenbing Huang

Medical Question-Answering (QA) encompasses a broad spectrum of tasks, including multiple choice questions (MCQ), open-ended text generation, and complex computational reasoning. Despite this variety, a unified framework for delivering…

计算与语言 · 计算机科学 2025-06-23 Xiaotian Zhang , Yuan Wang , Zhaopeng Feng , Ruizhe Chen , Zhijie Zhou , Yan Zhang , Hongxia Xu , Jian Wu , Zuozhu Liu

Leveraging multimodal large models for image segmentation has become a prominent research direction. However, existing approaches typically rely heavily on manually annotated datasets that include explicit reasoning processes, which are…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Jiaqi Huang , Zunnan Xu , Jun Zhou , Ting Liu , Yicheng Xiao , Mingwen Ou , Bowen Ji , Xiu Li , Kehong Yuan

Recent advancements in Chain of Thought (COT) generation have significantly improved the reasoning capabilities of Large Language Models (LLMs), with reinforcement learning (RL) emerging as an effective post-training approach. Multimodal…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Yi Chen , Yuying Ge , Rui Wang , Yixiao Ge , Lu Qiu , Ying Shan , Xihui Liu

Incentivizing the reasoning ability of Multimodal Large Language Models (MLLMs) is essential for medical applications to transparently analyze medical scans and provide reliable diagnosis. However, existing medical MLLMs rely solely on…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Lehan Wang , Yi Qin , Honglong Yang , Xiaomeng Li

Reinforcement fine-tuning (RFT) has shown great promise in achieving humanlevel reasoning capabilities of Large Language Models (LLMs), and has recently been extended to MLLMs. Nevertheless, reasoning about videos, which is a fundamental…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Qi Wang , Yanrui Yu , Ye Yuan , Rui Mao , Tianfei Zhou

Medical visual grounding serves as a crucial foundation for fine-grained multimodal reasoning and interpretable clinical decision support. Despite recent advances in reinforcement learning (RL) for grounding tasks, existing approaches such…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Guangjing Yang , Ziyuan Qin , Chaoran Zhang , Chenlin Du , Jinlin Wang , Wanran Sun , Zhenyu Zhang , Bing Ji , Qicheng Lao