中文
相关论文

相关论文: When Does RL Help Medical VLMs? Disentangling Visi…

200 篇论文

Recent advances in vision-language models (VLMs) have improved Chest X-ray (CXR) interpretation in multiple aspects. However, many medical VLMs rely solely on supervised fine-tuning (SFT), which optimizes next-token prediction without…

Recent advances in vision-language models (VLMs) reasoning have been largely attributed to the rise of reinforcement Learning (RL), which has shifted the community's focus away from the supervised fine-tuning (SFT) paradigm. Many studies…

Reinforcement learning (RL) with verifiable rewards has become a standard post-training stage for boosting visual reasoning in vision-language models, yet it remains unclear what capabilities RL actually improves compared with supervised…

计算机视觉与模式识别 · 计算机科学 2026-02-16 Xirui Li , Ming Li , Tianyi Zhou

Recently, reinforcement learning (RL)-based tuning has shifted the trajectory of Multimodal Large Language Models (MLLMs), particularly following the introduction of Group Relative Policy Optimization (GRPO). However, directly applying it…

计算与语言 · 计算机科学 2025-05-21 Wenhui Zhu , Xuanzhao Dong , Xin Li , Peijie Qiu , Xiwen Chen , Abolfazl Razi , Aris Sotiras , Yi Su , Yalin Wang

Enhancing the complex reasoning capabilities of Large Language Models (LLMs) attracts widespread attention. While reinforcement learning (RL) has shown superior performance for improving complex reasoning, its impact on cross-lingual…

计算与语言 · 计算机科学 2025-09-30 Shulin Huang , Yiran Ding , Junshu Pan , Yue Zhang

Recent advancements in Chain of Thought (COT) generation have significantly improved the reasoning capabilities of Large Language Models (LLMs), with reinforcement learning (RL) emerging as an effective post-training approach. Multimodal…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Yi Chen , Yuying Ge , Rui Wang , Yixiao Ge , Lu Qiu , Ying Shan , Xihui Liu

Reinforcement learning (RL) has recently shown strong potential in improving the reasoning capabilities of large language models and is now being actively extended to vision-language models (VLMs). However, existing RL applications in VLMs…

机器学习 · 计算机科学 2025-04-07 Yan Ma , Steffi Chern , Xuyang Shen , Yiran Zhong , Pengfei Liu

Reinforcement learning (RL) has emerged as a promising approach for eliciting reasoning chains before generating final answers. However, multimodal large language models (MLLMs) generate reasoning that lacks integration of visual…

计算机视觉与模式识别 · 计算机科学 2026-01-05 Omar Sharif , Eftekhar Hossain , Patrick Ng

In post-training for reasoning Large Language Models (LLMs), the current state of practice trains LLMs in two independent stages: Supervised Fine-Tuning (SFT) and Reinforcement Learning with Verifiable Rewards (RLVR, shortened as ``RL''…

Reinforcement learning (RL) has proven highly effective in eliciting the reasoning capabilities of large language models (LLMs). Inspired by this success, recent studies have explored applying similar techniques to vision-language models…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Yan Chen , Long Li , Teng Xi , Long Zeng , Jingdong Wang

Vision tool-use reinforcement learning (RL) can equip vision language models with visual operators such as crop-and-zoom and achieves strong performance gains, yet it remains unclear whether these gains are driven by improvements in tool…

计算机视觉与模式识别 · 计算机科学 2026-05-22 Yan Ma , Weiyu Zhang , Tianle Li , Linge Du , Xuyang Shen , Pengfei Liu

Recent Reinforcement Learning (RL) advances for Large Language Models (LLMs) have improved reasoning tasks, yet their resource-constrained application to medical imaging remains underexplored. We introduce ChexReason, a vision-language…

Recent research looks to harness the general knowledge and reasoning of large language models (LLMs) into agents that accomplish user-specified goals in interactive environments. Vision-language models (VLMs) extend LLMs to multi-modal data…

机器学习 · 计算机科学 2025-05-07 Jake Grigsby , Yuke Zhu , Michael Ryoo , Juan Carlos Niebles

Large vision-language models (VLMs) increasingly adopt post-training techniques such as long chain-of-thought (CoT) supervised fine-tuning (SFT) and reinforcement learning (RL) to elicit sophisticated reasoning. While these methods exhibit…

计算与语言 · 计算机科学 2025-07-11 Jierun Chen , Tiezheng Yu , Haoli Bai , Lewei Yao , Jiannan Wu , Kaican Li , Fei Mi , Chaofan Tao , Lei Zhu , Manyi Zhang , Xiaohui Li , Lu Hou , Lifeng Shang , Qun Liu

Recent advances in vision-language models (VLMs) emphasize long chain-of-thought reasoning; yet, we find that their performance on visual tasks is primarily limited by a lack of visual perception as opposed to reasoning itself. In this…

计算与语言 · 计算机科学 2026-05-20 Juncheng Wu , Hardy Chen , Haoqin Tu , Xianfeng Tang , Freda Shi , Hui Liu , Hanqing Lu , Cihang Xie , Yuyin Zhou

Reinforcement Fine-Tuning (RFT) is proved to be greatly valuable for enhancing the reasoning ability of LLMs. Researchers have been starting to apply RFT to MLLMs, hoping it will also enhance the capabilities of visual understanding.…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Xiaxu Chen , Wei Li , Chunxu Liu , Chi Xie , Xiaoyan Hu , Chengqian Ma , Feng Zhu , Rui Zhao

Reasoning is a critical frontier for advancing medical image analysis, where transparency and trustworthiness play a central role in both clinician trust and regulatory approval. Although Medical Visual Language Models (VLMs) show promise…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Jiazhen Pan , Che Liu , Junde Wu , Fenglin Liu , Jiayuan Zhu , Hongwei Bran Li , Chen Chen , Cheng Ouyang , Daniel Rueckert

Large Vision-Language Action (VLA) models have shown significant potential for embodied AI. However, their predominant training via supervised fine-tuning (SFT) limits generalization due to susceptibility to compounding errors under…

机器学习 · 计算机科学 2026-01-15 Jijia Liu , Feng Gao , Bingwen Wei , Xinlei Chen , Qingmin Liao , Yi Wu , Chao Yu , Yu Wang

This work revisits the dominant supervised fine-tuning (SFT) then reinforcement learning (RL) paradigm for training Large Vision-Language Models (LVLMs), and reveals a key finding: SFT can significantly undermine subsequent RL by inducing…

计算与语言 · 计算机科学 2025-04-17 Hardy Chen , Haoqin Tu , Fali Wang , Hui Liu , Xianfeng Tang , Xinya Du , Yuyin Zhou , Cihang Xie

The growing integration of vision-language models (VLMs) in medical applications offers promising support for diagnostic reasoning. However, current medical VLMs often face limitations in generalization, transparency, and computational…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Tan-Hanh Pham , Chris Ngo
‹ 上一页 1 2 3 10 下一页 ›