English
Related papers

Related papers: Learning Only with Images: Visual Reinforcement Le…

200 papers

Reinforcement Learning with Verifiable Rewards (RLVR) plays a key role in stimulating the explicit reasoning capability of Large Language Models (LLMs). We can achieve expert-level performance in some specific domains via RLVR, such as…

Artificial Intelligence · Computer Science 2026-03-12 Haoqing Wang , Xiang Long , Ziheng Li , Yilong Xu , Tingguang Li , Yehui Tang

Vision-language models (VLMs) have achieved impressive progress in natural image reasoning, yet their potential in medical imaging remains underexplored. Medical vision-language tasks demand precise understanding and clinically coherent…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yuxiang Lai , Jike Zhong , Ming Li , Shitian Zhao , Yuheng Li , Konstantinos Psounis , Xiaofeng Yang

Reinforcement learning has recently improved the reasoning ability of Large Language Models and Multimodal LLMs, yet prevailing reward designs emphasise final-answer correctness and consequently tolerate process hallucinations--cases where…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yantao Li , Qiang Hui , Chenyang Yan , Kanzhi Cheng , Fang Zhao , Chao Tan , Huanling Gao , Jianbing Zhang , Kai Wang , Xinyu Dai , Shiguo Lian

Vision-language models (VLMs) excel at multimodal understanding, yet their text-only decoding forces them to verbalize visual reasoning, limiting performance on tasks that demand visual imagination. Recent attempts train VLMs to render…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Zeyuan Yang , Xueyang Yu , Delin Chen , Maohao Shen , Chuang Gan

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across diverse tasks, yet they lag significantly behind humans in spatial reasoning. We investigate this gap through Transformation-Driven Visual Reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Zongzhao Li , Zongyang Ma , Mingze Li , Songyou Li , Yu Rong , Tingyang Xu , Ziqi Zhang , Deli Zhao , Wenbing Huang

Reasoning in vision-language models (VLMs) has recently attracted significant attention due to its broad applicability across diverse downstream tasks. However, it remains unclear whether the superior performance of VLMs stems from genuine…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Yige Xu , Yongjie Wang , Zizhuo Wu , Kaisong Song , Jun Lin , Zhiqi Shen

As textual reasoning with large language models (LLMs) has advanced significantly, there has been growing interest in enhancing the multimodal reasoning capabilities of large vision-language models (LVLMs). However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Junfei Wu , Jian Guan , Kaituo Feng , Qiang Liu , Shu Wu , Liang Wang , Wei Wu , Tieniu Tan

Reward design is of great importance for solving complex tasks with reinforcement learning. Recent studies have explored using image-text similarity produced by vision-language models (VLMs) to augment rewards of a task with visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Lirui Luo , Guoxi Zhang , Hongming Xu , Yaodong Yang , Cong Fang , Qing Li

Recent document question answering models consist of two key components: the vision encoder, which captures layout and visual elements in images, and a Large Language Model (LLM) that helps contextualize questions to the image and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Nidhi Hegde , Sujoy Paul , Gagan Madan , Gaurav Aggarwal

Vision Language Models exhibit impressive performance for various tasks, yet they often lack the sophisticated situational reasoning required for complex decision-making. This paper shows that VLMs can achieve surprisingly strong…

Computation and Language · Computer Science 2025-10-07 Zhe Hu , Jing Li , Zhongzhu Pu , Hou Pong Chan , Yu Yin

Reinforcement Fine-Tuning (RFT) with verifiable rewards has advanced large language models but remains underexplored for Vision-Language (VL) models. The Vision-Language Reward Model (VL-RM) is key to aligning VL models by providing…

Computation and Language · Computer Science 2025-06-18 Jipeng Zhang , Kehao Miao , Renjie Pi , Zhaowei Wang , Runtao Liu , Rui Pan , Tong Zhang

Multimodal Large Language Models (MLLMs) have recently been applied to universal multimodal retrieval, where Chain-of-Thought (CoT) reasoning improves candidate reranking. However, existing approaches remain largely language-driven, relying…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Dongyang Chen , Chaoyang Wang , Dezhao Su , Xi Xiao , Zeyu Zhang , Jing Xiong , Qing Li , Yuzhang Shang , Shichao Kan

Large Language Models (LLMs) show great promise in complex reasoning, with Reinforcement Learning with Verifiable Rewards (RLVR) being a key enhancement strategy. However, a prevalent issue is ``superficial self-reflection'', where models…

Artificial Intelligence · Computer Science 2025-05-20 Xiaoyuan Liu , Tian Liang , Zhiwei He , Jiahao Xu , Wenxuan Wang , Pinjia He , Zhaopeng Tu , Haitao Mi , Dong Yu

Large Language Models (LLMs) have made substantial strides in structured tasks through Reinforcement Learning (RL), demonstrating proficiency in mathematical reasoning and code generation. However, applying RL in broader domains like…

Computation and Language · Computer Science 2025-02-10 Hao Sun , Yunyi Shen , Jean-Francois Ton , Mihaela van der Schaar

Inspired by the impressive reasoning capabilities demonstrated by reinforcement learning approaches like DeepSeek-R1, recent emerging research has begun exploring the use of reinforcement learning (RL) to enhance vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Yizhen Zhang , Yang Ding , Shuoshuo Zhang , Xinchen Zhang , Haoling Li , Zhong-zhi Li , Peijie Wang , Jie Wu , Lei Ji , Yelong Shen , Yujiu Yang , Yeyun Gong

Large Vision-Language Models (LVLMs) have shown exceptional performance in multimodal tasks, but their effectiveness in complex visual reasoning is still constrained, especially when employing Chain-of-Thought prompting techniques. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Congzhi Zhang , Jiawei Peng , Zhenglin Wang , Yilong Lai , Haowen Sun , Heng Chang , Fei Ma , Weijiang Yu

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), yet how visual evidence is integrated during reasoning remains poorly understood. We…

Artificial Intelligence · Computer Science 2026-02-13 Zhengbo Jiao , Shaobo Wang , Zifan Zhang , Wei Wang , Bing Zhao , Hu Wei , Linfeng Zhang

Reinforcement learning (RL) has significantly enhanced the reasoning capabilities of large language models (LLMs), but its reliance on expensive human-labeled data or complex reward models severely limits scalability. While existing…

Artificial Intelligence · Computer Science 2025-08-19 Wenzhen Yuan , Shengji Tang , Weihao Lin , Jiacheng Ruan , Ganqu Cui , Bo Zhang , Tao Chen , Ting Liu , Yuzhuo Fu , Peng Ye , Lei Bai

Recent advances have shown success in eliciting strong reasoning abilities in multimodal large language models (MLLMs) through rule-based reinforcement learning (RL) with outcome rewards. However, this paradigm typically lacks supervision…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Kaixuan Fan , Kaituo Feng , Haoming Lyu , Dongzhan Zhou , Xiangyu Yue

Reinforcement learning (RL) has proven highly effective in eliciting the reasoning capabilities of large language models (LLMs). Inspired by this success, recent studies have explored applying similar techniques to vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Yan Chen , Long Li , Teng Xi , Long Zeng , Jingdong Wang