English
Related papers

Related papers: Stabilizing Knowledge, Promoting Reasoning: Dual-T…

200 papers

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for Large Language Model (LLM) reasoning, yet current methods face key challenges in resource allocation and policy optimization dynamics: (i) uniform rollout…

Machine Learning · Computer Science 2026-04-24 Yangyi Fang , Jiaye Lin , Xiaoliang Fu , Cong Qin , Haolin Shi , Chaowen Hu , Lu Pan , Ke Zeng , Xunliang Cai

While reinforcement learning (RL) demonstrated remarkable success in enhancing the reasoning capabilities of language models, the training dynamics of RL in LLMs remain unclear. In this work, we provide an explanation of the RL training…

Machine Learning · Computer Science 2025-09-30 Xingwu Chen , Tianle Li , Difan Zou

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), yet how visual evidence is integrated during reasoning remains poorly understood. We…

Artificial Intelligence · Computer Science 2026-02-13 Zhengbo Jiao , Shaobo Wang , Zifan Zhang , Wei Wang , Bing Zhao , Hu Wei , Linfeng Zhang

Reinforcement learning with verifiable rewards (RLVR) scales the reasoning ability of large language models (LLMs) but remains bottlenecked by limited labeled samples for continued data scaling. Reinforcement learning with intrinsic rewards…

Machine Learning · Computer Science 2025-10-13 Chuyi Tan , Peiwen Yuan , Xinglin Wang , Yiwei Li , Shaoxiong Feng , Yueqi Zhang , Jiayi Shi , Ji Zhang , Boyuan Pan , Yao Hu , Kan Li

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced the reasoning capabilities of Large Language Models (LLMs) by optimizing them against factual outcomes. However, this paradigm falters in long-context…

Computation and Language · Computer Science 2026-03-03 Guanzheng Chen , Michael Qizhe Shieh , Lidong Bing

Reinforcement Learning with Verifiable Rewards (RLVR) plays a key role in stimulating the explicit reasoning capability of Large Language Models (LLMs). We can achieve expert-level performance in some specific domains via RLVR, such as…

Artificial Intelligence · Computer Science 2026-03-12 Haoqing Wang , Xiang Long , Ziheng Li , Yilong Xu , Tingguang Li , Yehui Tang

Reinforcement learning (RL) has shown strong potential for enhancing reasoning in multimodal large language models, yet existing video reasoning methods often rely on coarse sequence-level rewards or single-factor token selection,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Ziyue Wang , Sheng Jin , Zhongrong Zuo , Jiawei Wu , Han Qiu , Qi She , Hao Zhang , Xudong Jiang

Reinforcement learning with verifiable rewards (RLVR) has substantially improved the reasoning ability of large language models (LLMs), but it often suffers from \textit{restricted exploration}, where the policy rapidly concentrates on a…

Computation and Language · Computer Science 2026-05-13 Hengrui Gu , Xiaotian Han , Yujing Bian , Feiyi Wang , Kaixiong Zhou

RL with Verifiable Rewards (RLVR) has emerged as a promising paradigm for improving the reasoning abilities of large language models (LLMs). Current methods rely primarily on policy optimization frameworks like PPO and GRPO, which follow…

Machine Learning · Computer Science 2025-09-30 Haoran He , Yuxiao Ye , Qingpeng Cai , Chen Hu , Binxing Jiao , Daxin Jiang , Ling Pan

Large language models (LLMs) and multimodal LLMs (MLL-Ms) excel at chain-of-thought reasoning but face distribution shift at test-time and a lack of verifiable supervision. Recent test-time reinforcement learning (TTRL) methods derive…

Computation and Language · Computer Science 2026-03-09 Jianghao Wu , Yasmeen George , Jin Ye , Yicheng Wu , Daniel F. Schmidt , Jianfei Cai

Reinforcement learning from verifiable rewards (RLVR) stimulates the thinking processes of large language models (LLMs), substantially enhancing their reasoning abilities on verifiable tasks. It is often assumed that similar gains should…

Computation and Language · Computer Science 2026-03-24 Kaiyuan Li , Jing-Cheng Pang , Yang Yu

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

Machine Learning · Computer Science 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

Reinforcement learning with verifiable rewards (RLVR) has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs). Unlike traditional RL approaches, RLVR leverages rule-based feedback to guide…

Computation and Language · Computer Science 2025-08-19 Jia Deng , Jie Chen , Zhipeng Chen , Daixuan Cheng , Fei Bai , Beichen Zhang , Yinqian Min , Yanzipeng Gao , Wayne Xin Zhao , Ji-Rong Wen

Recently, Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective approach to incentivizing reasoning capability in Large Multimodal Models (LMMs), while the underlying mechanisms behind this post-training paradigm…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Yun Xing , Xiaobin Hu , Qingdong He , Jiangning Zhang , Shuicheng Yan , Shijian Lu , Yu-Gang Jiang

Video reasoning has advanced with large multimodal models (LMMs), yet their inference is often a single pass that returns an answer without verifying whether the reasoning is evidence-aligned. We introduce Reinforce to Learn, Elect to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Songyuan Yang , Weijiang Yu , Jilin Ma , Ziyu Liu , Guijian Tang , Wenjing Yang , Huibin Tan , Nong Xiao

Reinforcement learning with verifiable rewards (RLVR) has delivered impressive gains in mathematical and multimodal reasoning and has become a standard post-training paradigm for contemporary language and vision-language models. However,…

Machine Learning · Computer Science 2025-10-28 Hoang Phan , Xianjun Yang , Kevin Yao , Jingyu Zhang , Shengjie Bi , Xiaocheng Tang , Madian Khabsa , Lijuan Liu , Deren Lei

While reinforcement learning with verifiable rewards (RLVR) is effective to improve the reasoning ability of large language models (LLMs), its reliance on human-annotated labels leads to the scaling up dilemma, especially for complex tasks.…

Machine Learning · Computer Science 2026-03-17 Zizhuo Zhang , Jianing Zhu , Xinmu Ge , Zihua Zhao , Zhanke Zhou , Xuan Li , Xiao Feng , Jiangchao Yao , Bo Han

Reinforcement Learning with Verifiable Rewards (RLVR) has established itself as the dominant paradigm for instilling rigorous reasoning capabilities in Large Language Models. While effective at amplifying dominant behaviors, we identify a…

Machine Learning · Computer Science 2026-02-16 Zesheng Hong , Jiadong Yu , Hui Pan

Large language models (LLMs) have exhibited remarkable performance on complex reasoning tasks, with reinforcement learning under verifiable rewards (RLVR) emerging as a principled framework for aligning model behavior with reasoning chains.…

Artificial Intelligence · Computer Science 2026-05-05 Yunjian Zhang , Sudong Wang , Yang Li , Peiran Xu , Conghao Zhou , Xiaoyue Ma , Jianing Li , Yao Zhu

Reinforcement Learning with Verifiable Rewards (RLVR) significantly enhances the reasoning capability of Large Language Models (LLMs). Current RLVR approaches typically conduct training across all generated tokens, but neglect to explore…

Computation and Language · Computer Science 2025-12-18 Yiliu Sun , Zicheng Zhao , Yang Wei , Yanfang Zhang , Chen Gong