English
Related papers

Related papers: Two is better than one: A Collapse-free Multi-Rewa…

200 papers

Reinforcement Learning with Verifiable Rewards (RLVR) is an effective paradigm for improving the reasoning capabilities of large language models. However, existing RLVR methods utilize rollouts in an indiscriminate and short-horizon manner:…

Machine Learning · Computer Science 2026-05-26 Xiaodong Lu , Xiaohan Wang , Jiajun Chai , Guojun Yin , Wei Lin , Zhijun Chen , Yu Luo , Fuzhen Zhuang , Yikun Ban , Deqing Wang

Post-training for reasoning of large language models (LLMs) increasingly relies on verifiable rewards: deterministic checkers that provide 0-1 correctness signals. While reliable, such binary feedback is brittle--many tasks admit partially…

Computation and Language · Computer Science 2025-10-20 Leitian Tao , Ilia Kulikov , Swarnadeep Saha , Tianlu Wang , Jing Xu , Sharon Li , Jason E Weston , Ping Yu

Reinforcement learning with verifiable rewards (RLVR) has substantially improved the reasoning capabilities of large language models. While existing analyses identify that RLVR-induced changes are sparse, they primarily focus on the…

Reinforcement Learning with Verifiable Rewards (RLVR) has improved the reasoning abilities of Large Language Models (LLMs) by using rule-based binary feedback. However, current RLVR methods typically assign the same reward to every token.…

Machine Learning · Computer Science 2025-10-21 Guofu Xie , Yunsheng Shi , Hongtao Tian , Ting Yao , Xiao Zhang

Large language models (LLMs) and multimodal LLMs (MLL-Ms) excel at chain-of-thought reasoning but face distribution shift at test-time and a lack of verifiable supervision. Recent test-time reinforcement learning (TTRL) methods derive…

Computation and Language · Computer Science 2026-03-09 Jianghao Wu , Yasmeen George , Jin Ye , Yicheng Wu , Daniel F. Schmidt , Jianfei Cai

Reinforcement Learning from Verifiable Rewards (RLVR) has substantially enhanced the reasoning capabilities of large language models in abstract reasoning tasks. However, its application to Large Vision-Language Models (LVLMs) remains…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yuhang Han , Yuyang Wu , Zhengbo Jiao , Yiyu Wang , Xuyang Liu , Shaobo Wang , Hanlin Xu , Xuming Hu , Linfeng Zhang

Reinforcement learning with verifiable rewards (RLVR) has been a main driver of recent breakthroughs in large reasoning models. Yet it remains a mystery how rewards based solely on final outcomes can help overcome the long-horizon barrier…

Machine Learning · Computer Science 2026-05-07 Yu Huang , Zixin Wen , Yuejie Chi , Yuting Wei , Aarti Singh , Yingbin Liang , Yuxin Chen

Reinforcement learning with verifiers (RLVR) is a central paradigm for improving large language model (LLM) reasoning, yet existing methods often suffer from limited exploration. Policies tend to collapse onto a few reasoning patterns and…

Machine Learning · Computer Science 2026-02-24 Zhongwei Wan , Yun Shen , Zhihao Dou , Donghao Zhou , Yu Zhang , Xin Wang , Hui Shen , Jing Xiong , Chaofan Tao , Zixuan Zhong , Peizhou Huang , Mi Zhang

Reinforcement Learning with Verifiable reward (RLVR) on preference data has become the mainstream approach for training Generative Reward Models (GRMs). Typically in pairwise rewarding tasks, GRMs generate reasoning chains ending with…

Computation and Language · Computer Science 2026-05-04 Zongqi Wang , Rui Wang , Yuchuan Wu , Yiyao Yu , Pinyi Zhang , Shaoning Sun , Yujiu Yang , Yongbin Li

Reinforcement learning (RL) has significantly improved the reasoning ability of large language models. However, current reward models underperform in challenging reasoning scenarios and predominant RL training paradigms rely on rule-based…

Computation and Language · Computer Science 2025-07-30 Meng Zhou , Bei Li , Jiahao Liu , Xiaowen Shi , Yang Bai , Rongxiang Weng , Jingang Wang , Xunliang Cai

Reinforcement learning with verifiable rewards (RLVR) has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs). Unlike traditional RL approaches, RLVR leverages rule-based feedback to guide…

Computation and Language · Computer Science 2025-08-19 Jia Deng , Jie Chen , Zhipeng Chen , Daixuan Cheng , Fei Bai , Beichen Zhang , Yinqian Min , Yanzipeng Gao , Wayne Xin Zhao , Ji-Rong Wen

Reinforcement Learning with Verifiable Rewards (RLVR) has advanced the reasoning capability of large language models (LLMs), enabling autonomous agents that can conduct effective multi-turn and tool-integrated reasoning. While instructions…

Machine Learning · Computer Science 2026-02-03 Han Zhou , Xingchen Wan , Ivan Vulić , Anna Korhonen

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a core paradigm for enhancing the reasoning capabilities of Large Language Models (LLMs). To address the lack of verification signals at test time, prior studies…

Computation and Language · Computer Science 2025-10-17 Wenkai Yang , Weijie Liu , Ruobing Xie , Yiju Guo , Lulu Wu , Saiyong Yang , Yankai Lin

Reinforcement Learning from Human Feedback (RLHF) aligns Large Language Models (LLMs) with human preferences, yet the underlying reward signals they internalize remain hidden, posing a critical challenge for interpretability and safety.…

Machine Learning · Computer Science 2026-01-21 Nyal Patel , Matthieu Bou , Arjun Jagota , Satyapriya Krishna , Sonali Parbhoo

Large language models (LLMs) excel at logical and algorithmic reasoning, yet their emotional intelligence (EQ) still lags far behind their cognitive prowess. While reinforcement learning from verifiable rewards (RLVR) has advanced in other…

Reinforcement learning from verifiable rewards (RLVR) has shown strong promise for LLM reasoning, but outcome-based RLVR remains inefficient on hard problems because correct final-answer rollouts are rare and sample-level credit assignment…

Machine Learning · Computer Science 2026-05-22 Xitai Jiang , Zihan Tang , Wenze Lin , Yang Yue , Shenzhi Wang , Gao Huang

While Reinforcement Learning (RL) has been proven essential for tuning large language models (LLMs), it can lead to reward over-optimization (ROO). Existing approaches address ROO by adding KL regularization, requiring computationally…

Computation and Language · Computer Science 2024-05-01 Mathieu Rita , Florian Strub , Rahma Chaabouni , Paul Michel , Emmanuel Dupoux , Olivier Pietquin

With the growing use of Retrieval-Augmented Generation (RAG), training large language models (LLMs) for context-sensitive reasoning and faithfulness is increasingly important. Existing RAG-oriented reinforcement learning (RL) methods rely…

Computation and Language · Computer Science 2026-03-06 Zhehao Tan , Yihan Jiao , Dan Yang , Junjie Wang , Duolin Sun , Jie Feng , Xidong Wang , Lei Liu , Yue Shen , Jian Wang , Jinjie Gu

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

Machine Learning · Computer Science 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

Multimodal Large Language Models (MLLMs) exhibit impressive performance across various visual tasks. Subsequent investigations into enhancing their visual reasoning abilities have significantly expanded their performance envelope. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Yang Chen , Yufan Shen , Wenxuan Huang , Sheng Zhou , Qunshu Lin , Xinyu Cai , Zhi Yu , Jiajun Bu , Botian Shi , Yu Qiao