English
Related papers

Related papers: Reinforcement Learning with Robust Rubric Rewards

200 papers

Reinforcement learning with verifiable rewards (RLVR) is effective for training large language models on deterministic outcome reasoning tasks. Prior work shows RLVR works with few prompts, but prompt selection is often based only on…

Machine Learning · Computer Science 2026-05-07 Yujuan Pang , Jiaxin Li , Xin Sheng , Ran Peng , Yong Ma

Inspired by the success of reinforcement learning (RL) in Large Language Model (LLM) training for domains like math and code, recent works have begun exploring how to train LLMs to use search engines more effectively as tools for…

Computation and Language · Computer Science 2026-02-05 Zhichao Xu , Zongyu Wu , Yun Zhou , Aosong Feng , Kang Zhou , Sangmin Woo , Kiran Ramnath , Yijun Tian , Xuan Qi , Weikang Qiu , Lin Lee Cheong , Haibo Ding

Recently, rubrics have been used to guide LLM judges in capturing subjective, nuanced, multi-dimensional human preferences, and have been extended from evaluation to reward signals for reinforcement fine-tuning (RFT). However, rubric…

In this paper, we propose R$^3$: Learning Reasoning through Reverse Curriculum Reinforcement Learning (RL), a novel method that employs only outcome supervision to achieve the benefits of process supervision for large language models. The…

Reinforcement learning with verifiable rewards (RLVR) for Large Reasoning Models hinges on baseline estimation for variance reduction, but existing approaches pay a heavy price: PPO requires a policy-model scale critic, while GRPO needs…

Machine Learning · Computer Science 2026-05-12 Yunho Choi , Jongwon Lim , Woojin Ahn , Minjae Oh , Jeonghoon Shim , Yohan Jo

Reinforcement Learning with Verifiable Reward (RLVR) is empirically shown to notably enhance the reasoning performance of large language models (LLMs), particularly in mathematics and programming. However, the mechanistic role of Sample…

Artificial Intelligence · Computer Science 2026-05-28 Yue Cheng , Jiajun Zhang , Xiaohui Gao , Weiwei Xing , Zheng Wang , Zhanxing Zhu

Reinforcement Learning with verifiable rewards (RLVR) has emerged as a primary learning paradigm for enhancing the reasoning capabilities of multi-modal large language models (MLLMs). However, during RL training, the enormous state space of…

Machine Learning · Computer Science 2026-03-13 Zhuoxu Huang , Mengxi Jia , Hao Sun , Xuelong Li , Jungong Han

Understanding real-world videos with complex semantics and long temporal dependencies remains a fundamental challenge in computer vision. Recent progress in multimodal large language models (MLLMs) has demonstrated strong capabilities in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Hongyu Li , Songhao Han , Yue Liao , Junfeng Luo , Jialin Gao , Shuicheng Yan , Si Liu

Reinforcement learning with verifiable rewards (RLVR) has emerged as a promising paradigm for advancing complex reasoning in large language models, and recent work extends RLVR to multimodal large language models (MLLMs). This transfer,…

Computation and Language · Computer Science 2026-05-22 Changyuan Tian , Zhicong Lu , Huaxing Liu , Xiang Wang , Shuai Li , Yu Chen , Wenqian Lv , Zichuan Lin , Juncheng Diao , Deheng Ye

Reinforcement Learning from Verifiable Rewards (RLVR) has substantially enhanced the reasoning capabilities of large language models in abstract reasoning tasks. However, its application to Large Vision-Language Models (LVLMs) remains…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yuhang Han , Yuyang Wu , Zhengbo Jiao , Yiyu Wang , Xuyang Liu , Shaobo Wang , Hanlin Xu , Xuming Hu , Linfeng Zhang

Reinforcement Learning with Verifiable Rewards (RLVR) has improved the reasoning abilities of Large Language Models (LLMs) by using rule-based binary feedback. However, current RLVR methods typically assign the same reward to every token.…

Machine Learning · Computer Science 2025-10-21 Guofu Xie , Yunsheng Shi , Hongtao Tian , Ting Yao , Xiao Zhang

Large language models (LLMs) have exhibited remarkable performance on complex reasoning tasks, with reinforcement learning under verifiable rewards (RLVR) emerging as a principled framework for aligning model behavior with reasoning chains.…

Artificial Intelligence · Computer Science 2026-05-05 Yunjian Zhang , Sudong Wang , Yang Li , Peiran Xu , Conghao Zhou , Xiaoyue Ma , Jianing Li , Yao Zhu

Reinforcement learning with verifiable rewards (RLVR) has become a dominant paradigm for improving reasoning in large language models (LLMs), yet the underlying geometry of the resulting parameter trajectories remains underexplored. In this…

Machine Learning · Computer Science 2026-05-21 Zhepei Wei , Xinyu Zhu , Wei-Lin Chen , Chengsong Huang , Jiaxin Huang , Yu Meng

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as a powerful paradigm for enhancing the complex reasoning capabilities of Large Reasoning Models. However, standard outcome-based supervision suffers from a critical…

Artificial Intelligence · Computer Science 2026-03-02 Yanwei Ren , Haotian Zhang , Likang Xiao , Xikai Zhang , Jiaxing Huang , Jiayan Qiu , Baosheng Yu , Quan Chen , Liu Liu

Reinforcement learning (RL) plays a central role in improving the reasoning and alignment of large language models, yet its efficiency critically depends on how training data are selected. Existing online selection strategies predominantly…

Machine Learning · Computer Science 2026-03-03 Xinyu Zhou , Boyu Zhu , Haotian Zhang , Huiming Wang , Zhijiang Guo

Reinforcement Learning with Verifiable Rewards (RLVR) plays a key role in stimulating the explicit reasoning capability of Large Language Models (LLMs). We can achieve expert-level performance in some specific domains via RLVR, such as…

Artificial Intelligence · Computer Science 2026-03-12 Haoqing Wang , Xiang Long , Ziheng Li , Yilong Xu , Tingguang Li , Yehui Tang

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) for multimodal large language models (MLLMs) have mainly focused on improving final answer correctness and strengthening visual grounding. However, a critical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jinda Lu , Junkang Wu , Jinghan Li , Kexin Huang , Shuo Yang , Mingzhu Chen , Jiancan Wu , Kuien Liu , Xiang Wang

Reinforcement Learning with Verifiable Reward (RLVR) has significantly advanced the complex reasoning abilities of Large Language Models (LLMs). However, it struggles to break through the inherent capability boundaries of the base LLM, due…

Artificial Intelligence · Computer Science 2026-04-16 Yihong Dong , Xue Jiang , Yongding Tao , Huanyu Liu , Kechi Zhang , Lili Mou , Rongyu Cao , Yingwei Ma , Jue Chen , Binhua Li , Zhi Jin , Fei Huang , Yongbin Li , Ge Li

Reinforcement Learning with Verifiable Rewards (RLVR) has advanced the reasoning capabilities of Large Language Models (LLMs) by leveraging direct outcome verification instead of learned reward models. Building on this paradigm, Group…

Machine Learning · Computer Science 2026-04-23 Jingyi Wang , Lei Zhu , Tengjin Weng , Song-Li Wu , Haochen Tan , Jierun Chen , Chaofan Tao , Haoli Bai , Lu Hou , Lifeng Shang , Xiao-Ping Zhang

We argue that decomposing reward into weighted, verifiable criteria and using an LLM judge to score them provides a partial-credit optimization signal: instead of a binary outcome or a single holistic score, each response is graded along…

Artificial Intelligence · Computer Science 2026-05-11 Manish Bhattarai , Ismael Boureima , Nishath Rajiv Ranasinghe , Scott Pakin , Dan O'Malley