English
Related papers

Related papers: Reinforcement Learning with Robust Rubric Rewards

200 papers

Recent advances in reinforcement learning with verifiable rewards (RLVR) show that large language models enhance their reasoning abilities when trained with verifiable signals. However, due to reward sparsity, effectiveness depends heavily…

Computation and Language · Computer Science 2026-01-27 Sanghwan Bae , Jiwoo Hong , Min Young Lee , Hanbyul Kim , JeongYeon Nam , Donghyun Kwak

Reinforcement learning with verifiable rewards (RLVR) has demonstrated superior performance in enhancing the reasoning capability of large language models (LLMs). However, this accuracy-oriented learning paradigm often suffers from entropy…

Artificial Intelligence · Computer Science 2026-01-19 Hongye Cao , Zhixin Bai , Ziyue Peng , Boyan Wang , Tianpei Yang , Jing Huo , Yuyao Zhang , Yang Gao

Reinforcement learning with verifiable rewards (RLVR) has proven effective in eliciting complex reasoning in large language models (LLMs). However, standard RLVR training often leads to excessively verbose processes (in reasoning tasks) and…

Artificial Intelligence · Computer Science 2025-10-01 Gang Li , Yulei Qin , Xiaoyu Tan , Dingkang Yang , Yuchen Shi , Zihan Xu , Xiang Li , Xing Sun , Ke Li

Reinforcement learning with verifiable rewards (RLVR) is a simple but powerful paradigm for training LLMs: sample a completion, verify it, and update. In practice, however, the verifier is almost never clean--unit tests probe only limited…

Machine Learning · Computer Science 2026-01-09 Ali Rad , Khashayar Filom , Darioush Keivan , Peyman Mohajerin Esfahani , Ehsan Kamalinejad

Reinforcement learning with verifiable rewards (RLVR) has improved the reasoning ability of large language models, yet training remains costly because many rollouts contribute little to optimization, considering the amount of computation…

Machine Learning · Computer Science 2026-02-20 Yan Sun , Jia Guo , Stanley Kok , Zihao Wang , Zujie Wen , Zhiqiang Zhang

Reinforcement learning with verifiable rewards (RLVR) has demonstrated promising potential to enhance the reasoning capabilities of large language models (LLMs) in domains such as mathematics and coding. However, its applications on…

Computation and Language · Computer Science 2026-05-19 Zhonghang Yuan , Zhefan Wang , Fang Hu , Zihong Chen , Jinzhe Li , Gang Li , Jie Ying , Huanjun Kong , Songyang Zhang , Nanqing Dong

Reinforcement Learning with Verifiable Rewards (RLVR) effectively trains reasoning models that rely on abundant perfect labels, but its vulnerability to unavoidable noisy labels due to expert scarcity remains critically underexplored. In…

Machine Learning · Computer Science 2026-04-07 Shenzhi Yang , Guangcheng Zhu , Bowen Song , Sharon Li , Haobo Wang , Xing Zheng , Yingfan Ma , Zhongqi Chen , Weiqiang Wang , Gang Chen

Reinforcement learning with verifiable rewards (RLVR) is central to training modern reasoning models, but the undisclosed training data raises concerns about benchmark contamination. Unlike pretraining methods, which optimize models using…

Artificial Intelligence · Computer Science 2026-02-13 Hongbo Zhang , Yue Yang , Jianhao Yan , Guangsheng Bao , Yue Zhang , Yue Zhang

Vision-Language Models (VLMs) frequently suffer from visual perception errors and hallucinations that compromise answer accuracy in complex reasoning tasks. Reinforcement Learning with Verifiable Rewards (RLVR) offers a promising solution…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yin Zhang , Jiaxuan Zhao , Zonghan Wu , Zengxiang Li , Junfeng Fang , Kun Wang , Qingsong Wen , Yilei Shao

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a powerful paradigm for enhancing the reasoning capabilities of LLMs. Existing research has predominantly concentrated on isolated reasoning domains such as mathematical…

Artificial Intelligence · Computer Science 2025-07-24 Yu Li , Zhuoshi Pan , Honglin Lin , Mengyuan Sun , Conghui He , Lijun Wu

Reinforcement learning with verifiable rewards (RLVR) has substantially improved the reasoning capabilities of large language models. While existing analyses identify that RLVR-induced changes are sparse, they primarily focus on the…

Reinforcement learning with verifiable rewards (RLVR) has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs). Unlike traditional RL approaches, RLVR leverages rule-based feedback to guide…

Computation and Language · Computer Science 2025-08-19 Jia Deng , Jie Chen , Zhipeng Chen , Daixuan Cheng , Fei Bai , Beichen Zhang , Yinqian Min , Yanzipeng Gao , Wayne Xin Zhao , Ji-Rong Wen

Reinforcement Learning with Verifiable Rewards (RLVR) has become a prominent method for post-training Large Language Models (LLMs). However, verifiers are rarely error-free; even deterministic checks can be inaccurate, and the growing…

Machine Learning · Computer Science 2026-04-10 Andreas Plesner , Francisco Guzmán , Anish Athalye

Recent advances in large language and vision-language models have enabled strong reasoning capabilities, yet they remain impractical for specialized domains like remote sensing, where annotated data is scarce and expensive. We present the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Aybora Koksal , A. Aydin Alatan

We propose Reinforcement Learning with Explicit Human Values (RLEV), a method that aligns Large Language Model (LLM) optimization directly with quantifiable human value signals. While Reinforcement Learning with Verifiable Rewards (RLVR)…

Machine Learning · Computer Science 2025-10-24 Dian Yu , Yulai Zhao , Kishan Panaganti , Linfeng Song , Haitao Mi , Dong Yu

Recently DeepSeek R1 has shown that reinforcement learning (RL) can substantially improve the reasoning capabilities of Large Language Models (LLMs) through a simple yet effective design. The core of R1 lies in its rule-based reward…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Haozhan Shen , Peng Liu , Jingcheng Li , Chunxin Fang , Yibo Ma , Jiajia Liao , Qiaoli Shen , Zilun Zhang , Kangjia Zhao , Qianqian Zhang , Ruochen Xu , Tiancheng Zhao

Reinforcement Learning with Verifiable Rewards (RLVR) demonstrates promising potential in advancing the reasoning capabilities of LLMs. However, its success remains largely confined to mathematical and code domains. This primary limitation…

Machine Learning · Computer Science 2025-06-24 Tianyu Yu , Bo Ji , Shouli Wang , Shu Yao , Zefan Wang , Ganqu Cui , Lifan Yuan , Ning Ding , Yuan Yao , Zhiyuan Liu , Maosong Sun , Tat-Seng Chua

Reinforcement learning with verifiable rewards (RLVR) improves language model reasoning by using rule-based rewards in verifiable domains such as mathematics and code. However, RLVR leads to limited generalization for open-ended tasks --…

Computation and Language · Computer Science 2025-09-25 Adithya Bhaskar , Xi Ye , Danqi Chen

Large Language Models (LLMs) show great promise in complex reasoning, with Reinforcement Learning with Verifiable Rewards (RLVR) being a key enhancement strategy. However, a prevalent issue is ``superficial self-reflection'', where models…

Artificial Intelligence · Computer Science 2025-05-20 Xiaoyuan Liu , Tian Liang , Zhiwei He , Jiahao Xu , Wenxuan Wang , Pinjia He , Zhaopeng Tu , Haitao Mi , Dong Yu

Reinforcement learning with verifiable rewards (RLVR) has emerged as a promising paradigm for post-training large language models (LLMs) on complex reasoning tasks. Yet, the conditions under which RLVR yields robust generalization remain…

Machine Learning · Computer Science 2026-03-05 Brian Lu , Hongyu Zhao , Shuo Sun , Hao Peng , Rui Ding , Hongyuan Mei