English
Related papers

Related papers: Aletheia: What Makes RLVR For Code Verifiers Tick?

200 papers

Code generation is important in software engineering, and Reinforcement Learning with Verifiable Rewards (RLVR) is a powerful paradigm to improve it through execution-based feedback. However, most RLVR pipelines rely on human-curated tests,…

Software Engineering · Computer Science 2026-04-10 Lishui Fan , Mouxiang Chen , Tingwei Zhu , Kui Liu , Xin Xia , Shanping Li , Zhongxin Liu

Large language models (LLMs) have shown strong performance in Verilog generation from natural language description. However, ensuring the functional correctness of the generated code remains a significant challenge. This paper introduces a…

Hardware Architecture · Computer Science 2025-04-23 Ning Wang , Bingkun Yao , Jie Zhou , Yuchen Hu , Xi Wang , Nan Guan , Zhe Jiang

Prevalent reinforcement learning~(RL) methods for fine-tuning LLM reasoners, such as GRPO or Leave-one-out PPO, abandon the learned value function in favor of empirically estimated returns. This hinders test-time compute scaling that relies…

Machine Learning · Computer Science 2026-04-14 Kusha Sareen , Morgane M Moss , Alessandro Sordoni , Rishabh Agarwal , Arian Hosseini

Reinforcement Learning with Verifiable Rewards (RLVR) significantly enhances the reasoning capabilities of Large Language Models. When applied to RLVR, Multiple-Choice Questions (MCQs) offer a scalable source of verifiable data but risk…

Computation and Language · Computer Science 2026-03-16 Xu Guo , Qiming Ge , Jian Tong , Kedi Chen , Jin Zhang , Xiaogui Yang , Xuan Gao , Haijun Lv , Zhihui Lu , Yicheng Zou , Qipeng Guo

In this paper, we investigate code-integrated reasoning, where models generate code when necessary and integrate feedback by executing it through a code interpreter. To acquire this capability, models must learn when and how to use external…

Computation and Language · Computer Science 2025-06-02 Fei Bai , Yingqian Min , Beichen Zhang , Zhipeng Chen , Wayne Xin Zhao , Lei Fang , Zheng Liu , Zhongyuan Wang , Ji-Rong Wen

LLMs for code generation are commonly evaluated in repeated-sampling settings using Pass@k, where multiple candidate programs are executed against unit tests under a finite sampling budget. While recent verifier-based reinforcement learning…

Computation and Language · Computer Science 2026-05-28 Le Bronnec Florian , Alexandre Verine , Rio Yokota , Benjamin Negrevergne

Verifiers are auxiliary models that assess the correctness of outputs generated by base large language models (LLMs). They play a crucial role in many strategies for solving reasoning-intensive problems with LLMs. Typically, verifiers are…

Artificial Intelligence · Computer Science 2025-04-24 Bartosz Piotrowski , Witold Drzewakowski , Konrad Staniszewski , Piotr Miłoś

Large language models (LLMs) can act as both problem solvers and solution verifiers, where the latter select high-quality answers from a pool of solver-generated candidates. This raises the question of under what conditions verification…

Computation and Language · Computer Science 2026-04-22 Jack Lu , Ryan Teehan , Jinran Jin , Mengye Ren

Large Reasoning Models (LRMs) demonstrate strong performance in complex tasks but often face the challenge of overthinking, leading to substantially high inference costs. Existing approaches synthesize shorter reasoning responses for LRMs…

Computation and Language · Computer Science 2026-03-02 Hexuan Deng , Wenxiang Jiao , Xuebo Liu , Jun Rao , Min Zhang

Large Language Models (LLMs) often produce hallucinated or unverifiable content, undermining their reliability in factual domains. This work investigates Reinforcement Learning with Verifiable Rewards (RLVR) as a training paradigm that…

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as a powerful paradigm for enhancing the complex reasoning capabilities of Large Reasoning Models. However, standard outcome-based supervision suffers from a critical…

Artificial Intelligence · Computer Science 2026-03-02 Yanwei Ren , Haotian Zhang , Likang Xiao , Xikai Zhang , Jiaxing Huang , Jiayan Qiu , Baosheng Yu , Quan Chen , Liu Liu

We show that reinforcement learning with verifiable rewards (RLVR) can elicit strong mathematical reasoning in certain language models even with spurious rewards that have little, no, or even negative correlation with the correct answer.…

Reinforcement Learning with Verifiable Rewards (RLVR) plays a key role in stimulating the explicit reasoning capability of Large Language Models (LLMs). We can achieve expert-level performance in some specific domains via RLVR, such as…

Artificial Intelligence · Computer Science 2026-03-12 Haoqing Wang , Xiang Long , Ziheng Li , Yilong Xu , Tingguang Li , Yehui Tang

Reinforcement learning with verifiable rewards (RLVR) has proven effective in eliciting complex reasoning in large language models (LLMs). However, standard RLVR training often leads to excessively verbose processes (in reasoning tasks) and…

Artificial Intelligence · Computer Science 2025-10-01 Gang Li , Yulei Qin , Xiaoyu Tan , Dingkang Yang , Yuchen Shi , Zihan Xu , Xiang Li , Xing Sun , Ke Li

Large language models (LLMs) excel at logical and algorithmic reasoning, yet their emotional intelligence (EQ) still lags far behind their cognitive prowess. While reinforcement learning from verifiable rewards (RLVR) has advanced in other…

Reinforcement learning with verifiable rewards (RLVR) has improved the reasoning ability of large language models, yet training remains costly because many rollouts contribute little to optimization, considering the amount of computation…

Machine Learning · Computer Science 2026-02-20 Yan Sun , Jia Guo , Stanley Kok , Zihao Wang , Zujie Wen , Zhiqiang Zhang

Reinforcement learning with verifiable rewards (RLVR) is a simple but powerful paradigm for training LLMs: sample a completion, verify it, and update. In practice, however, the verifier is almost never clean--unit tests probe only limited…

Machine Learning · Computer Science 2026-01-09 Ali Rad , Khashayar Filom , Darioush Keivan , Peyman Mohajerin Esfahani , Ehsan Kamalinejad

In this work, we present the first application of Reinforcement Learning with Verifiable Reward (RLVR) to an Omni-multimodal large language model in the context of emotion recognition, a task where both visual and audio modalities play…

Machine Learning · Computer Science 2025-03-11 Jiaxing Zhao , Xihan Wei , Liefeng Bo

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a powerful paradigm for enhancing the reasoning capabilities of LLMs. Existing research has predominantly concentrated on isolated reasoning domains such as mathematical…

Artificial Intelligence · Computer Science 2025-07-24 Yu Li , Zhuoshi Pan , Honglin Lin , Mengyuan Sun , Conghui He , Lijun Wu

Reinforcement Learning with Verifiable Rewards (RLVR) is widely used to improve reasoning in large language models, but rewards only final-answer correctness with no supervision over intermediate steps. Rubric-based methods such as Rubrics…