English
Related papers

Related papers: Leveraging Error Diversity in Group Rollouts for R…

200 papers

Recent applications of Reinforcement Learning with Verifiable Rewards (RLVR) to Large Language Models (LLMs) and Vision-Language Models (VLMs) have demonstrated significant success in enhancing reasoning capabilities for complex tasks.…

Computation and Language · Computer Science 2026-02-06 Fanfan Liu , Youyang Yin , Peng Shi , Siqi Yang , Zhixiong Zeng , Haibo Qiu

Large Language Models (LLMs) have achieved remarkable advancements in reasoning capabilities empowered by Reinforcement Learning with Verifiable Rewards (RLVR). Nonetheless, RLVR intrinsically relies on ground-truth labels for reward…

Machine Learning · Computer Science 2026-05-26 Li Wang , Xiaodong Lu , Xiaohan Wang , Yikun Ban , Jiajun Chai , Wei Lin , Tianhao Peng , Guojun Yin

Recently, Reinforcement Learning from Verifiable Rewards (RLVR) has been established as a highly effective technique for augmenting the math reasoning skills of Large Language Models (LLMs) based on a single instance. Current…

Machine Learning · Computer Science 2026-05-05 Rudray Dave , Vedang Dubey , Smit Deoghare , Sudhakar Mishra

Reinforcement Learning with Verifiable Reward (RLVR) is empirically shown to notably enhance the reasoning performance of large language models (LLMs), particularly in mathematics and programming. However, the mechanistic role of Sample…

Artificial Intelligence · Computer Science 2026-05-28 Yue Cheng , Jiajun Zhang , Xiaohui Gao , Weiwei Xing , Zheng Wang , Zhanxing Zhu

Group-relative RL training (GRPO) samples a small group of parallel rollouts for every training prompt and uses their within-group reward spread to compute per-trajectory advantages. In agentic environments each rollout is a long multi-turn…

Machine Learning · Computer Science 2026-05-08 Zhiyuan Zhai , Xin Wang

Equivariant diffusion policies (EDPs) combine the generative expressivity of diffusion models with the strong generalization and sample efficiency afforded by geometric symmetries. While steering these policies with reinforcement learning…

Machine Learning · Computer Science 2025-12-15 Minwoo Park , Junwoo Chang , Jongeun Choi , Roberto Horowitz

Test-time reinforcement learning (TTRL) enables large language models (LLMs) to self-improve on unlabeled inputs, but its effectiveness critically depends on how reward signals are estimated without ground-truth supervision. Most existing…

Computation and Language · Computer Science 2026-01-30 Bodong Du , Xuanqi Huang , Xiaomeng Li

Reinforcement learning with verifiable rewards (RLVR) has become a key technique for enhancing LLMs' reasoning abilities, yet its data inefficiency remains a major bottleneck. To address this critical yet challenging issue, we present a…

Machine Learning · Computer Science 2026-04-28 Shipeng Li , Zhiqin Yang , Shikun Li , Xiaobo Xia , Hengyu Liu , Xinghua Zhang , Gaode Chen , Dong Fang , Ying Tai , Zhe Peng

Recent advances in large language models (LLMs) have demonstrated significant potential in hardware design automation, particularly in using natural language to synthesize Register-Transfer Level (RTL) code. Despite this progress, a gap…

Machine Learning · Computer Science 2026-02-26 Jiahe Shi , Zhengqi Gao , Ching-Yun Ko , Duane Boning

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a key approach for enhancing LLM reasoning. However, standard frameworks like Group Relative Policy Optimization (GRPO) typically employ a uniform rollout budget, leading…

Machine Learning · Computer Science 2026-02-09 Zhiyuan Yao , Yi-Kai Zhang , Yuxin Chen , Yueqing Sun , Zishan Xu , Yu Yang , Tianhao Hu , Qi Gu , Hui Su , Xunliang Cai

Reinforcement learning (RL) systems typically optimize scalar reward functions that assume precise and reliable evaluation of outcomes. However, real-world objectives--especially those derived from human preferences--are often uncertain,…

Machine Learning · Computer Science 2026-04-30 Disha Singha

Reinforcement learning (RL) is a powerful machine learning technique that has been successfully applied to a wide variety of problems. However, it can be unpredictable and produce suboptimal results in complicated learning environments.…

Multiagent Systems · Computer Science 2024-11-19 Brian Mintz , Feng Fu

Reinforcement Learning from Verifiable Rewards (RLVR) has recently shown that large language models (LLMs) can develop their own reasoning without direct supervision. However, applications in the medical domain, specifically for question…

Machine Learning · Computer Science 2025-09-22 Mirza Farhan Bin Tarek , Rahmatollah Beheshti

Risk-sensitive reinforcement learning (RL) has garnered significant attention in recent years due to the growing interest in deploying RL agents in real-world scenarios. A critical aspect of risk awareness involves modeling highly rare risk…

Machine Learning · Computer Science 2023-08-30 Karthik Somayaji NS , Yu Wang , Malachi Schram , Jan Drgona , Mahantesh Halappanavar , Frank Liu , Peng Li

Reinforcement learning with verifiable rewards (RLVR) generates hundreds of thousands of tokens per training step, with rollout generation dominating the computational cost. The overall token budget can be controlled along two main…

Machine Learning · Computer Science 2026-05-12 Haoyu Hu , Xuandong Zhao , Xuhai "Orson'' Xu , Nori Jacoby

Reinforcement Learning with Verifiable Rewards (RLVR) is a powerful framework for improving the reasoning abilities of Large Language Models (LLMs). However, current methods such as GRPO rely only on problems where the model responses to…

Computation and Language · Computer Science 2026-02-10 Thanh-Long V. Le , Myeongho Jeon , Kim Vu , Viet Lai , Eunho Yang

Deep Reinforcement Learning (or just "RL") is gaining popularity for industrial and research applications. However, it still suffers from some key limits slowing down its widespread adoption. Its performance is sensitive to initial…

Machine Learning · Computer Science 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

Reinforcement Learning with Verifiable Rewards (RLVR), which uses simple binary feedback to post-train large language models, has found significant empirical success. However, a principled understanding of why it works is lacking. This…

Machine Learning · Computer Science 2026-05-08 Joe Suk , Yaqi Duan

By integrating dynamics models into model-free reinforcement learning (RL) methods, model-based value expansion (MVE) algorithms have shown a significant advantage in sample efficiency as well as value estimation. However, these methods…

Machine Learning · Computer Science 2019-12-12 Bo Zhou , Hongsheng Zeng , Fan Wang , Yunxiang Li , Hao Tian

Reinforcement Learning with Verifiable Rewards (RLVR) is a central paradigm for turning large language models (LLMs) into reliable problem solvers, especially in logic-heavy domains. Despite its empirical success, it remains unclear whether…

Machine Learning · Computer Science 2026-01-27 Mingyuan Fan , Weiguang Han , Daixin Wang , Cen Chen , Zhiqiang Zhang , Jun Zhou