中文
相关论文

相关论文: From Accuracy to Robustness: A Study of Rule- and …

200 篇论文

Reinforcement learning from verifiable rewards (RLVR) has shown strong promise for LLM reasoning, but outcome-based RLVR remains inefficient on hard problems because correct final-answer rollouts are rare and sample-level credit assignment…

机器学习 · 计算机科学 2026-05-22 Xitai Jiang , Zihan Tang , Wenze Lin , Yang Yue , Shenzhi Wang , Gao Huang

Whether Reinforcement Learning with Verifiable Rewards (RLVR) endows Large Language Models (LLMs) with new capabilities or merely elicits latent traces remains a central debate. In this work, we align with the former view, proposing a…

计算与语言 · 计算机科学 2026-02-10 Zhilin Wang , Yafu Li , Shunkai Zhang , Zhi Wang , Haoran Zhang , Xiaoye Qu , Yu Cheng

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective in enhancing the reasoning capabilities of large language models, particularly in domains such as mathematics where reliable rule-based verifiers can be constructed.…

机器学习 · 计算机科学 2026-03-12 Changyi Xiao , Caijun Xu , Yixin Cao

Reinforcement Learning with Human Feedback (RLHF) and Reinforcement Learning with Verifiable Rewards (RLVR) are the main RL paradigms used in LLM post-training, each offering distinct advantages. However, RLHF struggles with…

While model-based verifiers are essential for scaling Reinforcement Learning with Verifiable Rewards (RLVR), current outcome-centric verification paradigms primarily focus on the consistency between the final result and the ground truth,…

Reasoning in large language models has long been a central research focus, and recent studies employing reinforcement learning (RL) have introduced diverse methods that yield substantial performance gains with minimal or even no external…

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as a powerful paradigm for enhancing the complex reasoning capabilities of Large Reasoning Models. However, standard outcome-based supervision suffers from a critical…

人工智能 · 计算机科学 2026-03-02 Yanwei Ren , Haotian Zhang , Likang Xiao , Xikai Zhang , Jiaxing Huang , Jiayan Qiu , Baosheng Yu , Quan Chen , Liu Liu

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for facilitating the self-improvement of large language models (LLMs), particularly in the domain of complex reasoning tasks. However,…

机器学习 · 计算机科学 2025-07-17 Ziru Liu , Cheng Gong , Xinyu Fu , Yaofang Liu , Ran Chen , Shoubo Hu , Suiyun Zhang , Rui Liu , Qingfu Zhang , Dandan Tu

Reinforcement Learning with Verifiable Rewards (RLVR) demonstrates promising potential in advancing the reasoning capabilities of LLMs. However, its success remains largely confined to mathematical and code domains. This primary limitation…

机器学习 · 计算机科学 2025-06-24 Tianyu Yu , Bo Ji , Shouli Wang , Shu Yao , Zefan Wang , Ganqu Cui , Lifan Yuan , Ning Ding , Yuan Yao , Zhiyuan Liu , Maosong Sun , Tat-Seng Chua

Recent advances at the intersection of reinforcement learning (RL) and visual intelligence have enabled agents that not only perceive complex visual scenes but also reason, generate, and act within them. This survey offers a critical and…

计算机视觉与模式识别 · 计算机科学 2025-12-24 Weijia Wu , Chen Gao , Joya Chen , Kevin Qinghong Lin , Qingwei Meng , Yiming Zhang , Yuke Qiu , Hong Zhou , Mike Zheng Shou

Training language models to produce both correct answers and sound reasoning remains an open challenge. Reinforcement learning with verifiable rewards typically optimizes only final outcomes, which can lead to a failure mode where task…

As reinforcement Learning with Verifiable Rewards (RLVR) has become the dominant paradigm for scaling reasoning capabilities in LLMs, a new failure mode emerges: LLMs gaming verifiers. We study this phenomenon on inductive reasoning tasks,…

Reinforcement Learning with Verifiable Rewards (RLVR) has demonstrated promising gains in enhancing the reasoning capabilities of large language models. However, its dependence on domain-specific verifiers significantly restricts its…

计算与语言 · 计算机科学 2026-01-22 Chongxuan Huang , Lei Lin , Xiaodong Shi , Wenping Hu , Ruiming Tang

Reinforcement learning with verifiable rewards (RLVR) scales the reasoning ability of large language models (LLMs) but remains bottlenecked by limited labeled samples for continued data scaling. Reinforcement learning with intrinsic rewards…

机器学习 · 计算机科学 2025-10-13 Chuyi Tan , Peiwen Yuan , Xinglin Wang , Yiwei Li , Shaoxiong Feng , Yueqi Zhang , Jiayi Shi , Ji Zhang , Boyuan Pan , Yao Hu , Kan Li

Reinforcement learning with verifiable rewards (RLVR) has become central to post-training reasoning models, yet a key limitation of existing studies is their narrow view of the reasoning space: difficulty is treated as reasoning depth…

计算与语言 · 计算机科学 2026-05-27 Yihua Zhu , Qianying Liu , Fei Cheng , Jiaxin Wang , Akiko Aizawa , Sadao Kurohashi , Hidetoshi Shimodaira

Reinforcement Learning with Verifiable Rewards (RLVR) has been successfully applied to significantly boost the capabilities of pretrained large language models, especially in the math and logic problem domains. However, current research and…

计算与语言 · 计算机科学 2026-03-16 Konstantin Dobler , Simon Lehnerer , Federico Scozzafava , Jonathan Janke , Mohamed Ali

While large language models (LLMs) have demonstrated strong performance on factoid question answering, they are still prone to hallucination and untruthful responses, particularly when tasks demand information outside their parametric…

An impediment to using Large Language Models (LLMs) for reasoning output verification is that LLMs struggle to reliably identify errors in thinking traces, particularly in long outputs, domains requiring expert knowledge, and problems…

计算与语言 · 计算机科学 2026-02-09 Kate Sanders , Nathaniel Weir , Sapana Chaudhary , Kaj Bostrom , Huzefa Rangwala

Large language models (LLMs) have exhibited remarkable performance on complex reasoning tasks, with reinforcement learning under verifiable rewards (RLVR) emerging as a principled framework for aligning model behavior with reasoning chains.…

人工智能 · 计算机科学 2026-05-05 Yunjian Zhang , Sudong Wang , Yang Li , Peiran Xu , Conghao Zhou , Xiaoyue Ma , Jianing Li , Yao Zhu

Reinforcement learning with verifiable rewards (RLVR) enhances the reasoning of large language models (LLMs), but standard RLVR often depends on human-annotated answers or carefully curated reward specifications. In machine-checkable…

人工智能 · 计算机科学 2026-04-29 Xinjie Chen , Biao Fu , Jing Wu , Guoxin Chen , Xinggao Liu , Dayiheng Liu , Minpeng Liao