中文
相关论文

相关论文: MulFeRL: Enhancing Reinforcement Learning with Ver…

200 篇论文

Video generation models produce visually coherent content but struggle with tasks requiring spatial reasoning and multi-step planning. Reinforcement learning (RL) offers a path to improve generalization, but its effectiveness in video…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Ming Liu , Yunbei Zhang , Shilong Liu , Liwen Wang , Wensheng Zhang

Reinforcement Learning with Verifiable Rewards (RLVR) has been successfully applied to significantly boost the capabilities of pretrained large language models, especially in the math and logic problem domains. However, current research and…

计算与语言 · 计算机科学 2026-03-16 Konstantin Dobler , Simon Lehnerer , Federico Scozzafava , Jonathan Janke , Mohamed Ali

Reinforcement learning (RL) has emerged as a promising approach to improve large language model (LLM) reasoning, yet most open efforts focus narrowly on math and code, limiting our understanding of its broader applicability to general…

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

机器学习 · 计算机科学 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

Large Language Models (LLMs) have achieved remarkable advancements in reasoning capabilities empowered by Reinforcement Learning with Verifiable Rewards (RLVR). Nonetheless, RLVR intrinsically relies on ground-truth labels for reward…

机器学习 · 计算机科学 2026-05-26 Li Wang , Xiaodong Lu , Xiaohan Wang , Yikun Ban , Jiajun Chai , Wei Lin , Tianhao Peng , Guojun Yin

Reinforcement learning with verifiable rewards (RLVR) is a simple but powerful paradigm for training LLMs: sample a completion, verify it, and update. In practice, however, the verifier is almost never clean--unit tests probe only limited…

机器学习 · 计算机科学 2026-01-09 Ali Rad , Khashayar Filom , Darioush Keivan , Peyman Mohajerin Esfahani , Ehsan Kamalinejad

Post-training has become a crucial step for unlocking the capabilities of large language models, with reinforcement learning (RL) emerging as a critical paradigm. Recent RL-based post-training has increasingly split into two paradigms:…

机器学习 · 计算机科学 2026-05-18 Shangjian Yin , Yu Fu , Yue Dong , Zhouxing Shi

Reinforcement learning with verifiable rewards (RLVR) has delivered impressive gains in mathematical and multimodal reasoning and has become a standard post-training paradigm for contemporary language and vision-language models. However,…

机器学习 · 计算机科学 2025-10-28 Hoang Phan , Xianjun Yang , Kevin Yao , Jingyu Zhang , Shengjie Bi , Xiaocheng Tang , Madian Khabsa , Lijuan Liu , Deren Lei

Large Language Models (LLMs) often produce hallucinated or unverifiable content, undermining their reliability in factual domains. This work investigates Reinforcement Learning with Verifiable Rewards (RLVR) as a training paradigm that…

Reinforcement learning with verifiable rewards (RLVR) has demonstrated promising potential to enhance the reasoning capabilities of large language models (LLMs) in domains such as mathematics and coding. However, its applications on…

计算与语言 · 计算机科学 2026-05-19 Zhonghang Yuan , Zhefan Wang , Fang Hu , Zihong Chen , Jinzhe Li , Gang Li , Jie Ying , Huanjun Kong , Songyang Zhang , Nanqing Dong

Reinforcement Learning with Verifiable Rewards (RLVR) is a central paradigm for turning large language models (LLMs) into reliable problem solvers, especially in logic-heavy domains. Despite its empirical success, it remains unclear whether…

机器学习 · 计算机科学 2026-01-27 Mingyuan Fan , Weiguang Han , Daixin Wang , Cen Chen , Zhiqiang Zhang , Jun Zhou

Language models must be adapted to understand and follow user instructions. Reinforcement learning is widely used to facilitate this -- typically using fixed criteria such as "helpfulness" and "harmfulness". In our work, we instead propose…

计算与语言 · 计算机科学 2025-12-02 Vijay Viswanathan , Yanchao Sun , Shuang Ma , Xiang Kong , Meng Cao , Graham Neubig , Tongshuang Wu

Reinforcement learning (RL) with verifiable rewards (RLVR) has demonstrated the great potential of enhancing the reasoning abilities in multimodal large language models (MLLMs). However, the reliance on language-centric priors and expensive…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Jiahao Xie , Alessio Tonioni , Nathalie Rauschmayr , Federico Tombari , Bernt Schiele

Multimodal Large Language Models (MLLMs) achieve strong multimodal reasoning performance, yet we identify a recurring failure mode in long-form generation: as outputs grow longer, models progressively drift away from image evidence and fall…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Shuai Lv , Chang Liu , Feng Tang , Yujie Yuan , Aojun Zhou , Kui Zhang , Xi Yang , Yangqiu Song

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a dominant paradigm for enhancing Large Language Models (LLMs) reasoning, yet its reliance on external verifiers limits its scalability. Recent findings suggest that RLVR…

机器学习 · 计算机科学 2026-05-25 Xin-Qiang Cai , Masashi Sugiyama

Reinforcement Learning with Verifiable Rewards (RLVR) demonstrates promising potential in advancing the reasoning capabilities of LLMs. However, its success remains largely confined to mathematical and code domains. This primary limitation…

机器学习 · 计算机科学 2025-06-24 Tianyu Yu , Bo Ji , Shouli Wang , Shu Yao , Zefan Wang , Ganqu Cui , Lifan Yuan , Ning Ding , Yuan Yao , Zhiyuan Liu , Maosong Sun , Tat-Seng Chua

Reinforcement Learning (RL) has become a powerful tool for enhancing the reasoning abilities of large language models (LLMs) by optimizing their policies with reward signals. Yet, RL's success relies on the reliability of rewards, which are…

The emergence of compositional reasoning in large language models through reinforcement learning with verifiable rewards (RLVR) has been a key driver of recent empirical successes. Despite this progress, it remains unclear which…

机器学习 · 计算机科学 2026-02-10 Daniel Barzilai , Yotam Wolf , Ronen Basri

Test-time scaling has been shown to substantially improve large language models' (LLMs) mathematical reasoning. However, for a large portion of mathematical corpora, especially theorem proving, RLVR's scalability is limited: intermediate…

计算与语言 · 计算机科学 2025-11-24 Zhen Wang , Zhifeng Gao , Guolin Ke

Recent advancements in large language models (LLMs) have shifted the post-training paradigm from traditional instruction tuning and human preference alignment toward reinforcement learning (RL) focused on reasoning capabilities. However,…

人工智能 · 计算机科学 2025-11-12 Qianxi He , Qingyu Ren , Shanzhe Lei , Xuhong Wang , Yingchun Wang