中文
相关论文

相关论文: Diversity-Incentivized Exploration for Versatile R…

200 篇论文

The prevailing paradigm for training large reasoning models--combining Supervised Fine-Tuning (SFT) with Reinforcement Learning with Verifiable Rewards (RLVR)--is fundamentally constrained by its reliance on high-quality, human-annotated…

机器学习 · 计算机科学 2026-03-24 Yuanfu Wang , Zhixuan Liu , Xiangtian Li , Chaochao Lu , Chao Yang

Reinforcement Learning (RL) has become a compelling way to strengthen the multi step reasoning ability of Large Language Models (LLMs). However, prevalent RL paradigms still lean on sparse outcome-based rewards and limited exploration,…

人工智能 · 计算机科学 2025-10-24 Xuan Zhang , Ruixiao Li , Zhijian Zhou , Long Li , Yulei Qin , Ke Li , Xing Sun , Xiaoyu Tan , Chao Qu , Yuan Qi

Training large language models (LLMs) for complex reasoning via Reinforcement Learning with Verifiable Rewards (RLVR) is effective but limited by reliance on costly, domain-specific supervision. We explore Reinforcement Learning from…

机器学习 · 计算机科学 2026-05-19 Xuandong Zhao , Zhewei Kang , Aosong Feng , Sergey Levine , Dawn Song

Reinforcement learning (RL) has demonstrated strong potential in training large language models (LLMs) capable of complex reasoning for real-world problem solving. More recently, RL has been leveraged to create sophisticated LLM-based…

计算与语言 · 计算机科学 2025-05-22 Bowen Jin , Jinsung Yoon , Priyanka Kargupta , Sercan O. Arik , Jiawei Han

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for post-training large language models (LLMs), achieving state-of-the-art performance on tasks with structured, verifiable answers. Applying…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Yiqing Liang , Jielin Qiu , Wenhao Ding , Zuxin Liu , James Tompkin , Mengdi Xu , Mengzhou Xia , Zhengzhong Tu , Laixi Shi , Jiacheng Zhu

Reinforcement learning with verifiable rewards (RLVR) is a practical, scalable way to improve large language models on math, code, and other structured tasks. However, we argue that many headline RLVR gains are not yet well validated…

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

机器学习 · 计算机科学 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

While Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a promising post-training paradigm for Large Language Models (LLMs), its dependency on the gold label or domain-specific verifiers limits its scalability to…

机器学习 · 计算机科学 2026-05-12 Xuexiang Wen , Hang Yu , Linchao Zhu , Gaoang Wang

While Reinforcement Learning with Verifiable Rewards (RLVR) is effective for deterministically checkable tasks, many vision-language tasks are partially verifiable, demanding multi-criteria supervision (e.g., perceptual details, reasoning…

Reinforcement Learning with Verifiable Rewards (RLVR) has propelled Large Language Models in complex reasoning, yet its scalability is often hindered by a training bottleneck where performance plateaus as policy entropy collapses, signaling…

机器学习 · 计算机科学 2025-11-10 Guanhua Huang , Tingqiang Xu , Mingze Wang , Qi Yi , Xue Gong , Siheng Li , Ruibin Xiong , Kejiao Li , Yuhao Jiang , Bo Zhou

Reinforcement learning with verifiable rewards (RLVR) has shown promise in enhancing the reasoning capabilities of large language models by learning directly from outcome-based rewards. Recent RLVR works that operate under the zero setting…

机器学习 · 计算机科学 2025-10-17 Andrew Zhao , Yiran Wu , Yang Yue , Tong Wu , Quentin Xu , Yang Yue , Matthieu Lin , Shenzhi Wang , Qingyun Wu , Zilong Zheng , Gao Huang

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective approach for improving the reasoning abilities of large language models (LLMs). The Group Relative Policy Optimization (GRPO) family has demonstrated strong…

计算与语言 · 计算机科学 2025-11-10 Chenxi Liu , Junjie Liang , Yuqi Jia , Bochuan Cao , Yang Bai , Heng Huang , Xun Chen

Reinforcement learning with verifiable rewards (RLVR), which typically adopts Pass@1 as the reward, has faced the issues in balancing exploration and exploitation, causing policies to prefer conservative actions, converging to a local…

机器学习 · 计算机科学 2025-08-15 Zhipeng Chen , Xiaobo Qin , Youbin Wu , Yue Ling , Qinghao Ye , Wayne Xin Zhao , Guang Shi

Balancing exploration and exploitation is a central goal in reinforcement learning (RL). Despite recent advances in enhancing large language model (LLM) reasoning, most methods lean toward exploitation, and increasingly encounter…

计算与语言 · 计算机科学 2025-11-11 Daixuan Cheng , Shaohan Huang , Xuekai Zhu , Bo Dai , Wayne Xin Zhao , Zhenliang Zhang , Furu Wei

Large Language Models (LLMs) show great promise in complex reasoning, with Reinforcement Learning with Verifiable Rewards (RLVR) being a key enhancement strategy. However, a prevalent issue is ``superficial self-reflection'', where models…

人工智能 · 计算机科学 2025-05-20 Xiaoyuan Liu , Tian Liang , Zhiwei He , Jiahao Xu , Wenxuan Wang , Pinjia He , Zhaopeng Tu , Haitao Mi , Dong Yu

Reinforcement Learning with Verifiable Rewards (RLVR) is an emerging paradigm that significantly boosts a Large Language Model's (LLM's) reasoning abilities on complex logical tasks, such as mathematics and programming. However, we…

密码学与安全 · 计算机科学 2026-04-14 Weiyang Guo , Zesheng Shi , Zeen Zhu , Yuan Zhou , Min Zhang , Jing Li

Recently, Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective approach to incentivizing reasoning capability in Large Multimodal Models (LMMs), while the underlying mechanisms behind this post-training paradigm…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Yun Xing , Xiaobin Hu , Qingdong He , Jiangning Zhang , Shuicheng Yan , Shijian Lu , Yu-Gang Jiang

Recent work on reinforcement learning with verifiable rewards (RLVR) has shown that large language models (LLMs) can be substantially improved using outcome-level verification signals, such as unit tests for code or exact-match checks for…

计算与语言 · 计算机科学 2026-01-27 Massimiliano Pronesti , Anya Belz , Yufang Hou

Reinforcement learning with verifiable rewards (RLVR) improves language model reasoning by using rule-based rewards in verifiable domains such as mathematics and code. However, RLVR leads to limited generalization for open-ended tasks --…

计算与语言 · 计算机科学 2025-09-25 Adithya Bhaskar , Xi Ye , Danqi Chen

Recently, reinforcement learning with verifiable rewards (RLVR) has been widely used for enhancing the reasoning abilities of large language models (LLMs). A core challenge in RLVR involves managing the exchange between entropy and…

计算与语言 · 计算机科学 2025-08-05 Jia Deng , Jie Chen , Zhipeng Chen , Wayne Xin Zhao , Ji-Rong Wen