中文
相关论文

相关论文: DRIVE: Data Curation Best Practices for Reinforcem…

200 篇论文

Reinforcement Learning with Verifiable Rewards~(RLVR) has emerged as a powerful learn-to-reason paradigm for large reasoning models to tackle complex tasks. However, the current RLVR paradigm is still not efficient enough, as it works in a…

计算与语言 · 计算机科学 2026-03-10 Junjie Zhang , Guozheng Ma , Shunyu Liu , Haoyu Wang , Jiaxing Huang , Ting-En Lin , Fei Huang , Yongbin Li , Dacheng Tao

Recent breakthroughs in large language models (LLMs) have fundamentally shifted recommender systems from discriminative to generative paradigms, where user behavior modeling is achieved by generating target items conditioned on historical…

信息检索 · 计算机科学 2025-10-15 Junfei Tan , Yuxin Chen , An Zhang , Junguang Jiang , Bin Liu , Ziru Xu , Han Zhu , Jian Xu , Bo Zheng , Xiang Wang

Video diffusion models have made rapid progress in perceptual realism and temporal coherence, but they remain primarily optimized for plausible generation rather than verifiable reasoning. This limitation is especially pronounced in tasks…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Tinghui Zhu , Sheng Zhang , James Y. Huang , Selena Song , Xiaofei Wen , Yuankai Li , Hoifung Poon , Muhao Chen

Reinforcement learning with verifiable rewards (RLVR) has emerged as a promising paradigm for post-training large language models (LLMs) on complex reasoning tasks. Yet, the conditions under which RLVR yields robust generalization remain…

机器学习 · 计算机科学 2026-03-05 Brian Lu , Hongyu Zhao , Shuo Sun , Hao Peng , Rui Ding , Hongyuan Mei

Reasoning models (RMs), language models (LMs) trained with reinforcement learning to produce long-form natural language reasoning, have been remarkably successful, but they still require large amounts of computation and data to train, and…

计算与语言 · 计算机科学 2025-10-27 Cedegao E. Zhang , Cédric Colas , Gabriel Poesia , Joshua B. Tenenbaum , Jacob Andreas

Reinforcement learning (RL) has become essential for post-training large language models (LLMs) in reasoning tasks. While scaling rollouts can stabilize training and enhance performance, the computational overhead is a critical issue. In…

机器学习 · 计算机科学 2026-03-27 Jiahao Wu , Ning Lu , Shengcai Liu , Kun Wang , Yanting Yang , Li Qing , Ke Tang

Reinforcement learning with verifiable rewards (RLVR) has emerged as a promising approach for training reasoning language models (RLMs) by leveraging supervision from verifiers. Although verifier implementation is easier than solution…

人工智能 · 计算机科学 2026-02-24 Andre He , Nathaniel Weir , Kaj Bostrom , Allen Nie , Darion Cassel , Sam Bayless , Huzefa Rangwala

Reinforcement Learning (RL) has emerged as a transformative approach for aligning and enhancing Large Language Models (LLMs), addressing critical challenges in instruction following, ethical alignment, and reasoning capabilities. This…

人工智能 · 计算机科学 2025-07-08 Saksham Sahai Srivastava , Vaneet Aggarwal

Reinforcement learning from verifiable rewards (RLVR) has shown strong promise for LLM reasoning, but outcome-based RLVR remains inefficient on hard problems because correct final-answer rollouts are rare and sample-level credit assignment…

机器学习 · 计算机科学 2026-05-22 Xitai Jiang , Zihan Tang , Wenze Lin , Yang Yue , Shenzhi Wang , Gao Huang

Long chain-of-thought (CoT) significantly enhances the reasoning capabilities of large language models (LLMs). However, extensive reasoning traces lead to inefficiencies and increased time-to-first-token (TTFT). We propose a training…

计算与语言 · 计算机科学 2026-01-08 Roy Xie , David Qiu , Deepak Gopinath , Dong Lin , Yanchao Sun , Chong Wang , Saloni Potdar , Bhuwan Dhingra

Reasoning in large language models has long been a central research focus, and recent studies employing reinforcement learning (RL) have introduced diverse methods that yield substantial performance gains with minimal or even no external…

Large Language Models (LLMs) have shown strong reasoning capabilities, with models like OpenAI's O-series and DeepSeek R1 excelling at tasks such as mathematics, coding, logic, and puzzles through Reinforcement Learning with Verifiable…

人工智能 · 计算机科学 2025-10-21 Xiaozhe Li , Xinyu Fang , Shengyuan Ding , Linyang Li , Haodong Duan , Qingwen Liu , Kai Chen

While Reinforcement Learning with Verifiable Rewards (RLVR) is effective for deterministically checkable tasks, many vision-language tasks are partially verifiable, demanding multi-criteria supervision (e.g., perceptual details, reasoning…

Reinforcement learning with verifiable rewards (RLVR) has recently advanced the reasoning capabilities of large language models (LLMs). While prior work has emphasized algorithmic design, data curation, and reward shaping, we investigate…

机器学习 · 计算机科学 2025-07-10 Xinjie Chen , Minpeng Liao , Guoxin Chen , Chengxi Li , Biao Fu , Kai Fan , Xinggao Liu

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising paradigm for enhancing reasoning in Large Language Models (LLMs). However, existing reward formulations typically treat exploration and consolidation as a…

机器学习 · 计算机科学 2026-05-15 Wenze Lin , Zhen Yang , Xitai Jiang , Xiaoteng Ma , Gao Huang

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for post-training large language models (LLMs), achieving state-of-the-art performance on tasks with structured, verifiable answers. Applying…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Yiqing Liang , Jielin Qiu , Wenhao Ding , Zuxin Liu , James Tompkin , Mengdi Xu , Mengzhou Xia , Zhengzhong Tu , Laixi Shi , Jiacheng Zhu

When applying reinforcement learning (RL) to a new problem, reward engineering is a necessary, but often difficult and error-prone task a system designer has to face. To avoid this step, we propose LR4GPM, a novel (deep) RL method that can…

机器学习 · 计算机科学 2023-03-17 Junqi Qian , Paul Weng , Chenmien Tan

The development of reasoning capabilities represents a critical frontier in large language models (LLMs) research, where reinforcement learning (RL) and process reward models (PRMs) have emerged as predominant methodological frameworks.…

人工智能 · 计算机科学 2025-12-09 Zhangying Feng , Qianglong Chen , Ning Lu , Yongqian Li , Siqi Cheng , Shuangmu Peng , Duyu Tang , Shengcai Liu , Zhirui Zhang

Reasoning large language models (LLMs) excel in complex tasks, which has drawn significant attention to reinforcement learning (RL) for LLMs. However, existing approaches allocate an equal number of rollouts to all questions during the RL…

机器学习 · 计算机科学 2025-10-21 Mengqi Liao , Xiangyu Xi , Ruinian Chen , Jia Leng , Yangen Hu , Ke Zeng , Shuai Liu , Huaiyu Wan

Recent advances in large language models (LLMs) have demonstrated that reinforcement learning with verifiable rewards (RLVR) can significantly enhance reasoning abilities by directly optimizing correctness, rather than relying solely on…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Minbin Huang , Runhui Huang , Chuanyang Zheng , Jingyao Li , Guoxuan Chen , Han Shi , Hong Cheng