中文
相关论文

相关论文: Stable and Efficient Single-Rollout RL for Multimo…

200 篇论文

Recent advances in Large Language Models (LLMs) have transformed text-to-speech (TTS) synthesis, inspiring autoregressive frameworks that represent speech as sequences of discrete codec tokens. Among them, single-codebook TTS LLMs have…

声音 · 计算机科学 2025-11-27 Yicheng Zhong , Peiji Yang , Zhisheng Wang

Reinforcement Learning with Verifiable Rewards (RLVR) offers a robust mechanism for enhancing mathematical reasoning in large models. However, we identify a systematic lack of emphasis on more challenging questions in existing methods from…

人工智能 · 计算机科学 2026-01-29 Yanqi Dai , Yuxiang Ji , Xiao Zhang , Yong Wang , Xiangxiang Chu , Zhiwu Lu

Video generation models produce visually coherent content but struggle with tasks requiring spatial reasoning and multi-step planning. Reinforcement learning (RL) offers a path to improve generalization, but its effectiveness in video…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Ming Liu , Yunbei Zhang , Shilong Liu , Liwen Wang , Wensheng Zhang

Reinforcement Learning with Verifiable Rewards (RLVR) is widely used to improve reasoning in large language models, but rewards only final-answer correctness with no supervision over intermediate steps. Rubric-based methods such as Rubrics…

Reinforcement learning (RL) plays a central role in improving the reasoning and alignment of large language models, yet its efficiency critically depends on how training data are selected. Existing online selection strategies predominantly…

机器学习 · 计算机科学 2026-03-03 Xinyu Zhou , Boyu Zhu , Haotian Zhang , Huiming Wang , Zhijiang Guo

Video reasoning has emerged as a critical capability for multimodal large language models (MLLMs), requiring models to move beyond static perception toward coherent understanding of temporal dynamics in complex scenes. Yet existing MLLMs…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Sicheng Tao , Jungang Li , Yibo Yan , Junyan Zhang , Yubo Gao , Hanqian Li , ShuHang Xun , Yuxuan Fan , Hong Chen , Jianxiang He , Xuming Hu

Reward design is of great importance for solving complex tasks with reinforcement learning. Recent studies have explored using image-text similarity produced by vision-language models (VLMs) to augment rewards of a task with visual…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Lirui Luo , Guoxi Zhang , Hongming Xu , Yaodong Yang , Cong Fang , Qing Li

Multi-agent LLM systems enable advanced reasoning and tool use via role specialization, yet reliable reinforcement learning (RL) post-training for such systems remains difficult. In this work, we theoretically pinpoint a key reason for…

机器学习 · 计算机科学 2026-02-10 Lang Feng , Longtao Zheng , Shuo He , Fuxiang Zhang , Bo An

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a key paradigm for post-training Large Language Models (LLMs), particularly for complex reasoning tasks. However, vanilla RLVR training has been shown to improve…

计算与语言 · 计算机科学 2025-12-16 Xiao Liang , Zhongzhi Li , Yeyun Gong , Yelong Shen , Ying Nian Wu , Zhijiang Guo , Weizhu Chen

Reinforcement Learning with Verifiable Reward (RLVR) is a powerful method for enhancing the reasoning abilities of Large Language Models, but its full potential is limited by a lack of exploration in two key areas: Depth (the difficulty of…

机器学习 · 计算机科学 2026-04-14 Zhicheng Yang , Zhijiang Guo , Yinya Huang , Yongxin Wang , Dongchun Xie , Hanhui Li , Yiwei Wang , Xiaodan Liang , Jing Tang

Reinforcement learning (RL) is effective in enhancing the accuracy of large language models in complex reasoning tasks. Existing RL policy optimization frameworks rely on final-answer correctness as feedback signals and rarely capture the…

Recent advances in large language models (LLMs) have demonstrated that reinforcement learning with verifiable rewards (RLVR) can significantly enhance reasoning abilities by directly optimizing correctness, rather than relying solely on…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Minbin Huang , Runhui Huang , Chuanyang Zheng , Jingyao Li , Guoxuan Chen , Han Shi , Hong Cheng

Reinforcement learning with verifiable rewards (RLVR) improves language model reasoning by using rule-based rewards in verifiable domains such as mathematics and code. However, RLVR leads to limited generalization for open-ended tasks --…

计算与语言 · 计算机科学 2025-09-25 Adithya Bhaskar , Xi Ye , Danqi Chen

Multimodal Large Reasoning Models (MLRMs) demonstrate impressive cross-modal reasoning but often amplify safety risks under adversarial or unsafe prompts, a phenomenon we call the \textit{Reasoning Tax}. Existing defenses mainly act at the…

机器学习 · 计算机科学 2025-10-10 Huahui Yi , Kun Wang , Qiankun Li , Miao Yu , Liang Lin , Gongli Xi , Hao Wu , Xuming Hu , Kang Li , Yang Liu

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective approach for improving the reasoning abilities of large language models (LLMs). The Group Relative Policy Optimization (GRPO) family has demonstrated strong…

计算与语言 · 计算机科学 2025-11-10 Chenxi Liu , Junjie Liang , Yuqi Jia , Bochuan Cao , Yang Bai , Heng Huang , Xun Chen

Reinforcement learning is critical to improving large reasoning models, but its success relies heavily on verifiable rewards (RLVR), making it hard to use in open-ended domains where correctness is ambiguous and cannot be verified.…

人工智能 · 计算机科学 2026-05-12 Yifan Wang , Bolian Li , David Cho , Ruqi Zhang , Fanping Sui , Ananth Grama

Reinforcement Learning with Verifiable Rewards (RLVR) has become an effective post-training method for improving the reasoning abilities of Large Language Models (LLMs). However, existing methods mainly apply uniform optimization…

计算与语言 · 计算机科学 2026-05-18 Jiakang Wang , Runze Liu , Fuzheng Zhang , Xiu Li , Guorui Zhou , Ling Pan

Since the release of Deepseek-R1, reinforcement learning with verifiable rewards (RLVR) has become a central approach for training large language models (LLMs) on reasoning tasks. Recent work has largely focused on modifying loss functions…

机器学习 · 计算机科学 2025-10-03 Weizhe Chen , Sven Koenig , Bistra Dilkina

Reinforcement learning with verifiable rewards (RLVR) has proven effective in training large reasoning models (LRMs) by leveraging answer-verifiable signals to guide policy optimization, which, however, suffers from high annotation costs.…

State-of-the-art large multi-modal models (LMMs) face challenges when processing high-resolution images, as these inputs are converted into enormous visual tokens, many of which are irrelevant to the downstream task. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Xinyu Huang , Yuhao Dong , Weiwei Tian , Bo Li , Rui Feng , Ziwei Liu