中文
相关论文

相关论文: Apriel-1.5-OpenReasoner: RL Post-Training for Gene…

200 篇论文

We introduce Open-Reasoner-Zero, the first open source implementation of large-scale reasoning-oriented RL training on the base model focusing on scalability, simplicity and accessibility. Through extensive experiments, we demonstrate that…

机器学习 · 计算机科学 2025-07-08 Jingcheng Hu , Yinmin Zhang , Qi Han , Daxin Jiang , Xiangyu Zhang , Heung-Yeung Shum

Rule-based reasoning is acknowledged as one of the fundamental problems of reasoning. While recent studies show that large reasoning models (LRMs) have remarkable reasoning capabilities enhanced by reinforcement learning (RL), real…

计算与语言 · 计算机科学 2026-02-17 Yang Liu , Jiaqi Li , Zilong Zheng

Recent advances in reinforcement learning for large language models have converged on increasing complexity: multi-stage training pipelines, dynamic hyperparameter schedules, and curriculum learning strategies. This raises a fundamental…

Reinforcement learning with verifiable rewards (RLVR) has delivered impressive gains in mathematical and multimodal reasoning and has become a standard post-training paradigm for contemporary language and vision-language models. However,…

机器学习 · 计算机科学 2025-10-28 Hoang Phan , Xianjun Yang , Kevin Yao , Jingyu Zhang , Shengjie Bi , Xiaocheng Tang , Madian Khabsa , Lijuan Liu , Deren Lei

Recent advances in reasoning-centric language models have highlighted reinforcement learning (RL) as a promising method for aligning models with verifiable rewards. However, it remains contentious whether RL truly expands a model's…

计算与语言 · 计算机科学 2025-06-02 Mingjie Liu , Shizhe Diao , Ximing Lu , Jian Hu , Xin Dong , Yejin Choi , Jan Kautz , Yi Dong

Despite advances in multilingual capabilities, most large language models (LLMs) remain English-centric in their training and, crucially, in their production of reasoning traces. Even when tasked with non-English problems, these models…

Reinforcement learning with verifiable rewards (RLVR) has proven effective in eliciting complex reasoning in large language models (LLMs). However, standard RLVR training often leads to excessively verbose processes (in reasoning tasks) and…

人工智能 · 计算机科学 2025-10-01 Gang Li , Yulei Qin , Xiaoyu Tan , Dingkang Yang , Yuchen Shi , Zihan Xu , Xiang Li , Xing Sun , Ke Li

Reinforcement Learning with Verifiable Rewards (RLVR) has been an effective approach for improving Large Language Models' reasoning in domains such as coding and mathematics. Here, we apply RLVR methods towards forecasting future real-world…

机器学习 · 计算机科学 2025-12-02 Benjamin Turtel , Danny Franklin , Kris Skotheim , Luke Hewitt , Philipp Schoenegger

Reasoning abilities, especially those for solving complex math problems, are crucial components of general intelligence. Recent advances by proprietary companies, such as o-series models of OpenAI, have made remarkable progress on reasoning…

To enhance the safety of VLMs, this paper introduces a novel reasoning-based VLM guard model dubbed GuardReasoner-VL. The core idea is to incentivize the guard model to deliberatively reason before making moderation decisions via online RL.…

While reinforcement learning with verifiable rewards (RLVR) significantly enhances LLM reasoning by optimizing the conditional distribution P(y|x), its potential is fundamentally bounded by the base model's existing output distribution.…

机器学习 · 计算机科学 2026-04-16 Yuqiao Tan , Minzheng Wang , Bo Liu , Zichen Liu , Tian Liang , Shizhu He , Jun Zhao , Kang Liu

Reinforcement learning with verifiable rewards (RLVR) has demonstrated significant success in enhancing mathematical reasoning and coding performance of large language models (LLMs), especially when structured reference answers are…

计算与语言 · 计算机科学 2025-04-02 Yi Su , Dian Yu , Linfeng Song , Juntao Li , Haitao Mi , Zhaopeng Tu , Min Zhang , Dong Yu

Long chain-of-thought (CoT) significantly enhances the reasoning capabilities of large language models (LLMs). However, extensive reasoning traces lead to inefficiencies and increased time-to-first-token (TTFT). We propose a training…

计算与语言 · 计算机科学 2026-01-08 Roy Xie , David Qiu , Deepak Gopinath , Dong Lin , Yanchao Sun , Chong Wang , Saloni Potdar , Bhuwan Dhingra

Recent reinforcement learning (RL) techniques have yielded impressive reasoning improvements in language models, yet it remains unclear whether post-training truly extends a model's reasoning ability beyond what it acquires during…

计算与语言 · 计算机科学 2025-12-09 Charlie Zhang , Graham Neubig , Xiang Yue

We introduce QwenLong-L1.5, a model that achieves superior long-context reasoning capabilities through systematic post-training innovations. The key technical breakthroughs of QwenLong-L1.5 are as follows: (1) Long-Context Data Synthesis…

Reinforcement Learning (RL) has shown promise in improving the reasoning abilities of Large Language Models (LLMs). However, the specific challenges of adapting RL to multimodal data and formats remain relatively unexplored. In this work,…

机器学习 · 计算机科学 2025-05-20 Zirun Guo , Minjie Hong , Tao Jin

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced the reasoning capabilities of Large Language Models (LLMs). However, methods such as GRPO and DAPO suffer from substantial computational cost, since they rely…

计算与语言 · 计算机科学 2026-03-27 Haobo Xu , Sirui Chen , Ruizhong Qiu , Yuchen Yan , Chen Luo , Monica Cheng , Jingrui He , Hanghang Tong

Reinforcement Learning with Verifiable Rewards (RLVR) significantly enhances the reasoning capability of Large Language Models (LLMs). Current RLVR approaches typically conduct training across all generated tokens, but neglect to explore…

计算与语言 · 计算机科学 2025-12-18 Yiliu Sun , Zicheng Zhao , Yang Wei , Yanfang Zhang , Chen Gong

Enhancing the reasoning capabilities of large language models (LLMs) typically relies on massive computational resources and extensive datasets, limiting accessibility for resource-constrained settings. Our study investigates the potential…

机器学习 · 计算机科学 2026-01-21 Quy-Anh Dang , Chris Ngo

Reinforcement Learning with Verifiable Rewards (RLVR) demonstrates promising potential in advancing the reasoning capabilities of LLMs. However, its success remains largely confined to mathematical and code domains. This primary limitation…

机器学习 · 计算机科学 2025-06-24 Tianyu Yu , Bo Ji , Shouli Wang , Shu Yao , Zefan Wang , Ganqu Cui , Lifan Yuan , Ning Ding , Yuan Yao , Zhiyuan Liu , Maosong Sun , Tat-Seng Chua