English
Related papers

Related papers: Open-Reasoner-Zero: An Open Source Approach to Sca…

200 papers

In this work, we present the first study to explore inference-time scaling on table reasoning tasks. We develop and evaluate two post-training strategies to enable inference-time scaling: distillation from frontier model reasoning traces…

Computation and Language · Computer Science 2025-09-29 Zheyuan Yang , Lyuhao Chen , Arman Cohan , Yilun Zhao

Process reward models (PRMs) that provide dense, step-level feedback have shown promise for reinforcement learning, yet their adoption remains limited by the need for expensive step-level annotations or ground truth references. We propose…

Machine Learning · Computer Science 2025-12-04 Salman Rahman , Sruthi Gorantla , Arpit Gupta , Swastik Roy , Nanyun Peng , Yang Liu

Large reasoning models such as OpenAI o1 and DeepSeek-R1 have demonstrated remarkable performance in complex reasoning tasks. A critical component of their training is the incorporation of reference-based reward systems within reinforcement…

Computation and Language · Computer Science 2026-02-19 Yuchen Yan , Jin Jiang , Zhenbang Ren , Yijun Li , Xudong Cai , Yang Liu , Xin Xu , Mengdi Zhang , Jian Shao , Yongliang Shen , Jun Xiao , Yueting Zhuang

Recent advancements in Large Reasoning Models (LRMs), such as OpenAI's o1/o3 and DeepSeek-R1, have demonstrated remarkable performance in specialized reasoning tasks through human-like deliberative thinking and long chain-of-thought…

Artificial Intelligence · Computer Science 2025-11-20 Weixiang Zhao , Xingyu Sui , Jiahe Guo , Yulin Hu , Yang Deng , Yanyan Zhao , Xuda Zhi , Yongbo Huang , Hao He , Wanxiang Che , Ting Liu , Bing Qin

Large language models (LLMs) have transformed sentiment analysis, yet balancing accuracy, efficiency, and explainability remains a critical challenge. This study presents the first comprehensive evaluation of DeepSeek-R1--an open-source…

Computation and Language · Computer Science 2026-02-05 Donghao Huang , Zhaoxia Wang

OpenAI o1 represents a significant milestone in Artificial Inteiligence, which achieves expert-level performances on many challanging tasks that require strong reasoning ability.OpenAI has claimed that the main techinique behinds o1 is the…

Artificial Intelligence · Computer Science 2024-12-19 Zhiyuan Zeng , Qinyuan Cheng , Zhangyue Yin , Bo Wang , Shimin Li , Yunhua Zhou , Qipeng Guo , Xuanjing Huang , Xipeng Qiu

We introduce Reward-Zero, a general-purpose implicit reward mechanism that transforms natural-language task descriptions into dense, semantically grounded progress signals for reinforcement learning (RL). Reward-Zero serves as a simple yet…

Machine Learning · Computer Science 2026-03-11 Heng Zhang , Haddy Alchaer , Arash Ajoudani , Yu She

Reinforcement learning (RL) for large language models is an energy-intensive endeavor: training can be unstable, and the policy may gradually drift away from its pretrained weights. We present \emph{RLEP}\, -- \,Reinforcement Learning with…

Computation and Language · Computer Science 2025-07-11 Hongzhi Zhang , Jia Fu , Jingyuan Zhang , Kai Fu , Qi Wang , Fuzheng Zhang , Guorui Zhou

In this paper, we survey recent advances in Reinforcement Learning (RL) for reasoning with Large Language Models (LLMs). RL has achieved remarkable success in advancing the frontier of LLM capabilities, particularly in addressing complex…

Recent advances in Reasoning LLMs (e.g., DeepSeek-R1 and OpenAI-o1) have showcased impressive reasoning capabilities via reinforcement learning. However, extending these capabilities to Multimodal LLMs (MLLMs) is hampered by the prohibitive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Hongchen Wei , Zhenzhong Chen

Existing Large Reasoning Models (LRMs) have shown the potential of reinforcement learning (RL) to enhance the complex reasoning capabilities of Large Language Models~(LLMs). While they achieve remarkable performance on challenging tasks…

Artificial Intelligence · Computer Science 2025-03-19 Huatong Song , Jinhao Jiang , Yingqian Min , Jie Chen , Zhipeng Chen , Wayne Xin Zhao , Lei Fang , Ji-Rong Wen

The growing disparity between the exponential scaling of computational resources and the finite growth of high-quality text data now constrains conventional scaling approaches for large language models (LLMs). To address this challenge, we…

Reward models (RMs) have become essential for aligning large language models (LLMs), serving as scalable proxies for human evaluation in both training and inference. However, existing RMs struggle on knowledge-intensive and long-form tasks,…

Computation and Language · Computer Science 2025-10-30 Ziyou Hu , Zhengliang Shi , Minghang Zhu , Haitao Li , Teng Sun , Pengjie Ren , Suzan Verberne , Zhaochun Ren

What does it take to build a visual reasoner that works across charts, science, spatial understanding, and open-ended tasks? The strongest vision-language models (VLMs) show such broad visual reasoning is within reach, but the recipe behind…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Gabriel Sarch , Linrong Cai , Qunzhong Wang , Haoyang Wu , Danqi Chen , Zhuang Liu

Reinforcement learning scaling enhances the reasoning capabilities of large language models, with reinforcement learning serving as the key technique to draw out complex reasoning. However, key technical details of state-of-the-art…

Machine Learning · Computer Science 2025-08-05 Xinhan Di , JoyJiaoW

Reinforcement learning (RL) has recently shown strong potential in improving the reasoning capabilities of large language models and is now being actively extended to vision-language models (VLMs). However, existing RL applications in VLMs…

Machine Learning · Computer Science 2025-04-07 Yan Ma , Steffi Chern , Xuyang Shen , Yiran Zhong , Pengfei Liu

Reinforcement learning (RL) has become a powerful approach for improving the reasoning capabilities of large language models (LLMs), as evidenced by recent successes such as OpenAI's o1 and Deepseek-R1. However, applying RL at scale remains…

Machine Learning · Computer Science 2025-06-23 Siru Ouyang , Xinyu Zhu , Zilin Xiao , Minhao Jiang , Yu Meng , Jiawei Han

Large language models have recently evolved from fluent text generation to advanced reasoning across diverse domains, giving rise to reasoning language models. Among these domains, mathematical reasoning serves as a representative benchmark…

We present AM-Thinking-v1, a 32B dense language model that advances the frontier of reasoning, embodying the collaborative spirit of open-source innovation. Outperforming DeepSeek-R1 and rivaling leading Mixture-of-Experts (MoE) models like…

Computation and Language · Computer Science 2025-05-27 Yunjie Ji , Xiaoyu Tian , Sitong Zhao , Haotian Wang , Shuaiting Chen , Yiping Peng , Han Zhao , Xiangang Li