English
Related papers

Related papers: Klear-Reasoner: Advancing Reasoning Capability via…

200 papers

Reinforcement learning with verifiable rewards (RLVR) has recently enhanced the reasoning capabilities of large language models (LLMs), particularly for mathematical problem solving. However, a fundamental limitation remains: as the…

Machine Learning · Computer Science 2025-11-03 Wenhao Deng , Long Wei , Chenglei Yu , Tailin Wu

Recently, test-time scaling Large Language Models (LLMs) have demonstrated exceptional reasoning capabilities across scientific and professional tasks by generating long chains-of-thought (CoT). As a crucial component for developing these…

Supervised Fine-Tuning (SFT) has been a go-to and effective method for enhancing long chain-of-thought (CoT) reasoning in relatively small LLMs by fine-tuning them with long CoT responses from larger LLMs. To continually improve reasoning…

Machine Learning · Computer Science 2025-02-20 Wang Yang , Hongye Jin , Jingfeng Yang , Vipin Chaudhary , Xiaotian Han

Recent research enhances language model reasoning by scaling test-time compute via longer chain-of-thought traces. This often improves accuracy but also introduces redundancy and high computational cost, especially for small language models…

Machine Learning · Computer Science 2025-05-26 Xuechen Zhang , Zijian Huang , Chenshun Ni , Ziyang Xiong , Jiasi Chen , Samet Oymak

Reinforcement learning is widely used to improve the reasoning ability of large language models, especially when answers can be automatically checked. Standard GRPO-style training updates the model using only the current step, while full…

Machine Learning · Computer Science 2026-05-11 Ismam Nur Swapnil , Aranya Saha , Tanvir Ahmed Khan , Mohammad Ariful Haque , Ser-Nam Lim

Reinforcement learning (RL)-based fine-tuning has become a crucial step in post-training language models for advanced mathematical reasoning and coding. Following the success of frontier reasoning models, recent work has demonstrated that…

Machine Learning · Computer Science 2025-08-11 Rosie Zhao , Alexandru Meterez , Sham Kakade , Cengiz Pehlevan , Samy Jelassi , Eran Malach

Large Reasoning Models (LRMs) have shown remarkable capabilities in solving complex problems through reinforcement learning (RL), particularly by generating long reasoning traces. However, these extended outputs often exhibit substantial…

Computation and Language · Computer Science 2025-05-22 Wei Liu , Ruochen Zhou , Yiyun Deng , Yuzhen Huang , Junteng Liu , Yuntian Deng , Yizhe Zhang , Junxian He

The effective training of Large Language Models (LLMs) for function calling faces a critical challenge: balancing exploration of complex reasoning paths with stable policy optimization. Standard methods like Supervised Fine-Tuning (SFT)…

Recent advances in post-training techniques have endowed Large Language Models (LLMs) with enhanced capabilities for tackling complex, logic-intensive tasks through the generation of supplementary planning tokens. This development raises a…

Computation and Language · Computer Science 2026-04-29 Pratham Singla , Shivank Garg , Ayush Singh , Ishan Garg , Ketan Suhaas Saichandran

Recently, reinforcement learning (RL) has been shown to greatly enhance the reasoning capabilities of large language models (LLMs), and RL-based approaches have been progressively applied to visual multimodal tasks. However, the audio…

Sound · Computer Science 2025-05-15 Gang Li , Jizhong Liu , Heinrich Dinkel , Yadong Niu , Junbo Zhang , Jian Luan

Enhancing the reasoning capabilities of large language models (LLMs) typically relies on massive computational resources and extensive datasets, limiting accessibility for resource-constrained settings. Our study investigates the potential…

Machine Learning · Computer Science 2026-01-21 Quy-Anh Dang , Chris Ngo

Inspired by DeepSeek-R1's success in eliciting reasoning abilities through rule-based reinforcement learning (RL), we introduce Video-R1 as the first attempt to systematically explore the R1 paradigm for incentivizing video reasoning within…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Kaituo Feng , Kaixiong Gong , Bohao Li , Zonghao Guo , Yibing Wang , Tianshuo Peng , Junfei Wu , Xiaoying Zhang , Benyou Wang , Xiangyu Yue

Scaling inference-time compute for Large Language Models (LLMs) has unlocked unprecedented reasoning capabilities. However, existing inference-time scaling methods typically rely on inefficient and suboptimal discrete search algorithms or…

Machine Learning · Computer Science 2026-03-06 Peihao Wang , Ruisi Cai , Zhen Wang , Hongyuan Mei , Qiang Liu , Pan Li , Zhangyang Wang

Recent advances in reinforcement learning (RL) have significantly enhanced the reasoning capabilities of large language models (LLMs). Group Relative Policy Optimization (GRPO), a lightweight variant of Proximal Policy Optimization (PPO),…

Machine Learning · Computer Science 2025-10-13 Chen Wang , Lai Wei , Yanzhi Zhang , Chenyang Shao , Zedong Dan , Weiran Huang , Yuzhi Zhang , Yue Wang

Large language models often require costly optimization, such as reinforcement learning, to master complex reasoning tasks. This work demonstrates that reasoning ability, once learned, can be extracted and transferred between models as a…

Computation and Language · Computer Science 2025-09-03 Mohammad Zbeeb , Hasan Abed Al Kader Hammoud , Bernard Ghanem

Reinforcement Learning (RL) can directly enhance the reasoning capabilities of large language models without extensive reliance on Supervised Fine-Tuning (SFT). In this work, we revisit the traditional Policy Gradient (PG) mechanism and…

Machine Learning · Computer Science 2026-02-04 Xiangxiang Chu , Hailang Huang , Xiao Zhang , Fei Wei , Yong Wang

We present PCL-Reasoner-V1.5, a 32-billion-parameter large language model (LLM) for mathematical reasoning. The model is built upon Qwen2.5-32B and refined via supervised fine-tuning (SFT) followed by reinforcement learning (RL). A central…

Machine Learning · Computer Science 2026-01-22 Yao Lu , Dengdong Fan , Jianzheng Nie , Fan Xu , Jie Chen , Bin Zhou , Yonghong Tian

Predicting cancer treatment outcomes requires models that are both accurate and interpretable, particularly in the presence of heterogeneous clinical data. While large language models (LLMs) have shown strong performance in biomedical NLP,…

Computation and Language · Computer Science 2025-10-21 Raghu Vamshi Hemadri , Geetha Krishna Guruju , Kristi Topollai , Anna Ewa Choromanska

Reinforcement learning (RL) has recently demonstrated strong potential in enhancing the reasoning capabilities of large language models (LLMs). Particularly, the "Zero" reinforcement learning introduced by Deepseek-R1-Zero, enables direct…

Computation and Language · Computer Science 2025-06-10 Xueguang Ma , Qian Liu , Dongfu Jiang , Ge Zhang , Zejun Ma , Wenhu Chen

Large reasoning models (LRMs) exhibit diverse high-level reasoning patterns (e.g., direct solution, reflection-and-verification, and exploring multiple solutions), yet prevailing training recipes implicitly bias models toward a limited set…

Artificial Intelligence · Computer Science 2026-01-13 Hanbin Wang , Jingwei Song , Jinpeng Li , Fei Mi , Lifeng Shang