English
Related papers

Related papers: Making Qwen3 Think in Korean with Reinforcement Le…

200 papers

Deep Research agents tackle knowledge-intensive tasks through multi-round retrieval and decision-oriented generation. While reinforcement learning (RL) has been shown to improve performance in this paradigm, its contributions remain…

Computation and Language · Computer Science 2026-02-24 Yinuo Xu , Shuo Lu , Jianjie Cheng , Meng Wang , Qianlong Xie , Xingxing Wang , Ran He , Jian Liang

Recent Large Reasoning Models (LRMs) have achieved remarkable performance in solving complex problems via supervised fine-tuning (SFT) and reinforcement learning (RL). Although existing RL algorithms significantly enhance model accuracy,…

Artificial Intelligence · Computer Science 2025-10-20 Zezhong Tan , Hang Gao , Xinhong Ma , Feng Zhang , Ziqiang Dong

Large reasoning models (LRMs) extend large language models by generating explicit chain-of-thought (CoT) reasoning, significantly improving mathematical and logical problem solving. However, this explicit reasoning process also introduces…

Computation and Language · Computer Science 2025-12-02 Jinghan Jia , Nathalie Baracaldo , Sijia Liu

Large language models trained with reinforcement learning with verifiable rewards tend to trade accuracy for length--inflating response lengths to achieve gains in accuracy. While longer answers may be warranted for harder problems, many…

Computation and Language · Computer Science 2025-08-14 Vaishnavi Shrivastava , Ahmed Awadallah , Vidhisha Balachandran , Shivam Garg , Harkirat Behl , Dimitris Papailiopoulos

Reinforcement learning algorithms such as group-relative policy optimization (GRPO) have shown strong potential for improving the mathematical reasoning capabilities of large language models. While a growing body of work seeks to improve…

Machine Learning · Computer Science 2026-05-12 Wenquan Lu , Hai Huang , Enqi Liu , Randall Balestriero

Test-time scaling methods have seen a rapid increase in popularity for its computational efficiency and parameter-independent training to improve reasoning performance on Large Language Models. One such method is called budget forcing, a…

Artificial Intelligence · Computer Science 2025-10-27 Ravindra Aribowo Tarunokusumo , Rafael Fernandes Cunha

The role of reinforcement learning (RL) in enhancing the reasoning of large language models (LLMs) is becoming increasingly significant. Despite the success of RL in many scenarios, there are still many challenges in improving the reasoning…

Artificial Intelligence · Computer Science 2024-12-25 Jiacai Liu , Chaojie Wang , Chris Yuhao Liu , Liang Zeng , Rui Yan , Yiwen Sun , Yang Liu , Yahui Zhou

Reinforcement Learning (RL) has emerged as a transformative approach for aligning and enhancing Large Language Models (LLMs), addressing critical challenges in instruction following, ethical alignment, and reasoning capabilities. This…

Artificial Intelligence · Computer Science 2025-07-08 Saksham Sahai Srivastava , Vaneet Aggarwal

Large reasoning models that use long chain-of-thought excel at problem-solving yet waste compute on redundant checks. Curbing this overthinking is hard: training-time length penalties can cripple ability, while inference-time early-exit…

Artificial Intelligence · Computer Science 2026-04-21 Benteng Chen , Weida Wang , Shufei Zhang , Mingbao Lin , Min Zhang

Reinforcement learning (RL) has emerged as a promising strategy for improving the reasoning capabilities of language models (LMs) in domains such as mathematics and coding. However, most modern RL algorithms were designed to target robotics…

Artificial Intelligence · Computer Science 2025-05-26 Lianghuan Huang , Shuo Li , Sagnik Anupam , Insup Lee , Osbert Bastani

Large Language Models (LLMs) show strong reasoning abilities, often amplified by Chain-of-Thought (CoT) prompting and reinforcement learning (RL). Although RL algorithms can substantially improve reasoning, they struggle to expand reasoning…

Computation and Language · Computer Science 2025-10-07 Xiangchi Yuan , Xiang Chen , Tong Yu , Dachuan Shi , Can Jin , Wenke Lee , Saayan Mitra

Reinforcement learning (RL) has emerged as a powerful tool for fine-tuning large language models (LLMs) to improve complex reasoning abilities. However, state-of-the-art policy optimization methods often suffer from high computational…

Machine Learning · Computer Science 2025-05-28 Kianté Brantley , Mingyu Chen , Zhaolin Gao , Jason D. Lee , Wen Sun , Wenhao Zhan , Xuezhou Zhang

Group Relative Policy Optimization (GRPO) is highly effective for post-training autoregressive (AR) language models, yet its direct application to diffusion large language models (dLLMs) often triggers reward collapse. We identify two…

Machine Learning · Computer Science 2026-03-10 Jianyuan Zhong , Kaibo Wang , Ding Ding , Zijin Feng , Haoli Bai , Yang Xiang , Jiacheng Sun , Qiang Xu

Small language models (SLMs) are more efficient, cost-effective, and customizable than large language models (LLMs), though they often underperform in specific areas like reasoning. Past methods for enhancing SLMs' reasoning, such as…

Computation and Language · Computer Science 2024-12-12 Kaiyuan Chen , Jin Wang , Xuejie Zhang

Reinforcement learning algorithms are fundamental to align large language models with human preferences and to enhance their reasoning capabilities. However, current reinforcement learning algorithms often suffer from training instability…

Machine Learning · Computer Science 2025-06-05 Yaru Hao , Li Dong , Xun Wu , Shaohan Huang , Zewen Chi , Furu Wei

Large Language Models (LLMs) are increasingly deployed in business-critical domains such as finance, education, healthcare, and customer support, where users expect consistent and reliable recommendations. Yet LLMs often exhibit variability…

Machine Learning · Computer Science 2026-04-20 Sonal Prabhune , Balaji Padmanabhan , Kaushik Dutta

Finetuning Large Vision-Language Models with reinforcement learning has emerged as a promising approach to enhance their capability in object-level grounding. However, existing methods, mainly based on GRPO, assign rewards at the response…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Yuyuan Liu , Yiping Ji , Anjie Le , Jiayuan Zhu , Jiazhen Pan , Can Peng , Jiajun Deng , Fengbei Liu , Junde Wu

Recent advances of Reinforcement Learning (RL) have highlighted its potential in complex reasoning tasks, yet effective training often relies on external supervision, which limits the broader applicability. In this work, we propose a novel…

Artificial Intelligence · Computer Science 2025-06-11 Kongcheng Zhang , Qi Yao , Shunyu Liu , Yingjie Wang , Baisheng Lai , Jieping Ye , Mingli Song , Dacheng Tao

Latent reasoning offers a more efficient alternative to explicit reasoning by compressing intermediate reasoning into continuous representations and substantially shortening reasoning chains. However, existing latent reasoning methods…

Machine Learning · Computer Science 2026-05-01 Jingcheng Deng , Zihao Wei , Liang Pang , Junhong Wu , Shicheng Xu , Zenghao Duan , Huawei Shen

Zero Reinforcement Learning (Zero-RL) has proven to be an effective approach for enhancing the reasoning capabilities of large language models (LLMs) by directly applying reinforcement learning with verifiable rewards on pretrained models,…

Artificial Intelligence · Computer Science 2025-10-30 Yuyuan Zeng , Yufei Huang , Can Xu , Qingfeng Sun , Jianfeng Yan , Guanghui Xu , Tao Yang , Fengzong Lian