English
Related papers

Related papers: Enhancing Math Reasoning in Small-sized LLMs via P…

200 papers

Large Language Models (LLMs) are increasingly relied upon for solving complex reasoning tasks in domains such as mathematics, logic, and multi-step question answering. A growing line of work seeks to improve reasoning quality by scaling…

Machine Learning · Computer Science 2025-08-05 Seyyed Saeid Cheshmi , Azal Ahmad Khan , Xinran Wang , Zirui Liu , Ali Anwar

Reinforcement Learning (RL) has proven highly effective at enhancing the complex reasoning abilities of Large Language Models (LLMs), yet underlying mechanisms driving this success remain largely opaque. Our analysis reveals that puzzling…

Artificial Intelligence · Computer Science 2025-09-30 Haozhe Wang , Qixin Xu , Che Liu , Junhong Wu , Fangzhen Lin , Wenhu Chen

Recent studies show that the reasoning capabilities of Large Language Models (LLMs) can be improved by applying Reinforcement Learning (RL) to question-answering (QA) tasks in areas such as math and coding. With a long context length, LLMs…

Computation and Language · Computer Science 2025-10-17 Stephen Chung , Wenyu Du , Jie Fu

In this paper, we propose R$^3$: Learning Reasoning through Reverse Curriculum Reinforcement Learning (RL), a novel method that employs only outcome supervision to achieve the benefits of process supervision for large language models. The…

Large language models (LLMs) have shown impressive capabilities, but still struggle with complex reasoning tasks requiring multiple steps. While prompt-based methods like Chain-of-Thought (CoT) can improve LLM reasoning at inference time,…

Artificial Intelligence · Computer Science 2024-11-25 Haolin Chen , Yihao Feng , Zuxin Liu , Weiran Yao , Akshara Prabhakar , Shelby Heinecke , Ricky Ho , Phil Mui , Silvio Savarese , Caiming Xiong , Huan Wang

Reward models (RMs) have become essential for aligning large language models (LLMs), serving as scalable proxies for human evaluation in both training and inference. However, existing RMs struggle on knowledge-intensive and long-form tasks,…

Computation and Language · Computer Science 2025-10-30 Ziyou Hu , Zhengliang Shi , Minghang Zhu , Haitao Li , Teng Sun , Pengjie Ren , Suzan Verberne , Zhaochun Ren

Large language models have recently evolved from fluent text generation to advanced reasoning across diverse domains, giving rise to reasoning language models. Among these domains, mathematical reasoning serves as a representative benchmark…

Improving the multi-step reasoning ability of Large Language Models (LLMs) is a critical yet challenging task. The dominant paradigm, outcome-supervised reinforcement learning (RLVR), rewards only correct final answers, often propagating…

Artificial Intelligence · Computer Science 2025-10-14 Beining Wang , Weihang Su , Hongtao Tian , Tao Yang , Yujia Zhou , Ting Yao , Qingyao Ai , Yiqun Liu

Reinforcement learning (RL) enhanced large language models (LLMs), particularly exemplified by DeepSeek-R1, have exhibited outstanding performance. Despite the effectiveness in improving LLM capabilities, its implementation remains highly…

Computation and Language · Computer Science 2025-02-25 Shuhe Wang , Shengyu Zhang , Jie Zhang , Runyi Hu , Xiaoya Li , Tianwei Zhang , Jiwei Li , Fei Wu , Guoyin Wang , Eduard Hovy

In recent years, general-purpose large language models (LLMs) such as GPT, Gemini, Claude, and DeepSeek have advanced at an unprecedented pace. Despite these achievements, their application to finance remains challenging, due to fragmented…

The reasoning ability of large language models (LLMs) can be unleashed with reinforcement learning (RL) (OpenAI, 2024; DeepSeek-AI et al., 2025a; Zeng et al., 2025). The success of existing RL attempts in LLMs usually rely on high-quality…

Machine Learning · Computer Science 2026-04-03 Yiyuan Li , Zhen Huang , Yanan Wu , Weixun Wang , Xuefeng Li , Yijia Luo , Wenbo Su , Bo Zheng , Pengfei Liu

Recent work shows that reinforcement learning(RL) can markedly sharpen the reasoning ability of large language models (LLMs) by prompting them to "think before answering." Yet whether and how these gains transfer to audio-language reasoning…

Computation and Language · Computer Science 2025-04-30 Cheng Wen , Tingwei Guo , Shuaijiang Zhao , Wei Zou , Xiangang Li

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective approach for improving the reasoning abilities of large language models (LLMs). The Group Relative Policy Optimization (GRPO) family has demonstrated strong…

Computation and Language · Computer Science 2025-11-10 Chenxi Liu , Junjie Liang , Yuqi Jia , Bochuan Cao , Yang Bai , Heng Huang , Xun Chen

Large Vision-Language Models (LVLMs) have recently advanced robotic manipulation by leveraging vision for scene perception and language for instruction following. However, existing methods rely heavily on costly human-annotated training…

Visual reasoning, a cornerstone of human intelligence, encompasses complex perceptual and logical processes essential for solving diverse visual problems. While advances in computer vision have produced powerful models for various…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Zetong Zhou , Dongping Chen , Zixian Ma , Zhihan Hu , Mingyang Fu , Sinan Wang , Yao Wan , Zhou Zhao , Ranjay Krishna

The math abilities of large language models can represent their abstract reasoning ability. In this paper, we introduce and open-source our math reasoning LLMs InternLM-Math which is continue pre-trained from InternLM2. We unify…

Test-time scaling methods have seen a rapid increase in popularity for its computational efficiency and parameter-independent training to improve reasoning performance on Large Language Models. One such method is called budget forcing, a…

Artificial Intelligence · Computer Science 2025-10-27 Ravindra Aribowo Tarunokusumo , Rafael Fernandes Cunha

Recently, test-time scaling has garnered significant attention from the research community, largely due to the substantial advancements of the o1 model released by OpenAI. By allocating more computational resources during the inference…

Large Vision-Language Models (LVLMs) have become powerful general-purpose assistants, yet their predictions often lack reliability and interpretability due to insufficient grounding in visual evidence. The emerging thinking-with-images…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Meng Cao , Haoze Zhao , Can Zhang , Xiaojun Chang , Ian Reid , Xiaodan Liang

To improve Multi-step Mathematical Reasoning (MsMR) of Large Language Models (LLMs), it is crucial to obtain scalable supervision from the corpus by automatically critiquing mistakes in the reasoning process of MsMR and rendering a final…

Computation and Language · Computer Science 2025-11-14 Changyuan Tian , Zhicong Lu , Shuang Qian , Nayu Liu , Peiguang Li , Li Jin , Leiyi Hu , Zhizhao Zeng , Sirui Wang , Ke Zeng , Zhi Guo