English
Related papers

Related papers: Nice Fold or Hero Call: Learning Budget-Efficient …

200 papers

Large Language Models (LLMs) have achieved remarkable success in complex reasoning tasks, but their inference remains computationally inefficient. We observe a common failure mode in many prevalent LLMs, overthinking, where models generate…

Machine Learning · Computer Science 2026-03-03 Junhong Lin , Xinyue Zeng , Jie Zhu , Song Wang , Julian Shun , Jun Wu , Dawei Zhou

Recently, a new wave of thinking-capable Large Language Models has emerged, demonstrating exceptional capabilities across a wide range of reasoning benchmarks. Early studies have begun to explore how the amount of compute in terms of the…

Computation and Language · Computer Science 2025-12-23 Ignacio Iacobacci , Zhaozhi Qian , Faroq AL-Tam , Muhammad AL-Qurishi , Riad Souissi

Large language models split into two families: reasoning-centric LLMs, which strengthen internal chain-of-thought reasoning but cannot invoke external tools, and agentic LLMs, which learn to interact with environments and leverage tools but…

Recent advances in mathematical reasoning typically rely on massive scale, yet the question remains: can strong reasoning capabilities be induced in small language models ($\leq1.5\text{B}$) under extreme constraints? We investigate this by…

Machine Learning · Computer Science 2026-01-13 Zohaib Khan , Omer Tafveez , Zoha Hayat Bhatti

Chain-of-thought (CoT) prompting enhances reasoning in large language models (LLMs) but often leads to verbose and redundant outputs, thus increasing inference cost. We hypothesize that many reasoning steps are unnecessary for producing…

Computation and Language · Computer Science 2025-09-30 Xin Liu , Lu Wang

As LLM reasoning performance plateau, improving inference-time compute efficiency is crucial to mitigate overthinking and long thinking traces even for simple queries. Prior approaches including length regularization, adaptive routing, and…

Machine Learning · Computer Science 2026-04-15 Neharika Jali , Anupam Nayak , Gauri Joshi

Current large-language models (LLMs) typically adopt a fixed reasoning strategy, either simple or complex, for all questions, regardless of their difficulty. This neglect of variation in task and reasoning process complexity leads to an…

Computation and Language · Computer Science 2025-05-27 Yi Wang , Junxiao Liu , Shimao Zhang , Jiajun Chen , Shujian Huang

Reasoning models have gained significant attention due to their strong performance, particularly when enhanced with retrieval augmentation. However, these models often incur high computational costs, as both retrieval and reasoning tokens…

Computation and Language · Computer Science 2025-10-20 Helia Hashemi , Victor Rühle , Saravan Rajmohan

Large Reasoning Models (LRMs) often suffer from \emph{overthinking}, a phenomenon in which redundant reasoning steps are generated after a correct solution has already been reached. Existing early reasoning exit methods primarily rely on…

Computation and Language · Computer Science 2026-04-17 Kang Liu , Yongkang Liu , Xiaocui Yang , Peidong Wang , Wen Zhang , Shi Feng , Yifei Zhang , Daling Wang

Large Language Models (LLMs) often rely on long chain-of-thought (CoT) reasoning to solve complex tasks. While effective, these trajectories are frequently inefficient, leading to high latency from excessive token generation, or unstable…

Recent advances in fine-tuning large language models (LLMs) with reinforcement learning (RL) have shown promising improvements in complex reasoning tasks, particularly when paired with chain-of-thought (CoT) prompting. However, these…

Machine Learning · Computer Science 2025-04-04 Hung Le , Dai Do , Dung Nguyen , Svetha Venkatesh

When applying reinforcement learning--typically through GRPO--to large vision-language model reasoning struggles to effectively scale reasoning length or generates verbose outputs across all tasks with only marginal gains in accuracy. To…

Computation and Language · Computer Science 2025-10-24 Wenyi Xiao , Leilei Gan

Generative LLMs typically improve Named Entity Recognition (NER) performance through instruction tuning. They excel at generating entities by semantic pattern matching but lack an explicit, verifiable reasoning mechanism. This "cognitive…

Computation and Language · Computer Science 2025-11-18 Hui Huang , Yanping Chen , Ruizhang Huang , Chuan Lin , Yongbin Qin

Large language models (LLMs) have shown impressive capabilities in handling complex tasks through long-chain reasoning. However, the extensive reasoning steps involved can significantly increase computational costs, posing challenges for…

Computation and Language · Computer Science 2025-05-28 Yunhao Wang , Yuhao Zhang , Tinghao Yu , Can Xu , Feng Zhang , Fengzong Lian

Large Reasoning Models (LRMs) demonstrate remarkable problem-solving capabilities through extended Chain-of-Thought (CoT) reasoning but often produce excessively verbose and redundant reasoning traces. This inefficiency incurs high…

Computation and Language · Computer Science 2025-09-11 Jiaxuan Gao , Shu Yan , Qixin Tan , Lu Yang , Shusheng Xu , Wei Fu , Zhiyu Mei , Kaifeng Lyu , Yi Wu

Large reasoning models (LRMs) achieve higher performance on challenging reasoning tasks by generating more tokens at inference time, but this verbosity often wastes computation on easy problems. Existing solutions, including supervised…

Artificial Intelligence · Computer Science 2025-06-09 Violet Xiang , Chase Blagden , Rafael Rafailov , Nathan Lile , Sang Truong , Chelsea Finn , Nick Haber

Large language models (LLMs) have shown remarkable performance in reasoning tasks but face limitations in mathematical and complex logical reasoning. Existing methods to improve LLMs' logical capabilities either involve traceable or…

Computation and Language · Computer Science 2025-05-27 Jiahao Yuan , Dehui Du , Hao Zhang , Zixiang Di , Usman Naseem

Large Reasoning Models (LRMs) generate chain-of-thought traces whose length tracks human reaction times across cognitive tasks, but recent debate questions whether this alignment reflects genuine computational structure or surface…

Computation and Language · Computer Science 2026-05-19 Yueqing Hu , Tianhong Wang

Test-time compute scaling, the practice of spending extra computation during inference via repeated sampling, search, or extended reasoning, has become a powerful lever for improving large language model performance. Yet deploying these…

Machine Learning · Computer Science 2026-04-17 Zhiyuan Zhai , Bingcong Li , Bingnan Xiao , Ming Li , Xin Wang

Large reasoning models (LRMs) excel on complex problems but face a critical barrier to efficiency: reinforcement learning (RL) training requires long rollouts for outcome-based rewards, where autoregressive decoding dominates time and…

Machine Learning · Computer Science 2026-02-20 Zeliang Zhang , Xiaodong Liu , Hao Cheng , Hao Sun , Chenliang Xu , Jianfeng Gao