English
Related papers

Related papers: Efficient Reasoning with Balanced Thinking

200 papers

Large reasoning models (LRMs) like OpenAI o1 and DeepSeek R1 have demonstrated impressive performance on complex reasoning tasks like mathematics and programming with long Chain-of-Thought (CoT) reasoning sequences (slow-thinking), compared…

Artificial Intelligence · Computer Science 2025-07-15 Jason Zhu , Hongyu Li

Test-time scaling has enabled Large Language Models (LLMs) to tackle complex reasoning, yet the limitations of current Chain-of-Thought (CoT) evaluation obscures whether performance gains stem from genuine reasoning or mere verbosity. To…

Artificial Intelligence · Computer Science 2026-01-08 Zhizhang Fu , Yuancheng Gu , Chenkai Hu , Hanmeng Liu , Yue Zhang

Large Reasoning Models (LRMs) achieve strong performance by generating long chains of thought (CoT), but often overthink, continuing to reason after a solution has already stabilized and thereby wasting tokens and increasing latency.…

Computation and Language · Computer Science 2026-05-19 Dehai Min , Giovanni Vaccarino , Huiyi Chen , Yongliang Wu , Gal Yona , Lu Cheng

Large Reasoning Models (LRMs) exhibit strong performance, yet often produce rationales that sound plausible but fail to reflect their true decision process, undermining reliability and trust. We introduce a formal framework for reasoning…

Artificial Intelligence · Computer Science 2026-02-24 Yunseok Han , Yejoon Lee , Jaeyoung Do

Many challenging reasoning tasks require not just rapid, intuitive responses, but a more deliberate, multi-step approach. Recent progress in large language models (LLMs) highlights an important shift from the "System 1" way of quick…

Computation and Language · Computer Science 2025-06-03 Guizhen Chen , Weiwen Xu , Hao Zhang , Hou Pong Chan , Chaoqun Liu , Lidong Bing , Deli Zhao , Anh Tuan Luu , Yu Rong

Large language models (LLMs) with Chain-of-Thought (CoT) prompting achieve strong reasoning but often produce unnecessarily long explanations, increasing cost and sometimes reducing accuracy. Fair comparison of efficiency-oriented…

Computation and Language · Computer Science 2025-11-14 Junquan Huang , Haotian Wu , Yubo Gao , Yibo Yan , Junyan Zhang , Yonghua Hei , Song Dai , Jie Zhang , Puay Siew Tan , Xuming Hu

O1/R1 style large reasoning models (LRMs) signal a substantial leap forward over conventional instruction-following LLMs. By applying test-time scaling to generate extended reasoning paths, they establish many SOTAs across a wide range of…

Artificial Intelligence · Computer Science 2025-09-09 Wei Han , Geng Zhan , Sicheng Yu , Chenyu Wang , Bryan Hooi

The rise of Large Reasoning Models (LRMs) signifies a paradigm shift toward advanced computational reasoning. Yet, this progress disrupts traditional agent frameworks, traditionally anchored by execution-oriented Large Language Models…

Artificial Intelligence · Computer Science 2025-05-28 Xueyang Zhou , Guiyao Tie , Guowen Zhang , Weidong Wang , Zhigang Zuo , Di Wu , Duanfeng Chu , Pan Zhou , Neil Zhenqiang Gong , Lichao Sun

Large Language Models (LLMs) often struggle with computational efficiency and error propagation in multi-step reasoning tasks. While recent advancements on prompting and post-training have enabled LLMs to perform step-wise reasoning, they…

Artificial Intelligence · Computer Science 2026-05-08 Yuan Sui , Yufei He , Tri Cao , Simeng Han , Yulin Chen , Bryan Hooi

Large Reasoning Models (LRMs) have revolutionized complex problem-solving, yet they exhibit a pervasive "overthinking", generating unnecessarily long reasoning chains. While current solutions improve token efficiency, they often sacrifice…

Artificial Intelligence · Computer Science 2026-04-10 Weiyang Huang , Xuefeng Bai , Kehai Chen , Xinyang Chen , Yibin Chen , Weili Guan , Min Zhang

Large Language Models (LLMs) rely on generating extensive intermediate reasoning units (e.g., tokens, sentences) to enhance final answer quality across a wide range of complex tasks. While this approach has proven effective, it inevitably…

Computation and Language · Computer Science 2025-06-05 Joonwon Jang , Jaehee Kim , Wonbin Kweon , Seonghyeon Lee , Hwanjo Yu

Large language models excel on static benchmarks, but their ability as self-learning agents in dynamic environments remains unclear. We evaluate three prompting strategies: self-reflection, heuristic mutation, and planning across dynamic…

Artificial Intelligence · Computer Science 2025-08-12 Annie Wong , Thomas Bäck , Aske Plaat , Niki van Stein , Anna V. Kononova

Structured reasoning can improve the inference performance of large language models (LLMs), but it also introduces computational cost and control constraints. When additional reasoning structure helps, and when it instead reduces efficiency…

Machine Learning · Computer Science 2026-04-14 Junyu Guo , Shangding Gu , Ming Jin , Costas Spanos , Javad Lavaei

Large Reasoning Models (LRMs) demonstrate strong performance in complex tasks but often face the challenge of overthinking, leading to substantially high inference costs. Existing approaches synthesize shorter reasoning responses for LRMs…

Computation and Language · Computer Science 2026-03-02 Hexuan Deng , Wenxiang Jiao , Xuebo Liu , Jun Rao , Min Zhang

With the growing success of reasoning models across complex natural language tasks, researchers in the Information Retrieval (IR) community have begun exploring how similar reasoning capabilities can be integrated into passage rerankers…

Information Retrieval · Computer Science 2025-05-23 Nour Jedidi , Yung-Sung Chuang , James Glass , Jimmy Lin

Large reasoning models with reasoning capabilities achieve state-of-the-art performance on complex tasks, but their robustness under multi-turn adversarial pressure remains underexplored. We evaluate nine frontier reasoning models under…

Artificial Intelligence · Computer Science 2026-03-13 Yubo Li , Ramayya Krishnan , Rema Padman

Recent progress in Large Reasoning Models (LRMs) has significantly enhanced the reasoning abilities of Large Language Models (LLMs), empowering them to tackle increasingly complex tasks through reflection capabilities, such as making…

Computation and Language · Computer Science 2025-06-26 Jianghao Chen , Zhenlin Wei , Zhenjiang Ren , Ziyong Li , Jiajun Zhang

While reasoning models (e.g., DeepSeek R1) trained with reinforcement learning (RL), excel in textual reasoning, they struggle in scenarios requiring structured problem-solving, such as geometric reasoning, concise computation, or complex…

Computation and Language · Computer Science 2025-04-18 Jiazhan Feng , Shijue Huang , Xingwei Qu , Ge Zhang , Yujia Qin , Baoquan Zhong , Chengquan Jiang , Jinxin Chi , Wanjun Zhong

Large Language Models (LLMs) consistently benefit from scaled Chain-of-Thought (CoT) reasoning, but also suffer from heavy computational overhead. To address this issue, efficient reasoning aims to incentivize short yet accurate thinking…

Computation and Language · Computer Science 2026-03-23 Taiqiang Wu , Zenan Xu , Bo Zhou , Ngai Wong

Retrieval-Augmented Generation (RAG) effectively enhances Large Language Models (LLMs) by incorporating retrieved external knowledge into the generation process. Reasoning models improve LLM performance in multi-hop QA tasks, which require…

Computation and Language · Computer Science 2026-01-21 Guo Chen , Junjie Huang , Huaijin Xie , Fei Sun , Tao Jia