English
Related papers

Related papers: Beyond Model Scaling: Test-Time Intervention for E…

200 papers

Large Language Models (LLMs) have achieved significant advances in reasoning tasks. A key approach is tree-based search with verifiers, which expand candidate reasoning paths and use reward models to guide pruning and selection. Although…

Artificial Intelligence · Computer Science 2025-10-01 Yingqian Cui , Zhenwei Dai , Pengfei He , Bing He , Hui Liu , Xianfeng Tang , Jingying Zeng , Suhang Wang , Yue Xing , Jiliang Tang , Benoit Dumoulin

Recent studies suggest that self-reflective prompting can significantly enhance the reasoning capabilities of Large Language Models (LLMs). However, the use of external feedback as a stop criterion raises doubts about the true extent of…

Computation and Language · Computer Science 2024-04-16 Yanhong Li , Chenghao Yang , Allyson Ettinger

Recent advancements in multimodal reward models (RMs) have substantially improved post-training for visual generative models. However, current RMs face inherent limitations: (1) visual inputs consume large context budgets, forcing fewer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Qunzhong Wang , Jie Liu , Jiajun Liang , Yilei Jiang , Yuanxing Zhang , Yaozhi Zheng , Xintao Wang , Pengfei Wan , Xiangyu Yue , Jiaheng Liu

Large language models (LLMs) have rapidly progressed into general-purpose agents capable of solving a broad spectrum of tasks. However, current models remain inefficient at reasoning: they apply fixed inference-time compute regardless of…

Large language models (LLMs) now solve multi-step problems by emitting extended chains of thought. During the process, they often re-derive the same intermediate steps across problems, inflating token usage and latency. This saturation of…

Machine Learning · Computer Science 2025-09-17 Aniket Didolkar , Nicolas Ballas , Sanjeev Arora , Anirudh Goyal

Job interviews play a critical role in shaping one's career, yet practicing interview skills can be challenging, especially without access to human coaches or peers for feedback. Recent advancements in large language models (LLMs) present…

Human-Computer Interaction · Computer Science 2024-11-05 Taufiq Daryanto , Xiaohan Ding , Lance T. Wilhelm , Sophia Stil , Kirk McInnis Knutsen , Eugenia H. Rho

Large reasoning models achieve strong performance by scaling inference-time chain-of-thought, but this paradigm suffers from quadratic cost, context length limits, and degraded reasoning due to lost-in-the-middle effects. Iterative…

Computation and Language · Computer Science 2026-02-10 Yuchen Yan , Liang Jiang , Jin Jiang , Shuaicheng Li , Zujie Wen , Zhiqiang Zhang , Jun Zhou , Jian Shao , Yueting Zhuang , Yongliang Shen

While large language models (LLMs) have demonstrated remarkable reasoning capabilities, they often struggle with complex tasks that require specific thinking paradigms, such as divide-and-conquer and procedural deduction, \etc Previous…

Software Engineering · Computer Science 2025-06-05 Kechi Zhang , Ge Li , Jia Li , Huangzhao Zhang , Jingjing Xu , Hao Zhu , Lecheng Wang , Jia Li , Yihong Dong , Jing Mai , Bin Gu , Zhi Jin

Large Reasoning Models (LRMs) achieve superior performance by extending the thought length. However, a lengthy thinking trajectory leads to reduced efficiency. Most of the existing methods are stuck in the assumption of overthinking and…

Computation and Language · Computer Science 2025-10-21 Xiaoang Xu , Shuo Wang , Xu Han , Zhenghao Liu , Huijia Wu , Peipei Li , Zhiyuan Liu , Maosong Sun , Zhaofeng He

Tool-integrated reasoning (TIR) offers a direct way to extend thinking models beyond the limits of text-only reasoning. Paradoxically, we observe that tool-enabled evaluation can degrade reasoning performance even when the strong thinking…

Computation and Language · Computer Science 2026-05-08 Qianjia Cheng , Yuchen Zhang , Zhilin Wang , Yuxin Zuo , Shunkai Zhang , Yuchen Fan , Yu Qiao , Bowen Zhou , Ning Ding , Yu Cheng , Yun Luo , Ganqu Cui

Recent advancements in large reasoning models (LRMs) have introduced an intermediate "thinking" process prior to generating final answers, improving their reasoning capabilities on complex downstream tasks. However, the potential of LRMs as…

Computation and Language · Computer Science 2025-10-24 Runzhe Zhan , Zhihong Huang , Xinyi Yang , Lidia S. Chao , Min Yang , Derek F. Wong

The rise of Large Language Models (LLMs) has sparked interest in their application to sequential recommendation tasks as they can provide supportive item information. However, due to the inherent complexities of sequential recommendation,…

Information Retrieval · Computer Science 2023-12-19 Yu Wang , Zhiwei Liu , Jianguo Zhang , Weiran Yao , Shelby Heinecke , Philip S. Yu

Large Language Models (LLMs) for complex reasoning is often hindered by high computational costs and latency, while resource-efficient Small Language Models (SLMs) typically lack the necessary reasoning capacity. Existing collaborative…

Computation and Language · Computer Science 2026-01-09 Chengsong Huang , Tong Zheng , Langlin Huang , Jinyuan Li , Haolin Liu , Jiaxin Huang

Temporal reasoning in multi-session dialogues presents a significant challenge which has been under-studied in previous temporal reasoning benchmarks. To bridge this gap, we propose a new evaluation task for temporal reasoning in…

Artificial Intelligence · Computer Science 2025-09-26 Yubin Ge , Salvatore Romeo , Jason Cai , Raphael Shu , Monica Sunkara , Yassine Benajiba , Yi Zhang

Large Language Models (LLMs) have demonstrated remarkable progress in reasoning across diverse domains. However, effective reasoning in real-world tasks requires adapting the reasoning strategy to the demands of the problem, ranging from…

Computation and Language · Computer Science 2025-08-19 Xinda Jia , Jinpeng Li , Zezhong Wang , Jingjing Li , Xingshan Zeng , Yasheng Wang , Weinan Zhang , Yong Yu , Weiwen Liu

Large language models (LLMs) face inherent performance bottlenecks under parameter constraints, particularly in processing critical tokens that demand complex reasoning. Empirical analysis reveals challenging tokens induce abrupt gradient…

Computation and Language · Computer Science 2025-02-25 Yilong Chen , Junyuan Shang , Zhenyu Zhang , Yanxi Xie , Jiawei Sheng , Tingwen Liu , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang

Large language models (LLMs) have demonstrated strong reasoning capabilities, and as existing approaches for enhancing LLM reasoning continue to mature, increasing attention has shifted toward meta-reasoning as a promising direction for…

Artificial Intelligence · Computer Science 2026-04-21 Ziqing Zhuang , Linhai Zhang , Jiasheng Si , Deyu Zhou , Yulan He

While large language models (LLMs) demonstrate emerging reasoning capabilities, current inference-time expansion methods incur prohibitive computational costs by exhaustive sampling. Through analyzing decoding trajectories, we observe that…

Artificial Intelligence · Computer Science 2026-02-03 Ziheng Li , Hengyi Cai , Xiaochi Wei , Yuchen Li , Shuaiqiang Wang , Zhi-Hong Deng , Dawei Yin

Reasoning models enhance performance by tackling problems in a step-by-step manner, decomposing them into sub-problems and exploring long chains of thought before producing an answer. However, applying extended reasoning to every step…

Artificial Intelligence · Computer Science 2025-10-08 Haiquan Lu , Gongfan Fang , Xinyin Ma , Qi Li , Xinchao Wang

Large language models (LLMs) have shown impressive capabilities in handling complex tasks through long-chain reasoning. However, the extensive reasoning steps involved can significantly increase computational costs, posing challenges for…

Computation and Language · Computer Science 2025-05-28 Yunhao Wang , Yuhao Zhang , Tinghao Yu , Can Xu , Feng Zhang , Fengzong Lian
‹ Prev 1 8 9 10 Next ›