中文
相关论文

相关论文: Does Your Reasoning Model Implicitly Know When to …

200 篇论文

Large Language Models (LLMs) have shown remarkable progress across domains, yet their ability to perform inductive reasoning - inferring latent rules from sparse examples - remains limited. It is often assumed that chain-of-thought (CoT)…

计算机视觉与模式识别 · 计算机科学 2025-06-02 Haibo Jin , Peiyan Zhang , Man Luo , Haohan Wang

Current answering paradigms for Large Reasoning Models (LRMs) often fail to account for the fact that some questions may lie beyond the model's operational capability boundary, leading to long but unproductive reasoning. In this paper, we…

人工智能 · 计算机科学 2026-03-17 Qingjie Zhang , Yujia Fu , Yang Wang , Liu Yan , Tao Wei , Ke Xu , Minlie Huang , Han Qiu

Long chain-of-thought (CoT) prompting helps Large Language Models (LLMs) solve difficult problems, but very long traces often slow or even degrade performance on fast, intuitive "System-1" tasks. We introduce Connector-Aware Compact CoT…

人工智能 · 计算机科学 2025-09-16 Sunguk Choi , Yonghoon Kwon , Heondeuk Lee

Large reasoning models (LRMs) have achieved remarkable progress on complex tasks by generating extended chains of thought (CoT). However, their uncontrolled output lengths pose significant challenges for real-world deployment, where…

机器学习 · 计算机科学 2025-05-22 Yuhui Xu , Hanze Dong , Lei Wang , Doyen Sahoo , Junnan Li , Caiming Xiong

Large Reasoning Models (LRMs) achieve strong performance through explicit chain-of-thought reasoning but suffer from \textit{overthinking}: generating excessive reasoning tokens even for trivial queries. {Beyond inflating cost, overthinking…

Large Reasoning Language Models (LRLMs) demonstrate impressive capabilities on complex tasks by utilizing long Chain-of-Thought reasoning. However, they are prone to overthinking, which generates redundant reasoning steps that degrade both…

计算与语言 · 计算机科学 2026-03-17 Weixin Guan , Liang Li , Jiapeng Liu , Bing Li , Peng Fu , Chengyang Fang , Xiaoshuai Hao , Can Ma , Weiping Wang

We construct evaluation tasks where extending the reasoning length of Large Reasoning Models (LRMs) deteriorates performance, exhibiting an inverse scaling relationship between test-time compute and accuracy. Our evaluation tasks span four…

Recent advancements in reasoning have significantly enhanced the capabilities of Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) across diverse tasks. However, excessive reliance on chain-of-thought (CoT) reasoning…

计算与语言 · 计算机科学 2025-05-22 Jinghui Lu , Haiyang Yu , Siliang Xu , Shiwei Ran , Guozhi Tang , Siqi Wang , Bin Shan , Teng Fu , Hao Feng , Jingqun Tang , Han Wang , Can Huang

Large reasoning models improve accuracy by producing long reasoning traces, but this inflates latency and cost, motivating inference-time efficiency. We propose Retrieval-of-Thought (RoT), which reuses prior reasoning as composable…

人工智能 · 计算机科学 2026-05-12 Ammar Ahmed , Azal Ahmad Khan , Ayaan Ahmad , Sheng Di , Zirui Liu , Ali Anwar

Listwise reranking utilizing Large Language Models (LLMs) has achieved state-of-the-art retrieval effectiveness. Recently, reasoning-enhanced models have further pushed these boundaries by employing Chain-of-Thought (CoT) to perform deep…

信息检索 · 计算机科学 2026-05-15 Danyang Liu , Kan Li

Large reasoning models (LRMs) achieve state-of-the-art performance by generating long chains-of-thought, but often waste computation on redundant reasoning after the correct answer has already been reached. We introduce Early-Stopping for…

人工智能 · 计算机科学 2026-02-11 Junda Wang , Zhichao Yang , Dongxu Zhang , Sanjit Singh Batra , Robert E. Tillman

Large reasoning models (LRMs) achieved remarkable performance via chain-of-thought (CoT), but recent studies showed that such enhanced reasoning capabilities are at the expense of significantly degraded safety capabilities. In this paper,…

人工智能 · 计算机科学 2026-05-05 Jianan Chen , Zhifang Zhang , Shuo He , Linan Yue , Lei Feng , Minling Zhang

Large Language Models (LLMs) face significant accuracy degradation due to insufficient reasoning ability when dealing with complex and abstract tasks. Thought structures such as Chain of Thought (CoT) and Tree of Thought (ToT) focus on…

计算与语言 · 计算机科学 2025-09-29 Fengxiao Tang , Yufeng Li , Zongzong Wu , Ming Zhao

Test-time scaling improves the reasoning performance of large language models but often results in token-inefficient overthinking, where models continue reasoning beyond what is necessary for a correct answer. Existing dynamic early-exit…

人工智能 · 计算机科学 2026-04-21 Jiakun Li , Xingwei He , Kefan Li , Hongzheng Chai , Hongyue Yu , Yuan Yuan

Large Language Models (LLMs) have shown impressive performance on complex tasks through Chain-of-Thought (CoT) reasoning. However, conventional CoT relies on explicitly verbalized intermediate steps, which constrains its broader…

计算与语言 · 计算机科学 2025-11-04 Xinghao Chen , Anhao Zhao , Heming Xia , Xuan Lu , Hanlin Wang , Yanjun Chen , Wei Zhang , Jian Wang , Wenjie Li , Xiaoyu Shen

Large language models (LLMs) are increasingly optimized for long reasoning, under the assumption that more reasoning leads to better performance. However, emerging evidence suggests that longer responses can sometimes degrade accuracy…

计算与语言 · 计算机科学 2025-05-02 Jinyan Su , Jennifer Healey , Preslav Nakov , Claire Cardie

Recent advances in speech large language models (speech LLMs) have enabled seamless spoken interactions, but these systems still struggle with complex reasoning tasks. Previously, chain-of-thought (CoT) prompting or fine-tuning has been to…

计算与语言 · 计算机科学 2025-10-10 Yi-Jen Shih , Desh Raj , Chunyang Wu , Wei Zhou , SK Bong , Yashesh Gaur , Jay Mahadeokar , Ozlem Kalinli , Mike Seltzer

With the release of R1, a publicly available large reasoning model (LRM), researchers commonly train new LRMs by training language models on R1's long chain-of-thought (CoT) inferences. While prior works show that LRMs' capabilities can be…

计算与语言 · 计算机科学 2025-06-04 Hyungjoo Chae , Dongjin Kang , Jihyuk Kim , Beong-woo Kwak , Sunghyun Park , Haeju Park , Jinyoung Yeo , Moontae Lee , Kyungjae Lee

Large reasoning models (LRMs) often generate extensive chain-of-thought (CoT) traces before producing a final answer. As explicit textual artifacts, these traces can be passed to other models to solve the same task, enabling cross-model…

计算与语言 · 计算机科学 2026-05-29 Xinyuan Cheng , Beiduo Chen , Philipp Mondorf , Barbara Plank

Large Reasoning Models (LRMs) demonstrate remarkable capabilities on complex tasks, exhibiting emergent, human-like thinking patterns. Despite their advances, we identify a fundamental limitation: current LRMs lack a dedicated meta-level…

人工智能 · 计算机科学 2025-08-26 Haonan Dong , Haoran Ye , Wenhao Zhu , Kehan Jiang , Guojie Song