中文
相关论文

相关论文: A*-Thought: Efficient Reasoning via Bidirectional …

200 篇论文

Large Reasoning Models (LRMs) often suffer from overthinking, generating verbose reasoning traces that compromise both computational efficiency and interpretability. Unlike prior efforts that rely on global length-based rewards, we propose…

Chain-of-Thought (CoT) reasoning enhances Large Language Models (LLMs) by prompting intermediate steps, improving accuracy and robustness in arithmetic, logic, and commonsense tasks. However, this benefit comes with high computational…

软件工程 · 计算机科学 2026-03-11 Kerui Huang , Shuhan Liu , Xing Hu , Tongtong Xu , Lingfeng Bao , Xin Xia

The Chain-of-Thought (CoT) paradigm has emerged as a critical approach for enhancing the reasoning capabilities of large language models (LLMs). However, despite their widespread adoption and success, CoT methods often exhibit instability…

人工智能 · 计算机科学 2024-09-06 Yu Wang , Shiwan Zhao , Zhihu Wang , Heyuan Huang , Ming Fan , Yubo Zhang , Zhixing Wang , Haijun Wang , Ting Liu

Recent Large Reasoning Models (LRMs) have shown substantially improved reasoning capabilities over traditional Large Language Models (LLMs) by incorporating extended thinking processes prior to producing final responses. However,…

计算与语言 · 计算机科学 2025-05-22 Lingjie Jiang , Xun Wu , Shaohan Huang , Qingxiu Dong , Zewen Chi , Li Dong , Xingxing Zhang , Tengchao Lv , Lei Cui , Furu Wei

Large Reasoning Models (LRMs) perform strongly in complex reasoning tasks via Chain-of-Thought (CoT) prompting, but often suffer from verbose outputs, increasing computational overhead. Existing fine-tuning-based compression methods either…

机器学习 · 计算机科学 2025-09-22 Ziqing Qiao , Yongheng Deng , Jiali Zeng , Dong Wang , Lai Wei , Guanbo Wang , Fandong Meng , Jie Zhou , Ju Ren , Yaoxue Zhang

Large language models (LLMs) face significant challenges in specialized biomedical tasks due to the inherent complexity of medical reasoning and the sensitive nature of clinical data. Existing LLMs often struggle with intricate medical…

计算与语言 · 计算机科学 2026-05-12 Zongxian Yang , Jiayu Qian , Kay Chen Tan , Hau-San Wong , Yulong Chen , Haoyu Zhang , Zhi-An Huang

Reasoning Large Language Models (RLLMs) have demonstrated impressive performance on complex tasks, largely due to the adoption of Long Chain-of-Thought (Long CoT) reasoning. However, they often exhibit overthinking -- performing unnecessary…

计算与语言 · 计算机科学 2025-05-30 Keqin Peng , Liang Ding , Yuanxin Ouyang , Meng Fang , Dacheng Tao

Large Reasoning Models (LRMs) have shown promising accuracy improvements on complex problem-solving tasks. While these models have attained high accuracy by leveraging additional computation at test time, they need to generate long…

Recent advances in inference time scaling with extended long chain-of thought have significantly improved the reasoning capabilities of both general and medical large language models (LLMs). However, these models tend to engage in lengthy…

计算与语言 · 计算机科学 2025-09-30 Shaohao Rui , Kaitao Chen , Weijie Ma , Xiaosong Wang

Chain-of-thought prompting has emerged as a powerful technique for enabling large language models (LLMs) to solve complex reasoning tasks. However, these reasoning chains can be verbose, raising concerns about efficiency. In response,…

计算与语言 · 计算机科学 2025-04-02 Ayeong Lee , Ethan Che , Tianyi Peng

Large reasoning models (LRMs) are proficient at generating explicit, step-by-step reasoning sequences before producing final answers. However, such detailed reasoning can introduce substantial computational overhead and latency,…

计算与语言 · 计算机科学 2025-10-10 Songjun Tu , Jiahao Lin , Qichao Zhang , Xiangyu Tian , Linjing Li , Xiangyuan Lan , Dongbin Zhao

K2-Think is a reasoning system that achieves state-of-the-art performance with a 32B parameter model, matching or surpassing much larger models like GPT-OSS 120B and DeepSeek v3.1. Built on the Qwen2.5 base model, our system shows that…

Reasoning-oriented Large Language Models (LLMs) often rely on generating explicit tokens step by step, and their effectiveness typically hinges on large-scale supervised fine-tuning or reinforcement learning. While Chain-of-Thought (CoT)…

Large Reasoning Models (LRMs) achieve strong performance in mathematics, code generation, and task planning, but their reliance on long chains of verbose "thinking" tokens leads to high latency, redundancy, and incoherent reasoning paths.…

人工智能 · 计算机科学 2025-12-01 Kumar Tanmay , Kriti Aggarwal , Paul Pu Liang , Subhabrata Mukherjee

Chain-of-Thought (CoT) reasoning improves performance on complex tasks but introduces significant inference latency due to verbosity. We propose Multiround Adaptive Chain-of-Thought Compression (MACC), a framework that leverages the token…

计算与语言 · 计算机科学 2025-09-29 Jianzhi Yan , Le Liu , Youcheng Pan , Shiwei Chen , Zike Yuan , Yang Xiang , Buzhou Tang

Long-context reasoning has significantly empowered large language models (LLMs) to tackle complex tasks, yet it introduces severe efficiency bottlenecks due to the computational complexity. Existing efficient approaches often rely on…

计算与语言 · 计算机科学 2026-02-03 Yibo Wang , Yongcheng Jing , Shunyu Liu , Hao Guan , Rong-cheng Tu , Chengyu Wang , Jun Huang , Dacheng Tao

Language Reasoning Models (LRMs) achieve strong performance by scaling test-time computation but often suffer from ``overthinking'', producing excessively long reasoning traces that increase latency and memory usage. Existing LRMs typically…

While reasoning large language models (LLMs) demonstrate remarkable performance across various tasks, they also contain notable security vulnerabilities. Recent research has uncovered a "thinking-stopped" vulnerability in DeepSeek-R1, where…

密码学与安全 · 计算机科学 2025-04-30 Yu Cui , Yujun Cai , Yiwei Wang

While recent advances in large reasoning models have demonstrated remarkable performance, efficient reasoning remains critical due to the rapid growth of output length. Existing optimization approaches highlights a tendency toward…

计算与语言 · 计算机科学 2025-06-17 Kaiyuan Liu , Chen Shen , Zhanwei Zhang , Junjie Liu , Xiaosong Yuan , Jieping ye

Tree of Thoughts (ToT) enhances Large Language Model (LLM) reasoning by structuring problem-solving as a spanning tree. However, recent methods focus on search accuracy while overlooking computational efficiency. The challenges of…