中文
相关论文

相关论文: Accelerating Structured Chain-of-Thought in Autono…

200 篇论文

Recently, the introduction of Chain-of-Thought (CoT) has largely improved the generation ability of unified models. However, it is observed that the current thinking process during generation mainly focuses on the text consistency with the…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Zixuan Ye , Quande Liu , Cong Wei , Yuanxing Zhang , Xintao Wang , Pengfei Wan , Kun Gai , Wenhan Luo

Reasoning ability is one of the most crucial capabilities of a foundation model, signifying its capacity to address complex reasoning tasks. Chain-of-Thought (CoT) technique is widely regarded as one of the effective methods for enhancing…

计算与语言 · 计算机科学 2023-08-14 Fanglong Yao , Changyuan Tian , Jintao Liu , Zequn Zhang , Qing Liu , Li Jin , Shuchao Li , Xiaoyu Li , Xian Sun

Recently, Chain-of-Thought (CoT) prompting has delivered success on complex reasoning tasks, which aims at designing a simple prompt like ``Let's think step by step'' or multiple in-context exemplars with well-designed rationales to elicit…

计算与语言 · 计算机科学 2024-06-04 Jianing Wang , Qiushi Sun , Xiang Li , Ming Gao

Language models are known to absorb biases from their training data, leading to predictions driven by statistical regularities rather than semantic relevance. We investigate the impact of these biases on answer choice preferences in the…

计算与语言 · 计算机科学 2025-08-12 Kyle Moore , Jesse Roberts , Thao Pham , Douglas Fisher

Large language models (LLMs) can achieve highly effective performance on various reasoning tasks by incorporating step-by-step chain-of-thought (CoT) prompting as demonstrations. However, the reasoning chains of demonstrations generated by…

计算与语言 · 计算机科学 2024-03-18 Jiashuo Sun , Yi Luo , Yeyun Gong , Chen Lin , Yelong Shen , Jian Guo , Nan Duan

Chain-of-Thought (CoT) prompting plays an indispensable role in endowing large language models (LLMs) with complex reasoning capabilities. However, CoT currently faces two fundamental challenges: (1) Sufficiency, which ensures that the…

计算与语言 · 计算机科学 2025-10-28 Xiangning Yu , Zhuohan Wang , Linyi Yang , Haoxuan Li , Anjie Liu , Xiao Xue , Jun Wang , Mengyue Yang

Recently, diffusion models have garnered significant interest in the field of text processing due to their many potential advantages compared to conventional autoregressive models. In this work, we propose Diffusion-of-Thought (DoT), a…

计算与语言 · 计算机科学 2024-12-06 Jiacheng Ye , Shansan Gong , Liheng Chen , Lin Zheng , Jiahui Gao , Han Shi , Chuan Wu , Xin Jiang , Zhenguo Li , Wei Bi , Lingpeng Kong

Chain-of-thought (CoT) prompting has become a widely used strategy for improving large language and multimodal model performance. However, it is still an open question under which settings CoT systematically reduces performance. In this…

机器学习 · 计算机科学 2025-06-17 Ryan Liu , Jiayi Geng , Addison J. Wu , Ilia Sucholutsky , Tania Lombrozo , Thomas L. Griffiths

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…

Chain-of-thought (CoT) reasoning enables large language models (LLMs) to move beyond fast System-1 responses and engage in deliberative System-2 reasoning. However, this comes at the cost of significant inefficiency due to verbose…

计算与语言 · 计算机科学 2025-06-03 Xiaoqiang Wang , Suyuchen Wang , Yun Zhu , Bang Liu

Enhancing the reasoning capability of large language models (LLMs) remains a core challenge in natural language processing. The Chain-of-Thought (CoT) paradigm dominates practical applications for its single-round efficiency, yet its…

Chain-of-thought (CoT) prompting is a de-facto standard technique to elicit reasoning-like responses from large language models (LLMs), allowing them to spell out individual steps before giving a final answer. While the resemblance to…

人工智能 · 计算机科学 2026-02-26 Gregor Bachmann , Yichen Jiang , Seyed Mohsen Moosavi Dezfooli , Moin Nabi

Long chain-of-thought reasoning (Long CoT) is now fundamental to state-of-the-art LLMs, especially in mathematical reasoning. However, LLM generation is highly sequential, and long CoTs lead to a high latency. We propose to train…

机器学习 · 计算机科学 2026-02-02 Arvind Mahankali , Kaiyue Wen , Tengyu Ma

Multimodal models for text-to-image generation have achieved strong visual fidelity, yet they remain brittle under compositional structural constraints-notably generative numeracy, attribute binding, and part-level relations. To address…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Yu Huo , Siyu Zhang , Kun Zeng , Haoyue Liu , Owen Lee , Junlin Chen , Yuquan Lu , Yifu Guo , Yaodong Liang , Xiaoying Tang

Vision-Language Models (VLM) exhibit strong reasoning capabilities, showing promise for end-to-end autonomous driving systems. Chain-of-Thought (CoT), as VLM's widely used reasoning strategy, is facing critical challenges. Existing textual…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Lingjun Zhang , Yujian Yuan , Changjie Wu , Xinyuan Chang , Xin Cai , Shuang Zeng , Linzhe Shi , Sijin Wang , Hang Zhang , Mu Xu

Chain-of-Thought (CoT) prompting has shown promise in enhancing the reasoning capabilities of large language models (LLMs) on text-attributed graphs (TAGs). This work reframes CoT-based graph learning through the principle of clustering as…

人工智能 · 计算机科学 2026-05-26 Xuanting Xie , Zhaochen Guo , Bingheng Li , Xingtong Yu , Zhifei Liao , Zhao Kang , Yuan Fang

In enhancing the reasoning capabilities of large language models (LLMs), prior research primarily focuses on specific prompting techniques such as few-shot or zero-shot chain-of-thought (CoT) prompting. These methods, while effective, often…

计算与语言 · 计算机科学 2024-05-27 Xuezhi Wang , Denny Zhou

Chain-of-thought (CoT) significantly enhances the performance of large language models (LLMs) across a wide range of tasks, and prior research shows that CoT can theoretically increase expressiveness. However, there is limited mechanistic…

计算与语言 · 计算机科学 2025-06-04 Yifan Zhang , Wenyu Du , Dongming Jin , Jie Fu , Zhi Jin

While Chain-of-Thought (CoT) significantly enhances the performance of Large Language Models (LLMs), explicit reasoning chains introduce substantial computational redundancy. Recent latent reasoning methods attempt to mitigate this by…

计算与语言 · 计算机科学 2026-02-02 Fanmeng Wang , Haotian Liu , Guojiang Zhao , Hongteng Xu , Zhifeng Gao

Chain-of-thought and more broadly test-time compute are known to augment the expressive capabilities of language models and have led to major innovations in reasoning. Motivated by this success, this paper explores latent chain-of-thought…

机器学习 · 计算机科学 2026-05-20 Carson Dudley , Samet Oymak