English
Related papers

Related papers: Data Shifts Hurt CoT: A Theoretical Study

200 papers

Large Language Models (LLMs) excel in reasoning tasks through Chain-of-Thought (CoT) prompting. However, CoT prompting greatly increases computational demands, which has prompted growing interest in distilling CoT capabilities into Small…

Computation and Language · Computer Science 2025-05-28 Xinghao Chen , Zhijing Sun , Wenjin Guo , Miaoran Zhang , Yanjun Chen , Yirong Sun , Hui Su , Yijie Pan , Dietrich Klakow , Wenjie Li , Xiaoyu Shen

Large Language Models (LLMs) have shown remarkable progress across domains, yet their ability to perform inductive reasoning - inferring latent rules from sparse examples - remains limited. It is often assumed that chain-of-thought (CoT)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Haibo Jin , Peiyan Zhang , Man Luo , Haohan Wang

Chain-of-Thought (CoT) prompting significantly enhances model reasoning, yet its internal mechanisms remain poorly understood. We analyze CoT's operational principles by reversely tracing information flow across decoding, projection, and…

Artificial Intelligence · Computer Science 2026-05-27 Hao Yang , Qinghua Zhao , Lei Li , Lingyi Meng , Mengda Yu

Scaling language models to larger and deeper sizes has led to significant boosts in performance. Even though the size of these models limits their application in compute-constrained environments, the race to continually develop ever larger…

Computation and Language · Computer Science 2024-08-16 Amirkeivan Mohtashami , Matteo Pagliardini , Martin Jaggi

Multi-step reasoning is essential for large language models (LLMs), yet multilingual performance remains challenging. While Chain-of-Thought (CoT) prompting improves reasoning, it struggles with non-English languages due to the entanglement…

Chain of thought (CoT) is a reasoning framework that can enhance the performance of Large Language Models (LLMs) on complex inference tasks. In particular, among various studies related to CoT, multi-path inference stands out as a simple…

Computation and Language · Computer Science 2024-12-31 Ziqi Zhang , Cunxiang Wang , Xiong Xiao , Yue Zhang , Donglin Wang

While Chain-of-Thought (CoT) prompting boosts Language Models' (LM) performance on a gamut of complex reasoning tasks, the generated reasoning chain does not necessarily reflect how the model arrives at the answer (aka. faithfulness). We…

Computation and Language · Computer Science 2023-09-22 Qing Lyu , Shreya Havaldar , Adam Stein , Li Zhang , Delip Rao , Eric Wong , Marianna Apidianaki , Chris Callison-Burch

Chain-of-Thought (CoT) is widely applied to enhance the LLM capability in math, coding and reasoning tasks. However, its performance is limited for open-domain tasks, when there are no clearly defined reasoning steps or logical transitions.…

Computation and Language · Computer Science 2025-11-18 Qingqing Gu , Dan Wang , Yue Zhao , Xiaoyu Wang , Zhonglin Jiang , Yong Chen , Hongyan Li , Luo Ji

Chain-of-thought (CoT) prompting enables large language models (LLMs) to solve complex reasoning tasks by generating an explanation before the final prediction. Despite it's promising ability, a critical downside of CoT prompting is that…

Computation and Language · Computer Science 2023-03-08 Seungone Kim , Se June Joo , Yul Jang , Hyungjoo Chae , Jinyoung Yeo

Chain-of-thought (CoT) reasoning in vision language models (VLMs) is crucial for improving interpretability and trustworthiness. However, current training recipes lack robust CoT reasoning data, relying on datasets dominated by short…

Artificial Intelligence · Computer Science 2024-10-22 Ruohong Zhang , Bowen Zhang , Yanghao Li , Haotian Zhang , Zhiqing Sun , Zhe Gan , Yinfei Yang , Ruoming Pang , Yiming Yang

Chain-of-Thought (CoT) has been a widely adopted prompting method, eliciting impressive reasoning abilities of Large Language Models (LLMs). Inspired by the sequential thought structure of CoT, a number of Chain-of-X (CoX) methods have been…

Computation and Language · Computer Science 2025-02-07 Yu Xia , Rui Wang , Xu Liu , Mingyan Li , Tong Yu , Xiang Chen , Julian McAuley , Shuai Li

As chain-of-thought (CoT) has become central to scaling reasoning capabilities in large language models (LLMs), it has also emerged as a promising tool for interpretability, suggesting the opportunity to understand model decisions through…

Artificial Intelligence · Computer Science 2026-03-03 Kyle Cox , Darius Kianersi , Adrià Garriga-Alonso

Chain-of-thought (CoT) reasoning is useful for monitoring language models only when the reasoning trace faithfully reflects the computation that produces the final answer. However, models can rely on prompt-to-answer shortcuts that bypass…

Machine Learning · Computer Science 2026-05-26 Jinghan Jia , Joe Benton , Eric Easley

Large Reasoning Models (LRMs) leverage Chain-of-Thought (CoT) reasoning to solve complex tasks, but this explicit reasoning process introduces a critical vulnerability: adversarial manipulation of the thought chain itself, known as…

Machine Learning · Computer Science 2026-02-13 Zihao Xue , Zhen Bi , Long Ma , Zhenlin Hu , Yan Wang , Xueshu Chen , Zhenfang Liu , Kang Zhao , Jie Xiao , Jungang Lou

Large Language Models (LLMs) often exhibit \textit{hallucinations}, generating factually incorrect or semantically irrelevant content in response to prompts. Chain-of-Thought (CoT) prompting can mitigate hallucinations by encouraging…

Computation and Language · Computer Science 2025-09-17 Jiahao Cheng , Tiancheng Su , Jia Yuan , Guoxiu He , Jiawei Liu , Xinqi Tao , Jingwen Xie , Huaxia Li

Test-time compute scaling has demonstrated the ability to improve the performance of reasoning language models by generating longer chain-of-thought (CoT) sequences. However, this increase in performance comes with a significant increase in…

Artificial Intelligence · Computer Science 2025-09-24 Adarsha Balaji , Le Chen , Rajeev Thakur , Franck Cappello , Sandeep Madireddy

We study how different Chain-of-Thought (CoT) designs affect the acquisition of the generalizable visual reasoning ability in vision-language models (VLMs). While CoT data, especially long or visual CoT such as "think with image", has been…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yifan Du , Kun Zhou , Yingqian Min , Yue Ling , Wayne Xin Zhao , Youbin Wu

Large Language Models (LLMs) have demonstrated remarkable performance in many applications, including challenging reasoning problems via chain-of-thoughts (CoTs) techniques that generate ``thinking tokens'' before answering the questions.…

Machine Learning · Computer Science 2025-11-04 Hanlin Zhu , Shibo Hao , Zhiting Hu , Jiantao Jiao , Stuart Russell , Yuandong Tian

While chain-of-thought (CoT) distillation from advanced large language models (LLMs) has proven effective in general reasoning tasks, it struggles in scientific domains where even advanced models often produce incorrect or superficial…

Computation and Language · Computer Science 2025-10-17 Kehua Feng , Keyan Ding , Zhihui Zhu , Lei Liang , Qiang Zhang , Huajun Chen

Large language models (LLMs) can now solve complex problems through long chain-of-thought (CoT) reasoning, but the trade-off between performance and token cost remains a central challenge. To address this issue, supervised fine-tuning (SFT)…

Artificial Intelligence · Computer Science 2026-05-28 Kohsei Matsutani , Gouki Minegishi , Takeshi Kojima , Yusuke Iwasawa , Yutaka Matsuo