English
Related papers

Related papers: Dissecting Chain-of-Thought: Compositionality thro…

200 papers

Chain-of-thought (CoT) prompting has been widely adopted to enhance the reasoning capabilities of large language models (LLMs). However, the effectiveness of CoT reasoning is inconsistent across tasks with different reasoning types. This…

Machine Learning · Computer Science 2025-06-17 Yue Wan , Xiaowei Jia , Xiang Lorraine Li

In information retrieval, large language models (LLMs) have demonstrated remarkable potential in text reranking tasks by leveraging their sophisticated natural language understanding and advanced reasoning capabilities. However,…

Information Retrieval · Computer Science 2025-09-22 Haowei Liu , Xuyang Wu , Guohao Sun , Zhiqiang Tao , Yi Fang

Chain-of-Thought (CoT) reasoning improves multi-step mathematical problem solving in large language models but remains vulnerable to exposure bias and error accumulation, as early mistakes propagate irreversibly through autoregressive…

Computation and Language · Computer Science 2026-04-21 Shidong Cao , Hongzhan Lin , Yuxuan Gu , Ziyang Luo , Jing Ma

The chain-of-though (CoT) prompting methods were successful in various natural language processing (NLP) tasks thanks to their ability to unveil the underlying complex reasoning processes. Such reasoning processes typically exhibit…

Computation and Language · Computer Science 2023-05-30 Ziqi Jin , Wei Lu

Chain-of-Thought (CoT) prompting can effectively elicit complex multi-step reasoning from Large Language Models~(LLMs). For example, by simply adding CoT instruction ``Let's think step-by-step'' to each input query of MultiArith dataset,…

Artificial Intelligence · Computer Science 2023-04-19 Jiuhai Chen , Lichang Chen , Heng Huang , Tianyi Zhou

Large language models (LLMs) have shown impressive performance on complex reasoning by leveraging chain-of-thought (CoT) prompting to generate intermediate reasoning chains as the rationale to infer the answer. However, existing CoT studies…

Computation and Language · Computer Science 2024-05-21 Zhuosheng Zhang , Aston Zhang , Mu Li , Hai Zhao , George Karypis , Alex Smola

Chain of Thought (CoT) reasoning has demonstrated remarkable deep reasoning capabilities in both large language models (LLMs) and multimodal large language models (MLLMs). However, its reliability is often undermined by the accumulation of…

Artificial Intelligence · Computer Science 2025-11-26 Zijun Chen , Wenbo Hu , Richang Hong

Recently, there has been significant progress in teaching language models to perform step-by-step reasoning to solve complex numerical reasoning tasks. Chain-of-thoughts prompting (CoT) is by far the state-of-art method for these tasks. CoT…

Computation and Language · Computer Science 2023-10-24 Wenhu Chen , Xueguang Ma , Xinyi Wang , William W. Cohen

Chain of Thought (CoT) is significant in improving the reasoning abilities of large language models (LLMs). However, the correlation between the effectiveness of CoT and the length of reasoning steps in prompts remains largely unknown. To…

Computation and Language · Computer Science 2024-06-25 Mingyu Jin , Qinkai Yu , Dong Shu , Haiyan Zhao , Wenyue Hua , Yanda Meng , Yongfeng Zhang , Mengnan Du

Large Language Models (LLMs) using Chain-of-Thought (CoT) prompting excel at complex reasoning but generate verbose thought processes with considerable redundancy, leading to increased inference costs and reduced efficiency. We introduce a…

Artificial Intelligence · Computer Science 2026-02-17 Zeju Li , Jianyuan Zhong , Ziyang Zheng , Xiangyu Wen , Zhijian Xu , Yingying Cheng , Fan Zhang , Qiang Xu

Step-by-step reasoning approaches like chain of thought (CoT) have proved to be very effective in inducing reasoning capabilities in large language models. However, the success of the CoT approach is fundamentally tied to the model size,…

Machine Learning · Computer Science 2023-05-19 Kumar Shridhar , Alessandro Stolfo , Mrinmaya Sachan

Chain-of-Thought (CoT) prompting has proven highly effective for enhancing complex reasoning in Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs). Yet, it struggles in complex spatial reasoning tasks. Nonetheless,…

Computation and Language · Computer Science 2025-01-14 Chengzu Li , Wenshan Wu , Huanyu Zhang , Yan Xia , Shaoguang Mao , Li Dong , Ivan Vulić , Furu Wei

Chain-of-Thought (CoT) prompting can enhance the reasoning capabilities of large language models (LLMs), establishing itself as a primary approach to solving complex reasoning tasks. Existing CoT synthesis approaches usually focus on…

Computation and Language · Computer Science 2024-03-22 Xiaoxue Cheng , Junyi Li , Wayne Xin Zhao , Ji-Rong Wen

Reasoning with a chain-of-thought (CoT) enables Large Language Models (LLMs) to solve complex tasks but incurs significant inference costs due to the generation of long rationales. We propose Thinking States, a method that performs…

Computation and Language · Computer Science 2026-02-10 Ido Amos , Avi Caciularu , Mor Geva , Amir Globerson , Jonathan Herzig , Lior Shani , Idan Szpektor

Chain-of-Thought (CoT) prompting has emerged as a powerful technique for enhancing language model's reasoning capabilities. However, generating long and correct CoT trajectories is challenging. Recent studies have demonstrated that Looped…

Computation and Language · Computer Science 2025-02-13 Qifan Yu , Zhenyu He , Sijie Li , Xun Zhou , Jun Zhang , Jingjing Xu , Di He

Chain-of-Thought (CoT) prompting has been shown to be effective in eliciting structured reasoning (i.e., CoT reasoning) from large language models (LLMs). Regardless of its popularity, recent studies expose its failures in some reasoning…

Artificial Intelligence · Computer Science 2026-05-12 Chengshuai Zhao , Zhen Tan , Pingchuan Ma , Dawei Li , Bohan Jiang , Yancheng Wang , Yingzhen Yang , Huan Liu

Large language models (LLMs) excel at complex reasoning but can still exhibit harmful behaviors. Current alignment strategies typically embed safety into model weights, making these controls implicit, static, and difficult to modify. This…

Computation and Language · Computer Science 2025-10-15 Xuanming Zhang , Yuxuan Chen , Samuel Yeh , Sharon Li

This report examines the effectiveness of Chain-of-Thought (CoT) prompting in improving the multi-step reasoning abilities of large language models (LLMs). Inspired by previous studies \cite{Min2022RethinkingWork}, we analyze the impact of…

Computation and Language · Computer Science 2023-09-29 Aayush Mishra , Karan Thakkar

Large Language Models (LLMs) excel in reasoning tasks through Chain-of-Thought (CoT) prompting. However, CoT prompting greatly increases computational demands, which has prompted growing interest in distilling CoT capabilities into Small…

Computation and Language · Computer Science 2025-05-28 Xinghao Chen , Zhijing Sun , Wenjin Guo , Miaoran Zhang , Yanjun Chen , Yirong Sun , Hui Su , Yijie Pan , Dietrich Klakow , Wenjie Li , Xiaoyu Shen

Recently, inference-time scaling of chain-of-thought (CoT) has been demonstrated as a promising approach for addressing multi-modal reasoning tasks. While existing studies have predominantly centered on text-based thinking, the integration…

Computation and Language · Computer Science 2025-05-27 Yujie Lin , Ante Wang , Moye Chen , Jingyao Liu , Hao Liu , Jinsong Su , Xinyan Xiao