English
Related papers

Related papers: Uncertainty-Guided Chain-of-Thought for Code Gener…

200 papers

Large Language Models (LLMs) can achieve strong performance on many tasks by producing step-by-step reasoning before giving a final output, often referred to as chain-of-thought reasoning (CoT). It is tempting to interpret these CoT…

Computation and Language · Computer Science 2023-12-12 Miles Turpin , Julian Michael , Ethan Perez , Samuel R. Bowman

Chain-of-Thought (CoT) reasoning has been widely adopted to enhance Large Language Models (LLMs) by decomposing complex tasks into simpler, sequential subtasks. However, extending CoT to vision-language reasoning tasks remains challenging,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Luozheng Qin , Jia Gong , Yuqing Sun , Tianjiao Li , Mengping Yang , Xiaomeng Yang , Chao Qu , Zhiyu Tan , Hao Li

Chain-of-thought (CoT) prompting has become central to mathematical reasoning in large language models, yet models remain brittle to early errors: a single arithmetic slip or unjustified inference typically propagates uncorrected to an…

Machine Learning · Computer Science 2025-12-22 Saraswathy Amjith , Mihika Dusad , Neha Muramalla , Shweta Shah

Chain-of-Thought (CoT) reasoning enhances large language models (LLMs) by decomposing complex problems into step-by-step solutions, improving performance on reasoning tasks. However, current CoT disclosure policies vary widely across…

Computers and Society · Computer Science 2025-03-20 Yihang Chen , Haikang Deng , Kaiqiao Han , Qingyue Zhao

Chain of thought (CoT) is a reasoning framework that can enhance the performance of Large Language Models (LLMs) on complex inference tasks. In particular, among various studies related to CoT, multi-path inference stands out as a simple…

Computation and Language · Computer Science 2024-12-31 Ziqi Zhang , Cunxiang Wang , Xiong Xiao , Yue Zhang , Donglin Wang

Multi-step reasoning is essential for large language models (LLMs), yet multilingual performance remains challenging. While Chain-of-Thought (CoT) prompting improves reasoning, it struggles with non-English languages due to the entanglement…

Chain-of-Thought (CoT) prompting has been used to enhance the reasoning capability of LLMs. However, its reliability in security-sensitive analytical tasks remains insufficiently examined, particularly under structured human evaluation.…

Cryptography and Security · Computer Science 2026-04-07 Jiling Zhou , Aisvarya Adeseye , Seppo Virtanen , Antti Hakkala , Jouni Isoaho

With the remarkable success of Multimodal Large Language Models (MLLMs) in perception tasks, enhancing their complex reasoning capabilities has emerged as a critical research focus. Existing models still suffer from challenges such as…

Computation and Language · Computer Science 2025-12-01 Wenxin Zhu , Andong Chen , Yuchen Song , Kehai Chen , Conghui Zhu , Ziyan Chen , Tiejun Zhao

This study investigates the internal information flow of large language models (LLMs) while performing chain-of-thought (CoT) style reasoning. Specifically, with a particular interest in the faithfulness of the CoT explanation to LLMs'…

Computation and Language · Computer Science 2026-03-20 Keito Kudo , Yoichi Aoki , Tatsuki Kuribayashi , Shusaku Sone , Masaya Taniguchi , Ana Brassard , Keisuke Sakaguchi , Kentaro Inui

Chain-based reasoning methods like chain of thought (CoT) play a rising role in solving reasoning tasks for large language models (LLMs). However, the causal hallucinations between a step of reasoning and corresponding state transitions are…

Computation and Language · Computer Science 2025-03-25 Kangsheng Wang , Xiao Zhang , Juntao Lyu , Tianyu Hu , Huimin Ma

Large reasoning models (LRMs) like OpenAI-o1 have shown impressive capabilities in natural language reasoning. However, these models frequently demonstrate inefficiencies or inaccuracies when tackling complex mathematical operations. While…

Computation and Language · Computer Science 2025-10-24 Chengpeng Li , Zhengyang Tang , Ziniu Li , Mingfeng Xue , Keqin Bao , Tian Ding , Ruoyu Sun , Benyou Wang , Xiang Wang , Junyang Lin , Dayiheng Liu

This report examines the effectiveness of Chain-of-Thought (CoT) prompting in improving the multi-step reasoning abilities of large language models (LLMs). Inspired by previous studies \cite{Min2022RethinkingWork}, we analyze the impact of…

Computation and Language · Computer Science 2023-09-29 Aayush Mishra , Karan Thakkar

Recently, with the chain of thought (CoT) prompting, large language models (LLMs), e.g., GPT-3, have shown strong reasoning ability in several natural language processing tasks such as arithmetic, commonsense, and logical reasoning.…

Artificial Intelligence · Computer Science 2023-10-20 Yixuan Weng , Minjun Zhu , Fei Xia , Bin Li , Shizhu He , Shengping Liu , Bin Sun , Kang Liu , Jun Zhao

Recently, DeepSeek-R1 (671B) (DeepSeek-AIet al., 2025) has demonstrated its excellent reasoning ability in complex tasks and has publiclyshared its methodology. This provides potentially high-quality chain-of-thought (CoT) data for…

Artificial Intelligence · Computer Science 2025-04-17 Qianjin Yu , Keyu Wu , Zihan Chen , Chushu Zhang , Manlin Mei , Lingjun Huang , Fang Tan , Yongsheng Du , Kunlin Liu , Yurui Zhu

Ensuring the reliability of Large Language Models (LLMs) in complex reasoning tasks remains a formidable challenge, particularly in scenarios that demand precise mathematical calculations and knowledge-intensive open-domain generation. In…

Machine Learning · Computer Science 2025-05-27 Ali Razghandi , Seyed Mohammad Hadi Hosseini , Mahdieh Soleymani Baghshah

Current research found the issue of Early Answering in large language models (LLMs), where the models already have an answer before generating the Chain-of-Thought (CoT). This phenomenon suggests a potential lack of necessary dependency…

Computation and Language · Computer Science 2025-03-18 Zezhong Wang , Xingshan Zeng , Weiwen Liu , Yufei Wang , Liangyou Li , Yasheng Wang , Lifeng Shang , Xin Jiang , Qun Liu , Kam-Fai Wong

Large Reasoning Models (LRMs) have recently demonstrated significant improvements in complex reasoning. While quantifying generation uncertainty in LRMs is crucial, traditional methods are often insufficient because they do not provide…

Artificial Intelligence · Computer Science 2026-04-16 Yangyi Li , Chenxu Zhao , Mengdi Huai

Implicit Chain-of-Thought (CoT) methods offer a token-efficient alternative to explicit CoT reasoning in Large Language Models (LLMs), but a persistent performance gap has limited their adoption. We identify a core latent instability issue…

Computation and Language · Computer Science 2025-09-26 Xilin Wei , Xiaoran Liu , Yuhang Zang , Xiaoyi Dong , Yuhang Cao , Jiaqi Wang , Xipeng Qiu , Dahua Lin

Large Language Models (LLMs) leverage chain-of-thought (CoT) prompting to provide step-by-step rationales, improving performance on complex tasks. Despite its benefits, vanilla CoT often fails to fully verify intermediate inferences and can…

Computation and Language · Computer Science 2025-02-05 Manish Sanwal

Large language models (LLMs) with Chain-of-thought (CoT) have recently emerged as a powerful technique for eliciting reasoning to improve various downstream tasks. As most research mainly focuses on English, with few explorations in a…

Computation and Language · Computer Science 2024-07-11 Huiyuan Lai , Malvina Nissim