English
Related papers

Related papers: Does Chain-of-Thought Reasoning Really Reduce Harm…

200 papers

The development of Long-CoT reasoning has advanced LLM performance across various tasks, including language understanding, complex problem solving, and code generation. This paradigm enables models to generate intermediate reasoning steps,…

Computation and Language · Computer Science 2025-09-05 Yanbo Wang , Yongcan Yu , Jian Liang , Ran He

Large Language Models (LLMs), despite their impressive capabilities across domains, have been shown to be vulnerable to backdoor attacks. Prior backdoor strategies predominantly operate at the token level, where an injected trigger causes…

Cryptography and Security · Computer Science 2026-04-17 Vu Tuan Truong , Long Bao Le

Large Language Models (LLMs) significantly benefit from Chain-of-Thought (CoT) prompting in performing various reasoning tasks. While CoT allows models to produce more comprehensive reasoning processes, its emphasis on intermediate…

Computation and Language · Computer Science 2023-10-05 Zhan Ling , Yunhao Fang , Xuanlin Li , Zhiao Huang , Mingu Lee , Roland Memisevic , Hao Su

Test-time compute scaling has demonstrated the ability to improve the performance of reasoning language models by generating longer chain-of-thought (CoT) sequences. However, this increase in performance comes with a significant increase in…

Artificial Intelligence · Computer Science 2025-09-24 Adarsha Balaji , Le Chen , Rajeev Thakur , Franck Cappello , Sandeep Madireddy

Chain of Thought (CoT) was introduced in recent research as a method for improving step-by-step reasoning in Large Language Models. However, CoT has limited applications such as its need for hand-crafted few-shot exemplar prompts and no…

Computation and Language · Computer Science 2024-12-11 Arda Sevinc , Abdurrahman Gumus

Recent studies have discovered that Chain-of-Thought prompting (CoT) can dramatically improve the performance of Large Language Models (LLMs), particularly when dealing with complex tasks involving mathematics or reasoning. Despite the…

Machine Learning · Computer Science 2023-12-27 Guhao Feng , Bohang Zhang , Yuntian Gu , Haotian Ye , Di He , Liwei Wang

Few-shot Chain-of-Thought (CoT) prompting has demonstrated strong performance in improving the reasoning capabilities of large language models (LLMs). While theoretical investigations have been conducted to understand CoT, the underlying…

Computation and Language · Computer Science 2024-10-23 Yingqian Cui , Pengfei He , Xianfeng Tang , Qi He , Chen Luo , Jiliang Tang , Yue Xing

Chain-of-thought (CoT) outputs let us read a model's step-by-step reasoning. Since any long, serial reasoning process must pass through this textual trace, the quality of the CoT is a direct window into what the model is thinking. This…

Machine Learning · Computer Science 2025-12-02 Austin Meek , Eitan Sprejer , Iván Arcuschin , Austin J. Brockmeier , Steven Basart

Language models trained via outcome-based reinforcement learning (RL) to reason using chain-of-thought (CoT) have shown remarkable performance. Monitoring such a model's CoT may allow us to understand its intentions and detect potential…

Machine Learning · Computer Science 2025-11-03 Arun Jose

Large language models (LLMs) perform better when they produce step-by-step, "Chain-of-Thought" (CoT) reasoning before answering a question, but it is unclear if the stated reasoning is a faithful explanation of the model's actual reasoning…

Chain-of-Thought (CoT) is a critical technique in enhancing the reasoning ability of Large Language Models (LLMs), and latent reasoning methods have been proposed to accelerate the inefficient token-level reasoning chain. We notice that…

Computation and Language · Computer Science 2026-02-05 Fangwei Zhu , Zhifang Sui

Chain-of-Thought (CoT) reasoning has emerged as a powerful tool for enhancing the problem-solving capabilities of large language models (LLMs). However, the theoretical foundations of learning from CoT data remain underdeveloped, and…

Artificial Intelligence · Computer Science 2025-07-29 Shai Shalev-Shwartz , Amnon Shashua

While the recent Chain-of-Thought (CoT) technique enhances the reasoning ability of large language models (LLMs) with the theory of mind, it might still struggle in handling logical reasoning that relies much on symbolic expressions and…

Computation and Language · Computer Science 2024-06-12 Jundong Xu , Hao Fei , Liangming Pan , Qian Liu , Mong-Li Lee , Wynne Hsu

Large language models have emerged as powerful tools for general intelligence, showcasing advanced natural language processing capabilities that find applications across diverse domains. Despite their impressive performance, recent studies…

Computation and Language · Computer Science 2025-04-01 Elita Lobo , Chirag Agarwal , Himabindu Lakkaraju

Chain-of-Thought (CoT) prompting has improved LLM reasoning, but models often generate explanations that appear coherent while containing unfaithful intermediate steps. Existing self-evaluation approaches are prone to inherent biases: the…

Artificial Intelligence · Computer Science 2026-04-21 Yuxi Sun , Aoqi Zuo , Haotian Xie , Wei Gao , Mingming Gong , Jing Ma

Recent findings suggest that misaligned models may exhibit deceptive behavior, raising concerns about output trustworthiness. Chain-of-thought (CoT) is a promising tool for alignment monitoring: when models articulate their reasoning…

Cryptography and Security · Computer Science 2025-10-24 Artur Zolkowski , Wen Xing , David Lindner , Florian Tramèr , Erik Jenner

Recent reasoning-based safety guardrails for Large Reasoning Models (LRMs), such as deliberative alignment, have shown strong defense against jailbreak attacks. By leveraging LRMs' reasoning ability, these guardrails help the models to…

Cryptography and Security · Computer Science 2025-10-24 Shuo Chen , Zhen Han , Haokun Chen , Bailan He , Shengyun Si , Jingpei Wu , Philip Torr , Volker Tresp , Jindong Gu

Chain-of-Thought (CoT) reasoning enhances the decision-making capabilities of vision-language-action models in autonomous driving, but its autoregressive nature introduces significant inference latency, making it impractical for real-time…

Robotics · Computer Science 2026-02-04 Yi Gu , Yan Wang , Yuxiao Chen , Yurong You , Wenjie Luo , Yue Wang , Wenhao Ding , Boyi Li , Heng Yang , Boris Ivanovic , Marco Pavone

Chain-of-Thought (CoT) prompting has been shown to be effective in eliciting structured reasoning (i.e., CoT reasoning) from large language models (LLMs). Regardless of its popularity, recent studies expose its failures in some reasoning…

Artificial Intelligence · Computer Science 2026-05-12 Chengshuai Zhao , Zhen Tan , Pingchuan Ma , Dawei Li , Bohan Jiang , Yancheng Wang , Yingzhen Yang , Huan Liu

Chain-of-Thought (CoT) reasoning enhances large language models (LLMs) by decomposing complex problems into step-by-step solutions, improving performance on reasoning tasks. However, current CoT disclosure policies vary widely across…

Computers and Society · Computer Science 2025-03-20 Yihang Chen , Haikang Deng , Kaiqiao Han , Qingyue Zhao