English
Related papers

Related papers: Thought Purity: A Defense Framework For Chain-of-T…

200 papers

Large language models are typically trained on vast amounts of data during the pre-training phase, which may include some potentially harmful information. Fine-tuning attacks can exploit this by prompting the model to reveal such…

Cryptography and Security · Computer Science 2025-02-04 Zhiyuan Xu , Joseph Gardiner , Sana Belguith

Chain-of-Thought (CoT) prompting symbolized a huge improvement of reasoning capabilities of Large Language Models (LLMs). However, scaling up test-time computation yields extensive CoT sequences, introducing severe inference latency and…

Machine Learning · Computer Science 2026-05-12 Tianhao Qian

Chain-of-Thought (CoT) prompting can enhance the reasoning capabilities of large language models (LLMs), establishing itself as a primary approach to solving complex reasoning tasks. Existing CoT synthesis approaches usually focus on…

Computation and Language · Computer Science 2024-03-22 Xiaoxue Cheng , Junyi Li , Wayne Xin Zhao , Ji-Rong Wen

The deployment of Large Reasoning Models (LRMs) in high-stakes decision-making pipelines has introduced a novel and opaque attack surface: reasoning backdoors. In these attacks, the model's intermediate Chain-of-Thought (CoT) is manipulated…

Cryptography and Security · Computer Science 2026-03-04 Zhen Guo , Shanghao Shi , Hao Li , Shamim Yazdani , Ning Zhang , Reza Tourani

Large Language Models (LLMs) leverage chain-of-thought (CoT) prompting to provide step-by-step rationales, improving performance on complex tasks. Despite its benefits, vanilla CoT often fails to fully verify intermediate inferences and can…

Computation and Language · Computer Science 2025-02-05 Manish Sanwal

Large Multimodal Models (LMMs) face limitations in geometric reasoning due to insufficient Chain of Thought (CoT) image-text training data. While existing approaches leverage template-based or LLM-assisted methods for geometric CoT data…

Artificial Intelligence · Computer Science 2025-06-02 Linger Deng , Linghao Zhu , Yuliang Liu , Yu Wang , Qunyi Xie , Jingjing Wu , Gang Zhang , Yingying Zhu , Xiang Bai

While Long Chain-of-Thought (CoT) reasoning significantly improves Large Language Models (LLMs) performance on complex reasoning tasks, the substantial computational and memory costs of generating long CoT sequences limit their efficiency…

Artificial Intelligence · Computer Science 2026-02-03 Liang Zhang , Yu Zhao , Longyue Wang , Tianqi Shi , Weihua Luo , Kaifu Zhang , Jinsong Su

Large language models (LLMs) achieve strong reasoning performance through chain-of-thought (CoT) reasoning, yet often generate unnecessarily long reasoning paths that incur high inference cost. Recent self-consistency-based approaches…

Computation and Language · Computer Science 2026-03-19 Juming Xiong , Kevin Guo , Congning Ni , Chao Yan , Katherine Brown , Avinash Baidya , Xiang Gao , Bradley Malin , Zhijun Yin

Large Language Models (LLMs) have demonstrated remarkable performance across multiple tasks through in-context learning. For complex reasoning tasks that require step-by-step thinking, Chain-of-Thought (CoT) prompting has given impressive…

Computation and Language · Computer Science 2024-10-10 Armel Zebaze , Benoît Sagot , Rachel Bawden

Large Reasoning Models (LRMs) have demonstrated remarkable performance on complex tasks by engaging in extended reasoning before producing final answers. Beyond improving abilities, these detailed reasoning traces also create a new…

Computation and Language · Computer Science 2026-01-08 Shu Yang , Junchao Wu , Xilin Gong , Xuansheng Wu , Derek Wong , Ninghao Liu , Di Wang

Chain of Thought (CoT) prompting can encourage language models to engage in multi-step logical reasoning. The quality of the provided demonstrations significantly influences the success of downstream inference tasks. Current unsupervised…

Computation and Language · Computer Science 2025-05-27 Yufeng Zhang , Xuepeng Wang , Lingxiang Wu , Jinqiao Wang

Chain-of-Thought (CoT) has been shown to significantly improve the reasoning accuracy of large language models (LLMs) on complex tasks. However, due to the autoregressive, step-by-step generation paradigm, existing CoT methods suffer from…

Artificial Intelligence · Computer Science 2026-03-03 Jiaquan Zhang , Chaoning Zhang , Shuxu Chen , Xudong Wang , Zhenzhen Huang , Pengcheng Zheng , Shuai Yuan , Sheng Zheng , Qigan Sun , Jie Zou , Lik-Hang Lee , Yang Yang

Recent advances in Chain-of-Thought (CoT) prompting have substantially enhanced the reasoning capabilities of large language models (LLMs), enabling sophisticated problem-solving through explicit multi-step reasoning traces. However, these…

Machine Learning · Computer Science 2025-08-28 Xinyu Li , Tianjin Huang , Ronghui Mu , Xiaowei Huang , Gaojie Jin

Recently, Chain-of-Thought (CoT) prompting has delivered success on complex reasoning tasks, which aims at designing a simple prompt like ``Let's think step by step'' or multiple in-context exemplars with well-designed rationales to elicit…

Computation and Language · Computer Science 2024-06-04 Jianing Wang , Qiushi Sun , Xiang Li , Ming Gao

Recent large language models achieve strong reasoning performance by generating detailed chain-of-thought traces, but this often leads to excessive token use and high inference latency. Existing efficiency approaches typically focus on…

Computation and Language · Computer Science 2025-12-01 Lukas Struppek , Dominik Hintersdorf , Hannah Struppek , Daniel Neider , Kristian Kersting

Chain-of-Thought (CoT) enhances an LLM's ability to perform complex reasoning tasks, but it also introduces new security issues. In this work, we present ShadowCoT, a novel backdoor attack framework that targets the internal reasoning…

Cryptography and Security · Computer Science 2026-04-23 Gejian Zhao , Hanzhou Wu , Xinpeng Zhang , Athanasios V. Vasilakos

Large language models (LLMs) can effectively handle outdated information through knowledge editing. However, current approaches face two key limitations: (I) Poor generalization: Most approaches rigidly inject new knowledge without ensuring…

Computation and Language · Computer Science 2026-04-08 Jinhu Fu , Yan Bai , Longzhu He , Yihang Lou , Yanxiao Zhao , Li Sun , Sen Su

Retrieval-augmented generation (RAG) systems can effectively mitigate the hallucination problem of large language models (LLMs),but they also possess inherent vulnerabilities. Identifying these weaknesses before the large-scale real-world…

Information Retrieval · Computer Science 2025-05-23 Hongru Song , Yu-an Liu , Ruqing Zhang , Jiafeng Guo , Yixing Fan

Large Reasoning Models (LRMs) have significantly advanced beyond traditional Large Language Models (LLMs) with their exceptional logical reasoning capabilities, yet these improvements introduce heightened safety risks. When subjected to…

Cryptography and Security · Computer Science 2025-06-04 Yang Yao , Xuan Tong , Ruofan Wang , Yixu Wang , Lujundong Li , Liang Liu , Yan Teng , Yingchun Wang

Large Reasoning Models (LRMs) achieve strong performance on complex multi-step reasoning, yet they still exhibit severe safety failures such as harmful content generation. Existing methods often apply coarse-grained constraints over the…

Artificial Intelligence · Computer Science 2026-04-27 Yingzhi Mao , Chunkang Zhang , Junxiang Wang , Xinyan Guan , Boxi Cao , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun