English
Related papers

Related papers: All Code, No Thought: Current Language Models Stru…

200 papers

The verbosity of Chain-of-Thought (CoT) reasoning hinders its mass deployment in efficiency-critical applications. Recently, implicit CoT approaches have emerged, which encode reasoning steps within LLM's hidden embeddings (termed…

Computation and Language · Computer Science 2026-01-28 Yinhan He , Wendy Zheng , Yaochen Zhu , Zaiyi Zheng , Lin Su , Sriram Vasudevan , Qi Guo , Liangjie Hong , Jundong Li

Mathematical reasoning has long represented one of the most fundamental and challenging frontiers in artificial intelligence research. In recent years, large language models (LLMs) have achieved significant advances in this area. This…

Artificial Intelligence · Computer Science 2025-06-11 Peng-Yuan Wang , Tian-Shuo Liu , Chenyang Wang , Yi-Di Wang , Shu Yan , Cheng-Xing Jia , Xu-Hui Liu , Xin-Wei Chen , Jia-Cheng Xu , Ziniu Li , Yang Yu

With the widespread use of language models (LMs) in NLP tasks, researchers have discovered the potential of Chain-of-thought (CoT) to assist LMs in accomplishing complex reasoning tasks by generating intermediate steps. However, human…

Computation and Language · Computer Science 2024-03-26 Yao Yao , Zuchao Li , Hai Zhao

Code generation, the task of creating executable programs from natural language requirements, has recently seen tremendous advances through Chain-of-Thought (CoT) reasoning, which enables Large Language Models (LLMs) to develop high-level…

Software Engineering · Computer Science 2025-10-21 Shuzheng Gao , Chaozheng Wang , Cuiyun Gao , Michael R. Lyu

Chain-of-Thought (CoT) enhances an LLM's ability to perform complex reasoning tasks, but it also introduces new security issues. In this work, we present ShadowCoT, a novel backdoor attack framework that targets the internal reasoning…

Cryptography and Security · Computer Science 2026-04-23 Gejian Zhao , Hanzhou Wu , Xinpeng Zhang , Athanasios V. Vasilakos

Large language models demonstrate strong reasoning capabilities through chain-of-thought prompting, but whether this reasoning quality transfers across languages remains underexplored. We introduce a human-validated framework to evaluate…

Computation and Language · Computer Science 2026-03-31 Anaelia Ovalle , Candace Ross , Sebastian Ruder , Adina Williams , Karen Ullrich , Mark Ibrahim , Levent Sagun

Chain of Thought (CoT) is significant in improving the reasoning abilities of large language models (LLMs). However, the correlation between the effectiveness of CoT and the length of reasoning steps in prompts remains largely unknown. To…

Computation and Language · Computer Science 2024-06-25 Mingyu Jin , Qinkai Yu , Dong Shu , Haiyan Zhao , Wenyue Hua , Yanda Meng , Yongfeng Zhang , Mengnan Du

Despite significant advances in alignment techniques, we demonstrate that state-of-the-art language models remain vulnerable to carefully crafted conversational scenarios that can induce various forms of misalignment without explicit…

Computation and Language · Computer Science 2025-08-07 Siddhant Panpatil , Hiskias Dingeto , Haon Park

Monitoring the chain-of-thought (CoT) of reasoning models is a promising approach for detecting covert misbehavior (i.e., hidden objectives) in code generation tasks. While large models (GPT-5, Gemini-3-Flash) can serve as effective CoT…

Cryptography and Security · Computer Science 2026-05-14 Nirav Diwan , Han Wang , Berkcan Kapusuzoglu , Ramin Moradi , Supriyo Chakraborty , Giri Iyengar , Sambit Sahu , Huan Zhang , Gang Wang

A new generation of language models reasons entirely in continuous hidden states, producing no tokens and leaving no audit trail. We show that this silence creates a fundamentally new attack surface. ThoughtSteer perturbs a single embedding…

Machine Learning · Computer Science 2026-04-02 Swapnil Parekh

Test-time compute scaling has demonstrated the ability to improve the performance of reasoning language models by generating longer chain-of-thought (CoT) sequences. However, this increase in performance comes with a significant increase in…

Artificial Intelligence · Computer Science 2025-09-24 Adarsha Balaji , Le Chen , Rajeev Thakur , Franck Cappello , Sandeep Madireddy

Chain-of-Thought (CoT) reasoning has proven effective in natural language tasks but remains underexplored in multimodal alignment. This study investigates its integration into 3D vision-language learning by embedding structured reasoning…

Computation and Language · Computer Science 2025-03-18 Yanjun Chen , Yirong Sun , Xinghao Chen , Jian Wang , Xiaoyu Shen , Wenjie Li , Wei Zhang

Recent studies have proposed integrating Chain-of-Thought (CoT) reasoning to further enhance the reliability of Code Language Models (CLMs) in generating code, a step-by-step approach that breaks down complex programming tasks into…

Software Engineering · Computer Science 2025-03-11 Naizhu Jin , Zhong Li , Yinggang Guo , Chao Su , Tian Zhang , Qingkai Zeng

Generating a Chain of Thought (CoT) has been shown to consistently improve large language model (LLM) performance on a wide range of NLP tasks. However, prior work has mainly focused on logical reasoning tasks (e.g. arithmetic, commonsense…

Computation and Language · Computer Science 2023-06-06 Omar Shaikh , Hongxin Zhang , William Held , Michael Bernstein , Diyi Yang

Chain-of-thought (CoT) prompting is a common technique for improving the reasoning abilities of large language models (LLMs). However, extended reasoning is often unnecessary and substantially increases token usage. As such, a key question…

Computation and Language · Computer Science 2026-01-09 Samuel Lewis-Lim , Xingwei Tan , Zhixue Zhao , Nikolaos Aletras

Chain-of-thought (CoT) reasoning has emerged as a powerful tool for improving large language model performance on complex tasks, but recent work shows that reasoning steps often fail to causally influence the final answer, creating brittle…

Reasoning capability is pivotal for Large Language Models (LLMs) to solve complex tasks, yet achieving reliable and scalable reasoning remains challenging. While Chain-of-Thought (CoT) prompting has become a mainstream approach, existing…

Computation and Language · Computer Science 2025-10-07 Honglin Lin , Qizhi Pei , Xin Gao , Zhuoshi Pan , Yu Li , Juntao Li , Conghui He , Lijun Wu

Chain-of-thought (CoT) reasoning has become a central mechanism for eliciting multi-step reasoning in Large Language Models (LLMs). Yet recent evidence presents a tension: hidden states appear to already encode future reasoning before CoT…

Machine Learning · Computer Science 2026-05-29 Liyan Xu , Mo Yu , Fandong Meng , Jie Zhou

Chain-of-Thought (CoT) prompting has demonstrably enhanced the performance of Large Language Models on tasks requiring multi-step inference. This success has led to widespread claims of emergent reasoning capabilities in these models. In…

Computation and Language · Computer Science 2025-06-10 Jintian Shao , Yiming Cheng

Recent progress in reasoning-oriented Large Language Models (LLMs) has been driven by introducing Chain-of-Thought (CoT) traces, where models generate intermediate reasoning traces before producing an answer. These traces, as in DeepSeek…

Computation and Language · Computer Science 2025-08-26 Siddhant Bhambri , Upasana Biswas , Subbarao Kambhampati