English
Related papers

Related papers: Reasoning Models Struggle to Control their Chains …

200 papers

Large Reasoning Models (LRMs) achieve promising performance but compromise token efficiency due to verbose reasoning processes. Unconscious Thought Theory (UTT) posits that complex problems can be solved more efficiently through…

Computation and Language · Computer Science 2025-05-27 Ruihan Gong , Yue Liu , Wenjie Qu , Mingzhe Du , Yufei He , Yingwei Ma , Yulin Chen , Xiang Liu , Yi Wen , Xinfeng Li , Ruidong Wang , Xinzhong Zhu , Bryan Hooi , Jiaheng Zhang

Chain-of-Thought (CoT) prompting is widely used to elicit explicit reasoning from large language models for code (LLM4Code). However, its impact on robustness and the stability of reasoning trajectories under realistic input perturbations…

Software Engineering · Computer Science 2026-04-15 Yang Liu , Da Song , Armstrong Foundjem , Heng Li , Foutse Khomh

Chain-of-Thought (CoT) prompting has significantly enhanced the mathematical reasoning capabilities of Large Language Models. We find existing fine-tuning datasets frequently suffer from the "answer right but reasoning wrong" probelm, where…

Artificial Intelligence · Computer Science 2026-01-13 Zihang Li , Yuhang Wang , Yikun Zong , Wenhan Yu , Xiaokun Yuan , Runhan Jiang , Zirui Liu , Tong Yang , Arthur Jiang

Chain of Thought (CoT) prompting improves the reasoning performance of large language models (LLMs) by encouraging step by step thinking. However, CoT-based methods depend on intermediate reasoning steps, which limits scalability and…

Artificial Intelligence · Computer Science 2025-06-02 Guanghao Li , Wenhao Jiang , Mingfeng Chen , Yan Li , Hao Yu , Shuting Dong , Tao Ren , Ming Tang , Chun Yuan

Large language models can generate long chain-of-thought (CoT) reasoning, yet prior work suggests that CoT can be post-hoc rationalization rather than a faithful reflection of the computation through explicitly designed settings. In this…

Machine Learning · Computer Science 2026-05-28 Jiachen Zhao , Yiyou Sun , Weiyan Shi , Dawn Song

Large language models exhibit high-level commonsense reasoning abilities, especially with enhancement methods like Chain-of-Thought (CoT). However, we find these CoT-like methods lead to a considerable number of originally correct answers…

Computation and Language · Computer Science 2024-10-15 Jiachun Li , Pengfei Cao , Chenhao Wang , Zhuoran Jin , Yubo Chen , Daojian Zeng , Kang Liu , Jun Zhao

Large language models (LLMs) are increasingly deployed in socially sensitive settings despite substantial documentation that they encode gender biases. Chain-of-Thought (CoT) prompting has been proposed as a bias-mitigation approach.…

Computation and Language · Computer Science 2026-05-21 Edie Pearman , Sophia Osborne , Mira Kandlikar-Bloch , Mina Arzaghi , Florian Carichon , Golnoosh Farnadi

Chain-of-Thought (CoT) has significantly enhanced the reasoning capabilities of Large Language Models (LLMs), especially when combined with reinforcement learning (RL) based post-training methods. While longer reasoning traces can improve…

Machine Learning · Computer Science 2026-02-16 Qinhang Wu , Sen Lin , Ming Zhang , Yingbin Liang , Ness B. Shroff

Chain-of-Thought (CoT) prompting has been shown to enhance the multi-step reasoning capabilities of Large Language Models (LLMs). However, debates persist about whether LLMs exhibit abstract generalization or rely on shallow heuristics when…

Computation and Language · Computer Science 2024-10-07 Akshara Prabhakar , Thomas L. Griffiths , R. Thomas McCoy

Chain-of-thought (CoT) prompting is a simple and effective method for improving the reasoning capabilities of Large Language Models (LLMs). The basic idea of CoT is to let LLMs break down their thought processes step-by-step by putting…

Computation and Language · Computer Science 2025-06-16 Yoonjeong Park , Hyunjin Kim , Chanyeol Choi , Junseong Kim , Jy-yong Sohn

Recent advances in test-time scaling have enabled Large Language Models (LLMs) to display sophisticated reasoning abilities via extended Chain-of-Thought (CoT) generation. Despite their potential, these Reasoning LLMs (RLMs) often…

Computation and Language · Computer Science 2025-05-21 Zhen Xiong , Yujun Cai , Zhecheng Li , Yiwei Wang

Long chain-of-thought (CoT) prompting helps Large Language Models (LLMs) solve difficult problems, but very long traces often slow or even degrade performance on fast, intuitive "System-1" tasks. We introduce Connector-Aware Compact CoT…

Artificial Intelligence · Computer Science 2025-09-16 Sunguk Choi , Yonghoon Kwon , Heondeuk Lee

Modern language models generate chain-of-thought traces by autoregressively sampling tokens from a finite vocabulary. While this discrete sampling has achieved remarkable success, conducting chain-of-thought with continuously-valued tokens…

Machine Learning · Computer Science 2026-03-06 Halil Alperen Gozeten , M. Emrullah Ildiz , Xuechen Zhang , Hrayr Harutyunyan , Ankit Singh Rawat , Samet Oymak

Chain-of-thought (CoT) prompting reliably improves language-model accuracy, but which properties of a rationale text drive the improvement is poorly understood. Prior work has largely studied generation-time behavior. We instead ask a…

Artificial Intelligence · Computer Science 2026-05-27 Xiang Wang , Wei Wei

Long chain-of-thought (Long-CoT) reasoning models have motivated a growing body of work on compressing reasoning traces to reduce inference cost, yet existing evaluations focus almost exclusively on task accuracy and token savings.…

Computation and Language · Computer Science 2026-04-07 Lingjie Zeng , Xiaofan Chen , Yanbo Wang , Xiuying Chen

Chain of Thought (CoT) was introduced in recent research as a method for improving step-by-step reasoning in Large Language Models. However, CoT has limited applications such as its need for hand-crafted few-shot exemplar prompts and no…

Computation and Language · Computer Science 2024-12-11 Arda Sevinc , Abdurrahman Gumus

Monitoring the chain-of-thought (CoT) of reasoning models is a promising approach for detecting covert misbehavior (i.e., hidden objectives) in code generation tasks. While large models (GPT-5, Gemini-3-Flash) can serve as effective CoT…

Cryptography and Security · Computer Science 2026-05-14 Nirav Diwan , Han Wang , Berkcan Kapusuzoglu , Ramin Moradi , Supriyo Chakraborty , Giri Iyengar , Sambit Sahu , Huan Zhang , Gang Wang

Training large language models (LLMs) with chain-of-thought (CoT) supervision has proven effective for enhancing their reasoning abilities. However, obtaining reliable and accurate reasoning supervision remains a significant challenge. We…

Computation and Language · Computer Science 2025-10-21 Dongwon Jung , Wenxuan Zhou , Muhao Chen

This paper target in addressing the challenges of underthinking and overthinking in long chain-of-thought (CoT) reasoning for Large Reasoning Models (LRMs) by introducing Reasoning Control Fields (RCF)--a novel test-time approach that…

Artificial Intelligence · Computer Science 2025-06-03 Di Zhang , Weida Wang , Junxian Li , Xunzhi Wang , Jiatong Li , Jianbo Wu , Jingdi Lei , Haonan He , Peng Ye , Shufei Zhang , Wanli Ouyang , Yuqiang Li , Dongzhan Zhou

Large Language Models (LLMs) have shown impressive performance in complex reasoning tasks through the use of Chain-of-Thought (CoT) reasoning, allowing models to break down problems into manageable sub-tasks. However, existing CoT…

Computation and Language · Computer Science 2025-07-11 Jean-Francois Ton , Muhammad Faaiz Taufiq , Yang Liu