English
Related papers

Related papers: Why Thinking Hurts? Diagnosing and Rectifying the …

200 papers

Chain-of-Thought (CoT) reasoning has driven recent gains of large language models (LLMs) on reasoning-intensive tasks by externalizing intermediate steps. However, excessive or redundant reasoning -- so-called overthinking -- can increase…

Computation and Language · Computer Science 2025-10-14 Renliang Sun , Wei Cheng , Dawei Li , Haifeng Chen , Wei Wang

Chain-of-Thought (CoT) prompting helps models think step by step. But naive CoT breaks down in visually grounded social tasks, where models must perceive, understand, and judge all at once; bridging perception with norm-grounded reasoning.…

Computation and Language · Computer Science 2026-04-21 Eunkyu Park , Wesley Hanwen Deng , Gunhee Kim , Motahhare Eslami , Maarten Sap

Large Language Models have demonstrated remarkable abilities across various tasks, with Chain-of-Thought (CoT) prompting emerging as a key technique to enhance reasoning capabilities. However, existing research primarily focuses on…

Artificial Intelligence · Computer Science 2024-10-07 Lijie Hu , Liang Liu , Shu Yang , Xin Chen , Zhen Tan , Muhammad Asif Ali , Mengdi Li , Di Wang

Chain-of-thought (CoT) reasoning has been proposed as a transparency mechanism for large language models in safety-critical deployments, yet its effectiveness depends on faithfulness (whether models accurately verbalize the factors that…

Computation and Language · Computer Science 2026-03-25 Richard J. Young

Video reasoning, the task of enabling machines to infer from dynamic visual content through multi-step logic, is crucial for advanced AI. While the Chain-of-Thought (CoT) mechanism has enhanced reasoning in text-based tasks, its application…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Mi Luo , Zihui Xue , Alex Dimakis , Kristen Grauman

Standard chain-of-thought reasoning generates a solution in a single forward pass, committing irrevocably to each token and lacking a mechanism to recover from early errors. We introduce Inference-Time Rethinking, a generative framework…

Computation and Language · Computer Science 2026-02-09 Deqian Kong , Minglu Zhao , Aoyang Qin , Bo Pang , Chenxin Tao , David Hartmann , Edouardo Honig , Dehong Xu , Amit Kumar , Matt Sarte , Chuan Li , Jianwen Xie , Ying Nian Wu

Chain-of-thought (CoT) prompting assumes that generated reasoning reflects a model's internal computation. We show this assumption is wrong in a specific, measurable way: models internally detect their own reasoning errors but outwardly…

Computation and Language · Computer Science 2026-05-12 Aojie Yuan , Zhiyuan Julian Su , Haiyue Zhang , Yi Nian , Yue Zhao

Chain-of-thought (CoT) prompting enhances reasoning in large language models (LLMs) but often leads to verbose and redundant outputs, thus increasing inference cost. We hypothesize that many reasoning steps are unnecessary for producing…

Computation and Language · Computer Science 2025-09-30 Xin Liu , Lu Wang

Chain of Thought (CoT) prompting can encourage language models to engage in multi-step logical reasoning. The quality of the provided demonstrations significantly influences the success of downstream inference tasks. Current unsupervised…

Computation and Language · Computer Science 2025-05-27 Yufeng Zhang , Xuepeng Wang , Lingxiang Wu , Jinqiao Wang

Reasoning-specialized models like OpenAI's 5.1 and DeepSeek-V3.2 allocate substantial inference compute to extended chain-of-thought (CoT) traces, yet reasoning tokens incur significant costs. How do different reasoning modalities of code,…

Machine Learning · Computer Science 2026-02-17 Ian Su , Gaurav Purushothaman , Jey Narayan , Ruhika Goel , Kevin Zhu , Sunishchal Dev , Yash More , Maheep Chaudhary

Chain-of-Thought (CoT) reasoning typically utilizes the discrete language space for thinking, which is inherently inefficient, as many generated tokens only enforce linguistic rules that are not required for reasoning. To bypass this,…

Computation and Language · Computer Science 2025-12-16 Enes Özeren , Matthias Aßenmacher

In information retrieval, large language models (LLMs) have demonstrated remarkable potential in text reranking tasks by leveraging their sophisticated natural language understanding and advanced reasoning capabilities. However,…

Information Retrieval · Computer Science 2025-09-22 Haowei Liu , Xuyang Wu , Guohao Sun , Zhiqiang Tao , Yi Fang

Long chain-of-thought~(CoT) has become a dominant paradigm for enhancing the reasoning capability of large reasoning models~(LRMs); however, the performance gains often come with a substantial increase in reasoning budget. Recent studies…

Artificial Intelligence · Computer Science 2026-03-03 Jie Cao , Tianwei Lin , Zhenxuan Fan , Bo Yuan , Ziyuan Zhao , Rolan Yan , Wenqiao Zhang , Siliang Tang

Chain-of-thought (CoT) reasoning is fundamental to modern LLM architectures and represents a critical intervention point for AI safety. However, CoT reasoning may exhibit failure modes that we note as pathologies, which prevent it from…

Artificial Intelligence · Computer Science 2026-02-17 Manqing Liu , David Williams-King , Ida Caspary , Linh Le , Hannes Whittingham , Puria Radmard , Cameron Tice , Edward James Young

Long chain-of-thought (CoT) is an essential ingredient in effective usage of modern large language models, but our understanding of the reasoning strategies underlying these capabilities remains limited. While some prior works have…

Computation and Language · Computer Science 2025-05-16 Seongyun Lee , Seungone Kim , Minju Seo , Yongrae Jo , Dongyoung Go , Hyeonbin Hwang , Jinho Park , Xiang Yue , Sean Welleck , Graham Neubig , Moontae Lee , Minjoon Seo

Large language models exhibit high-level commonsense reasoning abilities, especially with enhancement methods like Chain-of-Thought (CoT). However, we find these CoT-like methods lead to a considerable number of originally correct answers…

Computation and Language · Computer Science 2024-10-15 Jiachun Li , Pengfei Cao , Chenhao Wang , Zhuoran Jin , Yubo Chen , Daojian Zeng , Kang Liu , Jun Zhao

Large vision-language models (VLMs) often benefit from chain-of-thought (CoT) prompting in general domains, yet its efficacy in medical vision-language tasks remains underexplored. We report a counter-intuitive trend: on medical visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yuan Wu , Zongxian Yang , Jiayu Qian , Songpan Gao , Guanxing Chen , Qiankun Li , Yu-An Huang , Zhi-An Huang

Chain-of-thought (CoT) prompting improves reasoning but often increases inference cost by one to two orders of magnitude. To address these challenges, we present \textbf{OneLatent}, a framework that compresses intermediate reasoning into a…

Artificial Intelligence · Computer Science 2026-02-17 Bo Lv , Yasheng Sun , Junjie Wang , Haoxiang Shi

Detecting harmful AI actions is important as AI agents gain adoption. Chain-of-thought (CoT) monitoring is one method widely used to detect adversarial attacks and AI misalignment. However, attackers and misaligned models might evade CoT…

Computation and Language · Computer Science 2025-10-17 Shiyuan Guo , Henry Sleight , Fabien Roger

Vision-language models (VLMs) are increasingly deployed in high-stakes settings where reliable uncertainty quantification (UQ) is as important as predictive accuracy. Extended reasoning via chain-of-thought (CoT) prompting or…

Machine Learning · Computer Science 2026-03-18 Robert Welch , Emir Konuk , Kevin Smith