English
Related papers

Related papers: Where Do Reasoning Models Refuse?

200 papers

Detecting harmful AI actions is important as AI agents gain adoption. Chain-of-thought (CoT) monitoring is one method widely used to detect adversarial attacks and AI misalignment. However, attackers and misaligned models might evade CoT…

Computation and Language · Computer Science 2025-10-17 Shiyuan Guo , Henry Sleight , Fabien Roger

Reasoning LLMs (RLLMs) generate step-by-step chains of thought (CoTs) before giving an answer, which improves performance on complex tasks and makes reasoning more transparent. But how robust are these reasoning traces to disruptions that…

Artificial Intelligence · Computer Science 2026-02-10 Alexander von Recum , Leander Girrbach , Zeynep Akata

Chain-of-thought (CoT) reasoning has enabled large language models (LLMs) to utilize additional computation through intermediate tokens to solve complex tasks. However, we posit that typical reasoning traces contain many redundant tokens,…

Computation and Language · Computer Science 2025-06-11 Tergel Munkhbat , Namgyu Ho , Seo Hyun Kim , Yongjin Yang , Yujin Kim , Se-Young Yun

While long, explicit chains-of-thought (CoT) have proven effective on complex reasoning tasks, they are costly to generate during inference. Non-verbal reasoning methods have emerged with shorter generation lengths by leveraging continuous…

Computation and Language · Computer Science 2026-04-28 Keshav Ramji , Tahira Naseem , Ramón Fernandez Astudillo

Can we trust the reasoning traces that large reasoning models (LRMs) produce? We investigate whether these traces faithfully reflect what drives model outputs, and whether models will honestly report their influence. We introduce Thought…

Artificial Intelligence · Computer Science 2026-03-24 Yijie Hao , Lingjie Chen , Ali Emami , Joyce Ho

Chain-of-Thought (CoT) prompting helps models think step by step. But naive CoT breaks down in visually grounded social tasks, where models must perceive, understand, and judge all at once; bridging perception with norm-grounded reasoning.…

Computation and Language · Computer Science 2026-04-21 Eunkyu Park , Wesley Hanwen Deng , Gunhee Kim , Motahhare Eslami , Maarten Sap

Extended-thinking models expose a second text-generation channel ("thinking tokens") alongside the user-visible answer. This study examines 12 open-weight reasoning models on MMLU and GPQA questions paired with misleading hints. Among the…

Computation and Language · Computer Science 2026-03-30 Richard J. Young

The zero-shot chain of thought (CoT) approach is often used in question answering (QA) by language models (LMs) for tasks that require multiple reasoning steps. However, some QA tasks hinge more on accessing relevant knowledge than on…

Computation and Language · Computer Science 2025-05-27 Jiacan Yu , Hannah An , Lenhart K. Schubert

Chain-of-thought (CoT) monitoring is one of the most promising tools we have for detecting model misbehavior, but its effectiveness depends on models faithfully externalizing their reasoning. Motivated by this vulnerability, we study…

Machine Learning · Computer Science 2026-05-18 Reilly Haskins , Bilal Chughtai , Joshua Engels

Chain-of-Thought (CoT) prompting has been shown to be effective in eliciting structured reasoning (i.e., CoT reasoning) from large language models (LLMs). Regardless of its popularity, recent studies expose its failures in some reasoning…

Artificial Intelligence · Computer Science 2026-05-12 Chengshuai Zhao , Zhen Tan , Pingchuan Ma , Dawei Li , Bohan Jiang , Yancheng Wang , Yingzhen Yang , Huan Liu

Mainstream creativity support design prioritizes compliant AI for seamless writing interactions, but concerns over inappropriate AI reliance highlight the need for designs fostering reflection on balanced AI and non-AI resource use.…

Human-Computer Interaction · Computer Science 2026-05-19 Hua Xuan Qin , Guangzhi Zhu , Mingming Fan , Pan Hui

Despite the success of chain of thought in enhancing language model reasoning, the underlying process remains less well understood. Although logically sound reasoning appears inherently crucial for chain of thought, prior studies…

Computation and Language · Computer Science 2023-11-17 Yew Ken Chia , Guizhen Chen , Luu Anh Tuan , Soujanya Poria , Lidong Bing

Chain-of-thought (CoT) traces promise transparency for reasoning language models, but prior work shows they are not always faithful reflections of internal computation. This raises challenges for oversight: practitioners may misinterpret…

Machine Learning · Computer Science 2025-10-28 Jiazheng Li , Andreas Damianou , J Rosser , José Luis Redondo García , Konstantina Palla

Chain-of-Thought (CoT) prompting enables large language models to solve complex reasoning problems by generating intermediate steps. However, confined by its inherent single-pass and sequential generation process, CoT heavily relies on the…

Computation and Language · Computer Science 2023-11-03 Jingyuan Qi , Zhiyang Xu , Ying Shen , Minqian Liu , Di Jin , Qifan Wang , Lifu Huang

Chain-of-thought (CoT) prompting for language models demonstrates impressive performance across reasoning tasks, but typically needs labeled exemplars of the reasoning process. In this work, we introduce a new prompting approach, analogical…

Machine Learning · Computer Science 2024-03-12 Michihiro Yasunaga , Xinyun Chen , Yujia Li , Panupong Pasupat , Jure Leskovec , Percy Liang , Ed H. Chi , Denny Zhou

Large language models (LLMs) are increasingly being applied to clinical care, a domain where both accuracy and transparent reasoning are critical for safe and trustworthy deployment. Chain-of-thought (CoT) prompting, which elicits…

Computation and Language · Computer Science 2025-12-09 Jiageng Wu , Kevin Xie , Bowen Gu , Nils Krüger , Kueiyu Joshua Lin , Jie Yang

Chain-of-Thought (CoT) is an efficient prompting method that enables the reasoning ability of large language models by augmenting the query using multiple examples with multiple intermediate steps. Despite the empirical success, the…

Machine Learning · Computer Science 2025-05-27 Hongkang Li , Songtao Lu , Pin-Yu Chen , Xiaodong Cui , Meng Wang

Large language models have manifested remarkable capabilities by leveraging chain-of-thought (CoT) reasoning techniques to solve intricate questions through step-by-step reasoning chains. Despite its success, the efficacy of such reasoning…

Computation and Language · Computer Science 2024-03-29 Yexin Wu , Zhuosheng Zhang , Hai Zhao

Recent progress in reasoning-oriented Large Language Models (LLMs) has been driven by introducing Chain-of-Thought (CoT) traces, where models generate intermediate reasoning traces before producing an answer. These traces, as in DeepSeek…

Computation and Language · Computer Science 2025-08-26 Siddhant Bhambri , Upasana Biswas , Subbarao Kambhampati

Recent advancements in Chain-of-Thought (CoT) reasoning utilize complex modules but are hampered by high token consumption, limited applicability, and challenges in reproducibility. This paper conducts a critical evaluation of CoT…

Computation and Language · Computer Science 2024-06-12 Mengru Ding , Hanmeng Liu , Zhizhang Fu , Jian Song , Wenbo Xie , Yue Zhang
‹ Prev 1 4 5 6 7 8 10 Next ›