English
Related papers

Related papers: The Chain Holds, the Answer Folds: Trace-Answer Di…

200 papers

Large reasoning models with reasoning capabilities achieve state-of-the-art performance on complex tasks, but their robustness under multi-turn adversarial pressure remains underexplored. We evaluate nine frontier reasoning models under…

Artificial Intelligence · Computer Science 2026-03-13 Yubo Li , Ramayya Krishnan , Rema Padman

When a language model sees a document contradicting its training knowledge, it must choose: follow the document or trust itself. Prior work proved this choice depends on how well-known the fact is. We ask: does the model's chain-of-thought…

Computation and Language · Computer Science 2026-05-28 Pruthvinath Jeripity Venkata

How do multi-turn reasoning systems fail? The expected answer is logical contradiction, in which the system's maintained state becomes unsatisfiable. We show that the dominant mode is instead satisfiable drift, where the internal state…

Artificial Intelligence · Computer Science 2026-05-26 Sebastien Kawada

Chain-of-thought (CoT) traces are increasingly used both to improve language model capability and to audit model behavior, implicitly assuming that the visible trace remains synchronized with the computation that determines the answer. We…

Artificial Intelligence · Computer Science 2026-05-13 Wenkai Li , Fan Yang , Ananya Hazarika , Shaunak A. Mehta , Koichi Onoue

For Large Language Models (LLMs) to be reliably deployed, models must effectively know when not to answer: abstain. Reasoning models, in particular, have gained attention for impressive performance on complex tasks. However, reasoning…

Artificial Intelligence · Computer Science 2026-04-03 Abinitha Gourabathina , Inkit Padhi , Manish Nagireddy , Subhajit Chaudhury , Prasanna Sattigeri

Extended-thinking models expose a second text-generation channel ("thinking tokens") alongside the user-visible answer. This study examines 12 open-weight reasoning models on MMLU and GPQA questions paired with misleading hints. Among the…

Computation and Language · Computer Science 2026-03-30 Richard J. Young

A new generation of language models reasons entirely in continuous hidden states, producing no tokens and leaving no audit trail. We show that this silence creates a fundamentally new attack surface. ThoughtSteer perturbs a single embedding…

Machine Learning · Computer Science 2026-04-02 Swapnil Parekh

Chain-of-Thought (CoT) reasoning has significantly advanced state-of-the-art AI capabilities. However, recent studies have shown that CoT reasoning is not always faithful when models face an explicit bias in their prompts, i.e., the CoT can…

Artificial Intelligence · Computer Science 2025-06-18 Iván Arcuschin , Jett Janiak , Robert Krzyzanowski , Senthooran Rajamanoharan , Neel Nanda , Arthur Conmy

Chain-of-thought (CoT) reasoning has been proposed as a transparency mechanism for large language models in safety-critical deployments, yet its effectiveness depends on faithfulness (whether models accurately verbalize the factors that…

Computation and Language · Computer Science 2026-03-25 Richard J. Young

As chain-of-thought (CoT) has become central to scaling reasoning capabilities in large language models (LLMs), it has also emerged as a promising tool for interpretability, suggesting the opportunity to understand model decisions through…

Artificial Intelligence · Computer Science 2026-03-03 Kyle Cox , Darius Kianersi , Adrià Garriga-Alonso

Large language models (LLMs) often improve their performance in downstream tasks when they generate Chain of Thought reasoning text before producing an answer. We investigate how LLMs recover from errors in Chain of Thought. Through…

Artificial Intelligence · Computer Science 2024-09-04 Evelyn Yee , Alice Li , Chenyu Tang , Yeon Ho Jung , Ramamohan Paturi , Leon Bergen

Chain-of-thought (CoT) prompting assumes that generated reasoning reflects a model's internal computation. We show this assumption is wrong in a specific, measurable way: models internally detect their own reasoning errors but outwardly…

Computation and Language · Computer Science 2026-05-12 Aojie Yuan , Zhiyuan Julian Su , Haiyue Zhang , Yi Nian , Yue Zhao

When a language model is fed a wrong answer, what happens inside the network? Current understanding treats truthfulness as a static property of individual-layer representations-a direction to be probed, a feature to be extracted. Less is…

Computation and Language · Computer Science 2026-03-17 Javier Marín

Large reasoning models (LRMs) with multi-step reasoning capabilities have shown remarkable problem-solving abilities, yet they exhibit concerning safety vulnerabilities that remain poorly understood. In this work, we investigate why safety…

Artificial Intelligence · Computer Science 2025-10-08 Qingyu Yin , Chak Tou Leong , Linyi Yang , Wenxuan Huang , Wenjie Li , Xiting Wang , Jaehong Yoon , YunXing , XingYu , Jinjin Gu

Explicit reasoning models are trained to produce intermediate reasoning traces before final answers, but downstream fine-tuning is often performed on ordinary instruction-response data that contains no such traces. We show that this…

Machine Learning · Computer Science 2026-05-21 Lukas Twist , Helen Yannakoudakis , Jie M. Zhang

Corruption studies, the standard tool for evaluating chain-of-thought (CoT) faithfulness, infer which steps are ``computationally important'' from accuracy loss when steps are corrupted. We show that when benchmark chains end with an…

Machine Learning · Computer Science 2026-05-18 Gabriel Garcia

When a language model agrees with a user's false belief, is it failing to detect the error, or noticing and agreeing anyway? We show the latter. Across twelve open-weight models from five labs, spanning small to frontier scale, the same…

Machine Learning · Computer Science 2026-05-05 Manav Pandey

Despite the success of test-time scaling, Large Reasoning Models (LRMs) frequently encounter repetitive loops that lead to computational waste and inference failure. In this paper, we identify a distinct failure mode termed Circular…

Artificial Intelligence · Computer Science 2026-01-12 Zenghao Duan , Liang Pang , Zihao Wei , Wenbin Duan , Yuxin Tian , Shicheng Xu , Jingcheng Deng , Zhiyi Yin , Xueqi Cheng

Chat models without chain-of-thought (CoT) reasoning must decide whether to refuse a harmful request before generating their first response token. Reasoning models, by contrast, produce extended chains of thought before their final output,…

Computation and Language · Computer Science 2026-05-14 Kureha Yamaguchi , Benjamin Etheridge , Andy Arditi

Mathematical reasoning models are widely deployed in education, automated tutoring, and decision support systems despite exhibiting fundamental computational instabilities. We demonstrate that state-of-the-art models (Qwen2.5-Math-7B)…

Machine Learning · Computer Science 2026-03-05 Subramanyam Sahoo , Aman Chadha , Vinija Jain , Divya Chaudhary
‹ Prev 1 2 3 10 Next ›