中文
相关论文

相关论文: Hidden Error Awareness in Chain-of-Thought Reasoni…

200 篇论文

Chain-of-thought (CoT) reasoning has been proposed as a transparency mechanism for large language models in safety-critical deployments, yet its effectiveness depends on faithfulness (whether models accurately verbalize the factors that…

计算与语言 · 计算机科学 2026-03-25 Richard J. Young

Chain-of-thought (CoT) traces are increasingly used both to improve language model capability and to audit model behavior, implicitly assuming that the visible trace remains synchronized with the computation that determines the answer. We…

人工智能 · 计算机科学 2026-05-13 Wenkai Li , Fan Yang , Ananya Hazarika , Shaunak A. Mehta , Koichi Onoue

Chain-of-thought (CoT) prompting boosts Large Language Models accuracy on multi-step tasks, yet whether the generated "thoughts" reflect the true internal reasoning process is unresolved. We present the first feature-level causal study of…

计算与语言 · 计算机科学 2025-08-01 Xi Chen , Aske Plaat , Niki van Stein

Whether intermediate reasoning is computationally useful or merely explanatory depends on whether chain-of-thought (CoT) tokens contain task-relevant information. We present a mechanistic causal analysis of CoT on GSM8K using activation…

计算与语言 · 计算机科学 2026-04-28 Houman Mehrafarin , Amit Parekh , Ioannis Konstas

Detecting harmful AI actions is important as AI agents gain adoption. Chain-of-thought (CoT) monitoring is one method widely used to detect adversarial attacks and AI misalignment. However, attackers and misaligned models might evade CoT…

计算与语言 · 计算机科学 2025-10-17 Shiyuan Guo , Henry Sleight , Fabien Roger

Chain-of-thought (CoT) offers a potential boon for AI safety as it allows monitoring a model's CoT to try to understand its intentions and reasoning processes. However, the effectiveness of such monitoring hinges on CoTs faithfully…

As chain-of-thought (CoT) has become central to scaling reasoning capabilities in large language models (LLMs), it has also emerged as a promising tool for interpretability, suggesting the opportunity to understand model decisions through…

人工智能 · 计算机科学 2026-03-03 Kyle Cox , Darius Kianersi , Adrià Garriga-Alonso

Chain-of-thought (CoT) reasoning improves the problem-solving ability of large language models (LLMs), but generated reasoning traces may not faithfully reflect the model's actual decision process. Existing CoT unfaithfulness detectors…

人工智能 · 计算机科学 2026-05-26 Xu Shen , Zhen Tan , Song Wang , Pingjun Hong , Rui Miao , Xin Wang , Tianlong Chen

Recent findings suggest that misaligned models may exhibit deceptive behavior, raising concerns about output trustworthiness. Chain-of-thought (CoT) is a promising tool for alignment monitoring: when models articulate their reasoning…

密码学与安全 · 计算机科学 2025-10-24 Artur Zolkowski , Wen Xing , David Lindner , Florian Tramèr , Erik Jenner

Chain of Thought (CoT) reasoning has demonstrated remarkable deep reasoning capabilities in both large language models (LLMs) and multimodal large language models (MLLMs). However, its reliability is often undermined by the accumulation of…

人工智能 · 计算机科学 2025-11-26 Zijun Chen , Wenbo Hu , Richang Hong

Chain-of-thought (CoT) prompting has become central to mathematical reasoning in large language models, yet models remain brittle to early errors: a single arithmetic slip or unjustified inference typically propagates uncorrected to an…

机器学习 · 计算机科学 2025-12-22 Saraswathy Amjith , Mihika Dusad , Neha Muramalla , Shweta Shah

When a language model sees a document contradicting its training knowledge, it must choose: follow the document or trust itself. Prior work proved this choice depends on how well-known the fact is. We ask: does the model's chain-of-thought…

计算与语言 · 计算机科学 2026-05-28 Pruthvinath Jeripity Venkata

We present the surprising finding that a language model's reasoning capabilities can be improved by training on synthetic datasets of chain-of-thought (CoT) traces from more capable models, even when all of those traces lead to an incorrect…

Large language models (LLMs) increasingly rely on chain-of-thought (CoT) prompting to solve mathematical and logical reasoning tasks. Yet, a central question remains: to what extent are these generated rationales \emph{faithful} to the…

Chain-of-thought (CoT) reasoning is fundamental to modern LLM architectures and represents a critical intervention point for AI safety. However, CoT reasoning may exhibit failure modes that we note as pathologies, which prevent it from…

Chain-of-thought (CoT) prompting is widely used as a reasoning aid and is often treated as a transparency mechanism. Yet behavioral gains under CoT do not imply that the model's internal computation causally depends on the emitted reasoning…

机器学习 · 计算机科学 2026-02-10 Anish Sathyanarayanan , Aditya Nagarsekar , Aarush Rathore

Chain-of-thought (CoT) monitoring has been proposed as a promising safety mechanism for detecting misaligned behavior in large language models. However, its reliability remains largely unexplored beyond English and across diverse model…

计算与语言 · 计算机科学 2026-05-28 Eric Onyame , Runtao Zhou , Kowshik Thopalli , Bhavya Kailkhura , Chirag Agarwal

Chain-of-thought (CoT) reasoning is useful for monitoring language models only when the reasoning trace faithfully reflects the computation that produces the final answer. However, models can rely on prompt-to-answer shortcuts that bypass…

机器学习 · 计算机科学 2026-05-26 Jinghan Jia , Joe Benton , Eric Easley

Recent advances in reasoning-focused Large Language Models (LLMs) have introduced Chain-of-Thought (CoT) traces - intermediate reasoning steps generated before a final answer. These traces, as in DeepSeek R1, guide inference and train…

计算与语言 · 计算机科学 2026-04-20 Siddhant Bhambri , Upasana Biswas , Subbarao Kambhampati

Chain-of-thought (CoT) prompting has been widely adopted to enhance the reasoning capabilities of large language models (LLMs). However, the effectiveness of CoT reasoning is inconsistent across tasks with different reasoning types. This…

机器学习 · 计算机科学 2025-06-17 Yue Wan , Xiaowei Jia , Xiang Lorraine Li
‹ 上一页 1 2 3 10 下一页 ›