中文
相关论文

相关论文: Measuring Black-Box Confidence via Reasoning Traje…

200 篇论文

As reasoning modules, such as the chain-of-thought mechanism, are applied to large language models, they achieve strong performance on various tasks such as answering common-sense questions and solving math problems. The main challenge now…

计算与语言 · 计算机科学 2026-01-21 Zhenjiang Mao , Anirudhh Venkat

Human cognition typically involves thinking through abstract, fluid concepts rather than strictly using discrete linguistic tokens. Current reasoning models, however, are constrained to reasoning within the boundaries of human language,…

计算与语言 · 计算机科学 2025-05-22 Zhen Zhang , Xuehai He , Weixiang Yan , Ao Shen , Chenyang Zhao , Shuohang Wang , Yelong Shen , Xin Eric Wang

Getting language models to reason correctly about code requires training on data where each reasoning step can be checked. Current synthetic Chain-of-Thought (CoT) training data often consists of plausible-sounding explanations generated by…

As large language models (LLMs) evolve into autonomous agents, evaluating repository-level reasoning, the ability to maintain logical consistency across massive, real-world, interdependent file systems, has become critical. Current…

软件工程 · 计算机科学 2026-05-05 Jia Li , Yuxin Su , Michael R. Lyu

Current frontier large-language models rely on reasoning to achieve state-of-the-art performance. Many existing interpretability are limited in this area, as standard methods have been designed to study single forward passes of a model…

机器学习 · 计算机科学 2025-10-28 Paul C. Bogdan , Uzay Macar , Neel Nanda , Arthur Conmy

This study presents DiagCoT, a multi-stage framework that applies supervised fine-tuning to general-purpose vision-language models (VLMs) to emulate radiologists' stepwise diagnostic reasoning using only free-text reports. DiagCoT combines…

人工智能 · 计算机科学 2025-09-09 Yihong Luo , Wenwu He , Zhuo-Xu Cui , Dong Liang

Chain-of-Thought (CoT) reasoning has proven effective in natural language tasks but remains underexplored in multimodal alignment. This study investigates its integration into 3D vision-language learning by embedding structured reasoning…

计算与语言 · 计算机科学 2025-03-18 Yanjun Chen , Yirong Sun , Xinghao Chen , Jian Wang , Xiaoyu Shen , Wenjie Li , Wei Zhang

Self-correction has achieved impressive results in enhancing the style and security of the generated output from large language models (LLMs). However, recent studies suggest that self-correction might be limited or even counterproductive…

计算与语言 · 计算机科学 2024-06-18 Che Zhang , Zhenyang Xiao , Chengcheng Han , Yixin Lian , Yuejian Fang

Large Multimodal Models (LMMs) face limitations in geometric reasoning due to insufficient Chain of Thought (CoT) image-text training data. While existing approaches leverage template-based or LLM-assisted methods for geometric CoT data…

人工智能 · 计算机科学 2025-06-02 Linger Deng , Linghao Zhu , Yuliang Liu , Yu Wang , Qunyi Xie , Jingjing Wu , Gang Zhang , Yingying Zhu , Xiang Bai

Reasoning-specialized models like OpenAI's 5.1 and DeepSeek-V3.2 allocate substantial inference compute to extended chain-of-thought (CoT) traces, yet reasoning tokens incur significant costs. How do different reasoning modalities of code,…

机器学习 · 计算机科学 2026-02-17 Ian Su , Gaurav Purushothaman , Jey Narayan , Ruhika Goel , Kevin Zhu , Sunishchal Dev , Yash More , Maheep Chaudhary

Multi-hop QA benchmarks frequently reward Large Language Models (LLMs) for spurious correctness, masking ungrounded or flawed reasoning steps. To shift toward rigorous reasoning, we propose SAFE, a dynamic benchmarking framework that…

计算与语言 · 计算机科学 2026-04-03 Daeyong Kwon , Soyoung Yoon , Seung-won Hwang

Despite rapid progress in claim verification, we lack a systematic understanding of what reasoning these benchmarks actually exercise. We generate structured reasoning traces for 24K claim-verification examples across 9 datasets using…

计算与语言 · 计算机科学 2026-04-03 Delip Rao , Chris Callison-Burch

While Multimodal Large Language Models (MLLMs) demonstrate proficiency in 2D scenes, extending their perceptual intelligence to 3D point cloud understanding remains a significant challenge. Current approaches focus primarily on aligning 3D…

Recent work, using the Biasing Features metric, labels a CoT as unfaithful if it omits a prompt-injected hint that affected the prediction. We argue this metric adopts a narrow notion of faithfulness and confuses unfaithfulness with…

计算与语言 · 计算机科学 2026-05-11 Kerem Zaman , Shashank Srivastava

Large language models (LLMs) increasingly rely on chain-of-thought (CoT) prompting to solve mathematical and logical reasoning tasks. Yet, a central question remains: to what extent are these generated rationales \emph{faithful} to the…

Chain-of-thought (CoT) prompting is a de-facto standard technique to elicit reasoning-like responses from large language models (LLMs), allowing them to spell out individual steps before giving a final answer. While the resemblance to…

人工智能 · 计算机科学 2026-02-26 Gregor Bachmann , Yichen Jiang , Seyed Mohsen Moosavi Dezfooli , Moin Nabi

Reasoning quality in large language models depends not only on producing correct answers but also on generating valid intermediate steps. We study this through multiple-choice question answering (MCQA), which provides a controlled setting…

人工智能 · 计算机科学 2025-10-01 Raphael Schumann , Stefan Riezler

While Chain-of-Thought (CoT) monitoring offers a unique opportunity for AI safety, this opportunity could be lost through shifts in training practices or model architecture. To help preserve monitorability, we propose a pragmatic way to…

机器学习 · 计算机科学 2025-10-29 Scott Emmons , Roland S. Zimmermann , David K. Elson , Rohin Shah

The transition from task-specific artificial intelligence toward general-purpose foundation models raises fundamental questions about their capacity to support the integrated reasoning required in clinical medicine, where diagnosis demands…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Alexandru Florea , Shansong Wang , Mingzhe Hu , Qiang Li , Zach Eidex , Luke del Balzo , Mojtaba Safari , Xiaofeng Yang

The Chain-of-Thought (CoT) paradigm has emerged as a critical approach for enhancing the reasoning capabilities of large language models (LLMs). However, despite their widespread adoption and success, CoT methods often exhibit instability…

人工智能 · 计算机科学 2024-09-06 Yu Wang , Shiwan Zhao , Zhihu Wang , Heyuan Huang , Ming Fan , Yubo Zhang , Zhixing Wang , Haijun Wang , Ting Liu