中文
相关论文

相关论文: Measuring Black-Box Confidence via Reasoning Traje…

200 篇论文

Closed-source large language models (LLMs), such as ChatGPT and Gemini, are increasingly consulted for medical advice, yet their explanations may appear plausible while failing to reflect the model's underlying reasoning process. This gap…

Chain-of-Thought significantly enhances a model's reasoning capability, but it also comes with a considerable increase in inference costs due to long chains. With the observation that the reasoning path can be easily compressed under easy…

人工智能 · 计算机科学 2025-02-14 Xinyin Ma , Guangnian Wan , Runpeng Yu , Gongfan Fang , Xinchao Wang

Textual reasoning has recently been widely adopted in Blind Image Quality Assessment (BIQA). However, it remains unclear how textual information contributes to quality prediction and to what extent text can represent the score-related image…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Yuan Li , Shin'ya Nishida

How do reasoning models verify their own answers? We study this question by training a model using DeepSeek R1's recipe on the CountDown task. We leverage the fact that preference tuning leads to mode collapse, yielding a model that always…

人工智能 · 计算机科学 2025-05-13 Andrew Lee , Lihao Sun , Chris Wendler , Fernanda Viégas , Martin Wattenberg

Mathematical reasoning through Chain-of-Thought (CoT) has emerged as a powerful capability of Large Language Models (LLMs), which can be further enhanced through Test-Time Scaling (TTS) methods like Beam Search and DVTS. However, these…

计算与语言 · 计算机科学 2025-05-26 Zezhong Wang , Xingshan Zeng , Weiwen Liu , Yufei Wang , Liangyou Li , Yasheng Wang , Lifeng Shang , Xin Jiang , Qun Liu , Kam-Fai Wong

Chain-of-thought (CoT) has emerged as a critical mechanism for enhancing reasoning capabilities in large language models (LLMs), with self-consistency demonstrating notable promise in boosting performance. However, inherent linguistic…

计算与语言 · 计算机科学 2025-04-03 Zhiwei Yu , Tuo Li , Changhong Wang , Hui Chen , Lang Zhou

Chain-of-thought (CoT) reasoning sometimes fails to faithfully reflect the true computation of a large language model (LLM), hampering its utility in explaining how LLMs arrive at their answers. Moreover, optimizing for faithfulness and…

计算与语言 · 计算机科学 2026-02-19 Nithin Sivakumaran , Shoubin Yu , Hyunji Lee , Yue Zhang , Ali Payani , Mohit Bansal , Elias Stengel-Eskin

Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning tasks. However, they remain highly susceptible to jailbreak attacks that undermine their safety alignment. Existing defense mechanisms typically…

密码学与安全 · 计算机科学 2026-03-17 Yu Pan , Wenlong Yu , Tiejun Wu , Xiaohu Ye , Qiannan Si , Guangquan Xu , Bin Wu

Recent test-time reasoning methods improve performance by generating more candidate chains or searching over larger reasoning trees, but they typically lack explicit control over when to expand, what to prune, how to repair, and when to…

人工智能 · 计算机科学 2026-03-31 Siyuan Ma , Bo Gao , Zikai Xiao , Hailong Wang , Xinlei Yu , Rui Qian , Jiayu Qian , Luqi Gong , Yang Liu

With the rapid advancement of large language models (LLMs) technologies, their application in the domain of autonomous driving has become increasingly widespread. However, existing methods suffer from unstructured reasoning, poor…

人工智能 · 计算机科学 2026-01-09 Chang Zhao , Zheming Yang , Yunqing Hu , Qi Guo , Zijian Wang , Pengcheng Li , Wen Ji

Modern large language models rely on chain-of-thought (CoT) reasoning to achieve impressive performance, yet the same mechanism can amplify deceptive alignment, situations in which a model appears aligned while covertly pursuing misaligned…

As autonomous agents become more capable of performing real-world tasks, distinguishing scheming behavior from benign task pursuit may become a central AI control problem. Existing monitors often rely on chain-of-thought access or internal…

Chain-of-thought (CoT) reasoning has advanced medical visual question answering (VQA), yet most existing CoT rationales are free-form and fail to capture the structured reasoning process clinicians actually follow. This work asks: Can…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Lin Fan , Yafei Ou , Zhipeng Deng , Pengyu Dai , Hou Chongxian , Jiale Yan , Yaqian Li , Kaiwen Long , Xun Gong , Masayuki Ikebe , Yefeng Zheng

Large language models (LLMs) increasingly rely on Chain-of-Thought (CoT) prompting to improve problem-solving and provide seemingly transparent explanations. However, growing evidence shows that CoT often fail to faithfully represent the…

人工智能 · 计算机科学 2026-03-03 Xu Shen , Song Wang , Zhen Tan , Laura Yao , Xinyu Zhao , Kaidi Xu , Xin Wang , Tianlong Chen

Strategic model selection and reasoning settings are more effective than ensembling for optimizing automated scoring with large language models (LLMs). We examined self-consistency (intra-model majority voting) and reasoning effort for…

计算机与社会 · 计算机科学 2026-05-01 Scott Frohn

Chains of thought (CoTs) have become central in interpreting and auditing behaviors of large language models. Yet growing evidence suggests that these traces often fail to faithfully represent the computations behind a model's predictions.…

计算与语言 · 计算机科学 2026-05-26 Yoav Gur-Arieh , Ana Marasović , Mor Geva

Large language models (LLMs) have demonstrated impressive performance in various natural language processing tasks, yet their ability to perform multi-step logical reasoning remains an open challenge. Although Chain-of-Thought prompting has…

Verbalized confidence, in which LLMs report a numerical certainty score, is widely used to estimate uncertainty in black-box settings, yet the confidence scale itself (typically 0--100) is rarely examined. We show that this design choice is…

人工智能 · 计算机科学 2026-03-11 Yuyang Dai

Answering questions with Chain-of-Thought (CoT) has significantly enhanced the reasoning capabilities of Large Language Models (LLMs), yet its impact on Large Multimodal Models (LMMs) still lacks a systematic assessment and in-depth…

计算机视觉与模式识别 · 计算机科学 2025-02-14 Dongzhi Jiang , Renrui Zhang , Ziyu Guo , Yanwei Li , Yu Qi , Xinyan Chen , Liuhui Wang , Jianhan Jin , Claire Guo , Shen Yan , Bo Zhang , Chaoyou Fu , Peng Gao , Hongsheng Li

Large Language Models often improve accuracy on reasoning tasks by sampling multiple Chain-of-Thought (CoT) traces and aggregating them with majority voting (MV), a test-time technique called self-consistency. When we truncate a CoT partway…

机器学习 · 统计学 2026-05-11 Naoto Iwase , Yuki Ichihara , Mohammad Atif Quamar , Junpei Komiyama