English
Related papers

Related papers: Measuring Black-Box Confidence via Reasoning Traje…

200 papers

Closed-source large language models (LLMs), such as ChatGPT and Gemini, are increasingly consulted for medical advice, yet their explanations may appear plausible while failing to reflect the model's underlying reasoning process. This gap…

Chain-of-Thought significantly enhances a model's reasoning capability, but it also comes with a considerable increase in inference costs due to long chains. With the observation that the reasoning path can be easily compressed under easy…

Artificial Intelligence · Computer Science 2025-02-14 Xinyin Ma , Guangnian Wan , Runpeng Yu , Gongfan Fang , Xinchao Wang

Textual reasoning has recently been widely adopted in Blind Image Quality Assessment (BIQA). However, it remains unclear how textual information contributes to quality prediction and to what extent text can represent the score-related image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yuan Li , Shin'ya Nishida

How do reasoning models verify their own answers? We study this question by training a model using DeepSeek R1's recipe on the CountDown task. We leverage the fact that preference tuning leads to mode collapse, yielding a model that always…

Artificial Intelligence · Computer Science 2025-05-13 Andrew Lee , Lihao Sun , Chris Wendler , Fernanda Viégas , Martin Wattenberg

Mathematical reasoning through Chain-of-Thought (CoT) has emerged as a powerful capability of Large Language Models (LLMs), which can be further enhanced through Test-Time Scaling (TTS) methods like Beam Search and DVTS. However, these…

Computation and Language · Computer Science 2025-05-26 Zezhong Wang , Xingshan Zeng , Weiwen Liu , Yufei Wang , Liangyou Li , Yasheng Wang , Lifeng Shang , Xin Jiang , Qun Liu , Kam-Fai Wong

Chain-of-thought (CoT) has emerged as a critical mechanism for enhancing reasoning capabilities in large language models (LLMs), with self-consistency demonstrating notable promise in boosting performance. However, inherent linguistic…

Computation and Language · Computer Science 2025-04-03 Zhiwei Yu , Tuo Li , Changhong Wang , Hui Chen , Lang Zhou

Chain-of-thought (CoT) reasoning sometimes fails to faithfully reflect the true computation of a large language model (LLM), hampering its utility in explaining how LLMs arrive at their answers. Moreover, optimizing for faithfulness and…

Computation and Language · Computer Science 2026-02-19 Nithin Sivakumaran , Shoubin Yu , Hyunji Lee , Yue Zhang , Ali Payani , Mohit Bansal , Elias Stengel-Eskin

Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning tasks. However, they remain highly susceptible to jailbreak attacks that undermine their safety alignment. Existing defense mechanisms typically…

Cryptography and Security · Computer Science 2026-03-17 Yu Pan , Wenlong Yu , Tiejun Wu , Xiaohu Ye , Qiannan Si , Guangquan Xu , Bin Wu

Recent test-time reasoning methods improve performance by generating more candidate chains or searching over larger reasoning trees, but they typically lack explicit control over when to expand, what to prune, how to repair, and when to…

Artificial Intelligence · Computer Science 2026-03-31 Siyuan Ma , Bo Gao , Zikai Xiao , Hailong Wang , Xinlei Yu , Rui Qian , Jiayu Qian , Luqi Gong , Yang Liu

With the rapid advancement of large language models (LLMs) technologies, their application in the domain of autonomous driving has become increasingly widespread. However, existing methods suffer from unstructured reasoning, poor…

Artificial Intelligence · Computer Science 2026-01-09 Chang Zhao , Zheming Yang , Yunqing Hu , Qi Guo , Zijian Wang , Pengcheng Li , Wen Ji

Modern large language models rely on chain-of-thought (CoT) reasoning to achieve impressive performance, yet the same mechanism can amplify deceptive alignment, situations in which a model appears aligned while covertly pursuing misaligned…

Artificial Intelligence · Computer Science 2025-05-27 Jiaming Ji , Wenqi Chen , Kaile Wang , Donghai Hong , Sitong Fang , Boyuan Chen , Jiayi Zhou , Juntao Dai , Sirui Han , Yike Guo , Yaodong Yang

As autonomous agents become more capable of performing real-world tasks, distinguishing scheming behavior from benign task pursuit may become a central AI control problem. Existing monitors often rely on chain-of-thought access or internal…

Computation and Language · Computer Science 2026-05-29 Aditya Sinha , Akshat Naik , Victor Gillioz , Simon Storf , Kilian Merkelbach , Rich Barton-Cooper , Axel Højmark , Marius Hobbhahn

Chain-of-thought (CoT) reasoning has advanced medical visual question answering (VQA), yet most existing CoT rationales are free-form and fail to capture the structured reasoning process clinicians actually follow. This work asks: Can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Lin Fan , Yafei Ou , Zhipeng Deng , Pengyu Dai , Hou Chongxian , Jiale Yan , Yaqian Li , Kaiwen Long , Xun Gong , Masayuki Ikebe , Yefeng Zheng

Large language models (LLMs) increasingly rely on Chain-of-Thought (CoT) prompting to improve problem-solving and provide seemingly transparent explanations. However, growing evidence shows that CoT often fail to faithfully represent the…

Artificial Intelligence · Computer Science 2026-03-03 Xu Shen , Song Wang , Zhen Tan , Laura Yao , Xinyu Zhao , Kaidi Xu , Xin Wang , Tianlong Chen

Strategic model selection and reasoning settings are more effective than ensembling for optimizing automated scoring with large language models (LLMs). We examined self-consistency (intra-model majority voting) and reasoning effort for…

Computers and Society · Computer Science 2026-05-01 Scott Frohn

Chains of thought (CoTs) have become central in interpreting and auditing behaviors of large language models. Yet growing evidence suggests that these traces often fail to faithfully represent the computations behind a model's predictions.…

Computation and Language · Computer Science 2026-05-26 Yoav Gur-Arieh , Ana Marasović , Mor Geva

Large language models (LLMs) have demonstrated impressive performance in various natural language processing tasks, yet their ability to perform multi-step logical reasoning remains an open challenge. Although Chain-of-Thought prompting has…

Verbalized confidence, in which LLMs report a numerical certainty score, is widely used to estimate uncertainty in black-box settings, yet the confidence scale itself (typically 0--100) is rarely examined. We show that this design choice is…

Artificial Intelligence · Computer Science 2026-03-11 Yuyang Dai

Answering questions with Chain-of-Thought (CoT) has significantly enhanced the reasoning capabilities of Large Language Models (LLMs), yet its impact on Large Multimodal Models (LMMs) still lacks a systematic assessment and in-depth…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Dongzhi Jiang , Renrui Zhang , Ziyu Guo , Yanwei Li , Yu Qi , Xinyan Chen , Liuhui Wang , Jianhan Jin , Claire Guo , Shen Yan , Bo Zhang , Chaoyou Fu , Peng Gao , Hongsheng Li

Large Language Models often improve accuracy on reasoning tasks by sampling multiple Chain-of-Thought (CoT) traces and aggregating them with majority voting (MV), a test-time technique called self-consistency. When we truncate a CoT partway…

Machine Learning · Statistics 2026-05-11 Naoto Iwase , Yuki Ichihara , Mohammad Atif Quamar , Junpei Komiyama