English
Related papers

Related papers: SteerConf: Steering LLMs for Confidence Elicitatio…

200 papers

Large Language Models (LLMs) have shown significant advances in text generation but often lack the reliability needed for autonomous deployment in high-stakes domains like healthcare, law, and finance. Existing approaches rely on external…

Artificial Intelligence · Computer Science 2024-11-12 Ninad Naik

Activation steering has emerged as a promising approach for efficiently adapting large language models (LLMs) to downstream behaviors. However, most existing steering methods rely on a single static direction per task or concept, making…

Self-Consistency, a widely-used decoding strategy, significantly boosts the reasoning capabilities of Large Language Models (LLMs). However, it depends on the plurality voting rule, which focuses on the most frequent answer while…

Computation and Language · Computer Science 2025-09-18 Siyuan Huang , Zhiyuan Ma , Jintao Du , Changhua Meng , Weiqiang Wang , Zhouhan Lin

We present a methodology for improving the accuracy of faithfulness evaluation in Large Language Models (LLMs). The proposed methodology is based on the combination of elementary faithfulness metrics into a combined (fused) metric, for the…

Computation and Language · Computer Science 2025-12-08 Ben Malin , Tatiana Kalganova , Nikolaos Boulgouris

Large Language Models (LLMs) are increasingly deployed for structured data generation, yet output consistency remains critical for production applications. We introduce a comprehensive framework for evaluating and improving consistency in…

Computation and Language · Computer Science 2026-01-01 Guanghui Wang , Jinze Yu , Xing Zhang , Dayuan Jiang , Yin Song , Tomal Deb , Xuefeng Liu , Peiyang He

Large Language Models (LLMs) can generate factually inaccurate content even if they have corresponding knowledge, which critically undermines their reliability. Existing approaches attempt to mitigate this by incorporating uncertainty in QA…

Computation and Language · Computer Science 2026-04-14 Xiaoning Dong , Chengyan Wu , Yajie Wen , Yu Chen , Yun Xue , Jing Zhang , Wei Xu , Bolei Ma

Large Language Models (LLMs) are expected to provide helpful and harmless responses, yet they often exhibit sycophancy--conforming to user beliefs regardless of factual accuracy or ethical soundness. Prior research on sycophancy has…

Computation and Language · Computer Science 2026-03-02 Jiseung Hong , Grace Byun , Seungone Kim , Kai Shu , Jinho D. Choi

Recent advances in large language models (LLMs) have enabled deep research systems that synthesize comprehensive, report-style answers to open-ended queries by combining retrieval, reasoning, and generation. Yet most frameworks rely on…

Computation and Language · Computer Science 2026-05-26 Lin Ai , Victor S. Bursztyn , Xiang Chen , Julia Hirschberg , Saayan Mitra

Large Language Models (LLMs) are increasingly applied to automate software engineering tasks, including the generation of UML class diagrams from natural language descriptions. While prior work demonstrates that LLMs can produce…

Software Engineering · Computer Science 2026-04-07 Rabia Iftikhar , Andreas Rausch

Over the last year, significant advancements have been made in the realms of large language models (LLMs) and multi-modal large language models (MLLMs), particularly in their application to autonomous driving. These models have showcased…

Robotics · Computer Science 2024-06-11 Xiangrui Kong , Thomas Braunl , Marco Fahmi , Yue Wang

Assessing the reliability of Large Language Models (LLMs) by confidence elicitation is a prominent approach to AI safety in high-stakes applications, such as healthcare and finance. Existing methods either require expensive computational…

Computation and Language · Computer Science 2026-04-08 Zhaohan Zhang , Ziquan Liu , Ioannis Patras

The proliferation of Large Language Models (LLMs) is challenged by hallucinations, critical failure modes where models generate non-factual, nonsensical or unfaithful text. This paper introduces Semantic Divergence Metrics (SDM), a novel…

Computation and Language · Computer Science 2025-08-15 Igor Halperin

As Large Language Models increasingly automate complex, long-horizon tasks such as \emph{vibe coding}, a supervision gap has emerged. While models excel at execution, users often struggle to guide them effectively due to insufficient domain…

Artificial Intelligence · Computer Science 2026-02-09 Enyu Zhou , Zhiheng Xi , Long Ma , Zhihao Zhang , Shihan Dou , Zhikai Lei , Guoteng Wang , Rui Zheng , Hang Yan , Tao Gui , Qi Zhang , Xuanjing Huang

As qualitative researchers show growing interest in using automated tools to support interpretive analysis, a large language model (LLM) is often introduced into an analytic workflow as is, without systematic evaluation of interpretive…

Computation and Language · Computer Science 2026-04-02 Songhee Han , Jueun Shin , Jiyoon Han , Bung-Woo Jun , Hilal Ayan Karabatman

Large Language Models (LLMs) have revolutionized inference across diverse natural language tasks, with larger models performing better but at higher computational costs. We propose a confidence-driven strategy that dynamically selects the…

Computation and Language · Computer Science 2026-02-26 Bo-Wei Chen , Chung-Chi Chen , An-Zi Yen

Large Language Models (LLMs) have exhibited remarkable performance across various downstream tasks, but they may generate inaccurate or false information with a confident tone. One of the possible solutions is to empower the LLM confidence…

Computation and Language · Computer Science 2024-04-17 Haixia Han , Tingyun Li , Shisong Chen , Jie Shi , Chengyu Du , Yanghua Xiao , Jiaqing Liang , Xin Lin

Large Language Models (LLMs) have significantly advanced automated test generation, yet existing methods often rely on ground-truth code for verification, risking bug propagation and limiting applicability in test-driven development. We…

Software Engineering · Computer Science 2026-02-12 Hamed Taherkhani , Alireza DaghighFarsoodeh , Mohammad Chowdhury , Hung Viet Pham , Hadi Hemmati

While test-time reasoning enables language models (LMs) to tackle complex tasks, searching or planning in natural language can be slow, costly, and error-prone. But even when LMs struggle to emulate the precise reasoning steps needed to…

Computation and Language · Computer Science 2025-08-11 Gabriel Grand , Joshua B. Tenenbaum , Vikash K. Mansinghka , Alexander K. Lew , Jacob Andreas

Ensuring the reliability of Large Language Models (LLMs) in complex reasoning tasks remains a formidable challenge, particularly in scenarios that demand precise mathematical calculations and knowledge-intensive open-domain generation. In…

Machine Learning · Computer Science 2025-05-27 Ali Razghandi , Seyed Mohammad Hadi Hosseini , Mahdieh Soleymani Baghshah

Large language models (LLMs) are now used in multi-turn workflows, but we still lack a clear way to measure when iteration helps and when it hurts. We present an evaluation framework for iterative refinement that spans ideation, code, and…

Artificial Intelligence · Computer Science 2025-09-16 Shashidhar Reddy Javaji , Bhavul Gauri , Zining Zhu