English
Related papers

Related papers: LLM Self-Explanations Fail Semantic Invariance

200 papers

A critical component in the trustworthiness of LLMs is reliable uncertainty communication, yet LLMs often use assertive language when conveying false claims, leading to over-reliance and eroded trust. We present the first systematic study…

Computation and Language · Computer Science 2025-10-03 Gabrielle Kaili-May Liu , Gal Yona , Avi Caciularu , Idan Szpektor , Tim G. J. Rudner , Arman Cohan

Reasoning failures in large language models (LLMs) are typically measured only at the end of a generation, yet many failures manifest as a process-level breakdown: the model "loses the thread" mid-reasoning. We study whether such breakdowns…

Artificial Intelligence · Computer Science 2026-02-04 Jinkun Chen , Fengxiang Cheng , Sijia Han , Vlado Keselj

Large Language Models (LLMs) tend to be unreliable in the factuality of their answers. To address this problem, NLP researchers have proposed a range of techniques to estimate LLM's confidence over facts. However, due to the lack of a…

Computation and Language · Computer Science 2024-11-28 Matéo Mahaut , Laura Aina , Paula Czarnowska , Momchil Hardalov , Thomas Müller , Lluís Màrquez

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

Computation and Language · Computer Science 2026-01-21 Md Talha Mohsin

Large Language Model (LLM) agents are increasingly expected to maintain coherent, long-term personalized memory, yet current benchmarks primarily measure static fact retrieval, overlooking the ability to revise stored beliefs when new…

Computation and Language · Computer Science 2026-05-08 Hanxiang Chao , Yihan Bai , Rui Sheng , Tianle Li , Yushi Sun

Large language models (LLMs) increasingly produce natural language explanations, yet these explanations often lack faithfulness, and they do not reliably reflect the evidence the model uses to decide. We introduce FaithLM, a model-agnostic…

Computation and Language · Computer Science 2025-10-28 Yu-Neng Chuang , Guanchu Wang , Chia-Yuan Chang , Ruixiang Tang , Shaochen Zhong , Fan Yang , Mengnan Du , Xuanting Cai , Vladimir Braverman , Xia Hu

Large Language Models (LLMs) have emerged as a groundbreaking technology with their unparalleled text generation capabilities across various applications. Nevertheless, concerns persist regarding the accuracy and appropriateness of their…

Computation and Language · Computer Science 2024-03-15 Jie Huang , Xinyun Chen , Swaroop Mishra , Huaixiu Steven Zheng , Adams Wei Yu , Xinying Song , Denny Zhou

Large language models (LLMs) demonstrate strong performance on standard digital logic and Boolean reasoning tasks, yet their reliability under locally redefined semantics remains poorly understood. In many formal settings, such as circuit…

Hardware Architecture · Computer Science 2026-02-20 Yogeswar Reddy Thota , Setareh Rafatirad , Homayoun Houman , Tooraj Nikoubin

We investigate the internal behavior of Transformer-based Large Language Models (LLMs) when they generate factually incorrect text. We propose modeling factual queries as constraint satisfaction problems and use this framework to…

Computation and Language · Computer Science 2024-04-18 Mert Yuksekgonul , Varun Chandrasekaran , Erik Jones , Suriya Gunasekar , Ranjita Naik , Hamid Palangi , Ece Kamar , Besmira Nushi

Large language models (LLMs) in research and development toolchains produce output that triggers attribution of agency and understanding -- a cognitive illusion that degrades verification behavior and trust calibration. No existing…

Software Engineering · Computer Science 2026-04-10 Marek Miller

We study the source of uncertainty in DeepSeek R1-32B by analyzing its self-reported verbal confidence on question answering (QA) tasks. In the default answer-then-confidence setting, the model is regularly over-confident, whereas semantic…

Computation and Language · Computer Science 2025-11-06 Jakub Podolak , Rajeev Verma

This paper presents a benchmark self-evolving framework to dynamically evaluate rapidly advancing Large Language Models (LLMs), aiming for a more accurate assessment of their capabilities and limitations. We utilize a multi-agent system to…

Computation and Language · Computer Science 2024-02-20 Siyuan Wang , Zhuohan Long , Zhihao Fan , Zhongyu Wei , Xuanjing Huang

Large Language Models (LLMs) are increasingly used in settings where reliable self-assessment is critical. Assessing model reliability has evolved from using probabilistic correctness estimates to, more recently, eliciting verbalized…

Computation and Language · Computer Science 2026-05-11 Sree Bhattacharyya , Samarth Khanna , Leona Chen , Lucas Craig , Tharun Dilliraj , James Z. Wang

At the staggering pace with which the capabilities of large language models (LLMs) are increasing, creating future-proof evaluation sets to assess their understanding becomes more and more challenging. In this paper, we propose a novel…

Computation and Language · Computer Science 2023-12-21 Xenia Ohmer , Elia Bruni , Dieuwke Hupkes

Explanations of neural models aim to reveal a model's decision-making process for its predictions. However, recent work shows that current methods giving explanations such as saliency maps or counterfactuals can be misleading, as they are…

Computation and Language · Computer Science 2023-07-03 Pepa Atanasova , Oana-Maria Camburu , Christina Lioma , Thomas Lukasiewicz , Jakob Grue Simonsen , Isabelle Augenstein

Large language models (LLMs) can explain their predictions through post-hoc or Chain-of-Thought (CoT) explanations. But an LLM could make up reasonably sounding explanations that are unfaithful to its underlying reasoning. Recent work has…

Computation and Language · Computer Science 2024-09-20 Letitia Parcalabescu , Anette Frank

Mitigating hallucinations in Large Language Models (LLMs) is critical for their reliable deployment. Existing methods typically fine-tune LLMs to abstain from answering questions beyond their knowledge scope. However, these methods often…

Computation and Language · Computer Science 2025-10-29 Hao An , Yang Xu

Evaluating whether explanations faithfully reflect a model's reasoning remains an open problem. Existing benchmarks use single interventions without statistical testing, making it impossible to distinguish genuine faithfulness from…

Computation and Language · Computer Science 2026-03-20 Abhinaba Basu , Pavan Chakraborty

Large language models (LLMs) exhibit compelling linguistic behaviour, and sometimes offer self-reports, that is to say statements about their own nature, inner workings, or behaviour. In humans, such reports are often attributed to a…

Computation and Language · Computer Science 2025-06-09 Iulia M. Comsa , Murray Shanahan

There have been widespread claims about Large Language Models (LLMs) being able to successfully verify or self-critique their candidate solutions in reasoning problems in an iterative mode. Intrigued by those claims, in this paper we set…

Artificial Intelligence · Computer Science 2023-10-13 Karthik Valmeekam , Matthew Marquez , Subbarao Kambhampati