English
Related papers

Related papers: From Confidence to Collapse in LLM Factual Robustn…

200 papers

Fact-checking real-world claims, particularly numerical claims, is inherently complex that require multistep reasoning and numerical reasoning for verifying diverse aspects of the claim. Although large language models (LLMs) including…

Computation and Language · Computer Science 2025-09-29 Primakov Chungkham , V Venktesh , Vinay Setty , Avishek Anand

Large language models (LLMs) show strong reasoning abilities across diverse tasks, yet their performance on extended contexts remains inconsistent. While prior research has emphasized mid-context degradation in question answering, this…

Computation and Language · Computer Science 2026-02-25 Pietro Bernardelle , Stefano Civelli , Kevin Roitero , Gianluca Demartini

Large language models (LLMs) have been treated as knowledge bases due to their strong performance in knowledge probing tasks. LLMs are typically evaluated using accuracy, yet this metric does not capture the vulnerability of LLMs to…

Computation and Language · Computer Science 2023-10-17 Weixuan Wang , Barry Haddow , Alexandra Birch , Wei Peng

Despite their widespread use in fact-checking, moderation, and high-stakes decision-making, large language models (LLMs) remain poorly understood as judges of truth. This study presents the largest evaluation to date of LLMs' veracity…

Computation and Language · Computer Science 2025-09-30 Emilio Barkett , Olivia Long , Madhavendra Thakur

As LLMs become embedded in research workflows and organizational decision processes, their effect on analytical reliability remains uncertain. We distinguish two dimensions of analytical reliability -- intelligence (the capacity to reach…

General Economics · Economics 2026-02-26 Ryan Allen , Aticus Peterson

Large language models (LLMs) often produce unsupported or unverifiable content, known as "hallucinations." To mitigate this, retrieval-augmented LLMs incorporate citations, grounding the content in verifiable sources. Despite such…

Information Retrieval · Computer Science 2024-08-26 Weijia Zhang , Mohammad Aliannejadi , Yifei Yuan , Jiahuan Pei , Jia-Hong Huang , Evangelos Kanoulas

Modern LLMs can now produce highly readable abstractive summaries, to the point that traditional automated metrics for evaluating summary quality, such as ROUGE, have saturated. However, LLMs still sometimes introduce inaccuracies into…

Computation and Language · Computer Science 2025-11-06 Sanjana Ramprasad , Byron C. Wallace

With the widespread application of Large Language Models (LLMs) to various domains, concerns regarding the trustworthiness of LLMs in safety-critical scenarios have been raised, due to their unpredictable tendency to hallucinate and…

Computation and Language · Computer Science 2024-11-04 Xin Qiu , Risto Miikkulainen

Large Language Models (LLMs) effectiveness is usually evaluated by means of benchmarks such as MMLU, ARC-C, or HellaSwag, where questions are presented in their original wording, thus in a fixed, standardized format. However, real-world…

Computation and Language · Computer Science 2025-09-05 Riccardo Lunardi , Vincenzo Della Mea , Stefano Mizzaro , Kevin Roitero

As language models (LMs) become integral to fields like healthcare, law, and journalism, their ability to differentiate between fact, belief, and knowledge is essential for reliable decision-making. Failure to grasp these distinctions can…

Computation and Language · Computer Science 2024-10-29 Mirac Suzgun , Tayfun Gur , Federico Bianchi , Daniel E. Ho , Thomas Icard , Dan Jurafsky , James Zou

Large Language Models (LLMs) are prone to generating fluent but incorrect content, known as confabulation, which poses increasing risks in multi-turn or agentic applications where outputs may be reused as context. In this work, we…

Computation and Language · Computer Science 2026-03-18 Tianyi Zhou , Johanne Medina , Sanjay Chawla

Large language models (LLMs) are widely used for long-form text generation. However, factual errors in the responses would undermine their reliability. Despite growing attention to LLM factuality, the effect of response length on factuality…

Computation and Language · Computer Science 2025-05-30 James Xu Zhao , Jimmy Z. J. Liu , Bryan Hooi , See-Kiong Ng

Vision-Language Models (VLMs) have great potential in medical tasks, like Visual Question Answering (VQA), where they could act as interactive assistants for both patients and clinicians. Yet their robustness to distribution shifts on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Kim-Celine Kahl , Selen Erkan , Jeremias Traub , Carsten T. Lüth , Klaus Maier-Hein , Lena Maier-Hein , Paul F. Jaeger

Knowledge Graphs (KGs) store structured factual knowledge by linking entities through relationships, crucial for many applications. These applications depend on the KG's factual accuracy, so verifying facts is essential, yet challenging.…

Databases · Computer Science 2026-02-12 Farzad Shami , Stefano Marchesin , Gianmaria Silvello

This project develops a self correcting framework for large language models (LLMs) that detects and mitigates hallucinations during multi-step reasoning. Rather than relying solely on final answer correctness, our approach leverages fine…

Artificial Intelligence · Computer Science 2025-11-21 Chelsea Zou , Yiheng Yao , Basant Khalil

Accurate confidence estimation is essential for trustworthy large language models (LLMs) systems, as it empowers the user to determine when to trust outputs and enables reliable deployment in safety-critical applications. Current confidence…

Computation and Language · Computer Science 2026-01-28 Mingruo Yuan , Shuyi Zhang , Ben Kao

Before deploying a language model (LM) within a given domain, it is important to measure its tendency to generate factually incorrect information in that domain. Existing methods for factuality evaluation of LLM generation focus on facts…

Computation and Language · Computer Science 2024-02-06 Dor Muhlgay , Ori Ram , Inbal Magar , Yoav Levine , Nir Ratner , Yonatan Belinkov , Omri Abend , Kevin Leyton-Brown , Amnon Shashua , Yoav Shoham

Large language models (LLMs) are increasingly used as decision-support tools in data-constrained scientific workflows, where correctness and validity are critical. However, evaluation practices often emphasize stability or reproducibility…

Machine Learning · Computer Science 2026-03-18 Nazia Riasat

Large Language Models (LLMs) have the potential to revolutionize scientific research, yet their robustness and reliability in domain-specific applications remain insufficiently explored. In this study, we evaluate the performance and…

Computation and Language · Computer Science 2025-08-15 Hongchen Wang , Kangming Li , Scott Ramsay , Yao Fehlis , Edward Kim , Jason Hattrick-Simpers

Large Language Models (LLMs) are trained on vast and diverse internet corpora that often include inaccurate or misleading content. Consequently, LLMs can generate misinformation, making robust fact-checking essential. This review…