English
Related papers

Related papers: Metric Ensembles For Hallucination Detection

200 papers

Large Language Models (LLMs) have been transformative across many domains. However, hallucination, i.e., confidently outputting incorrect information, remains one of the leading challenges for LLMs. This raises the question of how to…

Computation and Language · Computer Science 2026-03-19 Toghrul Abbasli , Kentaroh Toyoda , Yuan Wang , Leon Witt , Muhammad Asif Ali , Yukai Miao , Dan Li , Qingsong Wei

Hierarchical Merging is a technique commonly used to summarize very long texts ($>$100K tokens) by breaking down the input into smaller sections, summarizing those sections individually, and then merging or combining those summaries into a…

Computation and Language · Computer Science 2025-08-11 Litu Ou , Mirella Lapata

Inspired by the superior language abilities of large language models (LLM), large vision-language models (LVLM) have been recently explored by integrating powerful LLMs for improving the performance on complex multimodal tasks. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Yifan Li , Yifan Du , Kun Zhou , Jinpeng Wang , Wayne Xin Zhao , Ji-Rong Wen

Large language models (LLMs) have achieved impressive performance across a wide range of natural language processing tasks, yet they often produce hallucinated content that undermines factual reliability. To address this challenge, we…

Computation and Language · Computer Science 2026-03-23 Yaxin Zhao , Yu Zhang

Recent advances in large language models (LLMs) have shown promising improvements, often surpassing existing methods across a wide range of downstream tasks in natural language processing. However, these models still face challenges, which…

Computation and Language · Computer Science 2025-02-13 Sujeong Lee , Hayoung Lee , Seongsoo Heo , Wonik Choi

Hallucination, posed as a pervasive challenge of multi-modal large language models (MLLMs), has significantly impeded their real-world usage that demands precise judgment. Existing methods mitigate this issue with either training with…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Qidong Huang , Xiaoyi Dong , Pan Zhang , Bin Wang , Conghui He , Jiaqi Wang , Dahua Lin , Weiming Zhang , Nenghai Yu

Since the introduction of ChatGPT, large language models (LLMs) have demonstrated significant utility in various tasks, such as answering questions through retrieval-augmented generation. Context can be retrieved using a vectorized…

Computation and Language · Computer Science 2025-07-01 Ming Cheung

Hallucination remains a persistent challenge in Large Language Models (LLMs), particularly in context-grounded settings such as RAG and agentic AI systems. This study focuses on contextual hallucination detection in summarization tasks. We…

Computation and Language · Computer Science 2026-05-12 I. F. Atasoy , B. Mutlu , E. A. Sezer , A. Wahdan

Hallucinations in Large Language Models (LLMs) -- generations that are plausible but factually unfaithful -- remain a critical barrier to high-stakes deployment. Current detection methods typically rely on computationally expensive external…

Artificial Intelligence · Computer Science 2026-01-23 Manish Bhatt

Large language models (LLMs) have demonstrated remarkable performance across diverse tasks by encoding vast amounts of factual knowledge. However, they are still prone to hallucinations, generating incorrect or misleading information, often…

Computation and Language · Computer Science 2025-11-13 Xiaomin Li , Zhou Yu , Ziji Zhang , Yingying Zhuang , Swair Shah , Narayanan Sadagopan , Anurag Beniwal

With the advance of large language models (LLMs), LLMs have been utilized for the various tasks. However, the issues of variability and reproducibility of results from each trial of LLMs have been largely overlooked in existing literature…

Computation and Language · Computer Science 2025-05-08 Junichiro Niimi

Hallucination detection is critical for ensuring the reliability of large language models (LLMs) in context-based generation. Prior work has explored intrinsic signals available during generation, among which attention offers a direct view…

Computation and Language · Computer Science 2026-02-23 Siya Qi , Yudong Chen , Runcong Zhao , Qinglin Zhu , Zhanghao Hu , Wei Liu , Yulan He , Zheng Yuan , Lin Gui

Hallucinations in large language models (LLMs) are outputs that are syntactically coherent but factually incorrect or contextually inconsistent. They are persistent obstacles in high-stakes industrial settings such as engineering design,…

Software Engineering · Computer Science 2026-04-07 Brian Freeman , Adam Kicklighter , Matt Erdman , Zach Gordon

To mitigate the impact of hallucination nature of LLMs, many studies propose detecting hallucinated generation through uncertainty estimation. However, these approaches predominantly operate at the sentence or paragraph level, failing to…

Computation and Language · Computer Science 2025-09-05 Min-Hsuan Yeh , Max Kamachee , Seongheon Park , Yixuan Li

Hallucinations are one of the major issues affecting LLMs, hindering their wide adoption in production systems. While current research solutions for detecting hallucinations are mainly based on heuristics, in this paper we introduce a…

Computation and Language · Computer Science 2025-02-14 Emanuele Ricco , Lorenzo Cima , Roberto Di Pietro

Reducing hallucinations in Large Language Models (LLMs) is essential for improving the accuracy of data extraction from large text corpora. Current methods, like prompt engineering and chain-of-thought prompting, focus on individual…

Artificial Intelligence · Computer Science 2026-04-03 Daniel Xie , Maxwell J. Jacobson , Adil Wazeer , Haiyan Wang , Xinghang Zhang , Yexiang Xue

Large language models (LLMs) have shown promise for generative and knowledge-intensive tasks including question-answering (QA) tasks. However, the practical deployment still faces challenges, notably the issue of "hallucination", where…

Computation and Language · Computer Science 2023-10-11 Ziwei Ji , Tiezheng Yu , Yan Xu , Nayeon Lee , Etsuko Ishii , Pascale Fung

Large Language Models (LLMs) offer promising solutions for text summarization. However, some domains require specific information to be available in the summaries. Generating these domain-adapted summaries is still an open challenge.…

Computation and Language · Computer Science 2024-11-26 Gaya Mehenni , Amal Zouaq

Recent advancements in massively multilingual machine translation systems have significantly enhanced translation accuracy; however, even the best performing systems still generate hallucinations, severely impacting user trust. Detecting…

Computation and Language · Computer Science 2024-10-22 Kenza Benkirane , Laura Gongas , Shahar Pelles , Naomi Fuchs , Joshua Darmon , Pontus Stenetorp , David Ifeoluwa Adelani , Eduardo Sánchez

This work proposes a novel approach to enhancing annotated bibliography generation through Large Language Model (LLM) ensembles. In particular, multiple LLMs in different roles -- controllable text generation, evaluation, and summarization…

Computation and Language · Computer Science 2024-12-31 Sergio Bermejo