English
Related papers

Related papers: Enhancing Hallucination Detection through Perturba…

200 papers

Large Language Models (LLMs) have shown their ability to collaborate effectively with humans in real-world scenarios. However, LLMs are apt to generate hallucinations, i.e., makeup incorrect text and unverified information, which can cause…

Computation and Language · Computer Science 2023-10-25 Shiping Yang , Renliang Sun , Xiaojun Wan

Hallucinations in large language models (LLMs) refer to the phenomenon of LLMs producing responses that are coherent yet factually inaccurate. This issue undermines the effectiveness of LLMs in practical applications, necessitating research…

Computation and Language · Computer Science 2024-06-11 Weihang Su , Changyue Wang , Qingyao Ai , Yiran HU , Zhijing Wu , Yujia Zhou , Yiqun Liu

In text generation, hallucinations refer to the generation of seemingly coherent text that contradicts established knowledge. One compelling hypothesis is that hallucinations occur when a language model is given a generation task outside…

Computation and Language · Computer Science 2024-08-21 Ameya Godbole , Nicholas Monath , Seungyeon Kim , Ankit Singh Rawat , Andrew McCallum , Manzil Zaheer

Recently developed large language models have achieved remarkable success in generating fluent and coherent text. However, these models often tend to 'hallucinate' which critically hampers their reliability. In this work, we address this…

Computation and Language · Computer Science 2023-08-15 Neeraj Varshney , Wenlin Yao , Hongming Zhang , Jianshu Chen , Dong Yu

Large Language Models (LLMs) are widely used to generate plausible text on online platforms, without revealing the generation process. As users increasingly encounter such black-box outputs, detecting hallucinations has become a critical…

Computation and Language · Computer Science 2026-04-08 Joosung Lee , Cheonbok Park , Hwiyeol Jo , Jeonghoon Kim , Joonsuk Park , Kang Min Yoo

Hallucinations in large language models (LLMs), defined as fluent yet incorrect or incoherent outputs, pose a significant challenge to the automatic generation of educational multiple-choice questions (MCQs). We identified four key…

Computation and Language · Computer Science 2026-01-22 Nicholas X. Wang , Aggelos K. Katsaggelos

Since the introduction of ChatGPT, large language models (LLMs) have demonstrated significant utility in various tasks, such as answering questions through retrieval-augmented generation. Context can be retrieved using a vectorized…

Computation and Language · Computer Science 2025-07-01 Ming Cheung

Hallucination in Large Language Models (LLMs) refers to the generation of content that is not faithful to the input or the real-world facts. This paper provides a rigorous treatment of hallucination in LLMs, including formal definitions and…

Computation and Language · Computer Science 2025-08-01 Esmail Gumaan

Large language models (LLMs) have transformed natural language processing, achieving remarkable performance across diverse tasks. However, their impressive fluency often comes at the cost of producing false or fabricated information, a…

Computation and Language · Computer Science 2026-03-20 Aisha Alansari , Hamzah Luqman

Is automated hallucination detection possible? In this work, we introduce a theoretical framework to analyze the feasibility of automatically detecting hallucinations produced by large language models (LLMs). Inspired by the classical…

Machine Learning · Computer Science 2025-06-03 Amin Karbasi , Omar Montasser , John Sous , Grigoris Velegkas

The rapidly developing Large Vision Language Models (LVLMs) have shown notable capabilities on a range of multi-modal tasks, but still face the hallucination phenomena where the generated texts do not align with the given contexts,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Wenyi Xiao , Ziwei Huang , Leilei Gan , Wanggui He , Haoyuan Li , Zhelun Yu , Fangxun Shu , Hao Jiang , Linchao Zhu

Large Language Models (LLMs) have demonstrated impressive generative capabilities across diverse tasks but remain susceptible to hallucinations, confidently generated yet factually incorrect outputs. We introduce a reference-free,…

Computation and Language · Computer Science 2025-10-17 Keshav Kumar

Large Language Models (LLMs) frequently generate plausible but non-factual content, a phenomenon known as hallucination. While existing detection methods typically rely on computationally expensive sampling-based consistency checks or…

Machine Learning · Computer Science 2026-05-07 Dan Wilson , Mohamed Akrout

Hallucination, the generation of factually incorrect information, remains a significant challenge for large language models (LLMs), especially in open-domain long-form generation. Existing approaches for detecting hallucination in long-form…

Hallucination is a well-known phenomenon in text generated by large language models (LLMs). The existence of hallucinatory responses is found in almost all application scenarios e.g., summarization, question-answering (QA) etc. For…

Computation and Language · Computer Science 2023-12-11 Mobashir Sadat , Zhengyu Zhou , Lukas Lange , Jun Araki , Arsalan Gundroo , Bingqing Wang , Rakesh R Menon , Md Rizwan Parvez , Zhe Feng

Neural sequence generation models are known to "hallucinate", by producing outputs that are unrelated to the source text. These hallucinations are potentially harmful, yet it remains unclear in what conditions they arise and how to mitigate…

Computation and Language · Computer Science 2023-02-28 Weijia Xu , Sweta Agrawal , Eleftheria Briakou , Marianna J. Martindale , Marine Carpuat

Vision-Language Models (VLMs) excel at visual understanding but often suffer from visual hallucinations, where they generate descriptions of nonexistent objects, actions, or concepts, posing significant risks in safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Tsung-Han Wu , Heekyung Lee , Jiaxin Ge , Joseph E. Gonzalez , Trevor Darrell , David M. Chan

Large language models (LLMs) have shown substantial capacity for generating fluent, contextually appropriate responses. However, they can produce hallucinated outputs, especially when a user query includes one or more false premises-claims…

Computation and Language · Computer Science 2026-02-18 Yuehan Qin , Shawn Li , Yi Nian , Xinyan Velocity Yu , Yue Zhao , Xuezhe Ma

Large Language Models (LLMs), when used for conditional text generation, often produce hallucinations, i.e., information that is unfaithful or not grounded in the input context. This issue arises in typical conditional text generation…

Computation and Language · Computer Science 2025-02-20 Song Duong , Florian Le Bronnec , Alexandre Allauzen , Vincent Guigue , Alberto Lumbreras , Laure Soulier , Patrick Gallinari

Despite their impressive ability to generate high-quality and fluent text, generative large language models (LLMs) also produce hallucinations: statements that are misaligned with established world knowledge or provided input context.…

Computation and Language · Computer Science 2025-01-15 Abhilasha Ravichander , Shrusti Ghela , David Wadden , Yejin Choi