English
Related papers

Related papers: Bolster Hallucination Detection via Prompt-Guided …

200 papers

Contemporary Language Models (LMs), while impressively fluent, often generate content that is factually incorrect or unfaithful to the input context - a critical issue commonly referred to as 'hallucination'. This tendency of LMs to…

Computation and Language · Computer Science 2025-06-24 Anwoy Chatterjee , Yash Goel , Tanmoy Chakraborty

Large language models (LLMs) often generate responses that deviate from user input or training data, a phenomenon known as "hallucination." These hallucinations undermine user trust and hinder the adoption of generative AI systems.…

Computation and Language · Computer Science 2025-04-25 Yejin Bang , Ziwei Ji , Alan Schelten , Anthony Hartshorn , Tara Fowler , Cheng Zhang , Nicola Cancedda , Pascale Fung

Detecting hallucinations in large language model (LLM) outputs is pivotal, yet traditional fine-tuning for this classification task is impeded by the expensive and quickly outdated annotation process, especially across numerous vertical…

Artificial Intelligence · Computer Science 2024-07-09 Dongxu Zhang , Varun Gangal , Barrett Martin Lattimer , Yi Yang

Although large Language Models (LLMs) have achieved remarkable success, their practical application is often hindered by the generation of non-factual content, which is called "hallucination". Ensuring the reliability of LLMs' outputs is a…

Computation and Language · Computer Science 2025-09-16 Yue Ding , Xiaofang Zhu , Tianze Xia , Junfei Wu , Xinlong Chen , Qiang Liu , Liang Wang

Despite their impressive capabilities, large language models (LLMs) have been observed to generate responses that include inaccurate or fabricated information, a phenomenon commonly known as ``hallucination''. In this work, we propose a…

Computation and Language · Computer Science 2024-03-12 Yue Zhang , Leyang Cui , Wei Bi , Shuming Shi

Empowered by large language models (LLMs), intelligent agents have become a popular paradigm for interacting with open environments to facilitate AI deployment. However, hallucinations generated by LLMs-where outputs are inconsistent with…

Machine Learning · Computer Science 2025-07-23 Siyuan Liu , Wenjing Liu , Zhiwei Xu , Xin Wang , Bo Chen , Tao Li

In the era of large language models (LLMs), hallucination (i.e., the tendency to generate factually incorrect content) poses great challenge to trustworthy and reliable deployment of LLMs in real-world applications. To tackle the LLM…

Computation and Language · Computer Science 2024-01-09 Junyi Li , Jie Chen , Ruiyang Ren , Xiaoxue Cheng , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Retrieval-augmented generation (RAG) has become a main technique for alleviating hallucinations in large language models (LLMs). Despite the integration of RAG, LLMs may still present unsupported or contradictory claims to the retrieved…

Computation and Language · Computer Science 2024-05-20 Cheng Niu , Yuanhao Wu , Juno Zhu , Siliang Xu , Kashun Shum , Randy Zhong , Juntong Song , Tong Zhang

Large language models (LLMs) often generate hallucinated content that lacks factual or contextual grounding, limiting their reliability in critical applications. Existing approaches such as supervised fine-tuning and reinforcement learning…

Computation and Language · Computer Science 2025-12-23 Jensen Zhang , Ningyuan Liu , Yijia Fan , Zihao Huang , Qinglin Zeng , Kaitong Cai , Jian Wang , Keze Wang

Large Language Models (LLMs) are widely used in critical fields such as healthcare, education, and finance due to their remarkable proficiency in various language-related tasks. However, LLMs are prone to generating factually incorrect…

Computation and Language · Computer Science 2023-11-27 Muneeswaran I , Shreya Saxena , Siva Prasad , M V Sai Prakash , Advaith Shankar , Varun V , Vishal Vaddina , Saisubramaniam Gopalakrishnan

Large Language Models (LLMs) are powerful linguistic engines but remain susceptible to hallucinations: plausible-sounding outputs that are factually incorrect or unsupported. In this work, we present a mathematically grounded framework to…

Computation and Language · Computer Science 2025-11-20 Moses Kiprono

Alignment is a standard procedure to fine-tune pre-trained large language models (LLMs) to follow natural language instructions and serve as helpful AI assistants. We have observed, however, that the conventional alignment process fails to…

Computation and Language · Computer Science 2024-05-03 Sheng-Chieh Lin , Luyu Gao , Barlas Oguz , Wenhan Xiong , Jimmy Lin , Wen-tau Yih , Xilun Chen

Large language models (LLMs) have shown substantial capacity for generating fluent, contextually appropriate responses. However, they can produce hallucinated outputs, especially when a user query includes one or more false premises-claims…

Computation and Language · Computer Science 2026-02-18 Yuehan Qin , Shawn Li , Yi Nian , Xinyan Velocity Yu , Yue Zhao , Xuezhe Ma

Detecting hallucinations in large language models (LLMs) remains a fundamental challenge for their trustworthy deployment. Going beyond basic uncertainty-driven hallucination detection frameworks, we propose a simple yet powerful method…

Artificial Intelligence · Computer Science 2025-10-10 Rui Wang , Zeming Wei , Guanzhang Yue , Meng Sun

While Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to generate contextually grounded responses, contextual faithfulness remains challenging as LLMs may not consistently trust provided context, leading to…

Computation and Language · Computer Science 2026-02-10 Yongchao Long , Xian Wu , Yingying Zhang , Xianbin Wen , Yuxi Zhou , Shenda Hong

Large Vision-Language Models (LVLMs) are an extension of Large Language Models (LLMs) that facilitate processing both image and text inputs, expanding AI capabilities. However, LVLMs struggle with object hallucinations due to their reliance…

Computation and Language · Computer Science 2024-08-12 Avshalom Manevich , Reut Tsarfaty

Large Language Models (LLMs) and Large Reasoning Models (LRMs) offer transformative potential for high-stakes domains like finance and law, but their tendency to hallucinate, generating factually incorrect or unsupported content, poses a…

Artificial Intelligence · Computer Science 2026-01-16 Ahmad Pesaranghader , Erin Li

Hallucination, the generation of factually incorrect content, is a growing challenge in Large Language Models (LLMs). Existing detection and mitigation methods are often isolated and insufficient for domain-specific needs, lacking a…

Computation and Language · Computer Science 2025-01-22 Mengfei Liang , Archish Arun , Zekun Wu , Cristian Munoz , Jonathan Lutch , Emre Kazim , Adriano Koshiyama , Philip Treleaven

This work introduces a novel methodology for the automatic detection of hallucinations generated during large language model (LLM) inference. The proposed approach is based on a systematic taxonomy and controlled reproduction of diverse…

Computation and Language · Computer Science 2025-10-08 Maksym Zavhorodnii , Dmytro Dehtiarov , Anna Konovalenko

Hallucination, the generation of factually incorrect information, remains a significant challenge for large language models (LLMs), especially in open-domain long-form generation. Existing approaches for detecting hallucination in long-form…