English
Related papers

Related papers: A Cause-Effect Look at Alleviating Hallucination o…

200 papers

Hallucinations, a phenomenon where a language model (LM) generates nonfactual content, pose a significant challenge to the practical deployment of LMs. While many empirical methods have been proposed to mitigate hallucinations, recent…

Computation and Language · Computer Science 2026-05-18 Atsushi Suzuki , Yulan He , Feng Tian , Zhongyuan Wang

Hallucination detection is critical for ensuring the reliability of large language models (LLMs) in context-based generation. Prior work has explored intrinsic signals available during generation, among which attention offers a direct view…

Computation and Language · Computer Science 2026-02-23 Siya Qi , Yudong Chen , Runcong Zhao , Qinglin Zhu , Zhanghao Hu , Wei Liu , Yulan He , Zheng Yuan , Lin Gui

A common and fundamental limitation of Generative AI (GenAI) is its propensity to hallucinate. While large language models (LLM) have taken the world by storm, without eliminating or at least reducing hallucinations, real-world GenAI…

Machine Learning · Computer Science 2024-12-03 Patrice Béchard , Orlando Marquez Ayala

Detecting hallucinations in large language model (LLM) outputs is pivotal, yet traditional fine-tuning for this classification task is impeded by the expensive and quickly outdated annotation process, especially across numerous vertical…

Artificial Intelligence · Computer Science 2024-07-09 Dongxu Zhang , Varun Gangal , Barrett Martin Lattimer , Yi Yang

Despite significant progress in the quality of language generated from abstractive summarization models, these models still exhibit the tendency to hallucinate, i.e., output content not supported by the source document. A number of works…

Computation and Language · Computer Science 2022-11-01 Liam van der Poel , Ryan Cotterell , Clara Meister

Large language models (LLMs) are increasingly being adopted as the cognitive core of embodied agents. However, inherited hallucinations, which stem from failures to ground user instructions in the observed physical environment, can lead to…

Knowledge-grounded dialogue is a task of generating a fluent and informative response based on both conversation context and a collection of external knowledge, in which knowledge selection plays an important role and attracts more and more…

Computation and Language · Computer Science 2021-09-01 Shilei Liu , Xiaofeng Zhao , Bochao Li , Feiliang Ren

Model hallucination is one of the most critical challenges faced by Large Language Models (LLMs), especially in high-stakes code intelligence tasks. As LLMs become increasingly integrated into software engineering tasks, understanding and…

Software Engineering · Computer Science 2025-11-04 Cuiyun Gao , Guodong Fan , Chun Yong Chong , Shizhan Chen , Chao Liu , David Lo , Zibin Zheng , Qing Liao

Large Language Models (LLMs) have become increasingly important in natural language processing, enabling advanced data analytics through natural language queries. However, these models often generate "hallucinations"-inaccurate or…

Computation and Language · Computer Science 2024-10-29 Mikhail Rumiantsau , Aliaksei Vertsel , Ilya Hrytsuk , Isaiah Ballah

High-stakes domains like cyber operations need responsible and trustworthy AI methods. While large language models (LLMs) are becoming increasingly popular in these domains, they still suffer from hallucinations. This research paper…

Human-Computer Interaction · Computer Science 2025-04-18 Harry Li , Gabriel Appleby , Kenneth Alperin , Steven R Gomez , Ashley Suh

Responding with knowledge has been recognized as an important capability for an intelligent conversational agent. Yet knowledge-grounded dialogues, as training data for learning such a response generation model, are difficult to obtain.…

Computation and Language · Computer Science 2020-02-25 Xueliang Zhao , Wei Wu , Chongyang Tao , Can Xu , Dongyan Zhao , Rui Yan

The growth of digital documents presents significant challenges in efficient management and knowledge extraction. Traditional methods often struggle with complex documents, leading to issues such as hallucinations and high latency in…

Information Retrieval · Computer Science 2024-11-12 Anantha Sharma , Sheeba Elizabeth John , Fatemeh Rezapoor Nikroo , Krupali Bhatt , Mrunal Zambre , Aditi Wikhe

Large language models (LLMs) based on generative pre-trained Transformer have achieved remarkable performance on knowledge graph question-answering (KGQA) tasks. However, LLMs often produce ungrounded subgraph planning or reasoning results…

Computation and Language · Computer Science 2025-03-10 Mufan Xu , Kehai Chen , Xuefeng Bai , Muyun Yang , Tiejun Zhao , Min Zhang

Since the introduction of ChatGPT, large language models (LLMs) have demonstrated significant utility in various tasks, such as answering questions through retrieval-augmented generation. Context can be retrieved using a vectorized…

Computation and Language · Computer Science 2025-07-01 Ming Cheung

Despite the groundbreaking advancements made by large language models (LLMs), hallucination remains a critical bottleneck for their deployment in high-stakes domains. Existing classification-based methods mainly rely on static and passive…

Machine Learning · Computer Science 2026-05-12 Linggang Kong , Lei Wu , Yunlong Zhang , Xiaofeng Zhong , Zhen Wang , Yongjie Wang , Yao Pan

Large language models (LLMs) achieve remarkable fluency across linguistic and reasoning tasks but remain systematically prone to hallucination. Prevailing accounts attribute hallucinations to data gaps, limited context, or optimization…

Computers and Society · Computer Science 2025-09-23 Richard Ackermann , Simeon Emanuilov

We explore question generation in the context of knowledge-grounded dialogs focusing on explainability and evaluation. Inspired by previous work on planning-based summarisation, we present a model which instead of directly generating a…

Computation and Language · Computer Science 2024-04-12 Juliette Faille , Quentin Brabant , Gwenole Lecorve , Lina M. Rojas-Barahona , Claire Gardent

Large language models (LLMs) suffer from the hallucination problem and face significant challenges when applied to knowledge-intensive tasks. A promising approach is to leverage evidence documents as extra supporting knowledge, which can be…

Computation and Language · Computer Science 2024-04-25 Xinxin Zheng , Feihu Che , Jinyang Wu , Shuai Zhang , Shuai Nie , Kang Liu , Jianhua Tao

Existing large language models (LLMs) are known for generating "hallucinated" content, namely a fabricated text of plausibly looking, yet unfounded, facts. To identify when these hallucination scenarios occur, we examine the properties of…

Computation and Language · Computer Science 2023-09-06 Mohamed Akrout

Hallucinations remain a significant challenge in current Generative AI models, undermining trust in AI systems and their reliability. This study investigates how orchestrating multiple specialized Artificial Intelligent Agents can help…

Computation and Language · Computer Science 2025-01-27 Diego Gosmar , Deborah A. Dahl