English
Related papers

Related papers: Reducing LLM Hallucinations using Epistemic Neural…

200 papers

The rapid advancement of large language models (LLMs) has significantly impacted various domains, including healthcare and biomedicine. However, the phenomenon of hallucination, where LLMs generate outputs that deviate from factual accuracy…

Computation and Language · Computer Science 2024-08-27 Duy Khoa Pham , Bao Quoc Vo

Hallucinations in large language models (LLMs), plausible but factually inaccurate text, are often viewed as undesirable. However, recent work suggests that such outputs may hold creative potential. In this paper, we investigate whether…

Computation and Language · Computer Science 2025-08-25 Shuzhou Yuan , Zhan Qu , Ashish Yashwanth Kangen , Michael Färber

Since the introduction of ChatGPT, large language models (LLMs) have demonstrated significant utility in various tasks, such as answering questions through retrieval-augmented generation. Context can be retrieved using a vectorized…

Computation and Language · Computer Science 2025-07-01 Ming Cheung

Despite the outstanding performance of large language models (LLMs) across various NLP tasks, hallucinations in LLMs--where LLMs generate inaccurate responses--remains as a critical problem as it can be directly connected to a crisis of…

Computation and Language · Computer Science 2025-07-22 Minsuh Joo , Hyunsoo Cho

The emergence of Large Language Models (LLMs) has revolutionized how users access information, shifting from traditional search engines to direct question-and-answer interactions with LLMs. However, the widespread adoption of LLMs has…

Computation and Language · Computer Science 2024-07-23 Weihang Su , Yichen Tang , Qingyao Ai , Changyue Wang , Zhijing Wu , Yiqun Liu

While the problem of hallucinations in neural machine translation has long been recognized, so far the progress on its alleviation is very little. Indeed, recently it turned out that without artificially encouraging models to hallucinate,…

Computation and Language · Computer Science 2022-12-21 David Dale , Elena Voita , Loïc Barrault , Marta R. Costa-jussà

Large language models (LLMs) have demonstrated exceptional proficiency in language understanding. However, when LLMs align their outputs with deceptive and/or misleading prompts, the generated responses could deviate from the de facto…

Computation and Language · Computer Science 2025-09-03 Zixuan Shangguan , Yanjie Dong , Lanjun Wang , Xiaoyi Fan , Victor C. M. Leung , Xiping Hu

Training LLMs on data containing unfamiliar knowledge during the instruction tuning stage can encourage hallucinations. To address this challenge, we introduce NOVA, a novel framework designed to identify high-quality data that aligns well…

Computation and Language · Computer Science 2025-05-27 Shuzheng Si , Haozhe Zhao , Gang Chen , Cheng Gao , Yuzhuo Bai , Zhitong Wang , Kaikai An , Kangyang Luo , Chen Qian , Fanchao Qi , Baobao Chang , Maosong Sun

Hallucination detection is critical for ensuring the reliability of large language models (LLMs) in context-based generation. Prior work has explored intrinsic signals available during generation, among which attention offers a direct view…

Computation and Language · Computer Science 2026-02-23 Siya Qi , Yudong Chen , Runcong Zhao , Qinglin Zhu , Zhanghao Hu , Wei Liu , Yulan He , Zheng Yuan , Lin Gui

Large Language Models (LLMs) demonstrate impressive capabilities in natural language processing but suffer from inaccuracies and logical inconsistencies known as hallucinations. This compromises their reliability, especially in domains…

Artificial Intelligence · Computer Science 2025-12-08 Ruslan Idelfonso Magana Vsevolodovna , Marco Monti

Large language models are extensively applied across a wide range of tasks, such as customer support, content creation, educational tutoring, and providing financial guidance. However, a well-known drawback is their predisposition to…

Computation and Language · Computer Science 2024-07-08 Noa Nonkes , Sergei Agaronian , Evangelos Kanoulas , Roxana Petcu

LLMs are often claimed to be capable of Natural Language Inference (NLI), which is widely regarded as a cornerstone of more complex forms of reasoning. However, recent works show that LLMs still suffer from hallucinations in NLI due to…

Computation and Language · Computer Science 2025-03-17 Liang Cheng , Tianyi Li , Zhaowei Wang , Tianyang Liu , Mark Steedman

Accurate prediction helps to achieve supply-demand balance in energy systems, supporting decision-making and scheduling. Traditional models, lacking AI-assisted automation, rely on experts, incur high costs, and struggle with sparse data…

Machine Learning · Computer Science 2024-12-25 Zihang Qiu , Chaojie Li , Zhongyang Wang , Renyou Xie , Borui Zhang , Huadong Mo , Guo Chen , Zhaoyang Dong

Hallucination is a common problem for Large Vision-Language Models (LVLMs) with long generations which is difficult to eradicate. The generation with hallucinations is partially inconsistent with the image content. To mitigate…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Yue Chang , Liqiang Jing , Xiaopeng Zhang , Yue Zhang

Large language models (LLMs) demonstrate remarkable capabilities but face challenges from hallucinations, which typically arise from insufficient knowledge or context. While instructing LLMs to acknowledge knowledge limitations by…

Computation and Language · Computer Science 2025-08-08 Jiaqi Li , Yixuan Tang , Yi Yang

Large language models (LLMs) exhibit hallucinations in long-form question-answering tasks across various domains and wide applications. Current hallucination detection and mitigation datasets are limited in domains and sizes, which struggle…

Computation and Language · Computer Science 2024-12-20 Yuzhe Gu , Ziwei Ji , Wenwei Zhang , Chengqi Lyu , Dahua Lin , Kai Chen

Large language models (LLMs) are prone to hallucination stemming from misaligned self-awareness, particularly when processing queries exceeding their knowledge boundaries. While existing mitigation strategies employ uncertainty estimation…

Computation and Language · Computer Science 2025-10-10 Hang Zheng , Hongshen Xu , Yuncong Liu , Lu Chen , Pascale Fung , Kai Yu

Large Vision Language Models (LVLMs) have shown remarkable capabilities in multimodal tasks like visual question answering or image captioning. However, inconsistencies between the visual information and the generated text, a phenomenon…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Laura Fieback , Jakob Spiegelberg , Hanno Gottschalk

Recent advancements in audio-aware large language models (ALLMs) enable them to process and understand audio inputs. However, these models often hallucinate non-existent sound events, reducing their reliability in real-world applications.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-02 Chun-Yi Kuan , Hung-yi Lee

Hallucinations in Large Language Models (LLMs) -- generations that are plausible but factually unfaithful -- remain a critical barrier to high-stakes deployment. Current detection methods typically rely on computationally expensive external…

Artificial Intelligence · Computer Science 2026-01-23 Manish Bhatt