English
Related papers

Related papers: FactCheckmate: Preemptively Detecting and Mitigati…

200 papers

Large Language Models (LLMs) are adept at text manipulation -- tasks such as machine translation and text summarization. However, these models can also be prone to hallucination, which can be detrimental to the faithfulness of any answers…

Computation and Language · Computer Science 2024-04-04 Priyesh Vakharia , Devavrat Joshi , Meenal Chavan , Dhananjay Sonawane , Bhrigu Garg , Parsa Mazaheri

LLMs have demonstrated unprecedented capabilities in natural language processing, yet their practical deployment remains hindered by persistent factuality and faithfulness hallucinations. While existing methods address these hallucination…

Computation and Language · Computer Science 2025-11-25 Pengbo Wang , Chaozhuo Li , Chenxu Wang , Liwen Zheng , Litian Zhang , Xi Zhang

Large language models (LLMs) often generate hallucinations -- unsupported content that undermines reliability. While most prior works frame hallucination detection as a binary task, many real-world applications require identifying…

Large Language Models (LLMs) sometimes suffer from producing hallucinations, especially LLMs may generate untruthful responses despite knowing the correct knowledge. Activating the truthfulness within LLM is the key to fully unlocking LLM's…

Computation and Language · Computer Science 2024-06-06 Shaolei Zhang , Tian Yu , Yang Feng

Large Language Models (LLMs) have gained widespread adoption in various natural language processing tasks, including question answering and dialogue systems. However, a major drawback of LLMs is the issue of hallucination, where they…

Computation and Language · Computer Science 2024-07-08 Yuyan Chen , Qiang Fu , Yichen Yuan , Zhihao Wen , Ge Fan , Dayiheng Liu , Dongmei Zhang , Zhixu Li , Yanghua Xiao

To address hallucination issues in large language models (LLMs), this paper proposes a method for mitigating prompt-induced hallucinations. Building on a knowledge distillation chain-style model, we introduce a code module to guide…

Computation and Language · Computer Science 2026-01-07 Jinbo Hao , Kai Yang , Qingzhen Su , Yang Chen , Yifan Li , Chao Jiang

Despite tremendous advancements in large language models (LLMs) over recent years, a notably urgent challenge for their practical deployment is the phenomenon of hallucination, where the model fabricates facts and produces non-factual…

Computation and Language · Computer Science 2024-04-09 Derui Zhu , Dingfan Chen , Qing Li , Zongxiong Chen , Lei Ma , Jens Grossklags , Mario Fritz

Recently evolved large reasoning models (LRMs) show powerful performance in solving complex tasks with long chain-of-thought (CoT) reasoning capability. As these LRMs are mostly developed by post-training on formal reasoning tasks, whether…

Computation and Language · Computer Science 2025-05-30 Zijun Yao , Yantao Liu , Yanxu Chen , Jianhui Chen , Junfeng Fang , Lei Hou , Juanzi Li , Tat-Seng Chua

Large language models (LLMs) are notorious for hallucinating, i.e., producing erroneous claims in their output. Such hallucinations can be dangerous, as occasional factual inaccuracies in the generated text might be obscured by the rest of…

Large language models(LLMs) excel at text generation and knowledge question-answering tasks, but they are prone to generating hallucinated content, severely limiting their application in high-risk domains. Current hallucination detection…

Computation and Language · Computer Science 2025-12-25 Shize Liang , Hongzhi Wang

To mitigate hallucinations in large language models (LLMs), we propose a framework that focuses on errors induced by prompts. Our method extends a chain-style knowledge distillation approach by incorporating a programmable module that…

Computation and Language · Computer Science 2026-01-08 Jinbo Hao , Kai Yang , Qingzhen Su , Yifan Li , Chao Jiang

Small language models (SLMs) are increasingly used for financial classification due to their fast inference and local deployability. However, compared with large language models, SLMs are more prone to factual hallucinations in reasoning…

Artificial Intelligence · Computer Science 2026-01-06 Han Yuan , Yilin Wu , Li Zhang , Zheng Ma

Large Language Models (LLMs) have demonstrated exceptional capabilities across various machine learning (ML) tasks. Given the high costs of creating annotated datasets for supervised learning, LLMs offer a valuable alternative by enabling…

Computation and Language · Computer Science 2024-08-23 Meiyun Wang , Masahiro Suzuki , Hiroki Sakaji , Kiyoshi Izumi

LLM deployment in critical domains is currently impeded by persistent hallucinations--generating plausible but factually incorrect assertions. While scaling laws drove significant improvements in general capabilities, theoretical frameworks…

Machine Learning · Computer Science 2026-01-29 Jiayun Wu , Jiashuo Liu , Zhiyuan Zeng , Tianyang Zhan , Tianle Cai , Wenhao Huang

Pretrained Large Language Models (LLMs) are prone to generating fluent yet factually incorrect text-a phenomenon known as hallucinations, undermining their reliability and utility in downstream tasks. We hypothesize that a generated text…

Computation and Language · Computer Science 2026-03-10 Koduvayur Subbalakshmi , Sabbir Hossain Ujjal , Venkata Krishna Teja Mangichetty , Nastaran Jamalipour Soofi

Large Language Models often generate factually incorrect but plausible outputs, known as hallucinations. We identify a more insidious phenomenon, LLM delusion, defined as high belief hallucinations, incorrect outputs with abnormally high…

Computation and Language · Computer Science 2025-03-11 Hongshen Xu , Zixv yang , Zichen Zhu , Kunyao Lan , Zihan Wang , Mengyue Wu , Ziwei Ji , Lu Chen , Pascale Fung , Kai Yu

Large Vision-Language Models (LVLMs) have achieved impressive performance in multimodal tasks, but they still suffer from hallucinations, i.e., generating content that is grammatically accurate but inconsistent with visual inputs. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Chenxi Li , Yichen Guo , Benfang Qian , Jinhao You , Kai Tang , Yaosong Du , Zonghao Zhang , Xiande Huang

Large Language Models (LLMs) are prone to hallucinations, e.g., factually incorrect information, in their responses. These hallucinations present challenges for LLM-based applications that demand high factual accuracy. Existing…

Computation and Language · Computer Science 2025-03-13 Borui Yang , Md Afif Al Mamun , Jie M. Zhang , Gias Uddin

Language models (LMs) often struggle to pay enough attention to the input context, and generate texts that are unfaithful or contain hallucinations. To mitigate this issue, we present context-aware decoding (CAD), which follows a…

Computation and Language · Computer Science 2023-05-25 Weijia Shi , Xiaochuang Han , Mike Lewis , Yulia Tsvetkov , Luke Zettlemoyer , Scott Wen-tau Yih

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

Artificial Intelligence · Computer Science 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan