English
Related papers

Related papers: Neural Message-Passing on Attention Graphs for Hal…

200 papers

The detection of hallucinations in multilingual scientific text generated by Large Language Models (LLMs) presents significant challenges for reliable AI systems. This paper describes our submission to the SHROOM-CAP 2025 shared task on…

Computation and Language · Computer Science 2025-11-25 Harsh Rathva , Pruthwik Mishra , Shrikant Malviya

Hallucinations in Large Language Model (LLM) outputs for Question Answering (QA) tasks can critically undermine their real-world reliability. This paper introduces a methodology for robust, one-shot hallucination detection, specifically…

Computation and Language · Computer Science 2026-01-21 Charles Moslonka , Hicham Randrianarivo , Arthur Garnier , Emmanuel Malherbe

Large language models (LLMs) have garnered significant interest in AI community. Despite their impressive generation capabilities, they have been found to produce misleading or fabricated information, a phenomenon known as hallucinations.…

Machine Learning · Computer Science 2025-10-21 Wenyun Li , Zheng Zhang , Dongmei Jiang , Xiangyuan Lan

Hallucination, a phenomenon where large language models (LLMs) produce output that is factually incorrect or unrelated to the input, is a major challenge for LLM applications that require accuracy and dependability. In this paper, we…

Computation and Language · Computer Science 2025-04-01 Song Wang , Xun Wang , Jie Mei , Yujia Xie , Sean Muarray , Zhang Li , Lingfeng Wu , Si-Qing Chen , Wayne Xiong

Graph data contains rich node features and unique edge information, which have been applied across various domains, such as citation networks or recommendation systems. Graph Neural Networks (GNNs) are specialized for handling such data and…

Machine Learning · Computer Science 2024-06-26 Faqian Guan , Tianqing Zhu , Hui Sun , Wanlei Zhou , Philip S. Yu

Hallucination is a major concern in LLM-driven service systems, necessitating explicit knowledge grounding for compliance-guaranteed responses. In this paper, we introduce Retrieval-Augmented Learning-to-Match (RAL2M), a novel framework…

Computation and Language · Computer Science 2026-01-07 Mengze Hong , Di Jiang , Jiangtao Wen , Zhiyang Su , Yawen Li , Yanjie Sun , Guan Wang , Chen Jason Zhang

We introduce Attention Graphs, a new tool for mechanistic interpretability of Graph Neural Networks (GNNs) and Graph Transformers based on the mathematical equivalence between message passing in GNNs and the self-attention mechanism in…

Machine Learning · Computer Science 2025-02-26 Batu El , Deepro Choudhury , Pietro Liò , Chaitanya K. Joshi

LLMs deployed in high-stakes domains face fundamental reliability challenges: hallucinations, inconsistencies, and privacy vulnerabilities introduce unacceptable risks where errors carry legal, financial, or safety consequences. This paper…

Artificial Intelligence · Computer Science 2026-05-27 Paul Sigloch , Christoph Benzmüller

This article surveys Evaluation models to automatically detect hallucinations in Retrieval-Augmented Generation (RAG), and presents a comprehensive benchmark of their performance across six RAG applications. Methods included in our study…

Machine Learning · Computer Science 2025-04-08 Ashish Sardana

To address hallucination issues in large language models (LLMs), this paper proposes a method for mitigating prompt-induced hallucinations. Building on a knowledge distillation chain-style model, we introduce a code module to guide…

Computation and Language · Computer Science 2026-01-07 Jinbo Hao , Kai Yang , Qingzhen Su , Yang Chen , Yifan Li , Chao Jiang

Despite their powerful chat, coding, and reasoning abilities, Large Language Models (LLMs) frequently hallucinate. Conventional wisdom suggests that hallucinations are a consequence of a balance between creativity and factuality, which can…

Large language models (LLMs) can generate fluent natural language texts when given relevant documents as background context. This ability has attracted considerable interest in developing industry applications of LLMs. However, LLMs are…

Computation and Language · Computer Science 2023-10-11 Deren Lei , Yaxi Li , Mengya Hu , Mingyu Wang , Vincent Yun , Emily Ching , Eslam Kamal

The surge in applications of large language models (LLMs) has prompted concerns about the generation of misleading or fabricated information, known as hallucinations. Therefore, detecting hallucinations has become critical to maintaining…

Machine Learning · Computer Science 2024-09-27 Xuefeng Du , Chaowei Xiao , Yixuan Li

Hallucination has been a long-standing and inevitable problem that hinders the application of Large Vision-Language Models (LVLMs) in domains that require high reliability. Various methods focus on improvement depending on data annotations…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Chao Wang , Jianming Yang , Yang Zhou

The emergence of large language models (LLMs) enables the development of intelligent agents capable of engaging in complex and multi-turn dialogues. However, multi-agent collaboration faces critical safety challenges, such as hallucination…

Artificial Intelligence · Computer Science 2025-10-16 Jialong Zhou , Lichao Wang , Xiao Yang

The neural attention model has achieved great success in data-to-text generation tasks. Though usually excelling at producing fluent text, it suffers from the problem of information missing, repetition and "hallucination". Due to the…

Computation and Language · Computer Science 2020-05-05 Xiaoyu Shen , Ernie Chang , Hui Su , Jie Zhou , Dietrich Klakow

Large Vision-Language Models (LVLMs) with discrete image tokenizers unify multimodal representations by encoding visual inputs into a finite set of tokens. Despite their effectiveness, we find that these models still hallucinate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Weixing Wang , Zifeng Ding , Jindong Gu , Rui Cao , Christoph Meinel , Gerard de Melo , Haojin Yang

In Natural Language Generation (NLG), contemporary Large Language Models (LLMs) face several challenges, such as generating fluent yet inaccurate outputs and reliance on fluency-centric metrics. This often leads to neural networks…

Computation and Language · Computer Science 2025-12-19 Federico Borra , Claudio Savelli , Giacomo Rosso , Alkis Koudounas , Flavio Giobergia

Contextual hallucinations -- statements unsupported by given context -- remain a significant challenge in AI. We demonstrate a practical interpretability insight: a generator-agnostic observer model detects hallucinations via a single…

Machine Learning · Computer Science 2025-08-01 Charles O'Neill , Slava Chalnev , Chi Chi Zhao , Max Kirkby , Mudith Jayasekara

Graph learning has attracted significant attention due to its widespread real-world applications. Current mainstream approaches rely on text node features and obtain initial node embeddings through shallow embedding learning using GNNs,…

Artificial Intelligence · Computer Science 2025-02-13 Chuanqi Shi , Yiyi Tao , Hang Zhang , Lun Wang , Shaoshuai Du , Yixian Shen , Yanxin Shen