English
Related papers

Related papers: Halu-J: Critique-Based Hallucination Judge

200 papers

Large Language Models (LLMs) frequently generate hallucinated content, posing significant challenges for applications where factuality is crucial. While existing hallucination detection methods typically operate at the sentence level or…

Machine Learning · Computer Science 2026-02-02 Albert Sawczyn , Jakub Binkowski , Denis Janiak , Bogdan Gabrys , Tomasz Kajdanowicz

Detecting content that contradicts or is unsupported by a given source text is a critical challenge for the safe deployment of generative language models. We introduce HALT-RAG, a post-hoc verification system designed to identify…

Computation and Language · Computer Science 2025-09-10 Saumya Goswami , Siddharth Kurra

Large Language Models are prompting us to view more NLP tasks from a generative perspective. At the same time, they offer a new way of accessing information, mainly through the RAG framework. While there have been notable improvements for…

Computation and Language · Computer Science 2025-03-21 Alex-Razvan Ispas , Charles-Elie Simon , Fabien Caspani , Vincent Guigue

Detecting hallucinations in large language models (LLMs) is critical for enhancing their reliability and trustworthiness. Most research focuses on hallucinations as deviations from information seen during training. However, the opaque…

Computation and Language · Computer Science 2025-03-26 Fabian Ridder , Malte Schilling

Retrieval-Augmented Generation (RAG) grounds Large Language Model (LLM) output by leveraging external knowledge sources to reduce factual hallucinations. However, prior work lacks a comprehensive evaluation of different language families,…

Hallucination, the generation of factually incorrect content, is a growing challenge in Large Language Models (LLMs). Existing detection and mitigation methods are often isolated and insufficient for domain-specific needs, lacking a…

Computation and Language · Computer Science 2025-01-22 Mengfei Liang , Archish Arun , Zekun Wu , Cristian Munoz , Jonathan Lutch , Emre Kazim , Adriano Koshiyama , Philip Treleaven

The emergence of Large Language Models (LLMs) has revolutionized how users access information, shifting from traditional search engines to direct question-and-answer interactions with LLMs. However, the widespread adoption of LLMs has…

Computation and Language · Computer Science 2024-07-23 Weihang Su , Yichen Tang , Qingyao Ai , Changyue Wang , Zhijing Wu , Yiqun Liu

Discharge summaries require extracting critical information from lengthy electronic health records (EHRs), a process that is labor-intensive when performed manually. Large language models (LLMs) can improve generation efficiency; however,…

Computation and Language · Computer Science 2026-05-06 Severin Ye , Xiao Kong , Xiaopeng He , Guangsu Yan , Dongsuk Oh

The recent advancements in Large Language Models (LLMs) have garnered widespread acclaim for their remarkable emerging capabilities. However, the issue of hallucination has parallelly emerged as a by-product, posing significant concerns.…

Investigating hallucination issues in large language models (LLMs) within cross-lingual and cross-modal scenarios can greatly advance the large-scale deployment in real-world applications. Nevertheless, the current studies are limited to a…

Computation and Language · Computer Science 2025-05-27 Yongheng Zhang , Xu Liu , Ruoxi Zhou , Qiguang Chen , Hao Fei , Wenpeng Lu , Libo Qin

Large language models (LLMs) offer transformative potential for clinical decision support in spine surgery but pose significant risks through hallucinations, which are factually inconsistent or contextually misaligned outputs that may…

Machine Learning · Computer Science 2025-11-21 Dong Chen , Yanzhe Wei , Zonglin He , Guan-Ming Kuang , Canhua Ye , Meiru An , Huili Peng , Yong Hu , Huiren Tao , Kenneth MC Cheung

Retrieval-Augmented Generation (RAG) models are designed to incorporate external knowledge, reducing hallucinations caused by insufficient parametric (internal) knowledge. However, even with accurate and relevant retrieved content, RAG…

Computation and Language · Computer Science 2025-01-22 Zhongxiang Sun , Xiaoxue Zang , Kai Zheng , Yang Song , Jun Xu , Xiao Zhang , Weijie Yu , Yang Song , Han Li

Hallucination remains a persistent challenge in Large Language Models (LLMs), particularly in context-grounded settings such as RAG and agentic AI systems. This study focuses on contextual hallucination detection in summarization tasks. We…

Computation and Language · Computer Science 2026-05-12 I. F. Atasoy , B. Mutlu , E. A. Sezer , A. Wahdan

Assessing whether an article supports an assertion is essential for hallucination detection and claim verification. While large language models (LLMs) have the potential to automate this task, achieving strong performance requires frontier…

Large language model hallucination represents a critical challenge where outputs deviate from factual accuracy due to distributional biases in training data. While recent investigations establish that specific hidden layers exhibit…

Computation and Language · Computer Science 2025-09-29 Wenkai Wang , Vincent Lee , Yizhen Zheng

Multi-modal large language models (MLLMs) have been shown to efficiently integrate natural language with visual information to handle multi-modal tasks. However, MLLMs still face a fundamental limitation of hallucinations, where they tend…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Chaoya Jiang , Haiyang Xu , Mengfan Dong , Jiaxing Chen , Wei Ye , Ming Yan , Qinghao Ye , Ji Zhang , Fei Huang , Shikun Zhang

While Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to generate contextually grounded responses, contextual faithfulness remains challenging as LLMs may not consistently trust provided context, leading to…

Computation and Language · Computer Science 2026-02-10 Yongchao Long , Xian Wu , Yingying Zhang , Xianbin Wen , Yuxi Zhou , Shenda Hong

To mitigate the impact of hallucination nature of LLMs, many studies propose detecting hallucinated generation through uncertainty estimation. However, these approaches predominantly operate at the sentence or paragraph level, failing to…

Computation and Language · Computer Science 2025-09-05 Min-Hsuan Yeh , Max Kamachee , Seongheon Park , Yixuan Li

Large language models (LLMs) have transformed various sectors, including education, finance, and medicine, by enhancing content generation and decision-making processes. However, their integration into the medical field is cautious due to…

Information Retrieval · Computer Science 2025-04-15 Yifan Feng , Hao Hu , Xingliang Hou , Shiquan Liu , Shihui Ying , Shaoyi Du , Han Hu , Yue Gao

Large language models (LLMs) have transformed the landscape of language processing, yet struggle with significant challenges in terms of security, privacy, and the generation of seemingly coherent but factually inaccurate outputs, commonly…

Software Engineering · Computer Science 2024-09-04 Ningke Li , Yuekang Li , Yi Liu , Ling Shi , Kailong Wang , Haoyu Wang