English
Related papers

Related papers: RadFlag: A Black-Box Hallucination Detection Metho…

200 papers

Retrieval-augmented generation (RAG) has become a main technique for alleviating hallucinations in large language models (LLMs). Despite the integration of RAG, LLMs may still present unsupported or contradictory claims to the retrieved…

Computation and Language · Computer Science 2024-05-20 Cheng Niu , Yuanhao Wu , Juno Zhu , Siliang Xu , Kashun Shum , Randy Zhong , Juntong Song , Tong Zhang

Large Language Models (LLMs) suffer from hallucination problems, which hinder their reliability in sensitive applications. In the black-box setting, several self-consistency-based techniques have been proposed for hallucination detection.…

Computation and Language · Computer Science 2025-02-25 Yihao Xue , Kristjan Greenewald , Youssef Mroueh , Baharan Mirzasoleiman

Detecting hallucinations in large language models (LLMs) is critical for their safety in many applications. Without proper detection, these systems often provide harmful, unreliable answers. In recent years, LLMs have been actively used in…

Computation and Language · Computer Science 2026-02-26 Rodion Oblovatny , Alexandra Kuleshova , Konstantin Polev , Alexey Zaytsev

Despite the great advancement of Language modeling in recent days, Large Language Models (LLMs) such as GPT3 are notorious for generating non-factual responses, so-called "hallucination" problems. Existing methods for detecting and…

Computation and Language · Computer Science 2025-09-29 Seongho Joo , Kyungmin Min , Jahyun Koo , Kyomin Jung

Radiology report generation (RRG) aims to automatically produce diagnostic reports from medical images, with the potential to enhance clinical workflows and reduce radiologists' workload. While recent approaches leveraging multimodal large…

Artificial Intelligence · Computer Science 2025-05-16 Ziruo Yi , Ting Xiao , Mark V. Albert

Retrieval-Augmented Generation (RAG) aims to reduce hallucination by grounding answers in retrieved evidence, yet hallucinated answers remain common even when relevant documents are available. Existing evaluations focus on answer-level or…

Computation and Language · Computer Science 2026-05-21 Passant Elchafei , Monorama Swain , Shahed Masoudian , Markus Schedl

Developing imaging models capable of detecting pathologies from chest X-rays can be cost and time-prohibitive for large datasets as it requires supervision to attain state-of-the-art performance. Instead, labels extracted from radiology…

Computation and Language · Computer Science 2024-08-09 Panagiotis Fytas , Anna Breger , Ian Selby , Simon Baker , Shahab Shahipasand , Anna Korhonen

The rapid advancement of large language models (LLMs) has significantly impacted various domains, including healthcare and biomedicine. However, the phenomenon of hallucination, where LLMs generate outputs that deviate from factual accuracy…

Computation and Language · Computer Science 2024-08-27 Duy Khoa Pham , Bao Quoc Vo

Large Language Models (LLMs) enhanced with retrieval, an approach known as Retrieval-Augmented Generation (RAG), have achieved strong performance in open-domain question answering. However, RAG remains prone to hallucinations: factually…

Hallucinations in Large Language Models (LLMs), defined as the generation of content inconsistent with facts or context, represent a core obstacle to their reliable deployment in critical domains. Current research primarily focuses on…

Computation and Language · Computer Science 2026-03-20 Yanyi Liu , Qingwen Yang , Tiezheng Guo , Feiyu Qu , Jun Liu , Yingyou Wen

Retrieval-augmented Generation (RAG) has demonstrated potential in enhancing medical question-answering systems through the integration of large language models (LLMs) with external medical literature. LLMs can retrieve relevant medical…

Computation and Language · Computer Science 2025-10-29 Mengzhou Sun , Sendong Zhao , Jianyu Chen , Haochun Wang , Bin Qin

The integration of artificial intelligence (AI) with radiology marks a transformative era in medicine. Vision foundation models have been adopted to enhance radiologic imaging analysis. However, the distinct complexities of radiologic 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Zhixiu Lu , Hailong Li , Nehal A. Parikh , Jonathan R. Dillman , Lili He

Large Language Models (LLMs) have gained widespread adoption in various natural language processing tasks, including question answering and dialogue systems. However, a major drawback of LLMs is the issue of hallucination, where they…

Computation and Language · Computer Science 2024-07-08 Yuyan Chen , Qiang Fu , Yichen Yuan , Zhihao Wen , Ge Fan , Dayiheng Liu , Dongmei Zhang , Zhixu Li , Yanghua Xiao

Large language models (LLMs) have transformed various sectors, including education, finance, and medicine, by enhancing content generation and decision-making processes. However, their integration into the medical field is cautious due to…

Information Retrieval · Computer Science 2025-04-15 Yifan Feng , Hao Hu , Xingliang Hou , Shiquan Liu , Shihui Ying , Shaoyi Du , Han Hu , Yue Gao

Detecting hallucinations in large language models (LLMs) remains a fundamental challenge for their trustworthy deployment. Going beyond basic uncertainty-driven hallucination detection frameworks, we propose a simple yet powerful method…

Artificial Intelligence · Computer Science 2025-10-10 Rui Wang , Zeming Wei , Guanzhang Yue , Meng Sun

Retrieval-Augmented Generation (RAG) models are designed to incorporate external knowledge, reducing hallucinations caused by insufficient parametric (internal) knowledge. However, even with accurate and relevant retrieved content, RAG…

Computation and Language · Computer Science 2025-01-22 Zhongxiang Sun , Xiaoxue Zang , Kai Zheng , Yang Song , Jun Xu , Xiao Zhang , Weijie Yu , Yang Song , Han Li

Biomedical question answering (QA) requires accurate interpretation of complex medical knowledge. Large language models (LLMs) have shown promising capabilities in this domain, with retrieval-augmented generation (RAG) systems enhancing…

Computation and Language · Computer Science 2025-10-21 Yingpeng Ning , Yuanyuan Sun , Ling Luo , Yanhua Wang , Yuchen Pan , Hongfei Lin

Evaluating automatically generated radiology reports remains a fundamental challenge due to the lack of clinically grounded, interpretable, and fine-grained metrics. Existing methods either produce coarse overall scores or rely on opaque…

Computation and Language · Computer Science 2025-08-22 Yingshu Li , Yunyi Liu , Lingqiao Liu , Lei Wang , Luping Zhou

Large Language Models (LLMs) frequently generate hallucinated content, posing significant challenges for applications where factuality is crucial. While existing hallucination detection methods typically operate at the sentence level or…

Machine Learning · Computer Science 2026-02-02 Albert Sawczyn , Jakub Binkowski , Denis Janiak , Bogdan Gabrys , Tomasz Kajdanowicz

Hallucination, broadly referring to unfaithful, fabricated, or inconsistent content generated by LLMs, has wide-ranging implications. Therefore, a large body of effort has been devoted to detecting LLM hallucinations, as well as designing…

Artificial Intelligence · Computer Science 2026-05-13 Wenbo Chen , Veena Padmanabhan , Tootiya Giyahchi , Elaine Wong , Leman Akoglu