English
Related papers

Related papers: ReXTrust: A Model for Fine-Grained Hallucination D…

200 papers

Hallucinations in large language models (LLMs) pose significant challenges in tasks requiring complex multi-step reasoning, such as mathematical problem-solving. Existing approaches primarily detect the presence of hallucinations but lack a…

Computation and Language · Computer Science 2025-09-19 Ruosen Li , Ziming Luo , Xinya Du

Text-to-image diffusion models have impactful applications in art, design, and entertainment, yet these technologies also pose significant risks by enabling the creation and dissemination of misinformation. Although recent advancements have…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Anisha Pal , Julia Kruk , Mansi Phute , Manognya Bhattaram , Diyi Yang , Duen Horng Chau , Judy Hoffman

Despite tremendous advancements in large language models (LLMs) over recent years, a notably urgent challenge for their practical deployment is the phenomenon of hallucination, where the model fabricates facts and produces non-factual…

Computation and Language · Computer Science 2024-04-09 Derui Zhu , Dingfan Chen , Qing Li , Zongxiong Chen , Lei Ma , Jens Grossklags , Mario Fritz

The increasing use of vision-language models (VLMs) in healthcare applications presents great challenges related to hallucinations, in which the models may generate seemingly plausible results that are in fact incorrect. Such hallucinations…

Artificial Intelligence · Computer Science 2025-03-03 Qiao Yan , Yuchen Yuan , Xiaowei Hu , Yihan Wang , Jiaqi Xu , Jinpeng Li , Chi-Wing Fu , Pheng-Ann Heng

Deep learning models achieve strong performance in chest radiograph (CXR) interpretation, yet fairness and reliability concerns persist. Models often show uneven accuracy across patient subgroups, leading to hidden failures not reflected in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Han-Jay Shu , Wei-Ning Chiu , Shun-Ting Chang , Meng-Ping Huang , Takeshi Tohyama , Ahram Han , Po-Chih Kuo

In real-world applications, Large Language Models (LLMs) often hallucinate, even in Retrieval-Augmented Generation (RAG) settings, which poses a significant challenge to their deployment. In this paper, we introduce AggTruth, a method for…

Artificial Intelligence · Computer Science 2025-06-24 Piotr Matys , Jan Eliasz , Konrad Kiełczyński , Mikołaj Langner , Teddy Ferdinan , Jan Kocoń , Przemysław Kazienko

Medical imaging has revolutionized disease diagnosis, yet the potential is hampered by limited access to diverse and privacy-conscious datasets. Open-source medical datasets, while valuable, suffer from data quality and clinical information…

Image and Video Processing · Electrical Eng. & Systems 2023-12-13 Gauri Bhardwaj , Yuvaraj Govindarajulu , Sundaraparipurnan Narayanan , Pavan Kulkarni , Manojkumar Parmar

Recent advancements in artificial intelligence have significantly improved the automatic generation of radiology reports. However, existing evaluation methods fail to reveal the models' understanding of radiological images and their…

Artificial Intelligence · Computer Science 2024-08-27 Xiaoman Zhang , Julián N. Acosta , Hong-Yu Zhou , Pranav Rajpurkar

This paper presents a comparative analysis of hallucination detection systems for AI, focusing on automatic summarization and question answering tasks for Large Language Models (LLMs). We evaluate different hallucination detection systems…

Computation and Language · Computer Science 2024-11-11 Alexander Thomas , Seth Rosen , Vishnu Vettrivel

LLMs often produce fluent but incorrect answers, yet detecting such hallucinations typically requires multiple sampling passes or post-hoc verification, adding significant latency and cost. We hypothesize that intermediate layers encode…

Computation and Language · Computer Science 2026-01-30 Rohan Bhatnagar , Youran Sun , Chi Andrew Zhang , Yixin Wen , Haizhao Yang

Response consistency-based, reference-free hallucination detection (RFHD) methods do not depend on internal model states, such as generation probabilities or gradients, which Grey-box models typically rely on but are inaccessible in…

Computation and Language · Computer Science 2025-05-28 Ashok Urlana , Gopichand Kanumolu , Charaka Vinayak Kumar , Bala Mallikarjunarao Garlapati , Rahul Mishra

Test-time compute has empowered multimodal large language models to generate extended reasoning chains, yielding strong performance on tasks such as multimodal math reasoning. However, this improved reasoning ability often comes with…

Computation and Language · Computer Science 2025-06-23 Chengzhi Liu , Zhongxing Xu , Qingyue Wei , Juncheng Wu , James Zou , Xin Eric Wang , Yuyin Zhou , Sheng Liu

Though Large Vision-Language Models (LVLMs) have achieved remarkable performance across various tasks, they are still prone to hallucinations-generating outputs that are textually plausible but visually ungrounded. While prior approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Le Yu , Kaishen Wang , Jianlong Xiong , Yue Cao , Lei Zhang , Zhang Yi Tao He

Vision-language models (VLMs) are increasingly used for medical image interpretation, yet they frequently hallucinate, generating clinically plausible but factually incorrect findings that pose direct patient safety risks. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Haoyu Wang , Zitong Li

Large language models (LLMs) show promise in healthcare, but hallucinations remain a major barrier to clinical use. We present CHECK, a continuous-learning framework that integrates structured clinical databases with a classifier grounded…

Large Language Models are prompting us to view more NLP tasks from a generative perspective. At the same time, they offer a new way of accessing information, mainly through the RAG framework. While there have been notable improvements for…

Computation and Language · Computer Science 2025-03-21 Alex-Razvan Ispas , Charles-Elie Simon , Fabien Caspani , Vincent Guigue

The growing realism of AI-generated images produced by recent GAN and diffusion models has intensified concerns over the reliability of visual media. Yet, despite notable progress in deepfake detection, current forensic systems degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Anshul Bagaria

Large Language Models (LLMs) are increasingly deployed in enterprise applications, yet their reliability remains limited by hallucinations, i.e., confident but factually incorrect information. Existing detection approaches, such as…

Computation and Language · Computer Science 2025-11-10 Channdeth Sok , David Luz , Yacine Haddam

Hallucinations in large language models (LLMs) pose significant safety concerns that impede their broader deployment. Recent research in hallucination detection has demonstrated that LLMs' internal representations contain truthfulness…

Machine Learning · Computer Science 2025-11-11 Mengjia Niu , Hamed Haddadi , Guansong Pang

Large language models (LLMs) have gained broad applications across various domains but still struggle with hallucinations. Currently, hallucinations occur frequently in the generation of factual content and pose a great challenge to…

Computation and Language · Computer Science 2025-12-01 Zouying Cao , Yifei Yang , XiaoJing Li , Hai Zhao