English
Related papers

Related papers: Hallucination Detection in Large Language Models w…

200 papers

Large Language Models (LLMs) suffer from hallucination problems, which hinder their reliability in sensitive applications. In the black-box setting, several self-consistency-based techniques have been proposed for hallucination detection.…

Computation and Language · Computer Science 2025-02-25 Yihao Xue , Kristjan Greenewald , Youssef Mroueh , Baharan Mirzasoleiman

Large language models (LLMs) have transformed various sectors, including education, finance, and medicine, by enhancing content generation and decision-making processes. However, their integration into the medical field is cautious due to…

Information Retrieval · Computer Science 2025-04-15 Yifan Feng , Hao Hu , Xingliang Hou , Shiquan Liu , Shihui Ying , Shaoyi Du , Han Hu , Yue Gao

Large Language Models (LLMs) are known to hallucinate and generate non-factual outputs which can undermine user trust. Traditional methods to directly mitigate hallucinations, such as representation editing and contrastive decoding, often…

Machine Learning · Computer Science 2025-03-11 Prasenjit Dey , Srujana Merugu , Sivaramakrishnan Kaveri

The rapidly developing Large Vision Language Models (LVLMs) have shown notable capabilities on a range of multi-modal tasks, but still face the hallucination phenomena where the generated texts do not align with the given contexts,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Wenyi Xiao , Ziwei Huang , Leilei Gan , Wanggui He , Haoyuan Li , Zhelun Yu , Fangxun Shu , Hao Jiang , Linchao Zhu

The rapid development of Multi-modality Large Language Models (MLLMs) has significantly influenced various aspects of industry and daily life, showcasing impressive capabilities in visual perception and understanding. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yinan Sun , Zicheng Zhang , Haoning Wu , Xiaohong Liu , Weisi Lin , Guangtao Zhai , Xiongkuo Min

Instruction tuned Large Vision Language Models (LVLMs) have significantly advanced in generalizing across a diverse set of multi-modal tasks, especially for Visual Question Answering (VQA). However, generating detailed responses that are…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Anisha Gunjal , Jihan Yin , Erhan Bas

Large Vision Language Models (LVLMs) are becoming increasingly important in the medical domain, yet Medical LVLMs (Med-LVLMs) frequently generate hallucinations due to limited expertise and the complexity of medical applications. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Aofei Chang , Le Huang , Parminder Bhatia , Taha Kass-Hout , Fenglong Ma , Cao Xiao

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

Artificial Intelligence · Computer Science 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

Recent advancements in multimodal large language models have enhanced document understanding by integrating textual and visual information. However, existing models exhibit incompleteness within their paradigm in real-world scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Zhentao He , Can Zhang , Ziheng Wu , Zhenghao Chen , Yufei Zhan , Yifan Li , Zhao Zhang , Xian Wang , Minghui Qiu

Multimodal Large Language Models (MLLMs) have recently demonstrated impressive capabilities in multimodal understanding, reasoning, and interaction. However, existing MLLMs prevalently suffer from serious hallucination problems, generating…

Computation and Language · Computer Science 2024-03-11 Tianyu Yu , Yuan Yao , Haoye Zhang , Taiwen He , Yifeng Han , Ganqu Cui , Jinyi Hu , Zhiyuan Liu , Hai-Tao Zheng , Maosong Sun , Tat-Seng Chua

Large language models (LLMs) are susceptible to hallucinations -- factually incorrect outputs -- leading to a large body of work on detecting and mitigating such cases. We argue that it is important to distinguish between two types of…

Computation and Language · Computer Science 2025-02-19 Adi Simhi , Jonathan Herzig , Idan Szpektor , Yonatan Belinkov

Despite the great advancement of Language modeling in recent days, Large Language Models (LLMs) such as GPT3 are notorious for generating non-factual responses, so-called "hallucination" problems. Existing methods for detecting and…

Computation and Language · Computer Science 2025-09-29 Seongho Joo , Kyungmin Min , Jahyun Koo , Kyomin Jung

Despite remarkable advancements in mitigating hallucinations in large language models (LLMs) by retrieval augmentation, it remains challenging to measure the reliability of LLMs using static question-answering (QA) data. Specifically, given…

Computation and Language · Computer Science 2024-06-04 Xiaodong Yu , Hao Cheng , Xiaodong Liu , Dan Roth , Jianfeng Gao

LLM deployment in critical domains is currently impeded by persistent hallucinations--generating plausible but factually incorrect assertions. While scaling laws drove significant improvements in general capabilities, theoretical frameworks…

Machine Learning · Computer Science 2026-01-29 Jiayun Wu , Jiashuo Liu , Zhiyuan Zeng , Tianyang Zhan , Tianle Cai , Wenhao Huang

Hallucination in large language models (LLMs) has been widely studied in recent years, with progress in both detection and mitigation aimed at improving truthfulness. Yet, a critical side effect remains largely overlooked: enhancing…

Computation and Language · Computer Science 2026-02-02 Omar Mahmoud , Ali Khalil , Buddhika Laknath Semage , Thommen George Karimpanal , Santu Rana

Large language models (LLMs) have introduced substantial challenges to software quality assurance due to their generative, probabilistic, and open-ended nature, which intensifies the oracle problem and limits the applicability of…

Software Engineering · Computer Science 2026-05-15 Zheng Zheng , Zenghui Zhou , Yinwang Xu , Daixu Ren , Tsong Yueh Chen

Large Language Models (LLMs) often hallucinate, producing unfaithful or factually incorrect outputs by misrepresenting the provided context or incorrectly recalling internal knowledge. Recent studies have identified specific attention heads…

Computation and Language · Computer Science 2024-10-25 Aryo Pradipta Gema , Chen Jin , Ahmed Abdulaal , Tom Diethe , Philip Teare , Beatrice Alex , Pasquale Minervini , Amrutha Saseendran

Detecting hallucinations in large language model (LLM) outputs is pivotal, yet traditional fine-tuning for this classification task is impeded by the expensive and quickly outdated annotation process, especially across numerous vertical…

Artificial Intelligence · Computer Science 2024-07-09 Dongxu Zhang , Varun Gangal , Barrett Martin Lattimer , Yi Yang

Hallucination, posed as a pervasive challenge of multi-modal large language models (MLLMs), has significantly impeded their real-world usage that demands precise judgment. Existing methods mitigate this issue with either training with…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Qidong Huang , Xiaoyi Dong , Pan Zhang , Bin Wang , Conghui He , Jiaqi Wang , Dahua Lin , Weiming Zhang , Nenghai Yu

Hallucination, the generation of factually incorrect content, is a growing challenge in Large Language Models (LLMs). Existing detection and mitigation methods are often isolated and insufficient for domain-specific needs, lacking a…

Computation and Language · Computer Science 2025-01-22 Mengfei Liang , Archish Arun , Zekun Wu , Cristian Munoz , Jonathan Lutch , Emre Kazim , Adriano Koshiyama , Philip Treleaven