中文
相关论文

相关论文: Pre-Training Multimodal Hallucination Detectors wi…

200 篇论文

The emergence of large language models (LLMs) has significantly advanced the development of natural language processing (NLP), especially in text generation tasks like question answering. However, model hallucinations remain a major…

计算与语言 · 计算机科学 2025-12-01 Zhongxin Liu , Zhiwei Wang , Jun Niu , Ying Li , Hongyu Sun , Meng Xu , He Wang , Gaofei Wu , Yuqing Zhang

Large Vision-Language Models (LVLMs) are an extension of Large Language Models (LLMs) that facilitate processing both image and text inputs, expanding AI capabilities. However, LVLMs struggle with object hallucinations due to their reliance…

计算与语言 · 计算机科学 2024-08-12 Avshalom Manevich , Reut Tsarfaty

Language models, particularly generative models, are susceptible to hallucinations, generating outputs that contradict factual knowledge or the source text. This study explores methods for detecting hallucinations in three SemEval-2024 Task…

Existing hallucination detection methods for large language models (LLMs) rely on external verification at inference time, requiring gold answers, retrieval systems, or auxiliary judge models. We ask whether this external supervision can…

Multilingual hallucination detection stands as an underexplored challenge, which the Mu-SHROOM shared task seeks to address. In this work, we propose an efficient, training-free LLM prompting strategy that enhances detection by translating…

Multimodal Large Language Models (MLLMs) have made significant progress in bridging the gap between visual and language modalities. However, hallucinations in MLLMs, where the generated text does not align with image content, continue to be…

人工智能 · 计算机科学 2024-08-05 Kohou Wang , Xiang Liu , Zhaoxiang Liu , Kai Wang , Shiguo Lian

Large Language Models (LLMs) and Large Reasoning Models (LRMs) offer transformative potential for high-stakes domains like finance and law, but their tendency to hallucinate, generating factually incorrect or unsupported content, poses a…

人工智能 · 计算机科学 2026-01-16 Ahmad Pesaranghader , Erin Li

Large vision-language models (LVLMs) often hallucinate content that is fluent yet unsupported by the image, limiting their reliability in real-world deployment. We show that a key failure mode arises from route competition: even when visual…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Zhe Cheng , Wenyu Chen , Fode Zhang , Dehuan Shen

Large Language Models (LLMs) have gained significant popularity for their impressive performance across diverse fields. However, LLMs are prone to hallucinate untruthful or nonsensical outputs that fail to meet user expectations in many…

计算与语言 · 计算机科学 2023-11-23 Tianhang Zhang , Lin Qiu , Qipeng Guo , Cheng Deng , Yue Zhang , Zheng Zhang , Chenghu Zhou , Xinbing Wang , Luoyi Fu

Despite improvements in performances on different natural language generation tasks, deep neural models are prone to hallucinating facts that are incorrect or nonexistent. Different hypotheses are proposed and examined separately for…

计算与语言 · 计算机科学 2021-03-30 Yijun Xiao , William Yang Wang

There has been significant research on developing pretrained transformer architectures for multimodal-to-text generation tasks. Albeit performance improvements, such models are frequently overparameterized, hence suffer from hallucination…

计算与语言 · 计算机科学 2023-09-08 Arvind Krishna Sridhar , Yinyi Guo , Erik Visser , Rehana Mahfuz

Large Language Models (LLMs) have shown their impressive capabilities, while also raising concerns about the data contamination problems due to privacy issues and leakage of benchmark datasets in the pre-training phase. Therefore, it is…

计算与语言 · 计算机科学 2024-06-04 Zhenhua Liu , Tong Zhu , Chuanyuan Tan , Haonan Lu , Bing Liu , Wenliang Chen

Large Language Models (LLMs) have transformed the Natural Language Processing (NLP) landscape with their remarkable ability to understand and generate human-like text. However, these models are prone to ``hallucinations'' -- outputs that do…

Multimodal Large Language Models (MLLMs) show impressive vision-language benchmark performance, yet growing concerns about data contamination (test set exposure during training) risk masking true generalization. This concern extends to…

人工智能 · 计算机科学 2025-06-10 Ming Liu , Wensheng Zhang

Hallucination, a phenomenon where multimodal large language models~(MLLMs) tend to generate textual responses that are plausible but unaligned with the image, has become one major hurdle in various MLLM-related applications. Several…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Han Qiu , Jiaxing Huang , Peng Gao , Qin Qi , Xiaoqin Zhang , Ling Shao , Shijian Lu

Large language models (LLMs) are increasingly used as alternatives to traditional search engines given their capacity to generate text that resembles human language. However, this shift is concerning, as LLMs often generate hallucinations,…

计算与语言 · 计算机科学 2024-10-25 Cléa Chataigner , Afaf Taïk , Golnoosh Farnadi

We present MedHal, a novel large-scale dataset specifically designed to evaluate if models can detect hallucinations in medical texts. Current hallucination detection methods face significant limitations when applied to specialized domains…

计算与语言 · 计算机科学 2025-10-08 Gaya Mehenni , Fabrice Lamarche , Odette Rios-Ibacache , John Kildea , Amal Zouaq

Large Language Models (LLMs) have become increasingly important in natural language processing, enabling advanced data analytics through natural language queries. However, these models often generate "hallucinations"-inaccurate or…

计算与语言 · 计算机科学 2024-10-29 Mikhail Rumiantsau , Aliaksei Vertsel , Ilya Hrytsuk , Isaiah Ballah

The opacity in developing large language models (LLMs) is raising growing concerns about the potential contamination of public benchmarks in the pre-training data. Existing contamination detection methods are typically based on the text…

计算与语言 · 计算机科学 2024-10-31 Feng Yao , Yufan Zhuang , Zihao Sun , Sunan Xu , Animesh Kumar , Jingbo Shang

This work introduces a novel methodology for the automatic detection of hallucinations generated during large language model (LLM) inference. The proposed approach is based on a systematic taxonomy and controlled reproduction of diverse…

计算与语言 · 计算机科学 2025-10-08 Maksym Zavhorodnii , Dmytro Dehtiarov , Anna Konovalenko