中文
相关论文

相关论文: ALOHa: A New Measure for Hallucination in Captioni…

200 篇论文

Hallucination poses a persistent challenge for multimodal large language models (MLLMs). However, existing benchmarks for evaluating hallucinations are generally static, which may overlook the potential risk of data contamination. To…

计算与语言 · 计算机科学 2025-07-08 Yahan Tu , Rui Hu , Jitao Sang

The hallucination of large multimodal models (LMMs), providing responses that appear correct but are actually incorrect, limits their reliability and applicability. This paper aims to study the hallucination problem of LMMs in video…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Hongcheng Gao , Jiashu Qu , Jingyi Tang , Baolong Bi , Yue Liu , Hongyu Chen , Li Liang , Li Su , Qingming Huang

Multimodal Large Language Models (MLLMs) demonstrate remarkable fluency in understanding visual scenes, yet they exhibit a critical lack in a fundamental cognitive skill: object counting. This blind spot severely limits their reliability in…

人工智能 · 计算机科学 2025-09-10 Jayant Sravan Tamarapalli , Rynaa Grover , Nilay Pande , Sahiti Yerramilli

Object hallucination is a critical issue in Large Vision-Language Models (LVLMs), where outputs include objects that do not appear in the input image. A natural question arises from this phenomenon: Which component of the LVLM pipeline…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Lingfeng Ren , Weihao Yu , Runpeng Yu , Xinchao Wang

Today's Large Language Models (LLMs) have showcased exemplary capabilities, ranging from simple text generation to advanced image processing. Such models are currently being explored for in-vehicle services such as supporting perception…

计算机视觉与模式识别 · 计算机科学 2024-09-20 Malsha Ashani Mahawatta Dona , Beatriz Cabrero-Daniel , Yinan Yu , Christian Berger

State-of-The-Art (SoTA) image captioning models are often trained on the MicroSoft Common Objects in Context (MS-COCO) dataset, which contains human-annotated captions with an average length of approximately ten tokens. Although effective…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Luigi Celona , Simone Bianco , Marco Donzella , Paolo Napoletano

Accurately detecting and localizing hallucinations is a critical task for ensuring high reliability of image captions. In the era of Multimodal Large Language Models (MLLMs), captions have evolved from brief sentences into comprehensive…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Xinran Wang , Yuxuan Zhang , Xiao Zhang , Haolong Yan , Muxi Diao , Songyu Xu , Zhonghao Yan , Hongbing Li , Kongming Liang , Zhanyu Ma

Attribution is a key concept in large language models (LLMs) as it enables control over information sources and enhances the factuality of LLMs. While existing approaches utilize open book question answering to improve attribution, factual…

计算与语言 · 计算机科学 2023-11-14 Abdullatif Köksal , Renat Aksitov , Chung-Ching Chang

Multimodal Large Language Models (MLLMs) have garnered significant attention recently and demonstrate outstanding capabilities in various tasks such as OCR, VQA, captioning, $\textit{etc}$. However, hallucination remains a persistent issue.…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Zehao Wang , Xinpeng Liu , Yudonglin Zhang , Xiaoqian Wu , Zhou Fang , Yifan Fang , Junfu Pu , Cewu Lu , Yong-Lu Li

Object hallucination in large vision-language models presents a significant challenge to their safe deployment in real-world applications. Recent works have proposed object-level hallucination scores to estimate the likelihood of object…

计算机视觉与模式识别 · 计算机科学 2025-10-16 Seongheon Park , Sharon Li

Recent advancements in multimodal large language models have enhanced document understanding by integrating textual and visual information. However, existing models exhibit incompleteness within their paradigm in real-world scenarios,…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Zhentao He , Can Zhang , Ziheng Wu , Zhenghao Chen , Yufei Zhan , Yifan Li , Zhao Zhang , Xian Wang , Minghui Qiu

Large Language Models (LLMs) have gained significant popularity for their impressive performance across diverse fields. However, LLMs are prone to hallucinate untruthful or nonsensical outputs that fail to meet user expectations in many…

计算与语言 · 计算机科学 2023-11-23 Tianhang Zhang , Lin Qiu , Qipeng Guo , Cheng Deng , Yue Zhang , Zheng Zhang , Chenghu Zhou , Xinbing Wang , Luoyi Fu

Multimodal Large Language Models often suffer from object hallucination. While existing research utilizes attention enhancement and visual retracing, we find these works lack sufficient interpretability regarding attention drift in final…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Chengxu Yang , Jingling Yuan , Chuang Hu , Jiawei Jiang

Large Language Models (LLMs) often produce hallucinations in retrieval-augmented or long-context generation, even when relevant evidence is present. This stems from two issues: head importance is treated as input-agnostic, and raw attention…

计算与语言 · 计算机科学 2025-09-09 Xin Tong , Zhi Lin , Jingya Wang , Bo Jin

Recently, Large Vision-Language Models (LVLMs) show remarkable performance across various domains. However, these models suffer from object hallucination. In this work, we study object hallucination primarily in a discriminative,…

计算机视觉与模式识别 · 计算机科学 2026-01-05 Hongseok Oh , Wonseok Hwang

Large Language Models (LLMs) exhibit remarkable capabilities in natural language understanding and reasoning, but suffer from hallucination: the generation of factually incorrect content. While numerous methods have been developed to reduce…

Medical Large Language Models (MLLMs) have demonstrated potential in healthcare applications, yet their propensity for hallucinations -- generating medically implausible or inaccurate information -- presents substantial risks to patient…

计算与语言 · 计算机科学 2025-04-01 Kaiwen Zuo , Yirui Jiang

The evaluation of machine-generated image captions poses an interesting yet persistent challenge. Effective evaluation measures must consider numerous dimensions of similarity, including semantic relevance, visual structure, object…

计算机视觉与模式识别 · 计算机科学 2023-10-26 David Chan , Suzanne Petryk , Joseph E. Gonzalez , Trevor Darrell , John Canny

The detection of hallucinations in multilingual scientific text generated by Large Language Models (LLMs) presents significant challenges for reliable AI systems. This paper describes our submission to the SHROOM-CAP 2025 shared task on…

计算与语言 · 计算机科学 2025-11-25 Harsh Rathva , Pruthwik Mishra , Shrikant Malviya

Vision-language models (VLMs) can achieve high accuracy while still accepting culturally plausible but visually incorrect interpretations. Existing hallucination benchmarks rarely test this failure mode, particularly outside Western…

计算与语言 · 计算机科学 2026-04-22 Basel Mousi , Fahim Dalvi , Shammur Chowdhury , Firoj Alam , Nadir Durrani