中文
相关论文

相关论文: Alleviating Hallucination in Large Vision-Language…

200 篇论文

Although Large Vision-Language Models (LVLMs) have made substantial progress, hallucination, where generated text is not grounded in the visual input, remains a challenge. As LVLMs become stronger, previously reported hallucination…

计算机视觉与模式识别 · 计算机科学 2026-03-03 April Fu

Despite great success across various multimodal tasks, Large Vision-Language Models (LVLMs) often encounter object hallucinations with generated textual responses being inconsistent with the actual objects in images. We examine different…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Wenbin An , Feng Tian , Sicong Leng , Jiahao Nie , Haonan Lin , QianYing Wang , Ping Chen , Xiaoqin Zhang , Shijian Lu

Large Language Models (LLMs) have gained widespread adoption in various natural language processing tasks, including question answering and dialogue systems. However, a major drawback of LLMs is the issue of hallucination, where they…

计算与语言 · 计算机科学 2024-07-08 Yuyan Chen , Qiang Fu , Yichen Yuan , Zhihao Wen , Ge Fan , Dayiheng Liu , Dongmei Zhang , Zhixu Li , Yanghua Xiao

Multimodal large language models (MLLMs) have achieved remarkable success across diverse vision-language tasks, yet they remain highly susceptible to hallucinations, producing content that is fluent but inconsistent with visual evidence.…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Youxu Shi , Suorong Yang , Dong Liu

Large vision-language models (LVLMs) have made substantial progress in integrating large language models (LLMs) with visual inputs, enabling advanced multimodal reasoning. Despite their success, a persistent challenge is hallucination-where…

计算与语言 · 计算机科学 2025-06-11 Jinghan He , Kuan Zhu , Haiyun Guo , Junfeng Fang , Zhenglin Hua , Yuheng Jia , Ming Tang , Tat-Seng Chua , Jinqiao Wang

Retrieval-Augmented Generation (RAG) aims to mitigate hallucinations in large language models (LLMs) by grounding responses in retrieved documents. Yet, RAG-based LLMs still hallucinate even when provided with correct and sufficient…

计算与语言 · 计算机科学 2026-02-04 Samuel Yeh , Sharon Li , Tanwi Mallick

Hallucinations in large vision-language models (LVLMs) pose significant challenges for real-world applications, as LVLMs may generate responses that appear plausible yet remain inconsistent with the associated visual content. This issue…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Xin Dong , Shichao Dong , Jin Wang , Jing Huang , Li Zhou , Zenghui Sun , Lihua Jing , Jingsong Lan , Xiaoyong Zhu , Bo Zheng

Object hallucination in Large Vision-Language Models (LVLMs) severely compromises their reliability in real-world applications, posing a critical barrier to their deployment in high-stakes scenarios such as autonomous driving and medical…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Han Sun , Qin Li , Peixin Wang , Min Zhang

Large Vision-Language Models (LVLMs) have shown remarkable performance on a wide range of vision-language tasks. Despite this progress, they are still prone to hallucination, generating responses that are inconsistent with visual content.…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Yutong Xie , Zhenglin Hua , Ran Wang , Wing W. Y. Ng , Xizhao Wang , Yuheng Jia

Current vision-language models (VLMs) still exhibit inferior performance on knowledge-intensive tasks, primarily due to the challenge of accurately encoding all the associations between visual objects and scenes to their corresponding…

计算与语言 · 计算机科学 2024-10-16 Jingyuan Qi , Zhiyang Xu , Rulin Shao , Yang Chen , Jin Di , Yu Cheng , Qifan Wang , Lifu Huang

Large Language Models (LLMs) are powerful linguistic engines but remain susceptible to hallucinations: plausible-sounding outputs that are factually incorrect or unsupported. In this work, we present a mathematically grounded framework to…

计算与语言 · 计算机科学 2025-11-20 Moses Kiprono

Existing Large Vision-Language Models (LVLMs) primarily align image features of vision encoder with Large Language Models (LLMs) to leverage their superior text generation capabilities. However, the scale disparity between vision encoder…

计算机视觉与模式识别 · 计算机科学 2024-08-01 Shi Liu , Kecheng Zheng , Wei Chen

Hallucinations in vision-language models (VLMs) hinder reliability and real-world applicability, usually stemming from distribution shifts between pretraining data and test samples. Existing solutions, such as retraining or fine-tuning on…

多媒体 · 计算机科学 2025-06-10 Fei Zhao , Chengcui Zhang , Runlin Zhang , Tianyang Wang , Xi Li

Although Large Language Models (LLMs) have demonstrated extraordinary capabilities in many domains, they still have a tendency to hallucinate and generate fictitious responses to user requests. This problem can be alleviated by augmenting…

信息检索 · 计算机科学 2023-06-09 Jiongnan Liu , Jiajie Jin , Zihan Wang , Jiehan Cheng , Zhicheng Dou , Ji-Rong Wen

Large Language Models (LLMs) achieve impressive performance across many tasks but remain prone to hallucination, especially in long-form generation where redundant retrieved contexts and lengthy reasoning chains amplify factual errors.…

计算与语言 · 计算机科学 2026-05-29 Yujie Feng , Jian Li , Zhihan Zhou , Pengfei Xu , Yujia Zhang , Xiaoyu Li , Xiaohui Zhou , Alan Zhao , Xi Chen , Xiao-Ming Wu

Large language models (LLMs) have demonstrated remarkable capabilities across various domains, although their susceptibility to hallucination poses significant challenges for their deployment in critical areas such as healthcare. To address…

计算与语言 · 计算机科学 2024-05-13 Mengjia Niu , Hao Li , Jie Shi , Hamed Haddadi , Fan Mo

Large pre-trained language models have demonstrated their proficiency in storing factual knowledge within their parameters and achieving remarkable results when fine-tuned for downstream natural language processing tasks. Nonetheless, their…

计算与语言 · 计算机科学 2023-09-29 Konstantinos Andriopoulos , Johan Pouwelse

Retrieval-Augmented Generation (RAG) models are designed to incorporate external knowledge, reducing hallucinations caused by insufficient parametric (internal) knowledge. However, even with accurate and relevant retrieved content, RAG…

计算与语言 · 计算机科学 2025-01-22 Zhongxiang Sun , Xiaoxue Zang , Kai Zheng , Yang Song , Jun Xu , Xiao Zhang , Weijie Yu , Yang Song , Han Li

Large Vision-Language Models (LVLMs) recently achieve significant breakthroughs in understanding complex visual-textual contexts. However, hallucination issues still limit their real-world applicability. Although previous mitigation methods…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Zhaoxu Li , Chenqi Kong , Yi Yu , Qiangqiang Wu , Xinghao Jiang , Ngai-Man Cheung , Bihan Wen , Alex Kot , Xudong Jiang

Large Vision-Language Models (LVLMs) have recently achieved remarkable success. However, LVLMs are still plagued by the hallucination problem, which limits the practicality in many scenarios. Hallucination refers to the information of…