中文
相关论文

相关论文: HIME: Mitigating Object Hallucinations in LVLMs vi…

200 篇论文

Large language models (LLMs) have demonstrated remarkable performance on various natural language processing tasks. However, they are prone to generating fluent yet untruthful responses, known as "hallucinations". Hallucinations can lead to…

计算与语言 · 计算机科学 2024-06-18 Minda Hu , Bowei He , Yufei Wang , Liangyou Li , Chen Ma , Irwin King

Hallucinations in large language models (LLMs) refer to the phenomenon of LLMs producing responses that are coherent yet factually inaccurate. This issue undermines the effectiveness of LLMs in practical applications, necessitating research…

计算与语言 · 计算机科学 2024-06-11 Weihang Su , Changyue Wang , Qingyao Ai , Yiran HU , Zhijing Wu , Yujia Zhou , Yiqun Liu

Large Vision-Language Models (LVLMs) have advanced considerably, intertwining visual recognition and language understanding to generate content that is not only coherent but also contextually attuned. Despite their success, LVLMs still…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Sicong Leng , Hang Zhang , Guanzheng Chen , Xin Li , Shijian Lu , Chunyan Miao , Lidong Bing

Multimodal large language models (MLLMs) have achieved remarkable success across diverse vision-language tasks, yet they remain highly susceptible to hallucinations, producing content that is fluent but inconsistent with visual evidence.…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Youxu Shi , Suorong Yang , Dong Liu

Multimodal Large Language Models (MLLMs) have made significant strides by combining visual recognition and language understanding to generate content that is both coherent and contextually accurate. However, MLLMs continue to struggle with…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Haoran Zhou , Zihan Zhang , Hao Chen

While large vision-language models (LVLMs) have demonstrated impressive capabilities in interpreting multi-modal contexts, they invariably suffer from object hallucinations (OH). We introduce HALC, a novel decoding algorithm designed to…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Zhaorun Chen , Zhuokai Zhao , Hongyin Luo , Huaxiu Yao , Bo Li , Jiawei Zhou

Multimodal large language models (MLLMs) have achieved remarkable progress in video understanding.However, hallucination, where the model generates plausible yet incorrect outputs, persists as a significant and under-addressed challenge in…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Jianfeng Cai , Wengang Zhou , Zongmeng Zhang , Jiale Hong , Nianji Zhan , Houqiang Li

Hallucinations in Large Language Models (LLMs) pose a significant challenge, generating misleading or unverifiable content that undermines trust and reliability. Existing evaluation methods, such as KnowHalu, employ multi-stage verification…

计算与语言 · 计算机科学 2026-04-10 Chenggong Zhang , Haopeng Wang , Hexi Meng

Large Vision-Language Models (LVLMs) are susceptible to hallucinations, where generated responses seem semantically plausible yet exhibit little or no relevance to the input image. Previous studies reveal that this issue primarily stems…

计算与语言 · 计算机科学 2025-10-24 Hao Fang , Changle Zhou , Jiawei Kong , Kuofeng Gao , Bin Chen , Shu-Tao Xia

Mitigating object hallucination in large vision-language models (LVLMs) is critical to their safe deployment. Existing methods either are restricted to specific decoding methods, or demand sophisticated modifications to visual inputs, or…

计算机视觉与模式识别 · 计算机科学 2025-07-11 Xixi Liu , Ailin Deng , Christopher Zach

Large vision-language models (LVLMs) have shown promising performance on a variety of vision-language tasks. However, they remain susceptible to hallucinations, generating outputs misaligned with visual content or instructions. While…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Jinrui Zhang , Teng Wang , Haigang Zhang , Ping Lu , Feng Zheng

Large Vision-Language Models (LVLMs) are increasingly adept at generating contextually detailed and coherent responses from visual inputs. However, their application in multimodal decision-making and open-ended generation is hindered by a…

计算机视觉与模式识别 · 计算机科学 2024-06-06 Xintong Wang , Jingheng Pan , Liang Ding , Chris Biemann

Hallucination, the generation of factually incorrect content, is a growing challenge in Large Language Models (LLMs). Existing detection and mitigation methods are often isolated and insufficient for domain-specific needs, lacking a…

Large vision-language models have become widely adopted to advance in various domains. However, developing a trustworthy system with minimal interpretable characteristics of large-scale models presents a significant challenge. One of the…

计算机视觉与模式识别 · 计算机科学 2025-06-02 Huu-Thien Tran , Thanh-Dat Truong , Khoa Luu

Large-scale vision-language pre-trained (VLP) models are prone to hallucinate non-existent visual objects when generating text based on visual information. In this paper, we systematically study the object hallucination problem from three…

计算与语言 · 计算机科学 2023-02-13 Wenliang Dai , Zihan Liu , Ziwei Ji , Dan Su , Pascale Fung

Large Vision-Language Models (LVLMs) have demonstrated impressive multimodal reasoning capabilities, but they remain susceptible to hallucination, particularly object hallucination where non-existent objects or incorrect attributes are…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Cong-Duy Nguyen , Xiaobao Wu , Duc Anh Vu , Shuai Zhao , Thong Nguyen , Anh Tuan Luu

Although Large Vision-Language Models (LVLMs) have demonstrated powerful capabilities in interpreting visual information, they frequently produce content that deviates from visual information, leading to object hallucination. To tackle…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Qiming Li , Zekai Ye , Xiaocheng Feng , Weihong Zhong , Libo Qin , Ruihan Chen , Baohang Li , Kui Jiang , Yaowei Wang , Ting Liu , Bing Qin

Large Vision-Language Models (LVLMs) have recently achieved impressive results in multimodal tasks such as image captioning and visual question answering. However, they remain prone to object hallucination -- generating descriptions of…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Jinlin Li , Yuran Wang , Yifei Yuan , Xiao Zhou , Yingying Zhang , Xixian Yong , Yefeng Zheng , Xian Wu

Hallucinations in large language models (LLMs) pose significant safety concerns that impede their broader deployment. Recent research in hallucination detection has demonstrated that LLMs' internal representations contain truthfulness…

机器学习 · 计算机科学 2025-11-11 Mengjia Niu , Hamed Haddadi , Guansong Pang

Although Large Vision-Language Models (LVLMs) have demonstrated remarkable performance on downstream tasks, they frequently produce contents that deviate from visual information, leading to object hallucination. To tackle this, recent works…

计算机视觉与模式识别 · 计算机科学 2026-05-07 Qiming Li , Zekai Ye , Xiaocheng Feng , Weihong Zhong , Libo Qin , Ruihan Chen , Lei Huang , Baohang Li , Kui Jiang , Yaowei Wang , Ting Liu , Bing Qin