中文
相关论文

相关论文: Adversarial Orthogonal Disentanglement for LVLM Ha…

200 篇论文

Detecting hallucinations in large language models is a critical open problem with significant implications for safety and reliability. While existing hallucination detection methods achieve strong performance in question-answering tasks,…

人工智能 · 计算机科学 2026-02-10 Litian Liu , Reza Pourreza , Yubing Jian , Yao Qin , Roland Memisevic

Medical Vision-Language Models (MedVLMs) show immense promise in clinical applicability. However, their reliability is hindered by hallucinations, where models often fail to derive answers from visual evidence, instead relying on learned…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Xiao Liang , Chenxi Liu , Zhi Ma , Di Wang , Bin Jing , Quan Wang , Yuanyuan Shi

Large Visual Language Models (LVLMs) integrate visual and linguistic modalities, exhibiting exceptional performance across various multimodal tasks. Nevertheless, LVLMs remain vulnerable to the issue of object hallucinations. Previous…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Chao Wang , Xuancheng Zhou , Weiwei Fu , Yang Zhou

Large Vision-Language Models (LVLMs) exhibit impressive multimodal reasoning capabilities but remain highly susceptible to object hallucination, where models generate responses that are not factually aligned with the visual content. Recent…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Younan Zhu , Linwei Tao , Minjing Dong , Chang Xu

Recent advancements in Large Vision-Language Models (LVLMs) have significantly expanded their utility in tasks like image captioning and visual question answering. However, they still struggle with object hallucination, where models…

计算机视觉与模式识别 · 计算机科学 2025-05-26 Yeongjae Cho , Keonwoo Kim , Taebaek Hwang , Sungzoon Cho

Although Visual-Language Models (VLMs) have shown impressive capabilities in tasks like visual question answering and image captioning, they still struggle with hallucinations. Analysis of attention distribution in these models shows that…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Xiaoyu Liang , Jiayuan Yu , Lianrui Mu , Jiedong Zhuang , Jiaqi Hu , Yuchen Yang , Jiangnan Ye , Lu Lu , Jian Chen , Haoji Hu

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in visual understanding and multimodal reasoning. However, LVLMs frequently exhibit hallucination phenomena, manifesting as the generated textual responses that…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Ziyun Dai , Xiaoqiang Li , Shaohua Zhang , Yuanchen Wu , Jide Li

Despite the significant success of Large Vision-Language models(LVLMs), these models still suffer hallucinations when describing images, generating answers that include non-existent objects. It is reported that these models tend to…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Bin Li , Dehong Gao , Yeyuan Wang , Linbo Jin , Shanqing Yu , Xiaoyan Cai , Libin Yang

Recent advancements in Large Vision-Language Models (LVLMs) have demonstrated significant progress across multiple domains. However, these models still face the inherent challenge of integrating vision and language for collaborative…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Jiabing Yang , Chenhang Cui , Yiyang Zhou , Yixiang Chen , Peng Xia , Ying Wei , Tao Yu , Yan Huang , Liang Wang

While Large Language Models (LLMs) have achieved remarkable capabilities, they unintentionally memorize sensitive data, posing critical privacy and security risks. Machine unlearning is pivotal for mitigating these risks, yet existing…

机器学习 · 计算机科学 2026-02-03 Pengyu Li , Lingling Zhang , Zhitao Gao , Yanrui Wu , Yuxuan Dong , Huan Liu , Bifan Wei , Jun Liu

Large Vision-Language Models (LVLMs) have shown remarkable performance on many visual-language tasks. However, these models still suffer from multimodal hallucination, which means the generation of objects or content that violates the…

计算与语言 · 计算机科学 2024-10-01 Fan Yuan , Chi Qin , Xiaogang Xu , Piji Li

Hallucination has been a long-standing and inevitable problem that hinders the application of Large Vision-Language Models (LVLMs) in domains that require high reliability. Various methods focus on improvement depending on data annotations…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Chao Wang , Jianming Yang , Yang Zhou

Large vision-language models (LVLMs) often hallucinate content that is fluent yet unsupported by the image, limiting their reliability in real-world deployment. We show that a key failure mode arises from route competition: even when visual…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Zhe Cheng , Wenyu Chen , Fode Zhang , Dehuan Shen

Multimodal large language models (MLLMs) frequently hallucinate by over-committing to spurious visual cues. Prior remedies-Visual and Instruction Contrastive Decoding (VCD, ICD)-mitigate this issue, yet the mechanism remains opaque. We…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Yujun Wang , Aniri , Jinhe Bi , Soeren Pirk , Yunpu Ma

Hallucinations in Large Vision-Language Models (LVLMs) significantly undermine their reliability, motivating researchers to explore the causes of hallucination. However, most studies primarily focus on the language aspect rather than the…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Zhangqi Jiang , Junkai Chen , Beier Zhu , Tingjin Luo , Yankun Shen , Xu Yang

Despite the great success of Large Vision-Language Models (LVLMs), they inevitably suffer from hallucination. As we know, both the visual encoder and the Large Language Model (LLM) decoder in LVLMs are Transformer-based, allowing the model…

计算与语言 · 计算机科学 2025-11-07 Xuan Gong , Tianshi Ming , Xinpeng Wang , Zhihua Wei

Multimodal large language models (MLLMs) have achieved remarkable progress in vision-language reasoning, yet they remain vulnerable to hallucination, where generated content deviates from visual evidence. Existing mitigation strategies…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Xingyu Zhu , Kesen Zhao , Liang Yi , Shuo Wang , Zhicai Wang , Beier Zhu , Hanwang Zhang

While Large Vision-Language Models (LVLMs) have rapidly advanced in recent years, the prevalent issue known as the `hallucination' problem has emerged as a significant bottleneck, hindering their real-world deployments. Existing methods…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Fushuo Huo , Wenchao Xu , Zhong Zhang , Haozhao Wang , Zhicheng Chen , Peilin Zhao

While Large Vision-Language Models (LVLMs) have exhibited remarkable capabilities across a wide range of tasks, they suffer from hallucination problems, where models generate plausible yet incorrect answers given the input image-query pair.…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Xiaoye Qu , Mingyang Song , Wei Wei , Jianfeng Dong , Yu Cheng

Instruction-following Vision Large Language Models (VLLMs) have achieved significant progress recently on a variety of tasks. These approaches merge strong pre-trained vision models and large language models (LLMs). Since these components…

机器学习 · 计算机科学 2024-02-20 Yiyang Zhou , Chenhang Cui , Rafael Rafailov , Chelsea Finn , Huaxiu Yao