中文
相关论文

相关论文: Mitigating Action-Relation Hallucinations in LVLMs…

200 篇论文

While Large Vision-Language Models (LVLMs) have exhibited remarkable capabilities across a wide range of tasks, they suffer from hallucination problems, where models generate plausible yet incorrect answers given the input image-query pair.…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Xiaoye Qu , Mingyang Song , Wei Wei , Jianfeng Dong , Yu Cheng

Large Vision-Language Models (LVLMs) have achieved impressive performance in multimodal tasks, but they still suffer from hallucinations, i.e., generating content that is grammatically accurate but inconsistent with visual inputs. In this…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Chenxi Li , Yichen Guo , Benfang Qian , Jinhao You , Kai Tang , Yaosong Du , Zonghao Zhang , Xiande Huang

Spatial relation hallucinations pose a persistent challenge in large vision-language models (LVLMs), leading to generate incorrect predictions about object positions and spatial configurations within an image. To address this issue, we…

计算与语言 · 计算机科学 2025-03-24 Jiarui Wu , Zhuo Liu , Hangfeng He

Large Vision-Language Models (LVLMs) are an extension of Large Language Models (LLMs) that facilitate processing both image and text inputs, expanding AI capabilities. However, LVLMs struggle with object hallucinations due to their reliance…

计算与语言 · 计算机科学 2024-08-12 Avshalom Manevich , Reut Tsarfaty

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

人工智能 · 计算机科学 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

Large Vision-Language Models (LVLMs) have demonstrated impressive multimodal abilities but remain prone to multilingual object hallucination, with a higher likelihood of generating responses inconsistent with the visual input when utilizing…

Despite the outstanding performance in vision-language reasoning, Large Vision-Language Models (LVLMs) might generate hallucinated contents that do not exist in the given image. Most existing LVLM hallucination benchmarks are constrained to…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Junjie Wu , Tsz Ting Chung , Kai Chen , Dit-Yan Yeung

Large Vision-Language Models (LVLMs) frequently suffer from severe hallucination issues. Existing mitigation strategies predominantly rely on isolated, single-step states to enhance visual focus or suppress strong linguistic priors.…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Bei Yan , Yuecong Min , Jie Zhang , Shiguang Shan , Xilin Chen

Although Large Vision-Language Models (LVLMs) have demonstrated remarkable performance on downstream tasks, they frequently produce contents that deviate from visual information, leading to object hallucination. To tackle this, recent works…

计算机视觉与模式识别 · 计算机科学 2026-05-07 Qiming Li , Zekai Ye , Xiaocheng Feng , Weihong Zhong , Libo Qin , Ruihan Chen , Lei Huang , Baohang Li , Kui Jiang , Yaowei Wang , Ting Liu , Bing Qin

Large Vision Language Models (LVLMs) have demonstrated remarkable capabilities in understanding and describing visual content, achieving state-of-the-art performance across various vision-language tasks. However, these models often generate…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Kazi Hasan Ibn Arif , Sajib Acharjee Dip , Khizar Hussain , Lang Zhang , Chris Thomas

Large vision language models (LVLMs) often suffer from object hallucination, producing objects not present in the given images. While current benchmarks for object hallucination primarily concentrate on the presence of a single object class…

计算机视觉与模式识别 · 计算机科学 2024-11-04 Xuweiyi Chen , Ziqiao Ma , Xuejun Zhang , Sihan Xu , Shengyi Qian , Jianing Yang , David F. Fouhey , Joyce Chai

Despite the great success of Large Vision-Language Models (LVLMs), they inevitably suffer from hallucination. As we know, both the visual encoder and the Large Language Model (LLM) decoder in LVLMs are Transformer-based, allowing the model…

计算与语言 · 计算机科学 2025-11-07 Xuan Gong , Tianshi Ming , Xinpeng Wang , Zhihua Wei

The rapidly developing Large Vision Language Models (LVLMs) have shown notable capabilities on a range of multi-modal tasks, but still face the hallucination phenomena where the generated texts do not align with the given contexts,…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Wenyi Xiao , Ziwei Huang , Leilei Gan , Wanggui He , Haoyuan Li , Zhelun Yu , Fangxun Shu , Hao Jiang , Linchao Zhu

Inspired by the superior language abilities of large language models (LLM), large vision-language models (LVLM) have been recently explored by integrating powerful LLMs for improving the performance on complex multimodal tasks. Despite the…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Yifan Li , Yifan Du , Kun Zhou , Jinpeng Wang , Wayne Xin Zhao , Ji-Rong Wen

In this work, we tackle action-scene hallucination in Video Large Language Models (Video-LLMs), where models incorrectly predict actions based on the scene context or scenes based on observed actions. We observe that existing Video-LLMs…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Kyungho Bae , Jinhyung Kim , Sihaeng Lee , Soonyoung Lee , Gunhee Lee , Jinwoo Choi

Multimodal Large Language Models (MLLMs) achieve strong performance on tasks like image captioning and visual question answering, but remain prone to hallucinations, where generated text conflicts with the visual input. Prior work links…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Tiancheng Yang , Lin Zhang , Jiaye Lin , Guimin Hu , Di Wang , Lijie Hu

Due to the unidirectional masking mechanism, Decoder-Only models propagate information from left to right. LVLMs (Large Vision-Language Models) follow the same architecture, with visual information gradually integrated into semantic…

计算机视觉与模式识别 · 计算机科学 2025-09-24 Jianfei Zhao , Feng Zhang , Xin Sun , Chong Feng

Hallucinations in large vision-language models (LVLMs) pose significant challenges for real-world applications, as LVLMs may generate responses that appear plausible yet remain inconsistent with the associated visual content. This issue…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Xin Dong , Shichao Dong , Jin Wang , Jing Huang , Li Zhou , Zenghui Sun , Lihua Jing , Jingsong Lan , Xiaoyong Zhu , Bo Zheng

Multimodal Large Language Models (MLLMs) excel in numerous vision-language tasks yet suffer from hallucinations, producing content inconsistent with input visuals, that undermine reliability in precision-sensitive domains. This issue stems…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Nan Sun , Zhenyu Zhang , Xixun Lin , Kun Wang , Yanmin Shang , Naibin Gu , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang , Yanan Cao

Large Vision Language Models (LVLMs) demonstrate strong capabilities in visual understanding and description, yet often suffer from hallucinations, attributing incorrect or misleading features to images. We observe that LVLMs…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Sangmin Woo , Donguk Kim , Jaehyuk Jang , Yubin Choi , Changick Kim