中文
相关论文

相关论文: ChainMPQ: Interleaved Text-Image Reasoning Chains …

200 篇论文

Recent advancements in multimodal large language models (MLLMs) have significantly improved performance in visual question answering. However, they often suffer from hallucinations. In this work, hallucinations are categorized into two main…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Feilong Tang , Chengzhi Liu , Zhongxing Xu , Ming Hu , Zelin Peng , Zhiwei Yang , Jionglong Su , Minquan Lin , Yifan Peng , Xuelian Cheng , Imran Razzak , Zongyuan Ge

Large-scale vision-language pre-trained (VLP) models are prone to hallucinate non-existent visual objects when generating text based on visual information. In this paper, we systematically study the object hallucination problem from three…

计算与语言 · 计算机科学 2023-02-13 Wenliang Dai , Zihan Liu , Ziwei Ji , Dan Su , Pascale Fung

Large Vision-Language Models (LVLMs) have achieved impressive performance, yet research has pointed out a serious issue with object hallucinations within these models. However, there is no clear conclusion as to which part of the model…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Yufang Liu , Tao Ji , Changzhi Sun , Yuanbin Wu , Aimin Zhou

Instruction tuned Large Vision Language Models (LVLMs) have significantly advanced in generalizing across a diverse set of multi-modal tasks, especially for Visual Question Answering (VQA). However, generating detailed responses that are…

计算机视觉与模式识别 · 计算机科学 2024-02-13 Anisha Gunjal , Jihan Yin , Erhan Bas

Large Vision-Language Models (LVLMs) have achieved remarkable performance on diverse vision-language tasks. However, LVLMs still suffer from hallucinations, generating text that contradicts the visual input. Existing research has primarily…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Zhenxin Qin , Qiang Li , Qingzhuo Wang , Ruiyang Qin , Zhihua Wei , Wen Shen

Despite growing interest in hallucination in Multimodal Large Language Models, existing studies primarily focus on single-image settings, leaving hallucination in multi-image scenarios largely unexplored. To address this gap, we conduct the…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Jiale Li , Mingrui Wu , Zixiang Jin , Hao Chen , Jiayi Ji , Xiaoshuai Sun , Liujuan Cao , Rongrong Ji

Hallucination is a well-known phenomenon in text generated by large language models (LLMs). The existence of hallucinatory responses is found in almost all application scenarios e.g., summarization, question-answering (QA) etc. For…

Recent advancements in large vision-language models (LVLMs) have demonstrated impressive capability in visual information understanding with human language. Despite these advances, LVLMs still face challenges with multimodal hallucination,…

计算机视觉与模式识别 · 计算机科学 2024-05-16 Zongbo Han , Zechen Bai , Haiyang Mei , Qianli Xu , Changqing Zhang , Mike Zheng Shou

Multimodal large language models (MLLMs) have advanced the integration of visual and linguistic modalities, establishing themselves as the dominant paradigm for visual-language tasks. Current approaches like chain of thought (CoT) reasoning…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Haojie Zheng , Tianyang Xu , Hanchi Sun , Shu Pu , Ruoxi Chen , Lichao Sun

Multimodal Large Language Models (MLLMs) strive to achieve a profound, human-like understanding of and interaction with the physical world, but often exhibit a shallow and incoherent integration when acquiring information (Perception) and…

While Multimodal Large Language Models (MLLMs) have achieved remarkable progress in open-ended visual question answering, they remain vulnerable to hallucinations. These are outputs that contradict or misrepresent input semantics, posing a…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Jianjiang Yang , Yanshu li , Ziyan Huang

Hallucinations in large vision-language models (LVLMs) are a significant challenge, i.e., generating objects that are not presented in the visual input, which impairs their reliability. Recent studies often attribute hallucinations to a…

计算与语言 · 计算机科学 2025-08-13 Yuying Shang , Xinyi Zeng , Yutao Zhu , Xiao Yang , Zhengwei Fang , Jingyuan Zhang , Jiawei Chen , Zinan Liu , Yu Tian

The hallucination problem in multimodal large language models (MLLMs) remains a common issue. Although image tokens occupy a majority of the input sequence of MLLMs, there is limited research to explore the relationship between image tokens…

计算机视觉与模式识别 · 计算机科学 2024-11-18 Xiaofeng Zhang , Yihao Quan , Chaochen Gu , Chen Shen , Xiaosong Yuan , Shaotian Yan , Hao Cheng , Kaijie Wu , Jieping Ye

This survey presents a comprehensive analysis of the phenomenon of hallucination in multimodal large language models (MLLMs), also known as Large Vision-Language Models (LVLMs), which have demonstrated significant advancements and…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Zechen Bai , Pichao Wang , Tianjun Xiao , Tong He , Zongbo Han , Zheng Zhang , Mike Zheng Shou

Hallucinations in large vision-language models (LVLMs) pose significant challenges for real-world applications, as LVLMs may generate responses that appear plausible yet remain inconsistent with the associated visual content. This issue…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Xin Dong , Shichao Dong , Jin Wang , Jing Huang , Li Zhou , Zenghui Sun , Lihua Jing , Jingsong Lan , Xiaoyong Zhu , Bo Zheng

Large language models (LLMs) have shown promise for generative and knowledge-intensive tasks including question-answering (QA) tasks. However, the practical deployment still faces challenges, notably the issue of "hallucination", where…

计算与语言 · 计算机科学 2023-10-11 Ziwei Ji , Tiezheng Yu , Yan Xu , Nayeon Lee , Etsuko Ishii , Pascale Fung

Despite their impressive capabilities, multimodal large language models (MLLMs) are prone to hallucinations, i.e., the generated content that is nonsensical or unfaithful to input sources. Unlike in LLMs, hallucinations in MLLMs often stem…

计算机视觉与模式识别 · 计算机科学 2025-05-09 Xin Zou , Yizhou Wang , Yibo Yan , Yuanhuiyi Lyu , Kening Zheng , Sirui Huang , Junkai Chen , Peijie Jiang , Jia Liu , Chang Tang , Xuming Hu

Multimodal Large Language Models (MLLMs) have shown impressive perception and reasoning capabilities, yet they often suffer from hallucinations -- generating outputs that are linguistically coherent but inconsistent with the context of the…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Bingkui Tong , Jiaer Xia , Kaiyang Zhou

Large Language Models (LLMs) and Large Reasoning Models (LRMs) offer transformative potential for high-stakes domains like finance and law, but their tendency to hallucinate, generating factually incorrect or unsupported content, poses a…

人工智能 · 计算机科学 2026-01-16 Ahmad Pesaranghader , Erin Li

Multimodal Large Language Models (MLLMs) frequently suffer from hallucination issues, generating information about objects that are not present in input images during vision-language tasks. These hallucinations particularly undermine model…

计算机视觉与模式识别 · 计算机科学 2025-06-16 Dokyoon Yoon , Youngsook Song , Woomyong Park