English
Related papers

Related papers: Mitigating Multimodal LLMs Hallucinations via Rele…

200 papers

Despite impressive progress in capabilities of large vision-language models (LVLMs), these systems remain vulnerable to hallucinations, i.e., outputs that are not grounded in the visual input. Prior work has attributed hallucinations in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Pegah Khayatan , Jayneel Parekh , Arnaud Dapogny , Mustafa Shukor , Alasdair Newson , Matthieu Cord

Multimodal Large Language Models (MLLMs) have made significant progress in bridging the gap between visual and language modalities. However, hallucinations in MLLMs, where the generated text does not align with image content, continue to be…

Artificial Intelligence · Computer Science 2024-08-05 Kohou Wang , Xiang Liu , Zhaoxiang Liu , Kai Wang , Shiguo Lian

Despite the impressive capabilities of multimodal large language models (MLLMs) in vision-language tasks, they are prone to hallucinations in real-world scenarios. This paper investigates the hallucination phenomenon in MLLMs from the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Zongmeng Zhang , Wengang Zhou , Jie Zhao , Houqiang Li

Vision-Language Models (VLMs) have become essential backbones of modern multimodal intelligence, yet their outputs remain prone to hallucination-plausible text misaligned with visual inputs. Existing alignment approaches often rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Kejia Chen , Jiawen Zhang , Jiacong Hu , Kewei Gao , Jian Lou , Zunlei Feng , Mingli Song

Recent advancements in multimodal large language models (MLLMs) have significantly improved performance in visual question answering. However, they often suffer from hallucinations. In this work, hallucinations are categorized into two main…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Feilong Tang , Chengzhi Liu , Zhongxing Xu , Ming Hu , Zelin Peng , Zhiwei Yang , Jionglong Su , Minquan Lin , Yifan Peng , Xuelian Cheng , Imran Razzak , Zongyuan Ge

Reducing hallucination of Large Language Models (LLMs) is imperative for use in the sciences, where reliability and reproducibility are crucial. However, LLMs inherently lack long-term memory, making it a nontrivial, ad hoc, and inevitably…

Computation and Language · Computer Science 2024-10-11 Yuan Chiang , Elvis Hsieh , Chia-Hong Chou , Janosh Riebesell

Recent advancements in large vision-language models (LVLMs) have demonstrated impressive capability in visual information understanding with human language. Despite these advances, LVLMs still face challenges with multimodal hallucination,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Zongbo Han , Zechen Bai , Haiyang Mei , Qianli Xu , Changqing Zhang , Mike Zheng Shou

Large Language Models (LLMs) are widely used in critical fields such as healthcare, education, and finance due to their remarkable proficiency in various language-related tasks. However, LLMs are prone to generating factually incorrect…

Computation and Language · Computer Science 2023-11-27 Muneeswaran I , Shreya Saxena , Siva Prasad , M V Sai Prakash , Advaith Shankar , Varun V , Vishal Vaddina , Saisubramaniam Gopalakrishnan

The rapid development of Multi-modality Large Language Models (MLLMs) has significantly influenced various aspects of industry and daily life, showcasing impressive capabilities in visual perception and understanding. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yinan Sun , Zicheng Zhang , Haoning Wu , Xiaohong Liu , Weisi Lin , Guangtao Zhai , Xiongkuo Min

In recent years, large-scale language models (LLMs) have gained attention for their impressive text generation capabilities. However, these models often face the challenge of "hallucination," which undermines their reliability. In this…

Computation and Language · Computer Science 2023-10-10 Yuchen Yang , Houqiang Li , Yanfeng Wang , Yu Wang

Large Vision and Language Models have enabled significant advances in fully supervised and zero-shot visual tasks. These large architectures serve as the baseline to what is currently known as Instruction Tuning Large Vision and Language…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Andrés Villa , Juan Carlos León Alcázar , Alvaro Soto , Bernard Ghanem

Large Vision-Language Models (LVLMs) are susceptible to hallucinations, where generated responses seem semantically plausible yet exhibit little or no relevance to the input image. Previous studies reveal that this issue primarily stems…

Computation and Language · Computer Science 2025-10-24 Hao Fang , Changle Zhou , Jiawei Kong , Kuofeng Gao , Bin Chen , Shu-Tao Xia

Despite achieving rapid developments and with widespread applications, Large Vision-Language Models (LVLMs) confront a serious challenge of being prone to generating hallucinations. An over-reliance on linguistic priors has been identified…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Lanyun Zhu , Deyi Ji , Tianrun Chen , Peng Xu , Jieping Ye , Jun Liu

While Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to generate contextually grounded responses, contextual faithfulness remains challenging as LLMs may not consistently trust provided context, leading to…

Computation and Language · Computer Science 2026-02-10 Yongchao Long , Xian Wu , Yingying Zhang , Xianbin Wen , Yuxi Zhou , Shenda Hong

Hallucinations present a significant challenge for large language models (LLMs). The utilization of parametric knowledge in generating factual content is constrained by the limited knowledge of LLMs, potentially resulting in internal…

Computation and Language · Computer Science 2025-10-07 Hanxing Ding , Liang Pang , Zihao Wei , Huawei Shen , Xueqi Cheng

In tasks like summarization and open-book question answering (QA), Large Language Models (LLMs) often encounter "contextual hallucination", where they produce irrelevant or incorrect responses despite having access to accurate source…

Computation and Language · Computer Science 2025-07-08 Yu Wang , Kamalika Das , Xiang Gao , Wendi Cui , Peng Li , Jiaxin Zhang

Large language models (LLMs) have enabled the creation of multi-modal LLMs that exhibit strong comprehension of visual data such as images and videos. However, these models usually rely on extensive visual tokens from visual encoders,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Yiwu Zhong , Zhuoming Liu , Yin Li , Liwei Wang

Despite their powerful chat, coding, and reasoning abilities, Large Language Models (LLMs) frequently hallucinate. Conventional wisdom suggests that hallucinations are a consequence of a balance between creativity and factuality, which can…

Recent advancements in massively multilingual machine translation systems have significantly enhanced translation accuracy; however, even the best performing systems still generate hallucinations, severely impacting user trust. Detecting…

Computation and Language · Computer Science 2024-10-22 Kenza Benkirane , Laura Gongas , Shahar Pelles , Naomi Fuchs , Joshua Darmon , Pontus Stenetorp , David Ifeoluwa Adelani , Eduardo Sánchez

Despite the rapid success of Large Vision-Language Models (LVLMs), a persistent challenge is their tendency to generate hallucinated content, undermining reliability in real-world use. Existing training-free methods address hallucinations…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Neeraj Anand , Samyak Jha , Udbhav Bamba , Rahul Rahaman