English
Related papers

Related papers: Mitigating Dialogue Hallucination for Large Vision…

200 papers

Multi-modal large language models (MLLMs) have been shown to efficiently integrate natural language with visual information to handle multi-modal tasks. However, MLLMs still face a fundamental limitation of hallucinations, where they tend…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Chaoya Jiang , Haiyang Xu , Mengfan Dong , Jiaxing Chen , Wei Ye , Ming Yan , Qinghao Ye , Ji Zhang , Fei Huang , Shikun Zhang

Large Vision-Language Models (VLMs) have achieved remarkable success across diverse multimodal tasks but remain vulnerable to hallucinations rooted in inherent language bias. Despite recent progress, existing hallucination mitigation…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Yilin Yang , Zhenghui Guo , Yuke Wang , Omprakash Gnawali , Sheng Di , Chengming Zhang

Large Vision-Language Models (LVLMs) have advanced multimodal understanding, yet their reliability is limited by hallucination, where generated content conflicts with visual facts. Existing mitigation methods either rely on costly external…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Ruoxi Cheng , Haoxuan Ma , Zhengfei Hai , Yiyan Huang , Ranjie Duan , Tianle Zhang , Xu Yang , Ziyi Ye , Xingjun Ma

Large language models (large LMs) are susceptible to producing text that contains hallucinated content. An important instance of this problem is self-contradiction, where the LM generates two contradictory sentences within the same context.…

Computation and Language · Computer Science 2024-03-19 Niels Mündler , Jingxuan He , Slobodan Jenko , Martin Vechev

The rapid advancement of large language models (LLMs) has significantly impacted various domains, including healthcare and biomedicine. However, the phenomenon of hallucination, where LLMs generate outputs that deviate from factual accuracy…

Computation and Language · Computer Science 2024-08-27 Duy Khoa Pham , Bao Quoc Vo

Large Vision Language Models (LVLMs) have achieved significant progress in integrating visual and textual inputs for multimodal reasoning. However, a recurring challenge is ensuring these models utilize visual information as effectively as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Estelle Aflalo , Gabriela Ben Melech Stan , Tiep Le , Man Luo , Shachar Rosenman , Sayak Paul , Shao-Yen Tseng , Vasudev Lal

Large Vision-Language Models (LVLMs) have made remarkable developments along with the recent surge of large language models. Despite their advancements, LVLMs have a tendency to generate plausible yet inaccurate or inconsistent information…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Dexter Neo , Tsuhan Chen

This paper presents null-shot prompting. Null-shot prompting exploits hallucination in large language models (LLMs) by instructing LLMs to utilize information from the "Examples" section that never exists within the provided context to…

Computation and Language · Computer Science 2024-11-19 Pittawat Taveekitworachai , Febri Abdullah , Ruck Thawonmas

Large vision-language models (LVLMs) suffer from hallucination, resulting in misalignment between the output textual response and the input visual content. Recent research indicates that the over-reliance on the Large Language Model (LLM)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Yuxi Xie , Guanzhen Li , Xiao Xu , Min-Yen Kan

Multimodal Large Language Models (MLLMs) have garnered significant attention recently and demonstrate outstanding capabilities in various tasks such as OCR, VQA, captioning, $\textit{etc}$. However, hallucination remains a persistent issue.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Zehao Wang , Xinpeng Liu , Yudonglin Zhang , Xiaoqian Wu , Zhou Fang , Yifan Fang , Junfu Pu , Cewu Lu , Yong-Lu Li

Large vision-language models (LVMs) extend large language models (LLMs) with visual perception capabilities, enabling them to process and interpret visual information. A major challenge compromising their reliability is object hallucination…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Kejia Zhang , Keda Tao , Jiasheng Tang , Huan Wang

Large Language Models (LLMs) have significantly advanced the field of Natural Language Processing (NLP), achieving remarkable performance across diverse tasks and enabling widespread real-world applications. However, LLMs are prone to…

Computation and Language · Computer Science 2024-06-12 Wen Luo , Tianshu Shen , Wei Li , Guangyue Peng , Richeng Xuan , Houfeng Wang , Xi Yang

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance in complex multimodal tasks. However, these models still suffer from hallucinations, particularly when required to implicitly recognize or infer diverse visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ashish Seth , Dinesh Manocha , Chirag Agarwal

Large language models (LLMs) have achieved a degree of success in generating coherent and contextually relevant text, yet they remain prone to a significant challenge known as hallucination: producing information that is not substantiated…

Computation and Language · Computer Science 2024-10-28 Ray Li , Tanishka Bagade , Kevin Martinez , Flora Yasmin , Grant Ayala , Michael Lam , Kevin Zhu

Large language models (LLMs) have demonstrated remarkable performance on various natural language processing tasks. However, they are prone to generating fluent yet untruthful responses, known as "hallucinations". Hallucinations can lead to…

Computation and Language · Computer Science 2024-06-18 Minda Hu , Bowei He , Yufei Wang , Liangyou Li , Chen Ma , Irwin King

Large language models and vision transformers have demonstrated impressive zero-shot capabilities, enabling significant transferability in downstream tasks. The fusion of these models has resulted in multi-modal architectures with enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Andrés Villa , Juan León Alcázar , Motasem Alfarra , Vladimir Araujo , Alvaro Soto , Bernard Ghanem

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in visual understanding and multimodal reasoning. However, LVLMs frequently exhibit hallucination phenomena, manifesting as the generated textual responses that…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Ziyun Dai , Xiaoqiang Li , Shaohua Zhang , Yuanchen Wu , Jide Li

Large Vision-Language Models (LVLMs) have achieved significant success in recent years, and they have been extended to the medical domain. Although demonstrating satisfactory performance on medical Visual Question Answering (VQA) tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Danfeng Guo , Demetri Terzopoulos

Large Language Models (LLMs) are powerful linguistic engines but remain susceptible to hallucinations: plausible-sounding outputs that are factually incorrect or unsupported. In this work, we present a mathematically grounded framework to…

Computation and Language · Computer Science 2025-11-20 Moses Kiprono

Large Language Models (LLMs) are widely used in industry but remain prone to hallucinations, limiting their reliability in critical applications. This work addresses hallucination reduction in consumer grievance chatbots built using LLaMA…