English
Related papers

Related papers: Hallucination Augmented Contrastive Learning for M…

200 papers

While large vision-language models (LVLMs) have shown impressive capabilities in generating plausible responses correlated with input visual contents, they still suffer from hallucinations, where the generated text inaccurately reflects…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yi-Lun Lee , Yi-Hsuan Tsai , Wei-Chen Chiu

Hallucination, a phenomenon where multimodal large language models~(MLLMs) tend to generate textual responses that are plausible but unaligned with the image, has become one major hurdle in various MLLM-related applications. Several…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Han Qiu , Jiaxing Huang , Peng Gao , Qin Qi , Xiaoqin Zhang , Ling Shao , Shijian Lu

As Large Language Models (LLMs) continue to advance in their ability to write human-like text, a key challenge remains around their tendency to hallucinate generating content that appears factual but is ungrounded. This issue of…

Computation and Language · Computer Science 2024-01-09 S. M Towhidul Islam Tonmoy , S M Mehedi Zaman , Vinija Jain , Anku Rani , Vipula Rawte , Aman Chadha , Amitava Das

Large vision-language models (LVLMs) suffer from hallucination a lot, generating responses that apparently contradict to the image content occasionally. The key problem lies in its weak ability to comprehend detailed content in a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyang Chen , Yousong Zhu , Yufei Zhan , Zhaowen Li , Chaoyang Zhao , Jinqiao Wang , Ming Tang

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in multimodal task reasoning. However, they often generate responses that appear plausible yet do not accurately reflect the visual content, a phenomenon known…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Jiaqi Wang , Yifei Gao , Jitao Sang

While Large Vision-Language Models (LVLMs) have exhibited remarkable capabilities across a wide range of tasks, they suffer from hallucination problems, where models generate plausible yet incorrect answers given the input image-query pair.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Xiaoye Qu , Mingyang Song , Wei Wei , Jianfeng Dong , Yu Cheng

Although Large Visual Language Models (LVLMs) have demonstrated exceptional abilities in understanding multimodal data, they invariably suffer from hallucinations, leading to a disconnect between the generated text and the corresponding…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Xinyu Lyu , Beitao Chen , Lianli Gao , Jingkuan Song , Heng Tao Shen

Multimodal Large Language Models (MLLMs) have recently demonstrated impressive capabilities in multimodal understanding, reasoning, and interaction. However, existing MLLMs prevalently suffer from serious hallucination problems, generating…

Computation and Language · Computer Science 2024-03-11 Tianyu Yu , Yuan Yao , Haoye Zhang , Taiwen He , Yifeng Han , Ganqu Cui , Jinyi Hu , Zhiyuan Liu , Hai-Tao Zheng , Maosong Sun , Tat-Seng Chua

Although large vision-language models (LVLMs) have demonstrated remarkable capabilities, they are prone to hallucinations in multi-image tasks. We attribute this issue to limitations in existing attention mechanisms and insufficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Xiaochen Yang , Hao Fang , Jiawei Kong , Yaoxin Mao , Bin Chen , Shu-Tao Xia

Large language models (LLMs) have demonstrated exceptional proficiency in language understanding. However, when LLMs align their outputs with deceptive and/or misleading prompts, the generated responses could deviate from the de facto…

Computation and Language · Computer Science 2025-09-03 Zixuan Shangguan , Yanjie Dong , Lanjun Wang , Xiaoyi Fan , Victor C. M. Leung , Xiping Hu

Instruction tuned Large Vision Language Models (LVLMs) have significantly advanced in generalizing across a diverse set of multi-modal tasks, especially for Visual Question Answering (VQA). However, generating detailed responses that are…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Anisha Gunjal , Jihan Yin , Erhan Bas

Large Language Models (LLMs) often generate hallucinations, producing outputs that are contextually inaccurate or factually incorrect. We introduce HICD, a novel method designed to induce hallucinations for contrastive decoding to mitigate…

Computation and Language · Computer Science 2025-05-26 Xinyan Jiang , Hang Ye , Yongxin Zhu , Xiaoying Zheng , Zikang Chen , Jun Gong

Large Language Models (LLMs) have transformed natural language processing (NLP) tasks, but they suffer from hallucination, generating plausible yet factually incorrect content. This issue extends to Video-Language Models (VideoLLMs), where…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ahmad Khalil , Mahmoud Khalil , Alioune Ngom

Hallucinations in vision-language models (VLMs) hinder reliability and real-world applicability, usually stemming from distribution shifts between pretraining data and test samples. Existing solutions, such as retraining or fine-tuning on…

Multimedia · Computer Science 2025-06-10 Fei Zhao , Chengcui Zhang , Runlin Zhang , Tianyang Wang , Xi Li

Visual hallucinations in Large Language Models (LLMs), where the model generates responses that are inconsistent with the visual input, pose a significant challenge to their reliability, particularly in contexts where precise and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Nokimul Hasan Arif , Shadman Rabby , Md Hefzul Hossain Papon , Sabbir Ahmed

Large vision-language models (LVLMs) have shown remarkable capabilities in visual-language understanding for downstream multi-modal tasks. Despite their success, LVLMs still suffer from generating hallucinations in complex generation tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Jiaming Li , Jiacheng Zhang , Zequn Jie , Lin Ma , Guanbin Li

How to alleviate the hallucinations of Large Language Models (LLMs) has always been the fundamental goal pursued by the LLMs research community. Looking through numerous hallucination-related studies, a mainstream category of methods is to…

Computation and Language · Computer Science 2025-02-12 Yinghui Li , Haojing Huang , Jiayi Kuang , Yangning Li , Shu-Yu Guo , Chao Qu , Xiaoyu Tan , Hai-Tao Zheng , Ying Shen , Philip S. Yu

Despite their impressive capabilities, multimodal large language models (MLLMs) are prone to hallucinations, i.e., the generated content that is nonsensical or unfaithful to input sources. Unlike in LLMs, hallucinations in MLLMs often stem…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Xin Zou , Yizhou Wang , Yibo Yan , Yuanhuiyi Lyu , Kening Zheng , Sirui Huang , Junkai Chen , Peijie Jiang , Jia Liu , Chang Tang , Xuming Hu

Machine Translation (MT) is undergoing a paradigm shift, with systems based on fine-tuned large language models (LLM) becoming increasingly competitive with traditional encoder-decoder models trained specifically for translation tasks.…

Computation and Language · Computer Science 2025-01-30 Zilu Tang , Rajen Chatterjee , Sarthak Garg

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

Computation and Language · Computer Science 2025-09-19 Martin Preiß