English
Related papers

Related papers: Causal Decoding for Hallucination-Resistant Multim…

200 papers

Large language models (LLMs) have revolutionized the field of natural language processing with their impressive reasoning and question-answering capabilities. However, these models are sometimes prone to generating credible-sounding but…

Computation and Language · Computer Science 2026-04-21 Ranganath Krishnan , Piyush Khanna , Omesh Tickoo

Recent advancements in Large Vision Language Models (LVLMs) have revolutionized how machines understand and generate textual responses based on visual inputs, yet they often produce "hallucinatory" outputs that misinterpret visual…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sangmin Woo , Jaehyuk Jang , Donguk Kim , Yubin Choi , Changick Kim

Multimodal Large Language Models (MLLMs) are increasingly deployed in real-world applications, yet their ability to make context-aware safety decisions remains limited. Existing methods often fail to balance oversensitivity (unjustified…

Computation and Language · Computer Science 2025-09-24 Zheyuan Liu , Zhangchen Xu , Guangyao Dou , Xiangchi Yuan , Zhaoxuan Tan , Radha Poovendran , Meng Jiang

Large Multi-modal Models (LMMs) have recently demonstrated remarkable abilities in visual context understanding and coherent response generation. However, alongside these advancements, the issue of hallucinations has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Junho Kim , Hyunjun Kim , Yeonju Kim , Yong Man Ro

While recent Large Vision-Language Models (LVLMs) have shown remarkable performance in multi-modal tasks, they are prone to generating hallucinatory text responses that do not align with the given visual input, which restricts their…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Ce Zhang , Zifu Wan , Zhehan Kan , Martin Q. Ma , Simon Stepputtis , Deva Ramanan , Russ Salakhutdinov , Louis-Philippe Morency , Katia Sycara , Yaqi Xie

Multimodal Large Language Models (MLLMs) suffer from cross-modal hallucinations, where one modality inappropriately influences generation about another, leading to fabricated output. This exposes a more fundamental deficiency in…

Artificial Intelligence · Computer Science 2026-01-30 Sangyun Chung , Se Yeon Kim , Youngchae Chee , Yong Man Ro

Vision Language models (VLMs) often hallucinate non-existent objects. Detecting hallucination is analogous to detecting deception: a single final statement is insufficient, one must examine the underlying reasoning process. Yet existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Abin Shoby , Ta Duc Huy , Tuan Dung Nguyen , Minh Khoi Ho , Qi Chen , Anton van den Hengel , Phi Le Nguyen , Johan W. Verjans , Vu Minh Hieu Phan

Large vision-language models (LVLMs) have achieved impressive results in various vision-language tasks. However, despite showing promising performance, LVLMs suffer from hallucinations caused by language bias, leading to diminished focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Haozhe Zhao , Shuzheng Si , Liang Chen , Yichi Zhang , Maosong Sun , Mingjia Zhang , Baobao Chang

Achieving deep alignment between vision and language remains a central challenge for Multimodal Large Language Models (MLLMs). These models often fail to fully leverage visual input, defaulting to strong language priors. Our approach first…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Aarti Ghatkesar , Ganesh Venkatesh

Despite their remarkable potential, Large Vision-Language Models (LVLMs) still face challenges with object hallucination, a problem where their generated outputs mistakenly incorporate objects that do not actually exist. Although most works…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Liwei Che , Tony Qingze Liu , Jing Jia , Weiyi Qin , Ruixiang Tang , Vladimir Pavlovic

Multimodal large language models (MLLMs) excel at generating highly detailed captions but often produce hallucinations. Our analysis reveals that existing hallucination detection methods struggle with detailed captions. We attribute this to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Saehyung Lee , Seunghyun Yoon , Trung Bui , Jing Shi , Sungroh Yoon

Multimodal large language models (MLLMs) contribute a powerful mechanism to understanding visual information building on large language models. However, MLLMs are notorious for suffering from hallucinations, especially when generating…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Kai Wu , Boyuan Jiang , Zhengkai Jiang , Qingdong He , Donghao Luo , Shengzhi Wang , Qingwen Liu , Chengjie Wang

Multi-modal Large Language Models (MLLMs) tuned on machine-generated instruction-following data have demonstrated remarkable performance in various multi-modal understanding and generation tasks. However, the hallucinations inherent in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Qifan Yu , Juncheng Li , Longhui Wei , Liang Pang , Wentao Ye , Bosheng Qin , Siliang Tang , Qi Tian , Yueting Zhuang

Hallucination is a well-known phenomenon in text generated by large language models (LLMs). The existence of hallucinatory responses is found in almost all application scenarios e.g., summarization, question-answering (QA) etc. For…

Computation and Language · Computer Science 2023-12-11 Mobashir Sadat , Zhengyu Zhou , Lukas Lange , Jun Araki , Arsalan Gundroo , Bingqing Wang , Rakesh R Menon , Md Rizwan Parvez , Zhe Feng

Multimodal large language models (MLLMs) have revolutionized cross-modal understanding but continue to struggle with hallucinations - fabricated content contradicting visual inputs. Existing hallucination mitigation methods either incur…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Shangpin Peng , Senqiao Yang , Li Jiang , Zhuotao Tian

Large language models (LLMs) frequently hallucinate and produce factual errors, yet our understanding of why they make these errors remains limited. In this study, we delve into the underlying mechanisms of LLM hallucinations from the…

Computation and Language · Computer Science 2024-03-13 Shiqi Chen , Miao Xiong , Junteng Liu , Zhengxuan Wu , Teng Xiao , Siyang Gao , Junxian He

The recent success of reinforcement learning (RL) in large reasoning models has inspired the growing adoption of RL for post-training Multimodal Large Language Models (MLLMs) to enhance their visual reasoning capabilities. Although many…

The emergence of large language models (LLMs) has marked a significant breakthrough in natural language processing (NLP), fueling a paradigm shift in information acquisition. Nevertheless, LLMs are prone to hallucination, generating…

Computation and Language · Computer Science 2024-11-20 Lei Huang , Weijiang Yu , Weitao Ma , Weihong Zhong , Zhangyin Feng , Haotian Wang , Qianglong Chen , Weihua Peng , Xiaocheng Feng , Bing Qin , Ting Liu

The rapid development of Multi-modality Large Language Models (MLLMs) has significantly influenced various aspects of industry and daily life, showcasing impressive capabilities in visual perception and understanding. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yinan Sun , Zicheng Zhang , Haoning Wu , Xiaohong Liu , Weisi Lin , Guangtao Zhai , Xiongkuo Min

Despite their remarkable capabilities, Large Language Models (LLMs) are prone to generate responses that contradict verifiable facts, i.e., unfaithful hallucination content. Existing efforts generally focus on optimizing model parameters or…

Computation and Language · Computer Science 2025-01-28 Dingkang Yang , Dongling Xiao , Jinjie Wei , Mingcheng Li , Zhaoyu Chen , Ke Li , Lihua Zhang