English
Related papers

Related papers: CHASD: Language Increment-Calibrated Contrastive D…

200 papers

Large Language Models (LLMs) often hallucinate, producing unfaithful or factually incorrect outputs by misrepresenting the provided context or incorrectly recalling internal knowledge. Recent studies have identified specific attention heads…

Computation and Language · Computer Science 2024-10-25 Aryo Pradipta Gema , Chen Jin , Ahmed Abdulaal , Tom Diethe , Philip Teare , Beatrice Alex , Pasquale Minervini , Amrutha Saseendran

Multi-modal large language models (MLLMs) have been shown to efficiently integrate natural language with visual information to handle multi-modal tasks. However, MLLMs still face a fundamental limitation of hallucinations, where they tend…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Chaoya Jiang , Haiyang Xu , Mengfan Dong , Jiaxing Chen , Wei Ye , Ming Yan , Qinghao Ye , Ji Zhang , Fei Huang , Shikun Zhang

Despite the rapid success of Large Vision-Language Models (LVLMs), a persistent challenge is their tendency to generate hallucinated content, undermining reliability in real-world use. Existing training-free methods address hallucinations…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Neeraj Anand , Samyak Jha , Udbhav Bamba , Rahul Rahaman

Contrastive decoding strategies are widely used to mitigate object hallucinations in multimodal large language models (MLLMs). By reducing over-reliance on language priors, these strategies ensure that generated content remains closely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Hao Yin , Guangzong Si , Zilei Wang

Large Vision-Language Models (LVLMs) have recently achieved impressive results in multimodal tasks such as image captioning and visual question answering. However, they remain prone to object hallucination -- generating descriptions of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Jinlin Li , Yuran Wang , Yifei Yuan , Xiao Zhou , Yingying Zhang , Xixian Yong , Yefeng Zheng , Xian Wu

Despite the significant success of Large Vision-Language models(LVLMs), these models still suffer hallucinations when describing images, generating answers that include non-existent objects. It is reported that these models tend to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bin Li , Dehong Gao , Yeyuan Wang , Linbo Jin , Shanqing Yu , Xiaoyan Cai , Libin Yang

Language models (LMs) often struggle to pay enough attention to the input context, and generate texts that are unfaithful or contain hallucinations. To mitigate this issue, we present context-aware decoding (CAD), which follows a…

Computation and Language · Computer Science 2023-05-25 Weijia Shi , Xiaochuang Han , Mike Lewis , Yulia Tsvetkov , Luke Zettlemoyer , Scott Wen-tau Yih

Hallucinations in Multimodal Large Language Models (MLLMs) where generated responses fail to accurately reflect the given image pose a significant challenge to their reliability. To address this, we introduce ConVis, a novel training-free…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Yeji Park , Deokyeong Lee , Junsuk Choe , Buru Chang

Multimodal large language models (MLLMs) have recently achieved remarkable progress in radiology by integrating visual perception with natural language understanding. However, they often generate clinically unsupported descriptions, known…

Computation and Language · Computer Science 2025-10-20 Xi Zhang , Zaiqiao Meng , Jake Lever , Edmond S. L. Ho

Although Large Visual Language Models (LVLMs) have demonstrated exceptional abilities in understanding multimodal data, they invariably suffer from hallucinations, leading to a disconnect between the generated text and the corresponding…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Xinyu Lyu , Beitao Chen , Lianli Gao , Jingkuan Song , Heng Tao Shen

Large language models (LLMs) often exhibit Context Faithfulness Hallucinations, where outputs deviate from retrieved information due to incomplete context integration. Our analysis reveals a strong correlation between token-level…

Computation and Language · Computer Science 2025-02-26 Yanwen Huang , Yong Zhang , Ning Cheng , Zhitao Li , Shaojun Wang , Jing Xiao

Large Vision Language Models (LVLMs) achieve strong multimodal reasoning but frequently exhibit hallucinations and incorrect responses with high certainty, which hinders their usage in high-stakes domains. Existing verbalized confidence…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Wenyi Xiao , Xinchi Xu , Leilei Gan

Large audio-language models (LALMs) generalize across speech, sound, and music, but unified decoders can exhibit a \emph{temporal smoothing bias}: transient acoustic cues may be underutilized in favor of temporally smooth context that is…

Sound · Computer Science 2026-04-20 Yanda Li , Yuhan Liu , Zirui Song , Yunchao Wei , Martin Takáč , Salem Lahlou

Large Vision-Language Models (LVLMs) have shown remarkable performance on many visual-language tasks. However, these models still suffer from multimodal hallucination, which means the generation of objects or content that violates the…

Computation and Language · Computer Science 2024-10-01 Fan Yuan , Chi Qin , Xiaogang Xu , Piji Li

Large Vision-Language Models (LVLMs) are susceptible to hallucinations, where generated responses seem semantically plausible yet exhibit little or no relevance to the input image. Previous studies reveal that this issue primarily stems…

Computation and Language · Computer Science 2025-10-24 Hao Fang , Changle Zhou , Jiawei Kong , Kuofeng Gao , Bin Chen , Shu-Tao Xia

Large Vision-Language Models (LVLMs) exhibit impressive multimodal reasoning capabilities but remain highly susceptible to object hallucination, where models generate responses that are not factually aligned with the visual content. Recent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Younan Zhu , Linwei Tao , Minjing Dong , Chang Xu

Recent advancements in Large Vision-Language Models (LVLMs) have demonstrated significant progress across multiple domains. However, these models still face the inherent challenge of integrating vision and language for collaborative…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jiabing Yang , Chenhang Cui , Yiyang Zhou , Yixiang Chen , Peng Xia , Ying Wei , Tao Yu , Yan Huang , Liang Wang

Multimodal Large Language Models (MLLMs) are increasingly deployed in real-world applications, yet their ability to make context-aware safety decisions remains limited. Existing methods often fail to balance oversensitivity (unjustified…

Computation and Language · Computer Science 2025-09-24 Zheyuan Liu , Zhangchen Xu , Guangyao Dou , Xiangchi Yuan , Zhaoxuan Tan , Radha Poovendran , Meng Jiang

Hallucinations in large vision--language models (LVLMs) often arise when language priors dominate over visual evidence, leading to object misidentification and visually inconsistent descriptions. We address this problem by framing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yujin Jo , Sangyoon Bae , Taesup Kim

Large multimodal models are increasingly used as the reasoning core of embodied agents operating in 3D environments, yet they remain prone to hallucinations that can produce unsafe and ungrounded decisions. Existing inference-time…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Makanjuola Ogunleye , Eman Abdelrahman , Ismini Lourentzou