English
Related papers

Related papers: Mitigating Hallucination in Large Vision-Language …

200 papers

LVLMs have achieved strong multimodal reasoning capabilities but remain prone to hallucinations, producing outputs inconsistent with visual inputs or user instructions. Existing training-free methods, including contrastive decoding and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Guangtao Lyu , Qi Liu , Chenghao Xu , Jiexi Yan , Muli Yang , Xueting Li , Fen Fang , Cheng Deng

Large Vision-Language Models (LVLMs) have made substantial progress by integrating pre-trained large language models (LLMs) and vision models through instruction tuning. Despite these advancements, LVLMs often exhibit the hallucination…

Machine Learning · Computer Science 2024-11-05 Yiyang Zhou , Zhiyuan Fan , Dongjie Cheng , Sihan Yang , Zhaorun Chen , Chenhang Cui , Xiyao Wang , Yun Li , Linjun Zhang , Huaxiu Yao

Large-scale vision-language pre-trained (VLP) models are prone to hallucinate non-existent visual objects when generating text based on visual information. In this paper, we systematically study the object hallucination problem from three…

Computation and Language · Computer Science 2023-02-13 Wenliang Dai , Zihan Liu , Ziwei Ji , Dan Su , Pascale Fung

Recent advances in Large Vision-Language Models (LVLMs) have significantly improve performance in image comprehension tasks, such as formatted charts and rich-content images. Yet, Graphical User Interface (GUI) pose a greater challenge due…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Ziyang Meng , Yu Dai , Zezheng Gong , Shaoxiong Guo , Minglong Tang , Tongquan Wei

Large Vision-Language Models (LVLMs) exhibit outstanding performance on vision-language tasks but struggle with hallucination problems. Through in-depth analysis of LVLM activation patterns, we reveal two key findings: 1) truthfulness and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Jianghao Yin , Qin Chen , Kedi Chen , Jie Zhou , Xingjiao Wu , Liang He

Large language models (LLMs) have shown promise for generative and knowledge-intensive tasks including question-answering (QA) tasks. However, the practical deployment still faces challenges, notably the issue of "hallucination", where…

Computation and Language · Computer Science 2023-10-11 Ziwei Ji , Tiezheng Yu , Yan Xu , Nayeon Lee , Etsuko Ishii , Pascale Fung

Vision-Language Models (VLMs) excel at visual understanding but often suffer from visual hallucinations, where they generate descriptions of nonexistent objects, actions, or concepts, posing significant risks in safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Tsung-Han Wu , Heekyung Lee , Jiaxin Ge , Joseph E. Gonzalez , Trevor Darrell , David M. Chan

This paper primarily focuses on the hallucinations caused due to AI language models(LLMs).LLMs have shown extraordinary Language understanding and generation capabilities .Still it has major a disadvantage hallucinations which give outputs…

Computation and Language · Computer Science 2026-04-07 Sailesh kiran kurra , Shiek Ruksana , Vishal Borusu

Multimodal large language models (MLLMs) have achieved remarkable progress in video understanding.However, hallucination, where the model generates plausible yet incorrect outputs, persists as a significant and under-addressed challenge in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Jianfeng Cai , Wengang Zhou , Zongmeng Zhang , Jiale Hong , Nianji Zhan , Houqiang Li

Visual attention serves as the primary mechanism through which MLLMs interpret visual information; however, its limited localization capability often leads to hallucinations. We observe that although MLLMs can accurately extract visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Jianfei Zhao , Feng Zhang , Xin Sun , Chong Feng , Zhixing Tan

Hallucination is a long-standing problem that has been actively investigated in Vision-Language Models (VLMs). Existing research commonly attributes hallucinations to technical limitations or sycophancy bias, where the latter means the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Xiangrui Liu , Man Luo , Agneet Chatterjee , Hua Wei , Chitta Baral , Yezhou Yang

Large-scale vision-language models have demonstrated impressive skill in handling tasks that involve both areas. Nevertheless, these models frequently experience significant issues with generating inaccurate information, which is…

Computation and Language · Computer Science 2024-05-07 Huixuan Zhang , Junzhe Zhang , Xiaojun Wan

Multimodal Chain-of-Thought (MCoT) models have demonstrated impressive capability in complex visual reasoning tasks. Unfortunately, recent studies reveal that they suffer from severe hallucination problems due to diminished visual attention…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Ji Ma , Wei Suo , Peng Wang , Yanning Zhang

Hallucination remains a major challenge in multimodal large language models (MLLMs). To address this, various contrastive decoding (CD) methods have been proposed that contrasts original logits with hallucinated logits generated from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Chaeyoung Jung , Youngjoon Jang , Joon Son Chung

Multi-modal large language models (MLLMs) have been shown to efficiently integrate natural language with visual information to handle multi-modal tasks. However, MLLMs still face a fundamental limitation of hallucinations, where they tend…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Chaoya Jiang , Haiyang Xu , Mengfan Dong , Jiaxing Chen , Wei Ye , Ming Yan , Qinghao Ye , Ji Zhang , Fei Huang , Shikun Zhang

Large language models (LLMs) often generate hallucinated content that lacks factual or contextual grounding, limiting their reliability in critical applications. Existing approaches such as supervised fine-tuning and reinforcement learning…

Computation and Language · Computer Science 2025-12-23 Jensen Zhang , Ningyuan Liu , Yijia Fan , Zihao Huang , Qinglin Zeng , Kaitong Cai , Jian Wang , Keze Wang

Multimodal large language models (MLLMs) have achieved strong performance on vision-language tasks but still struggle with fine-grained visual differences, leading to hallucinations or missed semantic shifts. We attribute this to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Tianyi Bai , Yuxuan Fan , Jiantao Qiu , Fupeng Sun , Jiayi Song , Junlin Han , Zichen Liu , Conghui He , Wentao Zhang , Binhang Yuan

Large Language Models (LLMs) have become increasingly important in natural language processing, enabling advanced data analytics through natural language queries. However, these models often generate "hallucinations"-inaccurate or…

Computation and Language · Computer Science 2024-10-29 Mikhail Rumiantsau , Aliaksei Vertsel , Ilya Hrytsuk , Isaiah Ballah

Test-time compute has empowered multimodal large language models to generate extended reasoning chains, yielding strong performance on tasks such as multimodal math reasoning. However, this improved reasoning ability often comes with…

Computation and Language · Computer Science 2025-06-23 Chengzhi Liu , Zhongxing Xu , Qingyue Wei , Juncheng Wu , James Zou , Xin Eric Wang , Yuyin Zhou , Sheng Liu

Large language models (LLMs) offer a valuable technology for various applications in healthcare. However, their tendency to hallucinate and the existing reliance on proprietary systems pose challenges in environments concerning critical…

Computation and Language · Computer Science 2025-02-27 Joshua Strong , Qianhui Men , Alison Noble
‹ Prev 1 8 9 10 Next ›