中文
相关论文

相关论文: Mitigating Behavioral Hallucination in Multimodal …

200 篇论文

Large Vision Language Models (LVLMs) are becoming increasingly important in the medical domain, yet Medical LVLMs (Med-LVLMs) frequently generate hallucinations due to limited expertise and the complexity of medical applications. Existing…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Aofei Chang , Le Huang , Parminder Bhatia , Taha Kass-Hout , Fenglong Ma , Cao Xiao

While Large Vision-Language Models (LVLMs) have exhibited remarkable capabilities across a wide range of tasks, they suffer from hallucination problems, where models generate plausible yet incorrect answers given the input image-query pair.…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Xiaoye Qu , Mingyang Song , Wei Wei , Jianfeng Dong , Yu Cheng

Large Vision-Language Models (LVLMs) have demonstrated impressive multimodal understanding capabilities, yet they remain prone to object hallucination, where models describe non-existent objects or attribute incorrect factual information,…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Ahmed Akl , Abdelwahed Khamis , Ali Cheraghian , Zhe Wang , Sara Khalifa , Kewen Wang

Despite the state-of-the-art performance of Large Language Models (LLMs), these models often suffer from hallucinations, which can undermine their performance in critical applications. In this work, we propose SAFE, a novel method for…

计算与语言 · 计算机科学 2025-03-06 Samir Abdaljalil , Filippo Pallucchini , Andrea Seveso , Hasan Kurban , Fabio Mercorio , Erchin Serpedin

Large Vision-Language Models (VLMs) have achieved remarkable success across diverse multimodal tasks but remain vulnerable to hallucinations rooted in inherent language bias. Despite recent progress, existing hallucination mitigation…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Yilin Yang , Zhenghui Guo , Yuke Wang , Omprakash Gnawali , Sheng Di , Chengming Zhang

Video multimodal large language models (Video-MLLMs) have achieved remarkable progress in video understanding. However, they remain vulnerable to hallucination-producing content inconsistent with or unrelated to video inputs. Previous video…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Hao Lu , Jiahao Wang , Yaolun Zhang , Ruohui Wang , Xuanyu Zheng , Yepeng Tang , Dahua Lin , Lewei Lu

Large vision-language models (VLMs) frequently suffer from hallucinations, generating content that is inconsistent with visual inputs. Existing methods typically address this problem through post-hoc filtering, additional training…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Tripti Shukla , Zsolt Kira

Test-time compute has empowered multimodal large language models to generate extended reasoning chains, yielding strong performance on tasks such as multimodal math reasoning. However, this improved reasoning ability often comes with…

计算与语言 · 计算机科学 2025-06-23 Chengzhi Liu , Zhongxing Xu , Qingyue Wei , Juncheng Wu , James Zou , Xin Eric Wang , Yuyin Zhou , Sheng Liu

Although Video Large Language Models perform remarkably well across tasks such as video understanding, question answering, and reasoning, they still suffer from the problem of hallucination, which refers to generating outputs that are…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Yuansheng Gao , Jinman Zhao , Tong Zhang , Xingguo Xu , Han Bao , Zonghui Wang , Wenzhi Chen

Multimodal Large Language Models (MLLMs) frequently suffer from hallucination issues, generating information about objects that are not present in input images during vision-language tasks. These hallucinations particularly undermine model…

计算机视觉与模式识别 · 计算机科学 2025-06-16 Dokyoon Yoon , Youngsook Song , Woomyong Park

Spatial relation hallucinations pose a persistent challenge in large vision-language models (LVLMs), leading to generate incorrect predictions about object positions and spatial configurations within an image. To address this issue, we…

计算与语言 · 计算机科学 2025-03-24 Jiarui Wu , Zhuo Liu , Hangfeng He

Multimodal Large Language Models (MLLMs) deliver detailed responses on vision-language tasks, yet remain susceptible to object hallucination (introducing objects not present in the image), undermining reliability in practice. Prior efforts…

机器学习 · 计算机科学 2026-02-26 Shiwei Tan , Hengyi Wang , Weiyi Qin , Qi Xu , Zhigang Hua , Hao Wang

The emergence of large language models (LLMs) has significantly advanced the development of natural language processing (NLP), especially in text generation tasks like question answering. However, model hallucinations remain a major…

计算与语言 · 计算机科学 2025-12-01 Zhongxin Liu , Zhiwei Wang , Jun Niu , Ying Li , Hongyu Sun , Meng Xu , He Wang , Gaofei Wu , Yuqing Zhang

Though advanced in understanding visual information with human languages, Large Vision-Language Models (LVLMs) still suffer from multimodal hallucinations. A natural concern is that during multimodal interaction, the generated…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Weihong Zhong , Xiaocheng Feng , Liang Zhao , Qiming Li , Lei Huang , Yuxuan Gu , Weitao Ma , Yuan Xu , Bing Qin

This research work delves into the manifestation of hallucination within Large Language Models (LLMs) and its consequential impacts on applications within the domain of mental health. The primary objective is to discern effective strategies…

计算与语言 · 计算机科学 2024-10-16 Abdul Muqtadir , Hafiz Syed Muhammad Bilal , Ayesha Yousaf , Hafiz Farooq Ahmed , Jamil Hussain

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

人工智能 · 计算机科学 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

While recent years have seen rapid progress in image-conditioned text generation, image captioning still suffers from the fundamental issue of hallucinations, namely, the generation of spurious details that cannot be inferred from the given…

计算机视觉与模式识别 · 计算机科学 2025-01-27 Assaf Ben-Kish , Moran Yanuka , Morris Alper , Raja Giryes , Hadar Averbuch-Elor

Multimodal large language models (MLLMs) have achieved strong performance on vision-language tasks but still struggle with fine-grained visual differences, leading to hallucinations or missed semantic shifts. We attribute this to…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Tianyi Bai , Yuxuan Fan , Jiantao Qiu , Fupeng Sun , Jiayi Song , Junlin Han , Zichen Liu , Conghui He , Wentao Zhang , Binhang Yuan

Large Vision-Language Models (LVLMs) demonstrate remarkable capabilities in multimodal tasks, but visual object hallucination remains a persistent issue. It refers to scenarios where models generate inaccurate visual object-related…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Liqiang Jing , Guiming Hardy Chen , Ehsan Aghazadeh , Xin Eric Wang , Xinya Du

The hallucination problem in multimodal large language models (MLLMs) remains a common issue. Although image tokens occupy a majority of the input sequence of MLLMs, there is limited research to explore the relationship between image tokens…

计算机视觉与模式识别 · 计算机科学 2024-11-18 Xiaofeng Zhang , Yihao Quan , Chaochen Gu , Chen Shen , Xiaosong Yuan , Shaotian Yan , Hao Cheng , Kaijie Wu , Jieping Ye