中文
相关论文

相关论文: Fighting Hallucinations with Counterfactuals: Diff…

200 篇论文

Vision-Language Models (VLMs) excel at visual understanding but often suffer from visual hallucinations, where they generate descriptions of nonexistent objects, actions, or concepts, posing significant risks in safety-critical…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Tsung-Han Wu , Heekyung Lee , Jiaxin Ge , Joseph E. Gonzalez , Trevor Darrell , David M. Chan

Hallucinations in Large Vision-Language Models (LVLMs) significantly undermine their reliability, motivating researchers to explore the causes of hallucination. However, most studies primarily focus on the language aspect rather than the…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Zhangqi Jiang , Junkai Chen , Beier Zhu , Tingjin Luo , Yankun Shen , Xu Yang

Despite the great success of Large Vision-Language Models (LVLMs), they inevitably suffer from hallucination. As we know, both the visual encoder and the Large Language Model (LLM) decoder in LVLMs are Transformer-based, allowing the model…

计算与语言 · 计算机科学 2025-11-07 Xuan Gong , Tianshi Ming , Xinpeng Wang , Zhihua Wei

Large Vision-Language Models (LVLMs) have demonstrated impressive multimodal understanding capabilities, yet they remain prone to object hallucination, where models describe non-existent objects or attribute incorrect factual information,…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Ahmed Akl , Abdelwahed Khamis , Ali Cheraghian , Zhe Wang , Sara Khalifa , Kewen Wang

Large Vision-Language Models (LVLMs) with discrete image tokenizers unify multimodal representations by encoding visual inputs into a finite set of tokens. Despite their effectiveness, we find that these models still hallucinate…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Weixing Wang , Zifeng Ding , Jindong Gu , Rui Cao , Christoph Meinel , Gerard de Melo , Haojin Yang

The generation of factually incorrect objects, commonly known as object hallucination, remains a persistent challenge in Large Vision-Language Models (LVLMs). Current approaches to address this issue - ranging from expensive data-driven…

人工智能 · 计算机科学 2026-05-26 Yuanzhi Xu , Qian Gao , Jun Fan , Guohui Ding , Zhenyu Yang , Sixue Lin , Yuteng Xiao

Penetration testing, a critical component of cybersecurity, typically requires extensive time and effort to find vulnerabilities. Beginners in this field often benefit from collaborative approaches with the community or experts. To address…

Large vision-language models (LVLMs) suffer from hallucination a lot, generating responses that apparently contradict to the image content occasionally. The key problem lies in its weak ability to comprehend detailed content in a…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Zhiyang Chen , Yousong Zhu , Yufei Zhan , Zhaowen Li , Chaoyang Zhao , Jinqiao Wang , Ming Tang

Large Language Model (LLM) hallucination is a significant barrier to their reliable deployment. Current methods like Retrieval-Augmented Generation (RAG) are often reactive. We introduce **Dynamic Self-reinforcing Calibration for…

计算与语言 · 计算机科学 2025-09-18 Xiao Zheng

Diffusion models, despite their impressive demos, often produce hallucinatory samples with structural inconsistencies that lie outside of the support of the true data distribution. Such hallucinations can be attributed to excessive…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Kostas Triaridis , Alexandros Graikos , Aggelina Chatziagapi , Grigorios G. Chrysos , Dimitris Samaras

Multimodal large language models (MLLMs) have achieved remarkable success across diverse vision-language tasks, yet they remain highly susceptible to hallucinations, producing content that is fluent but inconsistent with visual evidence.…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Youxu Shi , Suorong Yang , Dong Liu

Large Vision-Language Models (LVLMs) have advanced considerably, intertwining visual recognition and language understanding to generate content that is not only coherent but also contextually attuned. Despite their success, LVLMs still…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Sicong Leng , Hang Zhang , Guanzheng Chen , Xin Li , Shijian Lu , Chunyan Miao , Lidong Bing

Recent advancements in Multimodal Large Language Models (MLLMs) have enabled them to effectively integrate vision and language, addressing a variety of downstream tasks. However, despite their significant success, these models still exhibit…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Zixian Gao , Chao Yang , Zhanhui Zhou , Xing Xu , Chaochao Lu

Although Large Vision-Language Models (LVLMs) have made substantial progress, hallucination, where generated text is not grounded in the visual input, remains a challenge. As LVLMs become stronger, previously reported hallucination…

计算机视觉与模式识别 · 计算机科学 2026-03-03 April Fu

Large vision-language models (LVLMs) frequently suffer from Object Hallucination (OH), wherein they generate descriptions containing objects that are not actually present in the input image. This phenomenon is particularly problematic in…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Yanbin Huang , Yisen Li , Guiyao Tie , Xiaoye Qu , Pan Zhou , Hongfei Wang , Zhaofan Zou , Hao Sun , Xuelong Li

Segmentation Vision-Language Models (VLMs) have significantly advanced grounded visual understanding, yet they remain prone to pixel-grounding hallucinations, producing masks for incorrect objects or for objects that are entirely absent.…

计算机视觉与模式识别 · 计算机科学 2026-04-24 Xinzhuo Li , Adheesh Juvekar , Jiaxun Zhang , Xingyou Liu , Muntasir Wahed , Kiet A. Nguyen , Yifan Shen , Tianjiao Yu , Ismini Lourentzou

Large Vision-Language Model (LVLM) systems have demonstrated impressive vision-language reasoning capabilities but suffer from pervasive and severe hallucination issues, posing significant risks in critical domains such as healthcare and…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Zhehan Kan , Ce Zhang , Zihan Liao , Yapeng Tian , Wenming Yang , Junyuan Xiao , Xu Li , Dongmei Jiang , Yaowei Wang , Qingmin Liao

Hallucinations in large language models (LLMs) present a growing challenge across real-world applications, from healthcare to law, where factual reliability is essential. Despite advances in alignment and instruction tuning, LLMs can still…

计算与语言 · 计算机科学 2025-05-02 Makoto Sato

Despite the impressive capabilities of Large Vision-Language Models (LVLMs), they remain susceptible to hallucinations-generating content that is inconsistent with the input image. Existing training-free hallucination mitigation methods…

机器学习 · 计算机科学 2025-05-20 Kai Tang , Jinhao You , Xiuqi Ge , Hanze Li , Yichen Guo , Xiande Huang

Vision-language models (VLMs) can achieve high accuracy while still accepting culturally plausible but visually incorrect interpretations. Existing hallucination benchmarks rarely test this failure mode, particularly outside Western…

计算与语言 · 计算机科学 2026-04-22 Basel Mousi , Fahim Dalvi , Shammur Chowdhury , Firoj Alam , Nadir Durrani