中文
相关论文

相关论文: Feedback-Enhanced Hallucination-Resistant Vision-L…

200 篇论文

Vision-language models often hallucinate details, generating non-existent objects or inaccurate attributes that compromise output reliability. Existing methods typically address these issues via extensive human annotations or external…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Mingfei Han , Haihong Hao , Jinxing Zhou , Zhihui Li , Yuhui Zheng , Xueqing Deng , Linjie Yang , Xiaojun Chang

Large Vision-Language Models (LVLMs) are an extension of Large Language Models (LLMs) that facilitate processing both image and text inputs, expanding AI capabilities. However, LVLMs struggle with object hallucinations due to their reliance…

计算与语言 · 计算机科学 2024-08-12 Avshalom Manevich , Reut Tsarfaty

Despite the recent breakthroughs achieved by Large Vision Language Models (LVLMs) in understanding and responding to complex visual-textual contexts, their inherent hallucination tendencies limit their practical application in real-world…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Junzhe Chen , Tianshu Zhang , Shiyu Huang , Yuwei Niu , Linfeng Zhang , Lijie Wen , Xuming Hu

Large multimodal models suffer from multimodal hallucination, where they provide incorrect responses misaligned with the given visual information. Recent works have conjectured that one of the reasons behind multimodal hallucination is due…

计算与语言 · 计算机科学 2024-04-03 Seongyun Lee , Sue Hyun Park , Yongrae Jo , Minjoon Seo

AI agents that execute tasks via tool calls frequently hallucinate results - fabricating tool executions, misstating output counts, or presenting inferences as facts. Recent approaches to verifiable AI inference rely on zero-knowledge…

密码学与安全 · 计算机科学 2026-03-12 Abhinaba Basu

Detecting hallucinations in large language model (LLM) outputs is pivotal, yet traditional fine-tuning for this classification task is impeded by the expensive and quickly outdated annotation process, especially across numerous vertical…

人工智能 · 计算机科学 2024-07-09 Dongxu Zhang , Varun Gangal , Barrett Martin Lattimer , Yi Yang

Factual hallucination remains a central challenge for large language models (LLMs). Existing mitigation approaches primarily rely on either external post-hoc verification or mapping uncertainty directly to abstention during fine-tuning,…

Hallucination--defined here as generating statements unsupported or contradicted by available evidence or conversational context--remains a major obstacle to deploying conversational AI systems in settings that demand factual reliability.…

计算与语言 · 计算机科学 2026-04-22 Ashley Lewis , Andrew Perrault , Eric Fosler-Lussier , Michael White

Hallucination, a phenomenon where large language models (LLMs) produce output that is factually incorrect or unrelated to the input, is a major challenge for LLM applications that require accuracy and dependability. In this paper, we…

计算与语言 · 计算机科学 2025-04-01 Song Wang , Xun Wang , Jie Mei , Yujia Xie , Sean Muarray , Zhang Li , Lingfeng Wu , Si-Qing Chen , Wayne Xiong

Hallucination has been a major problem for large language models and remains a critical challenge when it comes to multimodality in which vision-language models (VLMs) have to deal with not just textual but also visual inputs. Despite rapid…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Zhecan Wang , Garrett Bingham , Adams Yu , Quoc Le , Thang Luong , Golnaz Ghiasi

We investigate the internal representations of vision-language models (VLMs) to address hallucinations, a persistent challenge despite advances in model size and training. We project VLMs' internal image representations to their language…

计算机视觉与模式识别 · 计算机科学 2025-02-12 Nick Jiang , Anish Kachinthaya , Suzie Petryk , Yossi Gandelsman

Contrastive decoding strategies are widely used to mitigate object hallucinations in multimodal large language models (MLLMs). By reducing over-reliance on language priors, these strategies ensure that generated content remains closely…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Hao Yin , Guangzong Si , Zilei Wang

Long-horizon robotic manipulation remains challenging for Vision-Language-Action (VLA) models despite recent progress in zero-shot generalization and simulation-to-real-world transfer. Current VLA models suffer from stage hallucination,…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Zeting Liu , Zida Yang , Zeyu Zhang , Hao Tang

Although Large Vision-Language Models (LVLMs) have demonstrated powerful capabilities in interpreting visual information, they frequently produce content that deviates from visual information, leading to object hallucination. To tackle…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Qiming Li , Zekai Ye , Xiaocheng Feng , Weihong Zhong , Libo Qin , Ruihan Chen , Baohang Li , Kui Jiang , Yaowei Wang , Ting Liu , Bing Qin

AI applications driven by multimodal large language models (MLLMs) are prone to hallucinations and pose considerable risks to human users. Crucially, such hallucinations are not equally problematic: some hallucination contents could be…

人工智能 · 计算机科学 2026-04-09 Jianhong Pang , Ruoxi Cheng , Ziyi Ye , Xingjun Ma , Zuxuan Wu , Xuanjing Huang , Yu-Gang Jiang

Large Vision-Language Models (VLMs) often exhibit text inertia, where attention drifts from visual evidence toward linguistic priors, resulting in object hallucinations. Existing decoding strategies intervene only at the output logits and…

计算机视觉与模式识别 · 计算机科学 2025-12-08 Weijue Bu , Guan Yuan , Guixian Zhang

Although Multimodal Large Language Models (MLLMs) have advanced substantially, they remain vulnerable to object hallucination caused by language priors and visual information loss. To address this, we propose SAVE (Sparse Autoencoder-Driven…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Sangha Park , Seungryong Yoo , Jisoo Mok , Sungroh Yoon

Large Vision-Language Models (VLMs) have achieved remarkable success across diverse multimodal tasks but remain vulnerable to hallucinations rooted in inherent language bias. Despite recent progress, existing hallucination mitigation…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Yilin Yang , Zhenghui Guo , Yuke Wang , Omprakash Gnawali , Sheng Di , Chengming Zhang

Large Vision-Language Models (LVLMs) have demonstrated proficiency in tackling a variety of visual-language tasks. However, current LVLMs suffer from misalignment between text and image modalities which causes three kinds of hallucination…

计算机视觉与模式识别 · 计算机科学 2025-05-07 Liqiang Jing , Xinya Du

The troubling rise of hallucination presents perhaps the most significant impediment to the advancement of responsible AI. In recent times, considerable research has focused on detecting and mitigating hallucination in Large Language Models…

人工智能 · 计算机科学 2024-04-02 Anku Rani , Vipula Rawte , Harshad Sharma , Neeraj Anand , Krishnav Rajbangshi , Amit Sheth , Amitava Das