中文
相关论文

相关论文: Detecting and Mitigating Insertion Hallucination i…

200 篇论文

Large Vision-Language Models (LVLMs) with discrete image tokenizers unify multimodal representations by encoding visual inputs into a finite set of tokens. Despite their effectiveness, we find that these models still hallucinate…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Weixing Wang , Zifeng Ding , Jindong Gu , Rui Cao , Christoph Meinel , Gerard de Melo , Haojin Yang

While large language models have transformed how we interact with AI systems, they have a critical weakness: they confidently state false information that sounds entirely plausible. This "hallucination" problem has become a major barrier to…

人工智能 · 计算机科学 2025-11-18 Piyushkumar Patel

Generative AI increasingly supports scientific inference, from protein structure prediction to weather forecasting. Yet its distinctive failure mode, hallucination, raises epistemic alarm bells. I argue that this failure mode can be…

计算机与社会 · 计算机科学 2026-01-14 Charles Rathkopf

The widespread adoption of large language and vision models in real-world applications has made urgent the need to address hallucinations -- instances where models produce incorrect or nonsensical outputs. These errors can propagate…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Zhengyi Ho , Siyuan Liang , Dacheng Tao

Multimodal large language models (MLLMs) have revolutionized cross-modal understanding but continue to struggle with hallucinations - fabricated content contradicting visual inputs. Existing hallucination mitigation methods either incur…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Shangpin Peng , Senqiao Yang , Li Jiang , Zhuotao Tian

Despite their impressive capabilities, large language models (LLMs) have been observed to generate responses that include inaccurate or fabricated information, a phenomenon commonly known as ``hallucination''. In this work, we propose a…

计算与语言 · 计算机科学 2024-03-12 Yue Zhang , Leyang Cui , Wei Bi , Shuming Shi

While large vision-language models (LVLMs) have demonstrated impressive capabilities in interpreting multi-modal contexts, they invariably suffer from object hallucinations (OH). We introduce HALC, a novel decoding algorithm designed to…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Zhaorun Chen , Zhuokai Zhao , Hongyin Luo , Huaxiu Yao , Bo Li , Jiawei Zhou

Empowered by the large-scale pretrained language models, existing dialogue systems have demonstrated impressive performance conducting fluent and natural-sounding conversations. However, they are still plagued by the hallucination problem,…

计算与语言 · 计算机科学 2024-04-05 Jifan Yu , Xiaohan Zhang , Yifan Xu , Xuanyu Lei , Zijun Yao , Jing Zhang , Lei Hou , Juanzi Li

As generative AI systems become competent and democratized in science, business, and government, deeper insight into their failure modes now poses an acute need. The occasional volatility in their behavior, such as the propensity of…

机器学习 · 计算机科学 2025-11-24 Praneet Suresh , Jack Stanley , Sonia Joseph , Luca Scimeca , Danilo Bzdok

Multimodal large language models achieve strong performance across diverse tasks but remain prone to hallucinations, where outputs are not grounded in visual inputs. This issue can be attributed to two main biases: text-visual bias, the…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Shan Wang , Maying Shen , Nadine Chang , Chuong Nguyen , Hongdong Li , Jose M. Alvarez

While video-to-audio generation has achieved remarkable progress in semantic and temporal alignment, most existing studies focus solely on these aspects, paying limited attention to the spatial perception and immersive quality of the…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Yanan Wang , Linjie Ren , Zihao Li , Junyi Wang , Tian Gan

Visual hallucination (VH) means that a multi-modal LLM (MLLM) imagines incorrect details about an image in visual question answering. Existing studies find VH instances only in existing image datasets, which results in biased understanding…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Wen Huang , Hongbin Liu , Minxin Guo , Neil Zhenqiang Gong

Recent advances in latent diffusion-based generative models for portrait image animation, such as Hallo, have achieved impressive results in short-duration video synthesis. In this paper, we present updates to Hallo, introducing several…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Jiahao Cui , Hui Li , Yao Yao , Hao Zhu , Hanlin Shang , Kaihui Cheng , Hang Zhou , Siyu Zhu , Jingdong Wang

Hallucination remains a major challenge for the safe and trustworthy deployment of large language models (LLMs) in factual content generation. Prior work has explored confidence estimation as an effective approach to hallucination…

计算与语言 · 计算机科学 2026-05-15 Caiqi Zhang , Xiaochen Zhu , Chengzu Li , Nigel Collier , Andreas Vlachos

Despite remarkable progress in image quality and prompt fidelity, text-to-image (T2I) diffusion models continue to exhibit persistent "hallucinations", where generated content subtly or significantly diverges from the intended prompt…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Jianjiang Yang , Ziyan Huang , Yanshu li , Da Peng , Huaiyuan Yao

Faithfulness hallucinations in VQA occur when vision-language models produce fluent yet visually ungrounded answers, severely undermining their reliability in safety-critical applications. Existing detection methods mainly fall into two…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Chaodong Tong , Qi Zhang , Chen Li , Lei Jiang , Yanbing Liu

Diffusion models have significantly advanced generative AI, but they encounter difficulties when generating complex combinations of multiple objects. As the final result heavily depends on the initial seed, accurately ensuring the desired…

计算机视觉与模式识别 · 计算机科学 2024-09-18 Federico Betti , Lorenzo Baraldi , Lorenzo Baraldi , Rita Cucchiara , Nicu Sebe

Generative AI (GenAI) is driving the intelligence of wireless communications. Due to data limitations, random generation, and dynamic environments, GenAI may generate channel information or optimization strategies that violate physical laws…

Large Vision-Language Models (LVLMs) have shown remarkable performance on a wide range of vision-language tasks. Despite this progress, they are still prone to hallucination, generating responses that are inconsistent with visual content.…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Yutong Xie , Zhenglin Hua , Ran Wang , Wing W. Y. Ng , Xizhao Wang , Yuheng Jia

This work introduces a new task, text-conditioned selective video-to-audio (V2A) generation, which produces only the user-intended sound from a multi-object video. This capability is especially crucial in multimedia production, where audio…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Junwon Lee , Juhan Nam , Jiyoung Lee