中文
相关论文

相关论文: Detecting and Mitigating Insertion Hallucination i…

200 篇论文

Text-to-video and image-to-video generation have made rapid progress in visual quality, but they remain limited in controlling the precise timing of motion. In contrast, audio provides temporal cues aligned with video motion, making it a…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Jibin Song , Mingi Kwon , Jaeseok Jeong , Youngjung Uh

Large Vision-Language Models often generate hallucinated content that is not grounded in its visual inputs. While prior work focuses on mitigating hallucinations, we instead explore leveraging hallucination correction as a training…

计算机视觉与模式识别 · 计算机科学 2025-02-24 Lingjun Zhao , Mingyang Xie , Paola Cascante-Bonilla , Hal Daumé , Kwonjoon Lee

Object hallucination is a significant challenge that hinders the application of large vision-language models (LVLMs) in practice. We hypothesize that one possible origin of hallucination is the model's tendency to prioritize text generation…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Meng Shen , Minghao Wu , Deepu Rajan

Although Video Large Language Models perform remarkably well across tasks such as video understanding, question answering, and reasoning, they still suffer from the problem of hallucination, which refers to generating outputs that are…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Yuansheng Gao , Jinman Zhao , Tong Zhang , Xingguo Xu , Han Bao , Zonghui Wang , Wenzhi Chen

Large language models frequently exhibit hallucinations: fluent and confident outputs that are factually incorrect or unsupported by the input context. While recent hallucination detection methods have explored various features derived from…

计算与语言 · 计算机科学 2026-04-14 Jakub Binkowski , Kamil Adamczewski , Tomasz Kajdanowicz

Vision language models (VLMs) perceive the world through a combination of a visual encoder and a large language model (LLM). The visual encoder, pre-trained on large-scale vision-text datasets, provides zero-shot generalization to visual…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Moon Ye-Bin , Nam Hyeon-Woo , Wonseok Choi , Tae-Hyun Oh

Audio-driven video generation aims to synthesize realistic videos that align with input audio recordings, akin to the human ability to visualize scenes from auditory input. However, existing approaches predominantly focus on exploring…

图形学 · 计算机科学 2026-03-17 Kien T. Pham , Yingqing He , Yazhou Xing , Qifeng Chen , Long Chen

Vision Language Models (VLMs) show impressive capabilities in integrating and reasoning with both visual and language data. But these models make mistakes. A common finding -- similar to LLMs -- is their tendency to hallucinate, i.e.,…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Sotirios Panagiotis Chytas , Miso Choi , Hyunwoo J. Kim , Vikas Singh

Large language models (LLMs) have significantly advanced natural language processing tasks, yet they are susceptible to generating inaccurate or unreliable responses, a phenomenon known as hallucination. In critical domains such as health…

计算与语言 · 计算机科学 2024-09-20 Sumera Anjum , Hanzhi Zhang , Wenjun Zhou , Eun Jin Paek , Xiaopeng Zhao , Yunhe Feng

Despite their success, Large Vision-Language Models (LVLMs) remain vulnerable to hallucinations. While existing studies attribute the cause of hallucinations to insufficient visual attention to image tokens, our findings indicate that…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Beitao Chen , Xinyu Lyu , Lianli Gao , Jingkuan Song , Heng Tao Shen

Memory systems are key components that enable AI systems such as LLMs and AI agents to achieve long-term learning and sustained interaction. However, during memory storage and retrieval, these systems frequently exhibit memory…

计算与语言 · 计算机科学 2026-01-06 Ding Chen , Simin Niu , Kehang Li , Peng Liu , Xiangping Zheng , Bo Tang , Xinchi Li , Feiyu Xiong , Zhiyu Li

Large Audio Language Models (LALMs) achieve strong performance on audio-language tasks; however, their reliability in real-world settings remains underexplored. We introduce Audio Hallucination Attacks (AHA), an attack suite called…

Recent studies have examined attention dynamics in large vision-language models (LVLMs) to detect hallucinations. However, existing approaches remain limited in reliably distinguishing hallucinated from factually grounded outputs, as they…

计算机视觉与模式识别 · 计算机科学 2026-01-29 Xiaofeng Zhang , Yuanchao Zhu , Chaochen Gu , Xiaosong Yuan , Qiyan Zhao , Jiawei Cao , Feilong Tang , Sinan Fan , Yaomin Shen , Chen Shen , Hao Tang

Natural Language Generation (NLG) has improved exponentially in recent years thanks to the development of sequence-to-sequence deep learning technologies such as Transformer-based language models. This advancement has led to more fluent and…

Hallucination, where models generate fluent text unsupported by visual evidence, remains a major flaw in vision-language models and is particularly critical in sign language translation (SLT). In SLT, meaning depends on precise grounding in…

In language and vision-language models, hallucination is broadly understood as content generated from a model's prior knowledge or biases rather than from the given input. While this phenomenon has been studied in those domains, it has not…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Seyed Amir Kasaei , Mohammad Hossein Rohban

Hallucinations in Speech Large Language Models (SpeechLLMs) pose significant risks, yet existing detection methods typically rely on gold-standard outputs that are costly or impractical to obtain. Moreover, hallucination detection methods…

计算与语言 · 计算机科学 2026-04-22 Jonas Waldendorf , Bashar Awwad Shiekh Hasan , Evgenii Tsymbalov

Video Large Language Models (VideoLLMs) have shown remarkable progress in video understanding. However, these models still struggle to effectively perceive and exploit rich temporal information in videos when responding to user queries.…

计算机视觉与模式识别 · 计算机科学 2025-12-05 Chang-Hsun Wu , Kai-Po Chang , Yu-Yang Sheng , Hung-Kai Chung , Kuei-Chun Wang , Yu-Chiang Frank Wang

Large vision-language models (LVLMs) often hallucinate content that is fluent yet unsupported by the image, limiting their reliability in real-world deployment. We show that a key failure mode arises from route competition: even when visual…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Zhe Cheng , Wenyu Chen , Fode Zhang , Dehuan Shen

Hallucinations in Large Language Models (LLMs) -- generations that are plausible but factually unfaithful -- remain a critical barrier to high-stakes deployment. Current detection methods typically rely on computationally expensive external…

人工智能 · 计算机科学 2026-01-23 Manish Bhatt