中文
相关论文

相关论文: SAVAA: Mitigating Hallucinations in LVLMs via Step…

200 篇论文

Large Vision-Language Models (LVLMs) are an extension of Large Language Models (LLMs) that facilitate processing both image and text inputs, expanding AI capabilities. However, LVLMs struggle with object hallucinations due to their reliance…

计算与语言 · 计算机科学 2024-08-12 Avshalom Manevich , Reut Tsarfaty

Recent studies have shown that Vision Language Large Models (VLLMs) may output content not relevant to the input images. This problem, called the hallucination phenomenon, undoubtedly degrades VLLM performance. Therefore, various…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Minyi Zhao , Jie Wang , Zhaoyang Li , Jiyuan Zhang , Zhenbang Sun , Shuigeng Zhou

Vision-Language Models (VLMs) have advanced multi-modal tasks like image captioning, visual question answering, and reasoning. However, they often generate hallucinated outputs inconsistent with the visual context or prompt, limiting…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Shawn Li , Jiashu Qu , Yuxiao Zhou , Yuehan Qin , Tiankai Yang , Yue Zhao

While multi-modal large language models (MLLMs) have made significant progress in recent years, the issue of hallucinations remains a major challenge. To mitigate this phenomenon, existing solutions either introduce additional data for…

计算机视觉与模式识别 · 计算机科学 2025-10-23 Fengyuan Sun , Hui Chen , Xinhao Xu , Dandan Zheng , Jingdong Chen , Jun Zhou , Jungong Han , Guiguang Ding

Large Vision-Language Models (LVLMs) demonstrate impressive capabilities in generating detailed and coherent responses from visual inputs. However, they are prone to generate hallucinations due to an over-reliance on language priors. To…

人工智能 · 计算机科学 2025-02-20 Kyungmin Min , Minbeom Kim , Kang-il Lee , Dongryeol Lee , Kyomin Jung

Multimodal Large Language Models (MLLMs) mainly fall into two architectures, each involving a trade-off between training and inference efficiency: embedding space alignment (e.g., LLaVA-1.5) is inefficient during inference, while…

计算与语言 · 计算机科学 2025-02-05 Qianhao Yuan , Yanjiang Liu , Yaojie Lu , Hongyu Lin , Ben He , Xianpei Han , Le Sun

To develop trustworthy Vision-Language Models (VLMs), it is essential to address adversarial robustness and hallucination mitigation, both of which impact factual accuracy in high-stakes applications such as defense and healthcare. Existing…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Chung-En , Yu , Hsuan-Chih , Chen , Brian Jalaian , Nathaniel D. Bastian

Video multimodal large language models (Video-MLLMs) have achieved remarkable progress in video understanding. However, they remain vulnerable to hallucination-producing content inconsistent with or unrelated to video inputs. Previous video…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Hao Lu , Jiahao Wang , Yaolun Zhang , Ruohui Wang , Xuanyu Zheng , Yepeng Tang , Dahua Lin , Lewei Lu

Large Vision-Language Model (LVLM) systems have demonstrated impressive vision-language reasoning capabilities but suffer from pervasive and severe hallucination issues, posing significant risks in critical domains such as healthcare and…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Zhehan Kan , Ce Zhang , Zihan Liao , Yapeng Tian , Wenming Yang , Junyuan Xiao , Xu Li , Dongmei Jiang , Yaowei Wang , Qingmin Liao

In this study, we consider the problem of generating visual explanations in visual foundation models. Numerous methods have been proposed for this purpose; however, they often cannot be applied to complex models due to their lack of…

计算机视觉与模式识别 · 计算机科学 2025-09-19 Shinnosuke Hirano , Yuiga Wada , Tsumugi Iida , Komei Sugiura

Multimodal Large Language Models (MLLMs) have recently demonstrated impressive capabilities in multimodal understanding, reasoning, and interaction. However, existing MLLMs prevalently suffer from serious hallucination problems, generating…

计算与语言 · 计算机科学 2024-03-11 Tianyu Yu , Yuan Yao , Haoye Zhang , Taiwen He , Yifeng Han , Ganqu Cui , Jinyi Hu , Zhiyuan Liu , Hai-Tao Zheng , Maosong Sun , Tat-Seng Chua

Hallucinations in large language models (LLMs) pose significant safety concerns that impede their broader deployment. Recent research in hallucination detection has demonstrated that LLMs' internal representations contain truthfulness…

机器学习 · 计算机科学 2025-11-11 Mengjia Niu , Hamed Haddadi , Guansong Pang

Large Vision-Language Models (LVLMs) have made remarkable developments along with the recent surge of large language models. Despite their advancements, LVLMs have a tendency to generate plausible yet inaccurate or inconsistent information…

计算机视觉与模式识别 · 计算机科学 2024-12-23 Dexter Neo , Tsuhan Chen

Despite impressive progress in capabilities of large vision-language models (LVLMs), these systems remain vulnerable to hallucinations, i.e., outputs that are not grounded in the visual input. Prior work has attributed hallucinations in…

计算机视觉与模式识别 · 计算机科学 2026-04-24 Pegah Khayatan , Jayneel Parekh , Arnaud Dapogny , Mustafa Shukor , Alasdair Newson , Matthieu Cord

Multimodal Large Language Models (MLLMs) excel in numerous vision-language tasks yet suffer from hallucinations, producing content inconsistent with input visuals, that undermine reliability in precision-sensitive domains. This issue stems…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Nan Sun , Zhenyu Zhang , Xixun Lin , Kun Wang , Yanmin Shang , Naibin Gu , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang , Yanan Cao

Vision-Language Models (VLMs) have demonstrated remarkable progress in multimodal tasks, but remain susceptible to hallucinations, where generated text deviates from the underlying visual content. Existing hallucination detection methods…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Feiran Zhang , Yixin Wu , Zhenghua Wang , Xiaohua Wang , Changze Lv , Xuanjing Huang , Xiaoqing Zheng

Vision-Language Models (VLMs) have become essential backbones of modern multimodal intelligence, yet their outputs remain prone to hallucination-plausible text misaligned with visual inputs. Existing alignment approaches often rely on…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Kejia Chen , Jiawen Zhang , Jiacong Hu , Kewei Gao , Jian Lou , Zunlei Feng , Mingli Song

Multimodal Large Language Models (MLLMs) have demonstrated strong performance in visual understanding tasks, yet they often suffer from object hallucinations--generating descriptions of objects that are inconsistent with or entirely absent…

人工智能 · 计算机科学 2025-05-27 Xinmiao Hu , Chun Wang , Ruihe An , ChenYu Shao , Xiaojun Ye , Sheng Zhou , Liangcheng Li

Recent advancements in Large Vision-Language Models (LVLMs) have demonstrated significant progress across multiple domains. However, these models still face the inherent challenge of integrating vision and language for collaborative…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Jiabing Yang , Chenhang Cui , Yiyang Zhou , Yixiang Chen , Peng Xia , Ying Wei , Tao Yu , Yan Huang , Liang Wang

Concerns regarding the propensity of Large Language Models (LLMs) to produce inaccurate outputs, also known as hallucinations, have escalated. Detecting them is vital for ensuring the reliability of applications relying on LLM-generated…

计算与语言 · 计算机科学 2024-05-31 Ernesto Quevedo , Jorge Yero , Rachel Koerner , Pablo Rivas , Tomas Cerny