中文
相关论文

相关论文: Kestrel: Grounding Self-Refinement for LVLM Halluc…

200 篇论文

Multimodal Diffusion Large Language Models (MDLLMs) achieve high-concurrency generation through parallel masked decoding, yet the architectures remain prone to multimodal hallucinations. This structural vulnerability stems from an…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Vishal Narnaware , Animesh Gupta , Kevin Zhai , Zhenyi Wang , Mubarak Shah

Large Vision-Language Models (LVLMs) have recently achieved remarkable success. However, LVLMs are still plagued by the hallucination problem, which limits the practicality in many scenarios. Hallucination refers to the information of…

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in visual understanding and multimodal reasoning. However, LVLMs frequently exhibit hallucination phenomena, manifesting as the generated textual responses that…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Ziyun Dai , Xiaoqiang Li , Shaohua Zhang , Yuanchen Wu , Jide Li

Reinforcement learning has recently improved the reasoning ability of Large Language Models and Multimodal LLMs, yet prevailing reward designs emphasise final-answer correctness and consequently tolerate process hallucinations--cases where…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Yantao Li , Qiang Hui , Chenyang Yan , Kanzhi Cheng , Fang Zhao , Chao Tan , Huanling Gao , Jianbing Zhang , Kai Wang , Xinyu Dai , Shiguo Lian

Despite the remarkable ability of large vision-language models (LVLMs) in image comprehension, these models frequently generate plausible yet factually incorrect responses, a phenomenon known as hallucination.Recently, in large language…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Xiaoye Qu , Qiyuan Chen , Wei Wei , Jishuo Sun , Jianfeng Dong

Large Vision-Language Models (LVLMs) usually generate texts which satisfy context coherence but don't match the visual input. Such a hallucination issue hinders LVLMs' applicability in the real world. The key to solving hallucination in…

计算机视觉与模式识别 · 计算机科学 2025-08-20 Nanxing Hu , Xiaoyue Duan , Jinchao Zhang , Guoliang Kang

Large Vision-Language Models (LVLMs) have demonstrated remarkable advancements in numerous areas such as multimedia. However, hallucination issues significantly limit their credibility and application potential. Existing mitigation methods…

机器学习 · 计算机科学 2025-08-20 Wenhao Li , Xiu Su , Jingyi Wu , Feng Yang , Yang Liu , Yi Chen , Shan You , Chang Xu

Inspired by the superior language abilities of large language models (LLM), large vision-language models (LVLM) have been recently explored by integrating powerful LLMs for improving the performance on complex multimodal tasks. Despite the…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Yifan Li , Yifan Du , Kun Zhou , Jinpeng Wang , Wayne Xin Zhao , Ji-Rong Wen

Context-grounded hallucinations are cases where model outputs contain information not verifiable against the source text. We study the applicability of LLMs for localizing such hallucinations, as a more practical alternative to existing…

计算与语言 · 计算机科学 2025-09-30 Yehonatan Peisakhovsky , Zorik Gekhman , Yosi Mass , Liat Ein-Dor , Roi Reichart

Large language models (LLMs) can be prone to hallucinations - generating unreliable outputs that are unfaithful to their inputs, external facts or internally inconsistent. In this work, we address several challenges for post-hoc…

计算与语言 · 计算机科学 2024-08-12 Simon Valentin , Jinmiao Fu , Gianluca Detommaso , Shaoyuan Xu , Giovanni Zappella , Bryan Wang

Large vision-language models (LVLMs) achieve strong performance on visual reasoning tasks but remain highly susceptible to hallucination. Existing detection methods predominantly rely on coarse, whole-image measures of how an object token…

Large Vision-Language Models have demonstrated exceptional performance in multimodal reasoning and complex scene understanding. However, these models still face significant hallucination issues, where outputs contradict visual facts. Recent…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Wei Suo , Hanzu Zhang , Lijun Zhang , Ji Ma , Peng Wang , Yanning Zhang

Large Vision-Language Models (LVLMs) increasingly rely on retrieval to answer knowledge-intensive multimodal questions. Existing benchmarks overlook conflicts between visual and textual evidence and the importance of generating deflections…

计算与语言 · 计算机科学 2026-04-15 Nicholas Moratelli , Christopher Davis , Leonardo F. R. Ribeiro , Bill Byrne , Gonzalo Iglesias

Large Language Models (LLMs) have gained significant popularity for their impressive performance across diverse fields. However, LLMs are prone to hallucinate untruthful or nonsensical outputs that fail to meet user expectations in many…

计算与语言 · 计算机科学 2023-11-23 Tianhang Zhang , Lin Qiu , Qipeng Guo , Cheng Deng , Yue Zhang , Zheng Zhang , Chenghu Zhou , Xinbing Wang , Luoyi Fu

Hallucination remains a major challenge for the safe and trustworthy deployment of large language models (LLMs) in factual content generation. Prior work has explored confidence estimation as an effective approach to hallucination…

计算与语言 · 计算机科学 2026-05-15 Caiqi Zhang , Xiaochen Zhu , Chengzu Li , Nigel Collier , Andreas Vlachos

While Multimodal Large Language Models (MLLMs) have achieved remarkable success across diverse tasks, their practical deployment is severely hindered by hallucination issues, which become particularly acute during Reinforcement Learning…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Miao Pan , Wangjie Gan , Jintao Chen , Wenqi Zhang , Bing Sun , Jianwei Yin , Xuhong Zhang

Large Vision-Language Models (LVLMs) have experienced significant advancements in recent years. However, their performance still falls short in tasks requiring deep visual perception, such as identifying subtle differences between images. A…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Qingguo Hu , Ante Wang , Jia Song , Delai Qiu , Qingsong Liu , Jinsong Su

Current Large Multimodal Models (LMMs) achieve remarkable progress, yet there remains significant uncertainty regarding their ability to accurately apprehend visual details, that is, in performing detailed captioning. To address this, we…

计算机视觉与模式识别 · 计算机科学 2024-04-01 Bohan Zhai , Shijia Yang , Chenfeng Xu , Sheng Shen , Kurt Keutzer , Chunyuan Li , Manling Li

Advancements in Large Vision-Language Models (LVLMs) have demonstrated promising performance in a variety of vision-language tasks involving image-conditioned free-form text generation. However, growing concerns about hallucinations in…

机器学习 · 计算机科学 2025-03-03 Zhuohang Li , Chao Yan , Nicholas J. Jackson , Wendi Cui , Bo Li , Jiaxin Zhang , Bradley A. Malin

Large Vision-Language Models (LVLMs) excel in diverse cross-modal tasks. However, object hallucination, where models produce plausible but inaccurate object descriptions, remains a significant challenge. In contrast to previous work…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Yiyang Huang , Liang Shi , Yitian Zhang , Yi Xu , Yun Fu