中文
相关论文

相关论文: Kestrel: Grounding Self-Refinement for LVLM Halluc…

200 篇论文

Hallucinations in Large Language Models (LLMs) pose a significant challenge, generating misleading or unverifiable content that undermines trust and reliability. Existing evaluation methods, such as KnowHalu, employ multi-stage verification…

计算与语言 · 计算机科学 2026-04-10 Chenggong Zhang , Haopeng Wang , Hexi Meng

Hallucinations in large vision-language models (LVLMs) pose significant challenges for real-world applications, as LVLMs may generate responses that appear plausible yet remain inconsistent with the associated visual content. This issue…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Xin Dong , Shichao Dong , Jin Wang , Jing Huang , Li Zhou , Zenghui Sun , Lihua Jing , Jingsong Lan , Xiaoyong Zhu , Bo Zheng

Hallucinations in vision-language models pose a significant challenge to their reliability, particularly in the generation of long captions. Current methods fall short of accurately identifying and mitigating these hallucinations. To…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Minchan Kim , Minyeong Kim , Junik Bae , Suhwan Choi , Sungkyung Kim , Buru Chang

Hallucinations in Large Language Models (LLMs) -- generations that are plausible but factually unfaithful -- remain a critical barrier to high-stakes deployment. Current detection methods typically rely on computationally expensive external…

人工智能 · 计算机科学 2026-01-23 Manish Bhatt

Recent research highlights the potential of multimodal foundation models in tackling complex decision-making challenges. However, their large parameters make real-world deployment resource-intensive and often impractical for constrained…

机器学习 · 计算机科学 2025-05-19 Donghoon Lee , Tung M. Luu , Younghwan Lee , Chang D. Yoo

Large language models can generate solutions to complex problems, but training them with reinforcement learning typically requires verifiable rewards that are expensive to create and not possible for all domains. We demonstrate that LLMs…

机器学习 · 计算机科学 2025-08-08 Toby Simonds , Kevin Lopez , Akira Yoshiyama , Dominique Garmier

Large Vision-Language Models (LVLMs) face a fundamental dilemma in video reasoning: they are caught between the prohibitive computational costs of verbose reasoning and the hallucination risks of efficient, ungrounded approaches. To resolve…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Yanxiang Huang , Guohua Gao , Zhaoyang Wei , Jianyuan Ni

Existing hallucination detection methods for large language models (LLMs) rely on external verification at inference time, requiring gold answers, retrieval systems, or auxiliary judge models. We ask whether this external supervision can…

Large Vision-Language Models (LVLMs) exhibit strong multimodal capabilities but remain vulnerable to hallucinations from intrinsic errors and adversarial attacks from external exploitations, limiting their reliability in real-world…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Chung-En Johnny Yu , Brian Jalaian , Nathaniel D. Bastian

Multimodal Large Language Models (MLLMs) rely on strong linguistic reasoning inherited from their base language models. However, multimodal instruction fine-tuning paradoxically degrades this text's reasoning capability, undermining…

Large language models excel at complex tasks by breaking down problems into structured reasoning steps. However, reasoning traces often extend beyond reaching a correct answer, causing wasted computation, reduced readability, and…

计算与语言 · 计算机科学 2025-05-26 Razvan-Gabriel Dumitru , Darius Peteleaza , Vikas Yadav , Liangming Pan

In large vision-language models, visual tokens typically constitute the majority of input tokens, leading to substantial computational overhead. To address this, recent studies have explored pruning redundant or less informative visual…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Sangin Lee , Yukyung Choi

Despite rapid progress, pretrained vision-language models still struggle when answers depend on tiny visual details or on combining clues spread across multiple regions, as in documents and compositional queries. We address this by framing…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Marcel Gröpl , Jaewoo Jung , Seungryong Kim , Marc Pollefeys , Sunghwan Hong

Spatial understanding remains a weakness of Large Vision-Language Models (LVLMs). Existing supervised fine-tuning (SFT) and recent reinforcement learning with verifiable rewards (RLVR) pipelines depend on costly supervision, specialized…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Yuhong Liu , Beichen Zhang , Yuhang Zang , Yuhang Cao , Long Xing , Xiaoyi Dong , Haodong Duan , Dahua Lin , Jiaqi Wang

This work introduces a novel methodology for the automatic detection of hallucinations generated during large language model (LLM) inference. The proposed approach is based on a systematic taxonomy and controlled reproduction of diverse…

计算与语言 · 计算机科学 2025-10-08 Maksym Zavhorodnii , Dmytro Dehtiarov , Anna Konovalenko

Multimodal large reasoning models (MLRMs) often suffer from hallucinations that stem not only from insufficient visual grounding but also from imbalanced allocation between perception and reasoning processes. Building upon recent…

人工智能 · 计算机科学 2026-03-10 Haolang Lu , Bolun Chu , WeiYe Fu , Guoshun Nan , Junning Liu , Minghui Pan , Qiankun Li , Yi Yu , Hua Wang , Kun Wang

To mitigate hallucinations in large language models (LLMs), we propose a framework that focuses on errors induced by prompts. Our method extends a chain-style knowledge distillation approach by incorporating a programmable module that…

计算与语言 · 计算机科学 2026-01-08 Jinbo Hao , Kai Yang , Qingzhen Su , Yifan Li , Chao Jiang

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse applications, from open-domain question answering to scientific writing, medical decision support, and legal analysis. However, their tendency to generate…

计算与语言 · 计算机科学 2025-12-30 Diyana Muhammed , Giusy Giulia Tuccari , Gollam Rabby , Sören Auer , Sahar Vahdati

Large vision-language models (LVLMs) often hallucinate content that is fluent yet unsupported by the image, limiting their reliability in real-world deployment. We show that a key failure mode arises from route competition: even when visual…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Zhe Cheng , Wenyu Chen , Fode Zhang , Dehuan Shen

The growing integration of vision-language models (VLMs) in medical applications offers promising support for diagnostic reasoning. However, current medical VLMs often face limitations in generalization, transparency, and computational…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Tan-Hanh Pham , Chris Ngo