中文
相关论文

相关论文: Alleviating Hallucination in Large Vision-Language…

200 篇论文

Hallucination is a major concern in LLM-driven service systems, necessitating explicit knowledge grounding for compliance-guaranteed responses. In this paper, we introduce Retrieval-Augmented Learning-to-Match (RAL2M), a novel framework…

计算与语言 · 计算机科学 2026-01-07 Mengze Hong , Di Jiang , Jiangtao Wen , Zhiyang Su , Yawen Li , Yanjie Sun , Guan Wang , Chen Jason Zhang

The troubling rise of hallucination presents perhaps the most significant impediment to the advancement of responsible AI. In recent times, considerable research has focused on detecting and mitigating hallucination in Large Language Models…

人工智能 · 计算机科学 2024-04-02 Anku Rani , Vipula Rawte , Harshad Sharma , Neeraj Anand , Krishnav Rajbangshi , Amit Sheth , Amitava Das

Visual hallucinations in Large Language Models (LLMs), where the model generates responses that are inconsistent with the visual input, pose a significant challenge to their reliability, particularly in contexts where precise and…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Nokimul Hasan Arif , Shadman Rabby , Md Hefzul Hossain Papon , Sabbir Ahmed

Recent studies have shown that Vision Language Large Models (VLLMs) may output content not relevant to the input images. This problem, called the hallucination phenomenon, undoubtedly degrades VLLM performance. Therefore, various…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Minyi Zhao , Jie Wang , Zhaoyang Li , Jiyuan Zhang , Zhenbang Sun , Shuigeng Zhou

Difficult decision-making problems abound in various disciplines and domains. The proliferation of generative techniques, especially large language models (LLMs), has excited interest in using them for decision support. However, LLMs cannot…

人工智能 · 计算机科学 2025-09-16 Boris Kovalerchuk , Brent D. Fegley

Instruction-following Vision Large Language Models (VLLMs) have achieved significant progress recently on a variety of tasks. These approaches merge strong pre-trained vision models and large language models (LLMs). Since these components…

机器学习 · 计算机科学 2024-02-20 Yiyang Zhou , Chenhang Cui , Rafael Rafailov , Chelsea Finn , Huaxiu Yao

Vision-language models (VLMs) frequently generate hallucinated content plausible but incorrect claims about image content. We propose a training-free self-correction framework enabling VLMs to iteratively refine responses through…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Kassoum Sanogo , Renzo Ardiccioni

Retriever Augmented Generation (RAG) systems have become pivotal in enhancing the capabilities of language models by incorporating external knowledge retrieval mechanisms. However, a significant challenge in deploying these systems in…

计算与语言 · 计算机科学 2024-06-06 Masha Belyi , Robert Friel , Shuai Shao , Atindriyo Sanyal

Hallucination, posed as a pervasive challenge of multi-modal large language models (MLLMs), has significantly impeded their real-world usage that demands precise judgment. Existing methods mitigate this issue with either training with…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Qidong Huang , Xiaoyi Dong , Pan Zhang , Bin Wang , Conghui He , Jiaqi Wang , Dahua Lin , Weiming Zhang , Nenghai Yu

This research work delves into the manifestation of hallucination within Large Language Models (LLMs) and its consequential impacts on applications within the domain of mental health. The primary objective is to discern effective strategies…

计算与语言 · 计算机科学 2024-10-16 Abdul Muqtadir , Hafiz Syed Muhammad Bilal , Ayesha Yousaf , Hafiz Farooq Ahmed , Jamil Hussain

Large vision-language models (LVLMs) have demonstrated remarkable multimodal comprehension and reasoning capabilities, but they still suffer from severe object hallucination. Previous studies primarily attribute the flaw to linguistic prior…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Haohan Zheng , Zhenguo Zhang

Large Language Models (LLMs) exhibit remarkable capabilities in natural language understanding and reasoning, but suffer from hallucination: the generation of factually incorrect content. While numerous methods have been developed to reduce…

Large Vision-Language Models have demonstrated exceptional performance in multimodal reasoning and complex scene understanding. However, these models still face significant hallucination issues, where outputs contradict visual facts. Recent…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Wei Suo , Hanzu Zhang , Lijun Zhang , Ji Ma , Peng Wang , Yanning Zhang

Large Vision Language Models (LVLMs) have recently achieved superior performance in various tasks on natural image and text data, which inspires a large amount of studies for LVLMs fine-tuning and training. Despite their advancements, there…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Zishan Gu , Changchang Yin , Fenglin Liu , Ping Zhang

Large Vision-Language Models (LVLMs) have made significant progress in recent years but are also prone to hallucination issues. They exhibit more hallucinations in longer, free-form responses, often attributed to accumulated uncertainties.…

计算机视觉与模式识别 · 计算机科学 2025-10-24 Ge Zheng , Jiaye Qian , Jiajin Tang , Sibei Yang

Inference time scaling drives extended reasoning to enhance the performance of Vision-Language Models (VLMs), thus forming powerful Vision-Language Reasoning Models (VLRMs). However, long reasoning dilutes visual tokens, causing visual…

计算机视觉与模式识别 · 计算机科学 2025-06-02 Xu Chu , Xinrong Chen , Guanyu Wang , Zhijie Tan , Kui Huang , Wenyu Lv , Tong Mo , Weiping Li

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

计算与语言 · 计算机科学 2025-09-19 Martin Preiß

Is automated hallucination detection possible? In this work, we introduce a theoretical framework to analyze the feasibility of automatically detecting hallucinations produced by large language models (LLMs). Inspired by the classical…

机器学习 · 计算机科学 2025-06-03 Amin Karbasi , Omar Montasser , John Sous , Grigoris Velegkas

Hallucination poses a challenge to the deployment of large vision-language models (LVLMs) in applications. Unlike in large language models (LLMs), hallucination in LVLMs often arises from misalignments between visual inputs and textual…

计算机视觉与模式识别 · 计算机科学 2024-10-23 Sheng Liu , Haotian Ye , Lei Xing , James Zou

Retrieval Augmented Generation (RAG) has emerged as a promising solution to address hallucination issues in Large Language Models (LLMs). However, the integration of multiple retrieval sources, while potentially more informative, introduces…

信息检索 · 计算机科学 2025-08-12 Wenlong Wu , Haofen Wang , Bohan Li , Peixuan Huang , Xinzhe Zhao , Lei Liang