中文
相关论文

相关论文: TruthPrInt: Mitigating Large Vision-Language Model…

200 篇论文

Large language models (LLMs) have achieved a degree of success in generating coherent and contextually relevant text, yet they remain prone to a significant challenge known as hallucination: producing information that is not substantiated…

计算与语言 · 计算机科学 2024-10-28 Ray Li , Tanishka Bagade , Kevin Martinez , Flora Yasmin , Grant Ayala , Michael Lam , Kevin Zhu

Despite progress in Large Vision Language Models (LVLMs), object hallucination remains a critical issue in image captioning task, where models generate descriptions of non-existent objects, compromising their reliability. Previous work…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Shiyu Liu , Xinyi Wen , Zhibin Lan , Ante Wang , Jinsong Su

Object hallucination has been an Achilles' heel which hinders the broader applications of large vision-language models (LVLMs). Object hallucination refers to the phenomenon that the LVLMs claim non-existent objects in the image. To…

计算机视觉与模式识别 · 计算机科学 2024-07-01 Junfei Wu , Qiang Liu , Ding Wang , Jinghao Zhang , Shu Wu , Liang Wang , Tieniu Tan

Large Vision-Language Models (LVLMs) have achieved remarkable success but continue to struggle with object hallucination (OH), generating outputs inconsistent with visual inputs. While previous work has proposed methods to reduce OH, the…

计算机视觉与模式识别 · 计算机科学 2025-05-26 Boxu Chen , Ziwei Zheng , Le Yang , Zeyu Geng , Zhengyu Zhao , Chenhao Lin , Chao Shen

Language models (LMs) hallucinate. We inquire: Can we detect and mitigate hallucinations before they happen? This work answers this research question in the positive, by showing that the internal representations of LMs provide rich signals…

计算与语言 · 计算机科学 2025-06-26 Deema Alnuhait , Neeraja Kirtane , Muhammad Khalifa , Hao Peng

Large-scale vision-language pre-trained (VLP) models are prone to hallucinate non-existent visual objects when generating text based on visual information. In this paper, we systematically study the object hallucination problem from three…

计算与语言 · 计算机科学 2023-02-13 Wenliang Dai , Zihan Liu , Ziwei Ji , Dan Su , Pascale Fung

Recent studies have shown that large vision-language models (LVLMs) often suffer from the issue of object hallucinations (OH). To mitigate this issue, we introduce an efficient method that edits the model weights based on an unsafe…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Le Yang , Ziwei Zheng , Boxu Chen , Zhengyu Zhao , Chenhao Lin , Chao Shen

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

计算与语言 · 计算机科学 2025-09-19 Martin Preiß

Large language models (LLMs), despite their powerful capabilities, suffer from factual hallucinations where they generate verifiable falsehoods. We identify a root of this issue: the imbalanced data distribution in the pretraining corpus,…

计算与语言 · 计算机科学 2026-02-03 Langming Liu , Kangtao Lv , Haibin Chen , Weidong Zhang , Yejing Wang , Shilei Liu , Xin Tong , Yujin Yuan , Yongwei Wang , Wenbo Su , Bo Zheng

Multimodal Large Language Models (MLLMs) have recently demonstrated impressive capabilities in multimodal understanding, reasoning, and interaction. However, existing MLLMs prevalently suffer from serious hallucination problems, generating…

计算与语言 · 计算机科学 2024-03-11 Tianyu Yu , Yuan Yao , Haoye Zhang , Taiwen He , Yifeng Han , Ganqu Cui , Jinyi Hu , Zhiyuan Liu , Hai-Tao Zheng , Maosong Sun , Tat-Seng Chua

Large vision-language models (LVLMs) have recently dramatically pushed the state of the art in image captioning and many image understanding tasks (e.g., visual question answering). LVLMs, however, often \textit{hallucinate} and produce…

计算机视觉与模式识别 · 计算机科学 2024-06-21 Gregor Geigle , Radu Timofte , Goran Glavaš

Large vision-language models (LVLMs) suffer from hallucination a lot, generating responses that apparently contradict to the image content occasionally. The key problem lies in its weak ability to comprehend detailed content in a…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Zhiyang Chen , Yousong Zhu , Yufei Zhan , Zhaowen Li , Chaoyang Zhao , Jinqiao Wang , Ming Tang

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance in complex multimodal tasks. However, these models still suffer from hallucinations, particularly when required to implicitly recognize or infer diverse visual…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Ashish Seth , Dinesh Manocha , Chirag Agarwal

While large language models (LLMs) have demonstrated remarkable abilities across various fields, hallucination remains a significant challenge. Recent studies have explored hallucinations through the lens of internal representations,…

计算与语言 · 计算机科学 2024-12-30 Junteng Liu , Shiqi Chen , Yu Cheng , Junxian He

Large vision-language models (LVLMs) have demonstrated remarkable multimodal comprehension and reasoning capabilities, but they still suffer from severe object hallucination. Previous studies primarily attribute the flaw to linguistic prior…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Haohan Zheng , Zhenguo Zhang

Multimodal Large Language Models (MLLMs) excel in numerous vision-language tasks yet suffer from hallucinations, producing content inconsistent with input visuals, that undermine reliability in precision-sensitive domains. This issue stems…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Nan Sun , Zhenyu Zhang , Xixun Lin , Kun Wang , Yanmin Shang , Naibin Gu , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang , Yanan Cao

While large language models (LLMs) have demonstrated increasing power, they have also called upon studies on their hallucinated outputs that deviate from factually correct statements. In this paper, we focus on one important scenario of…

计算与语言 · 计算机科学 2025-01-23 Nan Xu , Xuezhe Ma

Large Vision-Language Models (LVLMs) bridge the gap between visual and linguistic modalities, demonstrating strong potential across a variety of domains. However, despite significant progress, LVLMs still suffer from severe hallucination…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Ruiqi Ma , Yu Yan , Chunhong Zhang , Minghao Yin , XinChao Liu , Zhihong Jin , Zheng Hu

Large language models (LLMs) frequently hallucinate and produce factual errors, yet our understanding of why they make these errors remains limited. In this study, we delve into the underlying mechanisms of LLM hallucinations from the…

计算与语言 · 计算机科学 2024-03-13 Shiqi Chen , Miao Xiong , Junteng Liu , Zhengxuan Wu , Teng Xiao , Siyang Gao , Junxian He

Large language models (LLMs) have shown remarkable performance in natural language processing (NLP) tasks. To comprehend and execute diverse human instructions over image data, instruction-tuned large vision-language models (LVLMs) have…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Lei Wang , Jiabang He , Shenshen Li , Ning Liu , Ee-Peng Lim