中文
相关论文

相关论文: Understanding Multimodal Hallucination with Parame…

200 篇论文

Large vision language models (LVLMs) often suffer from object hallucination, producing objects not present in the given images. While current benchmarks for object hallucination primarily concentrate on the presence of a single object class…

计算机视觉与模式识别 · 计算机科学 2024-11-04 Xuweiyi Chen , Ziqiao Ma , Xuejun Zhang , Sihan Xu , Shengyi Qian , Jianing Yang , David F. Fouhey , Joyce Chai

Large Vision-Language Models (LVLMs) suffer from hallucination issues, wherein the models generate plausible-sounding but factually incorrect outputs, undermining their reliability. A comprehensive quantitative evaluation is necessary to…

计算与语言 · 计算机科学 2024-10-07 Haoyi Qiu , Wenbo Hu , Zi-Yi Dou , Nanyun Peng

Recent advancements in multimodal large language models (MLLMs) have shown unprecedented capabilities in advancing various vision-language tasks. However, MLLMs face significant challenges with hallucinations, and misleading outputs that do…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Shengqiong Wu , Hao Fei , Liangming Pan , William Yang Wang , Shuicheng Yan , Tat-Seng Chua

Large vision-language models (LVLMs) suffer from hallucination a lot, generating responses that apparently contradict to the image content occasionally. The key problem lies in its weak ability to comprehend detailed content in a…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Zhiyang Chen , Yousong Zhu , Yufei Zhan , Zhaowen Li , Chaoyang Zhao , Jinqiao Wang , Ming Tang

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

Multimodal Large Language Models (MLLMs) have made significant progress in bridging the gap between visual and language modalities. However, hallucinations in MLLMs, where the generated text does not align with image content, continue to be…

人工智能 · 计算机科学 2024-08-05 Kohou Wang , Xiang Liu , Zhaoxiang Liu , Kai Wang , Shiguo Lian

Multimodal Large Language Models (MLLMs) have demonstrated strong performance in visual understanding tasks, yet they often suffer from object hallucinations--generating descriptions of objects that are inconsistent with or entirely absent…

人工智能 · 计算机科学 2025-05-27 Xinmiao Hu , Chun Wang , Ruihe An , ChenYu Shao , Xiaojun Ye , Sheng Zhou , Liangcheng Li

Instruction-following Vision Large Language Models (VLLMs) have achieved significant progress recently on a variety of tasks. These approaches merge strong pre-trained vision models and large language models (LLMs). Since these components…

机器学习 · 计算机科学 2024-02-20 Yiyang Zhou , Chenhang Cui , Rafael Rafailov , Chelsea Finn , Huaxiu Yao

Although demonstrating superb performance on various NLP tasks, large language models (LLMs) still suffer from the hallucination problem, which threatens the reliability of LLMs. To measure the level of hallucination of LLMs, previous works…

人工智能 · 计算机科学 2023-09-12 Li Du , Yequan Wang , Xingrun Xing , Yiqun Ya , Xiang Li , Xin Jiang , Xuezhi Fang

Multimodal Large Language Models (MLLMs) deliver detailed responses on vision-language tasks, yet remain susceptible to object hallucination (introducing objects not present in the image), undermining reliability in practice. Prior efforts…

机器学习 · 计算机科学 2026-02-26 Shiwei Tan , Hengyi Wang , Weiyi Qin , Qi Xu , Zhigang Hua , Hao Wang

Multimodal large language models (MLLMs) have attracted increasing attention in the past few years, but they may still generate descriptions that include objects not present in the corresponding images, a phenomenon known as object…

计算与语言 · 计算机科学 2024-09-24 Shangyu Xing , Fei Zhao , Zhen Wu , Tuo An , Weihao Chen , Chunhui Li , Jianbing Zhang , Xinyu Dai

Multimodal large reasoning models (MLRMs) often suffer from hallucinations that stem not only from insufficient visual grounding but also from imbalanced allocation between perception and reasoning processes. Building upon recent…

人工智能 · 计算机科学 2026-03-10 Haolang Lu , Bolun Chu , WeiYe Fu , Guoshun Nan , Junning Liu , Minghui Pan , Qiankun Li , Yi Yu , Hua Wang , Kun Wang

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

人工智能 · 计算机科学 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

Multi-modal large language models (MLLMs) have been shown to efficiently integrate natural language with visual information to handle multi-modal tasks. However, MLLMs still face a fundamental limitation of hallucinations, where they tend…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Chaoya Jiang , Haiyang Xu , Mengfan Dong , Jiaxing Chen , Wei Ye , Ming Yan , Qinghao Ye , Ji Zhang , Fei Huang , Shikun Zhang

Large Vision-Language Models (LVLMs) have achieved impressive performance, yet research has pointed out a serious issue with object hallucinations within these models. However, there is no clear conclusion as to which part of the model…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Yufang Liu , Tao Ji , Changzhi Sun , Yuanbin Wu , Aimin Zhou

Recently, 3D-LLMs, which combine point-cloud encoders with large models, have been proposed to tackle complex tasks in embodied intelligence and scene understanding. In addition to showing promising results on 3D tasks, we found that they…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Ruiying Peng , Kaiyuan Li , Weichen Zhang , Chen Gao , Xinlei Chen , Yong Li

While Large Language Models (LLMs) have emerged as powerful foundational models to solve a variety of tasks, they have also been shown to be prone to hallucinations, i.e., generating responses that sound confident but are actually incorrect…

计算与语言 · 计算机科学 2026-04-29 Jiawei Li , Akshayaa Magesh , Venugopal V. Veeravalli

Multi-modal Large Language Models (MLLMs) have demonstrated remarkable performance on various visual-language understanding and generation tasks. However, MLLMs occasionally generate content inconsistent with the given images, which is…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Peng Ding , Jingyu Wu , Jun Kuang , Dan Ma , Xuezhi Cao , Xunliang Cai , Shi Chen , Jiajun Chen , Shujian Huang

Large Vision-Language Models (LVLMs) have shown remarkable performance on many visual-language tasks. However, these models still suffer from multimodal hallucination, which means the generation of objects or content that violates the…

计算与语言 · 计算机科学 2024-10-01 Fan Yuan , Chi Qin , Xiaogang Xu , Piji Li

Context-grounded hallucinations are cases where model outputs contain information not verifiable against the source text. We study the applicability of LLMs for localizing such hallucinations, as a more practical alternative to existing…

计算与语言 · 计算机科学 2025-09-30 Yehonatan Peisakhovsky , Zorik Gekhman , Yosi Mass , Liat Ein-Dor , Roi Reichart