English
Related papers

Related papers: Mitigating Hallucinations via Inter-Layer Consiste…

200 papers

Recent advancements in Multimodal Large Language Models (MLLMs) have enabled them to effectively integrate vision and language, addressing a variety of downstream tasks. However, despite their significant success, these models still exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Zixian Gao , Chao Yang , Zhanhui Zhou , Xing Xu , Chaochao Lu

Despite their significant advancements, Multimodal Large Language Models (MLLMs) often generate factually inaccurate information, referred to as hallucination. In this work, we address object hallucinations in MLLMs, where information is…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Pritam Sarkar , Sayna Ebrahimi , Ali Etemad , Ahmad Beirami , Sercan Ö. Arık , Tomas Pfister

Hallucinations in Multimodal Large Language Models (MLLMs) where generated responses fail to accurately reflect the given image pose a significant challenge to their reliability. To address this, we introduce ConVis, a novel training-free…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Yeji Park , Deokyeong Lee , Junsuk Choe , Buru Chang

Large Language Models (LLMs) have demonstrated exceptional performance across various natural language processing tasks. However, they occasionally generate inaccurate and counterfactual outputs, a phenomenon commonly referred to as…

Computation and Language · Computer Science 2025-06-04 Dingwei Chen , Feiteng Fang , Shiwen Ni , Feng Liang , Xiping Hu , Ahmadreza Argha , Hamid Alinejad-Rokny , Min Yang , Chengming Li

Large vision-language models (LVLMs) have achieved remarkable performance across diverse multimodal tasks, yet they continue to suffer from hallucinations, generating content that is inconsistent with the visual input. Prior work DHCP…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Wei Ding , Yilin Li , Yudong Zhang , Ruobing Xie , Xingwu Sun , Jiansheng Chen , Yu Wang

Although Large Visual Language Models (LVLMs) have demonstrated exceptional abilities in understanding multimodal data, they invariably suffer from hallucinations, leading to a disconnect between the generated text and the corresponding…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Xinyu Lyu , Beitao Chen , Lianli Gao , Jingkuan Song , Heng Tao Shen

Large Vision-Language Models have demonstrated exceptional performance in multimodal reasoning and complex scene understanding. However, these models still face significant hallucination issues, where outputs contradict visual facts. Recent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Wei Suo , Hanzu Zhang , Lijun Zhang , Ji Ma , Peng Wang , Yanning Zhang

Recent decoding methods improve the factuality of large language models (LLMs) by refining how the next token is selected during generation. These methods typically operate at the token level, leveraging internal representations to suppress…

Computation and Language · Computer Science 2025-09-16 Hongxiang Zhang , Hao Chen , Muhao Chen , Tianyi Zhang

Recent methodologies utilizing synthetic datasets have aimed to address inconsistent hallucinations in large language models (LLMs); however,these approaches are primarily tailored to specific tasks, limiting their generalizability.…

Artificial Intelligence · Computer Science 2025-02-28 Xinxin You , Xien Liu , Qixin Sun , Huan Zhang , Kaiyin Zhou , Shaohui Liu , GuoPing Hu , ShiJin Wang , Si Liu , Ji Wu

Large language models (LLMs) demonstrate strong capabilities in natural language processing but remain prone to hallucinations, generating factually incorrect or fabricated content. This issue undermines their reliability, particularly in…

Computation and Language · Computer Science 2025-02-19 Cheng Peng Huang , Hao-Yuan Chen

Multimodal Diffusion Large Language Models (MDLLMs) achieve high-concurrency generation through parallel masked decoding, yet the architectures remain prone to multimodal hallucinations. This structural vulnerability stems from an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Vishal Narnaware , Animesh Gupta , Kevin Zhai , Zhenyi Wang , Mubarak Shah

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in visual understanding and multimodal reasoning. However, LVLMs frequently exhibit hallucination phenomena, manifesting as the generated textual responses that…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Ziyun Dai , Xiaoqiang Li , Shaohua Zhang , Yuanchen Wu , Jide Li

Multimodal large language models (MLLMs) have achieved remarkable success across diverse vision-language tasks, yet they remain highly susceptible to hallucinations, producing content that is fluent but inconsistent with visual evidence.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Youxu Shi , Suorong Yang , Dong Liu

Large Language Models (LLMs) have become increasingly important in natural language processing, enabling advanced data analytics through natural language queries. However, these models often generate "hallucinations"-inaccurate or…

Computation and Language · Computer Science 2024-10-29 Mikhail Rumiantsau , Aliaksei Vertsel , Ilya Hrytsuk , Isaiah Ballah

Multimodal Large Language Models (MLLMs) have made significant strides by combining visual recognition and language understanding to generate content that is both coherent and contextually accurate. However, MLLMs continue to struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Haoran Zhou , Zihan Zhang , Hao Chen

As Large Language Models (LLMs) continue to advance in their ability to write human-like text, a key challenge remains around their tendency to hallucinate generating content that appears factual but is ungrounded. This issue of…

Computation and Language · Computer Science 2024-01-09 S. M Towhidul Islam Tonmoy , S M Mehedi Zaman , Vinija Jain , Anku Rani , Vipula Rawte , Aman Chadha , Amitava Das

Hallucination poses a challenge to the deployment of large vision-language models (LVLMs) in applications. Unlike in large language models (LLMs), hallucination in LVLMs often arises from misalignments between visual inputs and textual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Sheng Liu , Haotian Ye , Lei Xing , James Zou

Large Vision-Language Models (LVLMs) have achieved impressive progress in multimodal reasoning, yet they remain prone to object hallucinations, generating descriptions of objects that are not present in the input image. Recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sohyeon Kim , Sang Yeon Yoon , Kyeongbo Kong

The development of Large Language Models (LLMs) has significantly advanced various AI applications in commercial and scientific research fields, such as scientific literature summarization, writing assistance, and knowledge graph…

Computation and Language · Computer Science 2024-10-17 Huiwen Wu , Xiaohan Li , Xiaogang Xu , Jiafei Wu , Deyi Zhang , Zhe Liu

Large Vision-Language Models (LVLMs) have advanced considerably, intertwining visual recognition and language understanding to generate content that is not only coherent but also contextually attuned. Despite their success, LVLMs still…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Sicong Leng , Hang Zhang , Guanzheng Chen , Xin Li , Shijian Lu , Chunyan Miao , Lidong Bing