English
Related papers

Related papers: Robust Multimodal Large Language Models Against Mo…

200 papers

Large Vision-Language Models (LVLMs) have achieved impressive performance, yet research has pointed out a serious issue with object hallucinations within these models. However, there is no clear conclusion as to which part of the model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Yufang Liu , Tao Ji , Changzhi Sun , Yuanbin Wu , Aimin Zhou

Large Language Models (LLMs) and Large Reasoning Models (LRMs) offer transformative potential for high-stakes domains like finance and law, but their tendency to hallucinate, generating factually incorrect or unsupported content, poses a…

Artificial Intelligence · Computer Science 2026-01-16 Ahmad Pesaranghader , Erin Li

Large Vision-Language Models (LVLMs) have exhibited impressive capabilities across various visual tasks, yet they remain hindered by the persistent challenge of hallucinations. To address this critical issue, we propose Mixture of Decoding…

Computation and Language · Computer Science 2025-06-11 Xinlong Chen , Yuanxing Zhang , Qiang Liu , Junfei Wu , Fuzheng Zhang , Tieniu Tan

The detection of sophisticated hallucinations in Large Language Models (LLMs) is hampered by a ``Detection Dilemma'': methods probing internal states (Internal State Probing) excel at identifying factual inconsistencies but fail on logical…

Computation and Language · Computer Science 2026-01-09 Yusheng Song , Lirong Qiu , Xi Zhang , Zhihao Tang

Large language models (LLMs) have transformed natural language processing, achieving remarkable performance across diverse tasks. However, their impressive fluency often comes at the cost of producing false or fabricated information, a…

Computation and Language · Computer Science 2026-03-20 Aisha Alansari , Hamzah Luqman

This research work delves into the manifestation of hallucination within Large Language Models (LLMs) and its consequential impacts on applications within the domain of mental health. The primary objective is to discern effective strategies…

Computation and Language · Computer Science 2024-10-16 Abdul Muqtadir , Hafiz Syed Muhammad Bilal , Ayesha Yousaf , Hafiz Farooq Ahmed , Jamil Hussain

Large Vision-Language Models (LVLMs) integrate image encoders with Large Language Models (LLMs) to process multi-modal inputs and perform complex visual tasks. However, they often generate hallucinations by describing non-existent objects…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Yaqi Sun , Kyohei Atarashi , Koh Takeuchi , Hisashi Kashima

Large Language Models often generate factually incorrect but plausible outputs, known as hallucinations. We identify a more insidious phenomenon, LLM delusion, defined as high belief hallucinations, incorrect outputs with abnormally high…

Computation and Language · Computer Science 2025-03-11 Hongshen Xu , Zixv yang , Zichen Zhu , Kunyao Lan , Zihan Wang , Mengyue Wu , Ziwei Ji , Lu Chen , Pascale Fung , Kai Yu

Recent methodologies utilizing synthetic datasets have aimed to address inconsistent hallucinations in large language models (LLMs); however,these approaches are primarily tailored to specific tasks, limiting their generalizability.…

Artificial Intelligence · Computer Science 2025-02-28 Xinxin You , Xien Liu , Qixin Sun , Huan Zhang , Kaiyin Zhou , Shaohui Liu , GuoPing Hu , ShiJin Wang , Si Liu , Ji Wu

Large Vision-Language Models (LVLMs) bridge the gap between visual and linguistic modalities, demonstrating strong potential across a variety of domains. However, despite significant progress, LVLMs still suffer from severe hallucination…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ruiqi Ma , Yu Yan , Chunhong Zhang , Minghao Yin , XinChao Liu , Zhihong Jin , Zheng Hu

Despite the remarkable multimodal capabilities of Large Vision-Language Models (LVLMs), discrepancies often occur between visual inputs and textual outputs--a phenomenon we term visual hallucination. This critical reliability gap poses…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Tao Huang , Zhekun Liu , Rui Wang , Yang Zhang , Liping Jing

Multi-modal Large Language Models (MLLMs) tuned on machine-generated instruction-following data have demonstrated remarkable performance in various multi-modal understanding and generation tasks. However, the hallucinations inherent in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Qifan Yu , Juncheng Li , Longhui Wei , Liang Pang , Wentao Ye , Bosheng Qin , Siliang Tang , Qi Tian , Yueting Zhuang

In recent years, multimodal large language models (MLLMs) have achieved significant breakthroughs, enhancing understanding across text and vision. However, current MLLMs still face challenges in effectively integrating knowledge across…

Computation and Language · Computer Science 2025-03-10 Boyu Jia , Junzhe Zhang , Huixuan Zhang , Xiaojun Wan

The emergence of large language models (LLMs) is a milestone in generative artificial intelligence, achieving significant success in text comprehension and generation tasks. Despite the tremendous success of LLMs in many downstream tasks,…

Computation and Language · Computer Science 2024-07-16 He Li , Haoang Chi , Mingyu Liu , Wenjing Yang

Hallucination is often regarded as a major impediment for using large language models (LLMs), especially for knowledge-intensive tasks. Even when the training corpus consists solely of true statements, language models still generate…

Computation and Language · Computer Science 2024-07-12 Yuji Zhang , Sha Li , Jiateng Liu , Pengfei Yu , Yi R. Fung , Jing Li , Manling Li , Heng Ji

Hallucination has been widely recognized to be a significant drawback for large language models (LLMs). There have been many works that attempt to reduce the extent of hallucination. These efforts have mostly been empirical so far, which…

Computation and Language · Computer Science 2025-02-14 Ziwei Xu , Sanjay Jain , Mohan Kankanhalli

Visual hallucinations in Large Language Models (LLMs), where the model generates responses that are inconsistent with the visual input, pose a significant challenge to their reliability, particularly in contexts where precise and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Nokimul Hasan Arif , Shadman Rabby , Md Hefzul Hossain Papon , Sabbir Ahmed

Multimodal large reasoning models (MLRMs) often suffer from hallucinations that stem not only from insufficient visual grounding but also from imbalanced allocation between perception and reasoning processes. Building upon recent…

Artificial Intelligence · Computer Science 2026-03-10 Haolang Lu , Bolun Chu , WeiYe Fu , Guoshun Nan , Junning Liu , Minghui Pan , Qiankun Li , Yi Yu , Hua Wang , Kun Wang

Large language models (LLMs) have demonstrated exceptional proficiency in language understanding. However, when LLMs align their outputs with deceptive and/or misleading prompts, the generated responses could deviate from the de facto…

Computation and Language · Computer Science 2025-09-03 Zixuan Shangguan , Yanjie Dong , Lanjun Wang , Xiaoyi Fan , Victor C. M. Leung , Xiping Hu

Large Vision-Language Models (LVLMs) have made significant progress in recent years but are also prone to hallucination issues. They exhibit more hallucinations in longer, free-form responses, often attributed to accumulated uncertainties.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Ge Zheng , Jiaye Qian , Jiajin Tang , Sibei Yang