English
Related papers

Related papers: Less is More: Mitigating Multimodal Hallucination …

200 papers

Object hallucination in Multimodal Large Language Models (MLLMs) is a persistent failure mode that causes the model to perceive objects absent in the image. This weakness of MLLMs is currently studied using static benchmarks with fixed…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Aryan Yazdan Parast , Parsa Hosseini , Hesam Asadollahzadeh , Arshia Soltani Moakhar , Basim Azam , Soheil Feizi , Naveed Akhtar

Large language models (LLMs) have shown impressive performance on complex reasoning by leveraging chain-of-thought (CoT) prompting to generate intermediate reasoning chains as the rationale to infer the answer. However, existing CoT studies…

Computation and Language · Computer Science 2024-05-21 Zhuosheng Zhang , Aston Zhang , Mu Li , Hai Zhao , George Karypis , Alex Smola

In the age of misinformation, hallucination - the tendency of Large Language Models (LLMs) to generate non-factual or unfaithful responses - represents the main risk for their global utility. Despite LLMs becoming increasingly multilingual,…

Computation and Language · Computer Science 2026-02-03 Saad Obaid ul Islam , Anne Lauscher , Goran Glavaš

Hallucinations in large language models (LLMs) are outputs that are syntactically coherent but factually incorrect or contextually inconsistent. They are persistent obstacles in high-stakes industrial settings such as engineering design,…

Software Engineering · Computer Science 2026-04-07 Brian Freeman , Adam Kicklighter , Matt Erdman , Zach Gordon

Inspired by the superior language abilities of large language models (LLM), large vision-language models (LVLM) have been recently explored by integrating powerful LLMs for improving the performance on complex multimodal tasks. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Yifan Li , Yifan Du , Kun Zhou , Jinpeng Wang , Wayne Xin Zhao , Ji-Rong Wen

Hallucinations in large language models (LLMs), defined as fluent yet incorrect or incoherent outputs, pose a significant challenge to the automatic generation of educational multiple-choice questions (MCQs). We identified four key…

Computation and Language · Computer Science 2026-01-22 Nicholas X. Wang , Aggelos K. Katsaggelos

As large language models (LLMs) continue to advance, there is increasing interest in their ability to infer human mental states and demonstrate a human-like Theory of Mind (ToM). Most existing ToM evaluations, however, are centered on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Siqi Liu , Xinyang Li , Bochao Zou , Junbao Zhuo , Huimin Ma , Jiansheng Chen

Current Large Multimodal Models (LMMs) achieve remarkable progress, yet there remains significant uncertainty regarding their ability to accurately apprehend visual details, that is, in performing detailed captioning. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Bohan Zhai , Shijia Yang , Chenfeng Xu , Sheng Shen , Kurt Keutzer , Chunyuan Li , Manling Li

Large Vision-Language Models (LVLMs) have recently achieved impressive results in multimodal tasks such as image captioning and visual question answering. However, they remain prone to object hallucination -- generating descriptions of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Jinlin Li , Yuran Wang , Yifei Yuan , Xiao Zhou , Yingying Zhang , Xixian Yong , Yefeng Zheng , Xian Wu

While multi-modal large language models (MLLMs) have made significant progress in recent years, the issue of hallucinations remains a major challenge. To mitigate this phenomenon, existing solutions either introduce additional data for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Fengyuan Sun , Hui Chen , Xinhao Xu , Dandan Zheng , Jingdong Chen , Jun Zhou , Jungong Han , Guiguang Ding

Multimodal large language models (MLLMs) have advanced the integration of visual and linguistic modalities, establishing themselves as the dominant paradigm for visual-language tasks. Current approaches like chain of thought (CoT) reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Haojie Zheng , Tianyang Xu , Hanchi Sun , Shu Pu , Ruoxi Chen , Lichao Sun

Large vision-language models (LVLMs) have shown remarkable capabilities in visual-language understanding for downstream multi-modal tasks. Despite their success, LVLMs still suffer from generating hallucinations in complex generation tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Jiaming Li , Jiacheng Zhang , Zequn Jie , Lin Ma , Guanbin Li

Recently evolved large reasoning models (LRMs) show powerful performance in solving complex tasks with long chain-of-thought (CoT) reasoning capability. As these LRMs are mostly developed by post-training on formal reasoning tasks, whether…

Computation and Language · Computer Science 2025-05-30 Zijun Yao , Yantao Liu , Yanxu Chen , Jianhui Chen , Junfeng Fang , Lei Hou , Juanzi Li , Tat-Seng Chua

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…

Artificial Intelligence · Computer Science 2026-04-14 Xiaoda Yang , Shuai Yang , Can Wang , Jingyang Xue , Menglan Tang , Checheng Yu , Xunzhe Zhou , Sashuai Zhou , Tao Jin , Lixin Yang , Xiangyu Yue , Zhou Zhao

Large Language Models (LLMs) have transformed natural language processing (NLP) tasks, but they suffer from hallucination, generating plausible yet factually incorrect content. This issue extends to Video-Language Models (VideoLLMs), where…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ahmad Khalil , Mahmoud Khalil , Alioune Ngom

Recent advancements in Large Vision-Language Models (LVLMs) have demonstrated significant progress across multiple domains. However, these models still face the inherent challenge of integrating vision and language for collaborative…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jiabing Yang , Chenhang Cui , Yiyang Zhou , Yixiang Chen , Peng Xia , Ying Wei , Tao Yu , Yan Huang , Liang Wang

Hallucinations in large language models (LLMs) pose significant safety concerns that impede their broader deployment. Recent research in hallucination detection has demonstrated that LLMs' internal representations contain truthfulness…

Machine Learning · Computer Science 2025-11-11 Mengjia Niu , Hamed Haddadi , Guansong Pang

Multimodal large language models (MLLMs) have revolutionized the landscape of AI, demonstrating impressive capabilities in tackling complex vision and audio-language tasks. However, a critical challenge remains: these models often suffer…

Machine Learning · Computer Science 2026-05-05 Itai Allouche , Joseph Keshet

Hallucination remains a fundamental challenge in vision-language models (VLMs), where autoregressive generation may produce linguistically plausible yet physically inconsistent or visually ungrounded responses due to likelihood maximization…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Qinwu Xu

Multimodal large language models (MLLMs) have revolutionized cross-modal understanding but continue to struggle with hallucinations - fabricated content contradicting visual inputs. Existing hallucination mitigation methods either incur…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Shangpin Peng , Senqiao Yang , Li Jiang , Zhuotao Tian