English
Related papers

Related papers: Mitigating Multimodal LLMs Hallucinations via Rele…

200 papers

The recent success of reinforcement learning (RL) in large reasoning models has inspired the growing adoption of RL for post-training Multimodal Large Language Models (MLLMs) to enhance their visual reasoning capabilities. Although many…

Hallucinations in large language models (LLMs) pose significant safety concerns that impede their broader deployment. Recent research in hallucination detection has demonstrated that LLMs' internal representations contain truthfulness…

Machine Learning · Computer Science 2025-11-11 Mengjia Niu , Hamed Haddadi , Guansong Pang

Large language models (LLMs) have garnered significant interest in AI community. Despite their impressive generation capabilities, they have been found to produce misleading or fabricated information, a phenomenon known as hallucinations.…

Machine Learning · Computer Science 2025-10-21 Wenyun Li , Zheng Zhang , Dongmei Jiang , Xiangyuan Lan

Large Vision-Language Models (LVLMs) have achieved impressive progress in multimodal reasoning, yet they remain prone to object hallucinations, generating descriptions of objects that are not present in the input image. Recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sohyeon Kim , Sang Yeon Yoon , Kyeongbo Kong

While multi-modal large language models (MLLMs) have made significant progress in recent years, the issue of hallucinations remains a major challenge. To mitigate this phenomenon, existing solutions either introduce additional data for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Fengyuan Sun , Hui Chen , Xinhao Xu , Dandan Zheng , Jingdong Chen , Jun Zhou , Jungong Han , Guiguang Ding

Large audio-language models (LALMs) enhance traditional large language models by integrating audio perception capabilities, allowing them to tackle audio-related tasks. Previous research has primarily focused on assessing the performance of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Chun-Yi Kuan , Wei-Ping Huang , Hung-yi Lee

Recent advancements in Multimodal Large Language Models (MLLMs) have achieved significant success across various domains. However, their use in high-stakes fields like healthcare remains limited due to persistent hallucinations, where…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Ziqiang Shi , Rujie Liu , Shanshan Yu , Satoshi Munakata , Koichi Shirahata

Large Language Models (LLMs) have transformed the Natural Language Processing (NLP) landscape with their remarkable ability to understand and generate human-like text. However, these models are prone to ``hallucinations'' -- outputs that do…

Recent advancements in Large Language Models (LLMs) have facilitated the development of Multimodal LLMs (MLLMs). Despite their impressive capabilities, MLLMs often suffer from over-reliance on unimodal biases (e.g., language bias and vision…

Computation and Language · Computer Science 2024-11-14 Meiqi Chen , Yixin Cao , Yan Zhang , Chaochao Lu

Large Language Models (LLMs) have demonstrated exceptional proficiency in text understanding and embedding tasks. However, their potential in multimodal representation, particularly for item-to-item (I2I) recommendations, remains…

Information Retrieval · Computer Science 2025-01-22 Chao Zhang , Haoxin Zhang , Shiwei Wu , Di Wu , Tong Xu , Xiangyu Zhao , Yan Gao , Yao Hu , Enhong Chen

Following the success of Large Language Models (LLMs), Large Multimodal Models (LMMs), such as the Flamingo model and its subsequent competitors, have started to emerge as natural steps towards generalist agents. However, interacting with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Mustafa Shukor , Alexandre Rame , Corentin Dancette , Matthieu Cord

Large Vision-Language Models (LVLMs) exhibit powerful generative capabilities but frequently produce hallucinations that compromise output reliability. Fine-tuning on annotated data devoid of hallucinations offers the most direct solution,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Xingyu Zhu , Junfeng Fang , Shuo Wang , Beier Zhu , Zhicai Wang , Yonghui Yang , Xiangnan He

Recent advancements in self-supervised learning have led to powerful surgical vision encoders capable of spatiotemporal understanding. However, extending these visual foundations to multi-modal reasoning tasks is severely bottlenecked by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Chengan Che , Chao Wang , Jiayuan Huang , Xinyue Chen , Luis C. Garcia-Peraza-Herrera

Multimodal Large Language Models (MLLMs) have recently demonstrated impressive capabilities in multimodal understanding, reasoning, and interaction. However, existing MLLMs prevalently suffer from serious hallucination problems, generating…

Computation and Language · Computer Science 2024-03-11 Tianyu Yu , Yuan Yao , Haoye Zhang , Taiwen He , Yifeng Han , Ganqu Cui , Jinyi Hu , Zhiyuan Liu , Hai-Tao Zheng , Maosong Sun , Tat-Seng Chua

Large Language Models (LLMs) have gained significant popularity for their impressive performance across diverse fields. However, LLMs are prone to hallucinate untruthful or nonsensical outputs that fail to meet user expectations in many…

Computation and Language · Computer Science 2023-11-23 Tianhang Zhang , Lin Qiu , Qipeng Guo , Cheng Deng , Yue Zhang , Zheng Zhang , Chenghu Zhou , Xinbing Wang , Luoyi Fu

Large language models (LLMs) have significantly advanced natural language processing tasks, yet they are susceptible to generating inaccurate or unreliable responses, a phenomenon known as hallucination. In critical domains such as health…

Computation and Language · Computer Science 2024-09-20 Sumera Anjum , Hanzhi Zhang , Wenjun Zhou , Eun Jin Paek , Xiaopeng Zhao , Yunhe Feng

Hallucinations in large language models (LLMs), defined as fluent yet incorrect or incoherent outputs, pose a significant challenge to the automatic generation of educational multiple-choice questions (MCQs). We identified four key…

Computation and Language · Computer Science 2026-01-22 Nicholas X. Wang , Aggelos K. Katsaggelos

Multimodal Large Language Models (MLLMs) suffer from cross-modal hallucinations, where one modality inappropriately influences generation about another, leading to fabricated output. This exposes a more fundamental deficiency in…

Artificial Intelligence · Computer Science 2026-01-30 Sangyun Chung , Se Yeon Kim , Youngchae Chee , Yong Man Ro

Hallucination in Large Language Models (LLMs) refers to the generation of content that is not faithful to the input or the real-world facts. This paper provides a rigorous treatment of hallucination in LLMs, including formal definitions and…

Computation and Language · Computer Science 2025-08-01 Esmail Gumaan

Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced the comprehension of multimedia content, bringing together diverse modalities such as text, images, and videos. However, a critical challenge faced…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Li Sun , Liuan Wang , Jun Sun , Takayuki Okatani