中文
相关论文

相关论文: Robust Multimodal Large Language Models Against Mo…

200 篇论文

Large Language Models (LLMs) have significantly advanced communications fields, such as Telecom Q\&A, mathematical modeling, and coding. However, LLMs encounter an inherent issue known as hallucination, i.e., generating fact-conflicting or…

网络与互联网体系结构 · 计算机科学 2024-12-10 Yinqiu Liu , Guangyuan Liu , Ruichen Zhang , Dusit Niyato , Zehui Xiong , Dong In Kim , Kaibin Huang , Hongyang Du

The recent success of reinforcement learning (RL) in large reasoning models has inspired the growing adoption of RL for post-training Multimodal Large Language Models (MLLMs) to enhance their visual reasoning capabilities. Although many…

Large Language Models (LLMs) are powerful linguistic engines but remain susceptible to hallucinations: plausible-sounding outputs that are factually incorrect or unsupported. In this work, we present a mathematically grounded framework to…

计算与语言 · 计算机科学 2025-11-20 Moses Kiprono

Multimodal Large Language Models (MLLMs) frequently suffer from hallucination issues, generating information about objects that are not present in input images during vision-language tasks. These hallucinations particularly undermine model…

计算机视觉与模式识别 · 计算机科学 2025-06-16 Dokyoon Yoon , Youngsook Song , Woomyong Park

Multi-modal Large Language Models (MLLMs) excel in vision-language tasks but remain vulnerable to visual adversarial perturbations that can induce hallucinations, manipulate responses, or bypass safety mechanisms. Existing methods seek to…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Hashmat Shadab Malik , Fahad Shamshad , Muzammal Naseer , Karthik Nandakumar , Fahad Khan , Salman Khan

Large language models (LLMs) have shown promise for generative and knowledge-intensive tasks including question-answering (QA) tasks. However, the practical deployment still faces challenges, notably the issue of "hallucination", where…

计算与语言 · 计算机科学 2023-10-11 Ziwei Ji , Tiezheng Yu , Yan Xu , Nayeon Lee , Etsuko Ishii , Pascale Fung

Despite their impressive capabilities, multimodal large language models (MLLMs) are prone to hallucinations, i.e., the generated content that is nonsensical or unfaithful to input sources. Unlike in LLMs, hallucinations in MLLMs often stem…

计算机视觉与模式识别 · 计算机科学 2025-05-09 Xin Zou , Yizhou Wang , Yibo Yan , Yuanhuiyi Lyu , Kening Zheng , Sirui Huang , Junkai Chen , Peijie Jiang , Jia Liu , Chang Tang , Xuming Hu

Large vision-language models (LVLMs) have shown remarkable capabilities in visual-language understanding for downstream multi-modal tasks. Despite their success, LVLMs still suffer from generating hallucinations in complex generation tasks,…

计算机视觉与模式识别 · 计算机科学 2025-03-13 Jiaming Li , Jiacheng Zhang , Zequn Jie , Lin Ma , Guanbin Li

Recent advances in multimodal large language models (MLLMs) mark a shift from non-thinking models to post-trained reasoning models capable of solving complex problems through thinking. However, whether such thinking mitigates hallucinations…

计算与语言 · 计算机科学 2026-02-02 Zhidian Huang , Zijun Yao , Ji Qi , Shangqing Tu , Junxian Ma , Jinxin Liu , Weichuan Liu , Xiaoyin Che , Lei Hou , Juanzi Li

Multimodal Large Language Models (MLLMs) have shown impressive perception and reasoning capabilities, yet they often suffer from hallucinations -- generating outputs that are linguistically coherent but inconsistent with the context of the…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Bingkui Tong , Jiaer Xia , Kaiyang Zhou

Multimodal Large Language Models (MLLMs) have demonstrated strong performance in visual understanding tasks, yet they often suffer from object hallucinations--generating descriptions of objects that are inconsistent with or entirely absent…

人工智能 · 计算机科学 2025-05-27 Xinmiao Hu , Chun Wang , Ruihe An , ChenYu Shao , Xiaojun Ye , Sheng Zhou , Liangcheng Li

The emergence of large language models (LLMs) has marked a significant breakthrough in natural language processing (NLP), fueling a paradigm shift in information acquisition. Nevertheless, LLMs are prone to hallucination, generating…

Fusing visual understanding into language generation, Multi-modal Large Language Models (MLLMs) are revolutionizing visual-language applications. Yet, these models are often plagued by the hallucination problem, which involves generating…

机器学习 · 计算机科学 2025-01-28 Yining Wang , Mi Zhang , Junjie Sun , Chenyue Wang , Min Yang , Hui Xue , Jialing Tao , Ranjie Duan , Jiexi Liu

Multimodal Large Language Models (MLLMs) deliver detailed responses on vision-language tasks, yet remain susceptible to object hallucination (introducing objects not present in the image), undermining reliability in practice. Prior efforts…

机器学习 · 计算机科学 2026-02-26 Shiwei Tan , Hengyi Wang , Weiyi Qin , Qi Xu , Zhigang Hua , Hao Wang

Hallucinations in vision-language models (VLMs) hinder reliability and real-world applicability, usually stemming from distribution shifts between pretraining data and test samples. Existing solutions, such as retraining or fine-tuning on…

多媒体 · 计算机科学 2025-06-10 Fei Zhao , Chengcui Zhang , Runlin Zhang , Tianyang Wang , Xi Li

Large language models (LLMs) have achieved a degree of success in generating coherent and contextually relevant text, yet they remain prone to a significant challenge known as hallucination: producing information that is not substantiated…

计算与语言 · 计算机科学 2024-10-28 Ray Li , Tanishka Bagade , Kevin Martinez , Flora Yasmin , Grant Ayala , Michael Lam , Kevin Zhu

MLLMs often generate outputs that are inconsistent with the visual content, a challenge known as hallucination. Previous methods focus on determining whether a generated output is hallucinated, without identifying which image region leads…

计算机视觉与模式识别 · 计算机科学 2024-07-31 Zheng Lin , Zhenxing Niu , Zhibin Wang , Yinghui Xu

Multi-modal Large Language Models (MLLMs) have emerged as a powerful paradigm for integrating visual and textual information, supporting a wide range of multi-modal tasks. However, these models often suffer from hallucination, producing…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Zhiyuan Chen , Yuecong Min , Jie Zhang , Bei Yan , Jiahao Wang , Xiaozhen Wang , Shiguang Shan

Multimodal Large Language Models demonstrate strong performance on multimodal benchmarks, yet often exhibit poor robustness when exposed to spurious modality interference, such as irrelevant text in vision understanding, or irrelevant…

机器学习 · 计算机科学 2026-01-30 Rui Cai , Bangzheng Li , Xiaofei Wen , Muhao Chen , Zhe Zhao

Though advanced in understanding visual information with human languages, Large Vision-Language Models (LVLMs) still suffer from multimodal hallucinations. A natural concern is that during multimodal interaction, the generated…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Weihong Zhong , Xiaocheng Feng , Liang Zhao , Qiming Li , Lei Huang , Yuxuan Gu , Weitao Ma , Yuan Xu , Bing Qin