中文
相关论文

相关论文: RSHallu: Dual-Mode Hallucination Evaluation for Re…

200 篇论文

Multimodal large language models (MLLMs) have revolutionized the landscape of AI, demonstrating impressive capabilities in tackling complex vision and audio-language tasks. However, a critical challenge remains: these models often suffer…

机器学习 · 计算机科学 2026-05-05 Itai Allouche , Joseph Keshet

Large Multimodal Models (LMM) are built across modalities and the misalignment between two modalities can result in "hallucination", generating textual outputs that are not grounded by the multimodal information in context. To address the…

计算机视觉与模式识别 · 计算机科学 2023-09-27 Zhiqing Sun , Sheng Shen , Shengcao Cao , Haotian Liu , Chunyuan Li , Yikang Shen , Chuang Gan , Liang-Yan Gui , Yu-Xiong Wang , Yiming Yang , Kurt Keutzer , Trevor Darrell

Large language models are increasingly used in scientific domains, especially for molecular understanding and analysis. However, existing models are affected by hallucination issues, resulting in errors in drug design and utilization. In…

计算与语言 · 计算机科学 2025-04-18 Hao Li , Liuzhenghao Lv , He Cao , Zijing Liu , Zhiyuan Yan , Yu Wang , Yonghong Tian , Yu Li , Li Yuan

Large Language Models (LLMs) have demonstrated advanced capabilities but often suffer from factual inaccuracies (hallucinations) and systematic biases. These issues, sometimes amplified in specific architectures like Mixture-of-Experts…

计算与语言 · 计算机科学 2026-04-28 Shuai Wu , Xue Li , Yanna Feng , Yufang Li , Zhijun Wang , Ran Wang

Vision language models (VLM) demonstrate sophisticated multimodal reasoning yet are prone to hallucination when confronted with knowledge conflicts, impeding their deployment in information-sensitive contexts. While existing research…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Peter Carragher , Nikitha Rao , Abhinand Jha , R Raghav , Kathleen M. Carley

Self-improvement in multimodal large language models (MLLMs) is crucial for enhancing their reliability and robustness. However, current methods often rely heavily on MLLMs themselves as judges, leading to high computational costs and…

计算与语言 · 计算机科学 2024-11-28 Shijian Deng , Wentian Zhao , Yu-Jhe Li , Kun Wan , Daniel Miranda , Ajinkya Kale , Yapeng Tian

Multimodal Large Language Models (MLLMs) are known to hallucinate, which limits their practical applications. Recent works have attempted to apply Direct Preference Optimization (DPO) to enhance the performance of MLLMs, but have shown…

计算与语言 · 计算机科学 2024-11-18 Yuhan Fu , Ruobing Xie , Xingwu Sun , Zhanhui Kang , Xirong Li

Large Language Models (LLMs) exhibit impressive reasoning and question-answering capabilities. However, they often produce inaccurate or unreliable content known as hallucinations. This unreliability significantly limits their deployment in…

机器学习 · 计算机科学 2025-09-16 Minh Vu , Brian K. Tran , Syed A. Shah , Geigh Zollicoffer , Nhat Hoang-Xuan , Manish Bhattarai

Large language models are increasingly being used in patient-facing medical question answering, where hallucinated outputs can vary widely in potential harm. However, existing hallucination standards and evaluation metrics focus primarily…

计算与语言 · 计算机科学 2026-03-02 Savan Doshi

Although large Language Models (LLMs) have achieved remarkable success, their practical application is often hindered by the generation of non-factual content, which is called "hallucination". Ensuring the reliability of LLMs' outputs is a…

计算与语言 · 计算机科学 2025-09-16 Yue Ding , Xiaofang Zhu , Tianze Xia , Junfei Wu , Xinlong Chen , Qiang Liu , Liang Wang

Large Vision-Language Models have demonstrated exceptional performance in multimodal reasoning and complex scene understanding. However, these models still face significant hallucination issues, where outputs contradict visual facts. Recent…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Wei Suo , Hanzu Zhang , Lijun Zhang , Ji Ma , Peng Wang , Yanning Zhang

Multimodal large language models (MLLMs) have shown great potential in perception and interpretation tasks, but their capabilities in predictive reasoning remain under-explored. To address this gap, we introduce a novel benchmark that…

计算机视觉与模式识别 · 计算机科学 2023-10-23 Mingwei Zhu , Leigang Sha , Yu Shu , Kangjia Zhao , Tiancheng Zhao , Jianwei Yin

While Large Language Models have transformed how we interact with AI systems, they suffer from a critical flaw: they confidently generate false information that sounds entirely plausible. This hallucination problem has become a major…

人工智能 · 计算机科学 2025-10-28 Piyushkumar Patel

Large language models (LLMs) have recently been extended to the vision-language realm, obtaining impressive general multi-modal capabilities. However, the exploration of multi-modal large language models (MLLMs) for remote sensing (RS) data…

计算机视觉与模式识别 · 计算机科学 2024-01-19 Yang Zhan , Zhitong Xiong , Yuan Yuan

We present DualFocus, a novel framework for integrating macro and micro perspectives within multi-modal large language models (MLLMs) to enhance vision-language task performance. Current MLLMs typically singularly focus on inputs at a…

计算机视觉与模式识别 · 计算机科学 2024-02-23 Yuhang Cao , Pan Zhang , Xiaoyi Dong , Dahua Lin , Jiaqi Wang

Hallucinations pose a significant challenge to the reliability of large vision-language models, making their detection essential for ensuring accuracy in critical applications. Current detection methods often rely on computationally…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Eunkyu Park , Minyeong Kim , Gunhee Kim

Large vision-language models (LVLMs) have made significant progress in recent years. While LVLMs exhibit excellent ability in language understanding, question answering, and conversations of visual inputs, they are prone to producing…

计算与语言 · 计算机科学 2024-11-20 Qing Li , Jiahui Geng , Chenyang Lyu , Derui Zhu , Maxim Panov , Fakhri Karray

Large language models (LLMs) often generate responses that deviate from user input or training data, a phenomenon known as "hallucination." These hallucinations undermine user trust and hinder the adoption of generative AI systems.…

计算与语言 · 计算机科学 2025-04-25 Yejin Bang , Ziwei Ji , Alan Schelten , Anthony Hartshorn , Tara Fowler , Cheng Zhang , Nicola Cancedda , Pascale Fung

Vision-Language Models (VLMs) have demonstrated great potential in interpreting remote sensing (RS) images through language-guided semantic. However, the effectiveness of these VLMs critically depends on high-quality image-text training…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Dilxat Muhtar , Enzhuo Zhang , Zhenshi Li , Feng Gu , Yanglangxing He , Pengfeng Xiao , Xueliang Zhang

Retrieval-Augmented Generation (RAG) aims to mitigate hallucinations in large language models (LLMs) by grounding responses in retrieved documents. Yet, RAG-based LLMs still hallucinate even when provided with correct and sufficient…

计算与语言 · 计算机科学 2026-02-04 Samuel Yeh , Sharon Li , Tanwi Mallick