中文
相关论文

相关论文: RSHallu: Dual-Mode Hallucination Evaluation for Re…

200 篇论文

Remote Sensing Vision-Language Models (RS VLMs) have made much progress in the tasks of remote sensing (RS) image comprehension. While performing well in multi-modal reasoning and multi-turn conversations, the existing models lack…

计算机视觉与模式识别 · 计算机科学 2024-12-11 Xu Liu , Zhouhui Lian

Multimodal Large Language Models (MLLMs) have unlocked powerful cross-modal capabilities, but still significantly suffer from hallucinations. As such, accurate detection of hallucinations in MLLMs is imperative for ensuring their…

As large language models (LLMs) are increasingly applied in sensitive domains such as medicine and law, hallucination detection has become a critical task. Although numerous benchmarks have been proposed to advance research in this area,…

计算与语言 · 计算机科学 2026-03-06 Yujie Ren , Niklas Gruhlke , Anne Lauscher

Multimodal Large Language Models (MLLMs) have garnered significant attention recently and demonstrate outstanding capabilities in various tasks such as OCR, VQA, captioning, $\textit{etc}$. However, hallucination remains a persistent issue.…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Zehao Wang , Xinpeng Liu , Yudonglin Zhang , Xiaoqian Wu , Zhou Fang , Yifan Fang , Junfu Pu , Cewu Lu , Yong-Lu Li

Large vision-language models (VLMs) exhibit strong performance across various tasks. However, these VLMs encounter significant challenges when applied to the remote sensing domain due to the inherent differences between remote sensing…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Yunkai Dang , Donghao Wang , Jiacheng Yang , Yifan Jiang , Meiyi Zhu , Yuekun Yang , Cong Wang , Qi Fan , Wenbin Li , Yang Gao

Recent studies have shown that large vision-language models (LVLMs) often suffer from the issue of object hallucinations (OH). To mitigate this issue, we introduce an efficient method that edits the model weights based on an unsafe…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Le Yang , Ziwei Zheng , Boxu Chen , Zhengyu Zhao , Chenhao Lin , Chao Shen

Video Large Language Models (VideoLLMs) exhibit various types of hallucinations. Existing research has primarily focused on hallucinations involving the presence of events, objects, and scenes in videos, while largely neglecting event…

计算机视觉与模式识别 · 计算机科学 2026-01-16 Zefan Zhang , Kehua Zhu , Shijie Jiang , Hongyuan Lu , Shengkai Sun , Tian Bai

Multimodal large language models (MLLMs) contribute a powerful mechanism to understanding visual information building on large language models. However, MLLMs are notorious for suffering from hallucinations, especially when generating…

计算机视觉与模式识别 · 计算机科学 2024-06-03 Kai Wu , Boyuan Jiang , Zhengkai Jiang , Qingdong He , Donghao Luo , Shengzhi Wang , Qingwen Liu , Chengjie Wang

This paper aims to address the challenge of hallucinations in Multimodal Large Language Models (MLLMs) particularly for dense image captioning tasks. To tackle the challenge, we identify the current lack of a metric that finely measures the…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Cong Chen , Mingyu Liu , Chenchen Jing , Yizhou Zhou , Fengyun Rao , Hao Chen , Bo Zhang , Chunhua Shen

Complex visual reasoning remains a key challenge today. Typically, the challenge is tackled using methodologies such as Chain of Thought (COT) and visual instruction tuning. However, how to organically combine these two methodologies for…

计算机视觉与模式识别 · 计算机科学 2025-01-08 Wanpeng Hu , Haodi Liu , Lin Chen , Feng Zhou , Changming Xiao , Qi Yang , Changshui Zhang

The revolutionary capabilities of large language models (LLMs) have paved the way for multimodal large language models (MLLMs) and fostered diverse applications across various specialized domains. In the remote sensing (RS) field, however,…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Dilxat Muhtar , Zhenshi Li , Feng Gu , Xueliang Zhang , Pengfeng Xiao

The rapidly developing Large Vision Language Models (LVLMs) have shown notable capabilities on a range of multi-modal tasks, but still face the hallucination phenomena where the generated texts do not align with the given contexts,…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Wenyi Xiao , Ziwei Huang , Leilei Gan , Wanggui He , Haoyuan Li , Zhelun Yu , Fangxun Shu , Hao Jiang , Linchao Zhu

Recent advancements in Multimodal Large Language Models (MLLMs) have enabled them to effectively integrate vision and language, addressing a variety of downstream tasks. However, despite their significant success, these models still exhibit…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Zixian Gao , Chao Yang , Zhanhui Zhou , Xing Xu , Chaochao Lu

Large language models (LLMs) have achieved significant success in interacting with human. However, recent studies have revealed that these models often suffer from hallucinations, leading to overly confident but incorrect judgments. This…

计算与语言 · 计算机科学 2023-09-06 Yusheng Liao , Yutong Meng , Hongcheng Liu , Yanfeng Wang , Yu Wang

Large language models (LLMs) are prone to three types of hallucination: Input-Conflicting, Context-Conflicting and Fact-Conflicting hallucinations. The purpose of this study is to mitigate the different types of hallucination by exploiting…

人工智能 · 计算机科学 2025-06-17 Ao Jia , Haiming Wu , Guohui Yao , Dawei Song , Songkun Ji , Yazhou Zhang

Multimodal Large Language Models (MLLMs) have shown impressive performance in vision and text tasks. However, hallucination remains a major challenge, especially in fields like healthcare where details are critical. In this work, we show…

计算与语言 · 计算机科学 2025-02-24 Yun-Wei Chu , Kai Zhang , Christopher Malon , Martin Renqiang Min

Multimodal Large Language Models (MLLMs) represent the cutting edge of AI technology, with DeepSeek models emerging as a leading open-source alternative offering competitive performance to closed-source systems. While these models…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Chashi Mahiul Islam , Samuel Jacob Chacko , Preston Horne , Xiuwen Liu

Despite the impressive capabilities of multimodal large language models (MLLMs) in vision-language tasks, they are prone to hallucinations in real-world scenarios. This paper investigates the hallucination phenomenon in MLLMs from the…

计算机视觉与模式识别 · 计算机科学 2025-07-11 Zongmeng Zhang , Wengang Zhou , Jie Zhao , Houqiang Li

Large language models and vision transformers have demonstrated impressive zero-shot capabilities, enabling significant transferability in downstream tasks. The fusion of these models has resulted in multi-modal architectures with enhanced…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Andrés Villa , Juan León Alcázar , Motasem Alfarra , Vladimir Araujo , Alvaro Soto , Bernard Ghanem

Large Language Models (LLMs) have advanced financial automation through Retrieval-Augmented Generation (RAG), yet hallucinations remain a critical barrier to deployment in high-stakes environments. Existing benchmarks focus on single-turn,…

机器学习 · 计算机科学 2026-05-29 Eunbyeol Cho , Yunseung Lee , Mirae Kim , Jeewon Yang , Youngjun Kwak , Edward Choi