中文
相关论文

相关论文: HalluClear: Diagnosing, Evaluating and Mitigating …

200 篇论文

Multimodal large language models (MLLMs) suffer from pronounced hallucinations in remote sensing visual question-answering (RS-VQA), primarily caused by visual grounding failures in large-scale scenes or misinterpretation of fine-grained…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Yi Liu , Jing Zhang , Di Wang , Xiaoyu Tian , Haonan Guo , Bo Du

Large Multimodal Models (LMMs) have achieved impressive progress in visual perception and reasoning. However, when confronted with visually ambiguous or non-semantic scene text, they often struggle to accurately spot and understand the…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Yan Shu , Hangui Lin , Yexin Liu , Yan Zhang , Gangyan Zeng , Yan Li , Yu Zhou , Ser-Nam Lim , Harry Yang , Nicu Sebe

Recent advancements in multimodal large language models have enhanced document understanding by integrating textual and visual information. However, existing models exhibit incompleteness within their paradigm in real-world scenarios,…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Zhentao He , Can Zhang , Ziheng Wu , Zhenghao Chen , Yufei Zhan , Yifan Li , Zhao Zhang , Xian Wang , Minghui Qiu

Multimodal large language models (MLLMs) have achieved strong performance on vision-language tasks but still struggle with fine-grained visual differences, leading to hallucinations or missed semantic shifts. We attribute this to…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Tianyi Bai , Yuxuan Fan , Jiantao Qiu , Fupeng Sun , Jiayi Song , Junlin Han , Zichen Liu , Conghui He , Wentao Zhang , Binhang Yuan

The widespread adoption of large language models (LLMs) across diverse AI applications is proof of the outstanding achievements obtained in several tasks, such as text mining, text generation, and question answering. However, LLMs are not…

计算与语言 · 计算机科学 2023-11-15 Alessandro Bruno , Pier Luigi Mazzeo , Aladine Chetouani , Marouane Tliba , Mohamed Amine Kerkouri

Recent studies have shown that large vision-language models (LVLMs) often suffer from the issue of object hallucinations (OH). To mitigate this issue, we introduce an efficient method that edits the model weights based on an unsafe…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Le Yang , Ziwei Zheng , Boxu Chen , Zhengyu Zhao , Chenhao Lin , Chao Shen

Autonomous graphical user interface (GUI) agents rely on accurate GUI grounding, which maps language instructions to on-screen coordinates, to execute user commands. However, current models, whether trained via supervised fine-tuning (SFT)…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Shaojie Zhang , Pei Fu , Ruoceng Zhang , Jiahui Yang , Anan Du , Xiuwen Xi , Shaokang Wang , Ying Huang , Bin Qin , Zhenbo Luo , Jian Luan

We introduce GUI-360$^\circ$, a large-scale, comprehensive dataset and benchmark suite designed to advance computer-using agents (CUAs). CUAs present unique challenges and is constrained by three persistent gaps: a scarcity of real-world…

Tool-augmented large language models (LLMs) are rapidly being integrated into real-world applications. Due to the lack of benchmarks, the community has yet to fully understand the hallucination issues within these models. To address this…

Recent years have witnessed a rapid development of mobile GUI agents powered by large language models (LLMs), which can autonomously execute diverse device-control tasks based on natural language instructions. The increasing accuracy of…

密码学与安全 · 计算机科学 2026-04-15 Guohong Liu , Jialei Ye , Jiacheng Liu , Yuanchun Li , Wei Liu , Pengzhi Gao , Jian Luan , Yunxin Liu

Graphical User Interface (GUI) Agents, powered by multimodal large language models (MLLMs), have shown great potential for task automation on computing devices such as computers and mobile phones. However, existing agents face challenges in…

人工智能 · 计算机科学 2025-01-09 Yuhang Liu , Pengxiang Li , Zishu Wei , Congkai Xie , Xueyu Hu , Xinchen Xu , Shengyu Zhang , Xiaotian Han , Hongxia Yang , Fei Wu

The increasing use of large language models (LLMs) in causal discovery as a substitute for human domain experts highlights the need for optimal model selection. This paper presents the first hallucination survey of popular LLMs for causal…

计算与语言 · 计算机科学 2024-11-21 Grace Sng , Yanming Zhang , Klaus Mueller

Hallucination remains a critical challenge for deploying Large Language Models (LLMs) in finance. Accurate extraction and precise calculation from tabular data are essential for reliable financial analysis, since even minor numerical errors…

机器学习 · 计算机科学 2025-10-27 Mengao Zhang , Jiayu Fu , Tanya Warrier , Yuwen Wang , Tianhui Tan , Ke-wei Huang

Retrieval-Augmented Generation (RAG) effectively reduces hallucinations in Large Language Models (LLMs) but can still produce inconsistent or unsupported content. Although LLM-as-a-Judge is widely used for RAG hallucination detection due to…

计算与语言 · 计算机科学 2025-02-27 Zhouyu Jiang , Mengshu Sun , Zhiqiang Zhang , Lei Liang

Despite the state-of-the-art performance of Large Language Models (LLMs), these models often suffer from hallucinations, which can undermine their performance in critical applications. In this work, we propose SAFE, a novel method for…

计算与语言 · 计算机科学 2025-03-06 Samir Abdaljalil , Filippo Pallucchini , Andrea Seveso , Hasan Kurban , Fabio Mercorio , Erchin Serpedin

The rapid development of multimodal large language models has resulted in remarkable advancements in visual perception and understanding, consolidating several tasks into a single visual question-answering framework. However, these models…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Yinan Sun , Xiongkuo Min , Zicheng Zhang , Yixuan Gao , Yuqin Cao , Guangtao Zhai

Autonomous systems are soon to be ubiquitous, spanning manufacturing, agriculture, healthcare, entertainment, and other industries. Most of these systems are developed with modular sub-components for decision-making, planning, and control…

人工智能 · 计算机科学 2025-02-12 Neeloy Chakraborty , Melkior Ornik , Katherine Driggs-Campbell

Although LLMs drive automation, it is critical to ensure immense consideration for high-stakes enterprise workflows such as those involving legal matters, risk management, and privacy compliance. For Meta, and other organizations like ours,…

In the era of large language models (LLMs), hallucination (i.e., the tendency to generate factually incorrect content) poses great challenge to trustworthy and reliable deployment of LLMs in real-world applications. To tackle the LLM…

计算与语言 · 计算机科学 2024-01-09 Junyi Li , Jie Chen , Ruiyang Ren , Xiaoxue Cheng , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Multimodal hallucination in multimodal large language models (MLLMs) restricts the correctness of MLLMs. However, multimodal hallucinations are multi-sourced and arise from diverse causes. Existing benchmarks fail to adequately distinguish…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Bowen Dong , Minheng Ni , Zitong Huang , Guanglei Yang , Wangmeng Zuo , Lei Zhang