中文
相关论文

相关论文: Localizing Before Answering: A Hallucination Evalu…

200 篇论文

Large Multimodal Models (LMM) are built across modalities and the misalignment between two modalities can result in "hallucination", generating textual outputs that are not grounded by the multimodal information in context. To address the…

计算机视觉与模式识别 · 计算机科学 2023-09-27 Zhiqing Sun , Sheng Shen , Shengcao Cao , Haotian Liu , Chunyuan Li , Yikang Shen , Chuang Gan , Liang-Yan Gui , Yu-Xiong Wang , Yiming Yang , Kurt Keutzer , Trevor Darrell

Understanding the mechanisms behind Large Language Models (LLMs) is crucial for designing improved models and strategies. While recent studies have yielded valuable insights into the mechanisms of textual LLMs, the mechanisms of Multi-modal…

计算与语言 · 计算机科学 2025-01-14 Zeping Yu , Sophia Ananiadou

Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, but the quality bar for medical and clinical applications is high. Today, attempts to assess models' clinical knowledge…

Large vision-language models (LVLMs) have made substantial progress in integrating large language models (LLMs) with visual inputs, enabling advanced multimodal reasoning. Despite their success, a persistent challenge is hallucination-where…

计算与语言 · 计算机科学 2025-06-11 Jinghan He , Kuan Zhu , Haiyun Guo , Junfeng Fang , Zhenglin Hua , Yuheng Jia , Ming Tang , Tat-Seng Chua , Jinqiao Wang

Hallucinations in Large Language Models (LLMs) represent a critical barrier to their reliable deployment, a vulnerability heavily exacerbated in non-English and resource-constrained contexts. Existing detection approaches that rely on…

计算与语言 · 计算机科学 2026-05-26 Riasad Alvi , Nurul Labib Sayeedi , Md. Faiyaz Abdullah Sayeedi

Multimodal Large Language Models (MLLMs) have shown remarkable proficiency on general-purpose vision-language benchmarks, reaching or even exceeding human-level performance. However, these evaluations typically rely on standard…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Wenjin Hou , Wei Liu , Han Hu , Xiaoxiao Sun , Serena Yeung-Levy , Hehe Fan

Establishing a clear link between model predictions and the visual evidence that supports them is critical for transparency and reliability in multimodal reasoning, yet current multimodal large language model (MLLM) evaluations do not…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Mozhgan Nasr Azadani , Yimu Wang , Yongpeng Zhu , Lihong Chen , Milan Ganai , Sean Sedwards , Marco Pavone , Krzysztof Czarnecki

Large language models (LLMs) have achieved remarkable progress in natural language generation, but remain susceptible to hallucination. In response to growing concerns about hallucinations, several benchmarks have been developed, primarily…

计算与语言 · 计算机科学 2026-05-19 Aisha Alansari , Hamzah Luqman

Large Language Models (LLMs) have advanced machine translation but remain vulnerable to hallucinations. Unfortunately, existing MT benchmarks are not capable of exposing failures in multilingual LLMs. To disclose hallucination in…

计算与语言 · 计算机科学 2025-10-29 Xinwei Wu , Heng Liu , Jiang Zhou , Xiaohu Zhao , Linlong Xu , Longyue Wang , Weihua Luo , Kaifu Zhang

Multimodal Large Language Models (MLLMs) deliver detailed responses on vision-language tasks, yet remain susceptible to object hallucination (introducing objects not present in the image), undermining reliability in practice. Prior efforts…

机器学习 · 计算机科学 2026-02-26 Shiwei Tan , Hengyi Wang , Weiyi Qin , Qi Xu , Zhigang Hua , Hao Wang

Large Vision Language Models (LVLMs) have shown remarkable capabilities in multimodal tasks like visual question answering or image captioning. However, inconsistencies between the visual information and the generated text, a phenomenon…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Laura Fieback , Jakob Spiegelberg , Hanno Gottschalk

Vision language models (VLM) demonstrate sophisticated multimodal reasoning yet are prone to hallucination when confronted with knowledge conflicts, impeding their deployment in information-sensitive contexts. While existing research…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Peter Carragher , Nikitha Rao , Abhinand Jha , R Raghav , Kathleen M. Carley

Multi-modal large language models (MLLMs) have been shown to efficiently integrate natural language with visual information to handle multi-modal tasks. However, MLLMs still face a fundamental limitation of hallucinations, where they tend…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Chaoya Jiang , Haiyang Xu , Mengfan Dong , Jiaxing Chen , Wei Ye , Ming Yan , Qinghao Ye , Ji Zhang , Fei Huang , Shikun Zhang

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

计算与语言 · 计算机科学 2025-09-19 Martin Preiß

Large Vision and Language Models have enabled significant advances in fully supervised and zero-shot visual tasks. These large architectures serve as the baseline to what is currently known as Instruction Tuning Large Vision and Language…

计算机视觉与模式识别 · 计算机科学 2025-06-02 Andrés Villa , Juan Carlos León Alcázar , Alvaro Soto , Bernard Ghanem

Multimodal Large Language Models (MLLMs) have shown impressive performance in vision and text tasks. However, hallucination remains a major challenge, especially in fields like healthcare where details are critical. In this work, we show…

计算与语言 · 计算机科学 2025-02-24 Yun-Wei Chu , Kai Zhang , Christopher Malon , Martin Renqiang Min

Large Vision-Language Models (LVLMs) have achieved impressive performance in multimodal tasks, but they still suffer from hallucinations, i.e., generating content that is grammatically accurate but inconsistent with visual inputs. In this…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Chenxi Li , Yichen Guo , Benfang Qian , Jinhao You , Kai Tang , Yaosong Du , Zonghao Zhang , Xiande Huang

Large Language Models (LLMs) in mental healthcare risk propagating biases that reinforce stigma and harm marginalized groups. While previous research identified concerning trends, systematic methods for detecting intersectional biases…

计算与语言 · 计算机科学 2025-06-24 Batool Haider , Atmika Gorti , Aman Chadha , Manas Gaur

Vision-language models (VLMs) enable open-ended visual question answering but remain prone to hallucinations. We present HEDGE, a unified framework for hallucination detection that combines controlled visual perturbations, semantic…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Sushant Gautam , Michael A. Riegler , Pål Halvorsen

Multimodal Large Language Models (MLLMs) in healthcare suffer from severe confirmation bias, often hallucinating visual details to support initial, potentially erroneous diagnostic hypotheses. Existing Chain-of-Thought (CoT) approaches lack…

计算与语言 · 计算机科学 2026-04-14 Zhixiang Lu , Jionglong Su