中文
相关论文

相关论文: Counterfactual Segmentation Reasoning: Diagnosing …

200 篇论文

The detection of sophisticated hallucinations in Large Language Models (LLMs) is hampered by a ``Detection Dilemma'': methods probing internal states (Internal State Probing) excel at identifying factual inconsistencies but fail on logical…

计算与语言 · 计算机科学 2026-01-09 Yusheng Song , Lirong Qiu , Xi Zhang , Zhihao Tang

Large Vision-Language Models (LVLMs) achieve strong performance on many multimodal tasks, but object hallucinations severely undermine their reliability. Most existing studies focus on the text modality, attributing hallucinations to overly…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Jiale Song , Jiaxin Luo , Xue-song Tang , Kuangrong Hao , Mingbo Zhao

Multimodal large reasoning models (MLRMs) often suffer from hallucinations that stem not only from insufficient visual grounding but also from imbalanced allocation between perception and reasoning processes. Building upon recent…

人工智能 · 计算机科学 2026-03-10 Haolang Lu , Bolun Chu , WeiYe Fu , Guoshun Nan , Junning Liu , Minghui Pan , Qiankun Li , Yi Yu , Hua Wang , Kun Wang

Multimodal hallucination in multimodal large language models (MLLMs) restricts the correctness of MLLMs. However, multimodal hallucinations are multi-sourced and arise from diverse causes. Existing benchmarks fail to adequately distinguish…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Bowen Dong , Minheng Ni , Zitong Huang , Guanglei Yang , Wangmeng Zuo , Lei Zhang

Multimodal Large Language Models (MLLMs) have unlocked powerful cross-modal capabilities, but still significantly suffer from hallucinations. As such, accurate detection of hallucinations in MLLMs is imperative for ensuring their…

Current open-source Large Multimodal Models (LMMs) excel at tasks such as open-vocabulary language grounding and segmentation but can suffer under false premises when queries imply the existence of something that is not actually present in…

计算机视觉与模式识别 · 计算机科学 2023-12-14 Tsung-Han Wu , Giscard Biamby , David Chan , Lisa Dunlap , Ritwik Gupta , Xudong Wang , Joseph E. Gonzalez , Trevor Darrell

Despite their success, large language models (LLMs) face the critical challenge of hallucinations, generating plausible but incorrect content. While much research has focused on hallucinations in multiple modalities including images and…

软件工程 · 计算机科学 2024-10-15 Nan Jiang , Qi Li , Lin Tan , Tianyi Zhang

Large Vision Language Models exhibit remarkable capabilities but struggle with hallucinations inconsistencies between images and their descriptions. Previous hallucination evaluation studies on LVLMs have identified hallucinations in terms…

人工智能 · 计算机科学 2024-11-11 Chaoya Jiang , Hongrui Jia , Wei Ye , Mengfan Dong , Haiyang Xu , Ming Yan , Ji Zhang , Shikun Zhang

Large-scale vision-language pre-trained (VLP) models are prone to hallucinate non-existent visual objects when generating text based on visual information. In this paper, we systematically study the object hallucination problem from three…

计算与语言 · 计算机科学 2023-02-13 Wenliang Dai , Zihan Liu , Ziwei Ji , Dan Su , Pascale Fung

Hallucinations in Large Language Models (LLMs) pose a major barrier to their reliable use in critical decision-making. Although existing hallucination detection methods have improved accuracy, they still struggle with disentangling semantic…

计算与语言 · 计算机科学 2026-04-02 Junjie Hu , Gang Tu , ShengYu Cheng , Jinxin Li , Jinting Wang , Rui Chen , Zhilong Zhou , Dongbo Shan

Large Vision-Language Models (LVLMs) often produce responses that misalign with factual information, a phenomenon known as hallucinations. While hallucinations are well-studied, the exact causes behind them remain underexplored. In this…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Sreyan Ghosh , Chandra Kiran Reddy Evuru , Sonal Kumar , Utkarsh Tyagi , Oriol Nieto , Zeyu Jin , Dinesh Manocha

LVLMs achieve remarkable multimodal understanding and generation but remain susceptible to hallucinations. Existing mitigation methods predominantly focus on output-level adjustments, leaving the internal mechanisms that give rise to these…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Guangtao Lyu , Xinyi Cheng , Qi Liu , Chenghao Xu , Jiexi Yan , Muli Yang , Fen Fang , Cheng Deng

Large Language Models (LLMs) have transformed natural language processing (NLP) tasks, but they suffer from hallucination, generating plausible yet factually incorrect content. This issue extends to Video-Language Models (VideoLLMs), where…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Ahmad Khalil , Mahmoud Khalil , Alioune Ngom

Visual hallucinations in Large Language Models (LLMs), where the model generates responses that are inconsistent with the visual input, pose a significant challenge to their reliability, particularly in contexts where precise and…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Nokimul Hasan Arif , Shadman Rabby , Md Hefzul Hossain Papon , Sabbir Ahmed

Vision-language models (VLMs) excel in semantic tasks but falter at a core human capability: detecting hidden content in optical illusions or AI-generated images through perceptual adjustments like zooming. We introduce HC-Bench, a…

计算与语言 · 计算机科学 2025-10-16 Sifan Li , Yujun Cai , Yiwei Wang

Promptable segmentation typically requires instance-specific manual prompts to guide the segmentation of each desired object. To minimize such a need, task-generic promptable segmentation has been introduced, which employs a single…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Jian Hu , Jiayi Lin , Junchi Yan , Shaogang Gong

We study fine-grained referring image segmentation via a decoupled reason-then-segment pipeline. A vision-language model (VLM) receives an image and a natural-language query, reasons about the scene, and emits structured spatial prompts: a…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Sandesh Hegde , Jaison Saji Chacko , Debarshi Banerjee , Uma Mahesh

Vision-language models (VLMs) can achieve high accuracy while still accepting culturally plausible but visually incorrect interpretations. Existing hallucination benchmarks rarely test this failure mode, particularly outside Western…

计算与语言 · 计算机科学 2026-04-22 Basel Mousi , Fahim Dalvi , Shammur Chowdhury , Firoj Alam , Nadir Durrani

Hallucinations in Large Language Models (LLMs) pose a significant challenge, generating misleading or unverifiable content that undermines trust and reliability. Existing evaluation methods, such as KnowHalu, employ multi-stage verification…

计算与语言 · 计算机科学 2026-04-10 Chenggong Zhang , Haopeng Wang , Hexi Meng

Medical image segmentation is crucial for clinical diagnosis, yet existing models are limited by their reliance on explicit human instructions and lack the active reasoning capabilities to understand complex clinical questions. While recent…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Yu Huang , Zelin Peng , Yichen Zhao , Piao Yang , Xiaokang Yang , Wei Shen