中文
相关论文

相关论文: Mitigating Entangled Steering in Large Vision-Lang…

200 篇论文

Hallucinations, generating responses inconsistent with the visual input, remain a critical limitation of large vision-language models (LVLMs), especially in open-ended tasks such as image captioning and visual reasoning. In this work, we…

计算机视觉与模式识别 · 计算机科学 2026-01-12 Mehrdad Fazli , Bowen Wei , Ziwei Zhu

Large Language Models (LLMs) are prone to generating plausible yet incorrect responses, known as hallucinations. Effectively detecting hallucinations is therefore crucial for the safe deployment of LLMs. Recent research has linked…

计算与语言 · 计算机科学 2026-03-03 Litian Liu , Reza Pourreza , Sunny Panchal , Apratim Bhattacharyya , Yubing Jian , Yao Qin , Roland Memisevic

Large Vision-Language Models (LVLMs) recently achieve significant breakthroughs in understanding complex visual-textual contexts. However, hallucination issues still limit their real-world applicability. Although previous mitigation methods…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Zhaoxu Li , Chenqi Kong , Yi Yu , Qiangqiang Wu , Xinghao Jiang , Ngai-Man Cheung , Bihan Wen , Alex Kot , Xudong Jiang

Large Vision Language Models (LVLMs) are becoming increasingly important in the medical domain, yet Medical LVLMs (Med-LVLMs) frequently generate hallucinations due to limited expertise and the complexity of medical applications. Existing…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Aofei Chang , Le Huang , Parminder Bhatia , Taha Kass-Hout , Fenglong Ma , Cao Xiao

Large vision-language models (LVLMs) achieve impressive performance on multimodal tasks but often suffer from hallucination, and confidently describe objects or attributes not present in the image. Current training-free interventions…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Mehrdad Fazli , Bowen Wei , Ahmet Sari , Ziwei Zhu

Hallucinations in large vision-language models (LVLMs) pose significant challenges for real-world applications, as LVLMs may generate responses that appear plausible yet remain inconsistent with the associated visual content. This issue…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Xin Dong , Shichao Dong , Jin Wang , Jing Huang , Li Zhou , Zenghui Sun , Lihua Jing , Jingsong Lan , Xiaoyong Zhu , Bo Zheng

Large Vision-Language Models (LVLMs) achieve strong performance on many multimodal tasks, but object hallucinations severely undermine their reliability. Most existing studies focus on the text modality, attributing hallucinations to overly…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Jiale Song , Jiaxin Luo , Xue-song Tang , Kuangrong Hao , Mingbo Zhao

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in multimodal task reasoning. However, they often generate responses that appear plausible yet do not accurately reflect the visual content, a phenomenon known…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Jiaqi Wang , Yifei Gao , Jitao Sang

Large Vision-Language Models (LVLMs) demonstrate remarkable capabilities in multimodal tasks, but visual object hallucination remains a persistent issue. It refers to scenarios where models generate inaccurate visual object-related…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Liqiang Jing , Guiming Hardy Chen , Ehsan Aghazadeh , Xin Eric Wang , Xinya Du

Multimodal large language models (MLLMs) have revolutionized cross-modal understanding but continue to struggle with hallucinations - fabricated content contradicting visual inputs. Existing hallucination mitigation methods either incur…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Shangpin Peng , Senqiao Yang , Li Jiang , Zhuotao Tian

Large Audio-Language Models and Multi-Modal Large Language Models have demonstrated strong capabilities in tasks such as Audio Question Answering (AQA), Audio Captioning, and Automatic Speech Recognition (ASR). However, there is growing…

声音 · 计算机科学 2025-10-16 Tsung-En Lin , Kuan-Yi Lee , Hung-Yi Lee

Recent advancements in Multimodal Large Language Models (MLLMs) have enabled them to effectively integrate vision and language, addressing a variety of downstream tasks. However, despite their significant success, these models still exhibit…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Zixian Gao , Chao Yang , Zhanhui Zhou , Xing Xu , Chaochao Lu

Despite achieving outstanding performance on various cross-modal tasks, current large vision-language models (LVLMs) still suffer from hallucination issues, manifesting as inconsistencies between their generated responses and the…

计算机视觉与模式识别 · 计算机科学 2025-06-05 Rui Hu , Yahan Tu , Shuyu Wei , Dongyuan Lu , Jitao Sang

Large language models (LLMs) demonstrate exceptional capabilities, yet still face the hallucination issue. Typical text generation approaches adopt an auto-regressive generation without deliberate reasoning, which often results in…

计算与语言 · 计算机科学 2025-01-06 Xiaoxue Cheng , Junyi Li , Wayne Xin Zhao , Ji-Rong Wen

Object hallucination is a significant challenge that hinders the application of large vision-language models (LVLMs) in practice. We hypothesize that one possible origin of hallucination is the model's tendency to prioritize text generation…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Meng Shen , Minghao Wu , Deepu Rajan

Hallucinations in LLMs pose a significant concern to their safe deployment in real-world applications. Recent approaches have leveraged the latent space of LLMs for hallucination detection, but their embeddings, optimized for linguistic…

机器学习 · 计算机科学 2025-05-23 Seongheon Park , Xuefeng Du , Min-Hsuan Yeh , Haobo Wang , Yixuan Li

Recent advancements in multimodal large reasoning models (MLRMs) have significantly improved performance in visual question answering. However, we observe that transition words (e.g., because, however, and wait) are closely associated with…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Zhongxing Xu , Zhonghua Wang , Zhe Qian , Dachuan Shi , Feilong Tang , Ming Hu , Shiyan Su , Xiaocheng Zou , Wei Feng , Dwarikanath Mahapatra , Yifan Peng , Mingquan Lin , Zongyuan Ge

Large Language Models (LLMs) and Large Reasoning Models (LRMs) offer transformative potential for high-stakes domains like finance and law, but their tendency to hallucinate, generating factually incorrect or unsupported content, poses a…

人工智能 · 计算机科学 2026-01-16 Ahmad Pesaranghader , Erin Li

Multilingual Large Language Models (LLMs) often exhibit hallucinations such as unintended code-switching, reducing reliability in downstream tasks. We propose latent-space language steering, a lightweight inference-time method that…

计算与语言 · 计算机科学 2026-04-16 Andrey Goncharov , Nikolai Kondusov , Alexey Zaytsev

Large Multimodal Models (LMMs) have achieved impressive progress in visual perception and reasoning. However, when confronted with visually ambiguous or non-semantic scene text, they often struggle to accurately spot and understand the…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Yan Shu , Hangui Lin , Yexin Liu , Yan Zhang , Gangyan Zeng , Yan Li , Yu Zhou , Ser-Nam Lim , Harry Yang , Nicu Sebe