中文
相关论文

相关论文: Interpreting and Editing Vision-Language Represent…

200 篇论文

Instruction-following Vision Large Language Models (VLLMs) have achieved significant progress recently on a variety of tasks. These approaches merge strong pre-trained vision models and large language models (LLMs). Since these components…

机器学习 · 计算机科学 2024-02-20 Yiyang Zhou , Chenhang Cui , Rafael Rafailov , Chelsea Finn , Huaxiu Yao

Hallucinations in large vision-language models (LVLMs) pose significant challenges for real-world applications, as LVLMs may generate responses that appear plausible yet remain inconsistent with the associated visual content. This issue…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Xin Dong , Shichao Dong , Jin Wang , Jing Huang , Li Zhou , Zenghui Sun , Lihua Jing , Jingsong Lan , Xiaoyong Zhu , Bo Zheng

Large language models (LLMs) possess extensive world knowledge, including geospatial knowledge, which has been successfully applied to various geospatial tasks such as mobility prediction and social indicator prediction. However, LLMs often…

计算与语言 · 计算机科学 2025-07-29 Shengyuan Wang , Jie Feng , Tianhui Liu , Dan Pei , Yong Li

Integration of Large Language Models (LLMs) into visual domain tasks, resulting in visual-LLMs (V-LLMs), has enabled exceptional performance in vision-language tasks, particularly for visual question answering (VQA). However, existing…

计算机视觉与模式识别 · 计算机科学 2024-04-12 Kanchana Ranasinghe , Satya Narayan Shukla , Omid Poursaeed , Michael S. Ryoo , Tsung-Yu Lin

Large Vision-Language Models (LVLMs) have demonstrated impressive multimodal reasoning capabilities, but they remain susceptible to hallucination, particularly object hallucination where non-existent objects or incorrect attributes are…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Cong-Duy Nguyen , Xiaobao Wu , Duc Anh Vu , Shuai Zhao , Thong Nguyen , Anh Tuan Luu

Vision language models (VLMs) perceive the world through a combination of a visual encoder and a large language model (LLM). The visual encoder, pre-trained on large-scale vision-text datasets, provides zero-shot generalization to visual…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Moon Ye-Bin , Nam Hyeon-Woo , Wonseok Choi , Tae-Hyun Oh

Large language models (LLMs) have demonstrated remarkable performance on various natural language processing tasks. However, they are prone to generating fluent yet untruthful responses, known as "hallucinations". Hallucinations can lead to…

计算与语言 · 计算机科学 2024-06-18 Minda Hu , Bowei He , Yufei Wang , Liangyou Li , Chen Ma , Irwin King

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

计算与语言 · 计算机科学 2025-09-19 Martin Preiß

Vision-Language Models (VLMs) often yield inconsistent descriptions of the same object across viewpoints, hindering the ability of embodied agents to construct consistent semantic representations over time. Previous methods resolved…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Tommaso Galliena , Stefano Rosa , Tommaso Apicella , Pietro Morerio , Alessio Del Bue , Lorenzo Natale

Large language models (LLMs) have shown remarkable performance in natural language processing (NLP) tasks. To comprehend and execute diverse human instructions over image data, instruction-tuned large vision-language models (LVLMs) have…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Lei Wang , Jiabang He , Shenshen Li , Ning Liu , Ee-Peng Lim

Object hallucination in Large Vision-Language Models (LVLMs) significantly impedes their real-world applicability. As the primary component for accurately interpreting visual information, the choice of visual encoder is pivotal. We…

计算机视觉与模式识别 · 计算机科学 2025-09-18 Weihang Wang , Xinhao Li , Ziyue Wang , Yan Pang , Jielei Zhang , Peiyi Li , Qiang Zhang , Longwen Gao

Vision-Language Models (VLMs) have recently demonstrated remarkable capabilities in comprehending complex visual content. However, the mechanisms underlying how VLMs process visual information remain largely unexplored. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Omri Kaduri , Shai Bagon , Tali Dekel

Vision-Language Models (VLMs) have demonstrated remarkable progress in multimodal tasks, but remain susceptible to hallucinations, where generated text deviates from the underlying visual content. Existing hallucination detection methods…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Feiran Zhang , Yixin Wu , Zhenghua Wang , Xiaohua Wang , Changze Lv , Xuanjing Huang , Xiaoqing Zheng

The emergence of large language models (LLMs) is a milestone in generative artificial intelligence, achieving significant success in text comprehension and generation tasks. Despite the tremendous success of LLMs in many downstream tasks,…

计算与语言 · 计算机科学 2024-07-16 He Li , Haoang Chi , Mingyu Liu , Wenjing Yang

Hallucinations pose a significant challenge to the reliability of large vision-language models, making their detection essential for ensuring accuracy in critical applications. Current detection methods often rely on computationally…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Eunkyu Park , Minyeong Kim , Gunhee Kim

Multimodal Large Language Models (MLLMs) represent the cutting edge of AI technology, with DeepSeek models emerging as a leading open-source alternative offering competitive performance to closed-source systems. While these models…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Chashi Mahiul Islam , Samuel Jacob Chacko , Preston Horne , Xiuwen Liu

Detecting hallucinations in large language models (LLMs) remains a fundamental challenge for their trustworthy deployment. Going beyond basic uncertainty-driven hallucination detection frameworks, we propose a simple yet powerful method…

人工智能 · 计算机科学 2025-10-10 Rui Wang , Zeming Wei , Guanzhang Yue , Meng Sun

Despite the rapid success of Large Vision-Language Models (LVLMs), a persistent challenge is their tendency to generate hallucinated content, undermining reliability in real-world use. Existing training-free methods address hallucinations…

计算机视觉与模式识别 · 计算机科学 2026-01-05 Neeraj Anand , Samyak Jha , Udbhav Bamba , Rahul Rahaman

Large Vision-Language Models (VLMs) often exhibit text inertia, where attention drifts from visual evidence toward linguistic priors, resulting in object hallucinations. Existing decoding strategies intervene only at the output logits and…

计算机视觉与模式识别 · 计算机科学 2025-12-08 Weijue Bu , Guan Yuan , Guixian Zhang

While large vision-language models (LVLMs) have shown impressive capabilities in generating plausible responses correlated with input visual contents, they still suffer from hallucinations, where the generated text inaccurately reflects…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Yi-Lun Lee , Yi-Hsuan Tsai , Wei-Chen Chiu