English
Related papers

Related papers: Context-Aware Decoding for Faithful Vision-Languag…

200 papers

Multimodal Large Language Models (MLLMs) have demonstrated remarkable proficiency in multimodal tasks. Despite their impressive performance, MLLMs suffer from the modality imbalance issue, where visual information is often underutilized…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Hengzhuang Li , Xinsong Zhang , Qiming Peng , Bin Luo , Han Hu , Dengyang Jiang , Han-Jia Ye , Teng Zhang , Hai Jin

Diffusion Large Language Models (DLLMs) enable fully parallel token decoding but often remain impractical at inference time due to the many denoising iterations required to refine an information-free, fully masked initialization into…

Computation and Language · Computer Science 2025-12-23 Tongyuan Miao , Gary Huang , Kai Jun Han , Annie Jiang

We propose Concept Tokens, a lightweight method that adds a new special token to a pretrained LLM and learns only its embedding from multiple natural language definitions of a target concept, where occurrences of the concept are replaced by…

Computation and Language · Computer Science 2026-01-09 Ignacio Sastre , Aiala Rosá

Vision-language models (VLMs) have recently shown remarkable capabilities in visual understanding and generation, but remain vulnerable to adversarial manipulations of visual content. Prior object-hiding attacks primarily rely on…

Cryptography and Security · Computer Science 2026-03-18 Amira Guesmi , Muhammad Shafique

Large vision-language models (LVLMs) are now central to healthcare applications such as medical visual question answering and imaging report generation. Yet, these models remain vulnerable to hallucination outputs that appear plausible but…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Zahra Mahdavi , Zahra Khodakaramimaghsoud , Hooman Khaloo , Sina Bakhshandeh Taleshani , Erfan Hashemi , Javad Mirzapour Kaleybar , Omid Nejati Manzari

Large Vision-Language Models (LVLMs) achieve strong performance on many multimodal tasks, but object hallucinations severely undermine their reliability. Most existing studies focus on the text modality, attributing hallucinations to overly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Jiale Song , Jiaxin Luo , Xue-song Tang , Kuangrong Hao , Mingbo Zhao

Vision language models (VLMs) are increasingly capable of reasoning over images, but robust visual reasoning often requires re-grounding intermediate steps in the underlying visual evidence. Recent approaches typically rely on external…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zeru Shi , Kai Mei , Yihao Quan , Dimitris N. Metaxas , Ruixiang Tang

Hallucinations in large vision-language models (LVLMs) pose significant challenges for real-world applications, as LVLMs may generate responses that appear plausible yet remain inconsistent with the associated visual content. This issue…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Xin Dong , Shichao Dong , Jin Wang , Jing Huang , Li Zhou , Zenghui Sun , Lihua Jing , Jingsong Lan , Xiaoyong Zhu , Bo Zheng

Large language models (LLMs) often generate hallucinated content that lacks factual or contextual grounding, limiting their reliability in critical applications. Existing approaches such as supervised fine-tuning and reinforcement learning…

Computation and Language · Computer Science 2025-12-23 Jensen Zhang , Ningyuan Liu , Yijia Fan , Zihao Huang , Qinglin Zeng , Kaitong Cai , Jian Wang , Keze Wang

While Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to generate contextually grounded responses, contextual faithfulness remains challenging as LLMs may not consistently trust provided context, leading to…

Computation and Language · Computer Science 2026-02-10 Yongchao Long , Xian Wu , Yingying Zhang , Xianbin Wen , Yuxi Zhou , Shenda Hong

Large vision-language models (LVLMs) are prone to hallucinations, where certain contextual cues in an image can trigger the language module to produce overconfident and incorrect reasoning about abnormal or hypothetical objects. While some…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Xiyang Wu , Tianrui Guan , Dianqi Li , Shuaiyi Huang , Xiaoyu Liu , Xijun Wang , Ruiqi Xian , Abhinav Shrivastava , Furong Huang , Jordan Lee Boyd-Graber , Tianyi Zhou , Dinesh Manocha

Despite the recent breakthroughs achieved by Large Vision Language Models (LVLMs) in understanding and responding to complex visual-textual contexts, their inherent hallucination tendencies limit their practical application in real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Junzhe Chen , Tianshu Zhang , Shiyu Huang , Yuwei Niu , Linfeng Zhang , Lijie Wen , Xuming Hu

The present study introduces the knowledge-augmented generator, which is specifically designed to produce information that remains grounded in contextual knowledge, regardless of alterations in the context. Previous research has…

Computation and Language · Computer Science 2024-02-23 Xinshuo Hu , Baotian Hu , Dongfang Li , Xiaoguang Li , Lifeng Shang

Multimodal large language models (MLLMs) have achieved remarkable progress in vision-language reasoning, yet they remain vulnerable to hallucination, where generated content deviates from visual evidence. Existing mitigation strategies…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xingyu Zhu , Kesen Zhao , Liang Yi , Shuo Wang , Zhicai Wang , Beier Zhu , Hanwang Zhang

Large Vision Language Models (LVLMs) excel at semantic understanding but struggle with fine grained spatial grounding, as the model must implicitly infer complex geometry without ever producing a spatial interpretation. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuchen Li , Amanmeet Garg , Shalini Chaudhuri , Rui Zhao , Garin Kessler

Nowadays, the research on Large Vision-Language Models (LVLMs) has been significantly promoted thanks to the success of Large Language Models (LLM). Nevertheless, these Vision-Language Models (VLMs) are suffering from the drawback of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Hongyu Hu , Jiyuan Zhang , Minyi Zhao , Zhenbang Sun

The emergence of large language models (LLMs) is a milestone in generative artificial intelligence, achieving significant success in text comprehension and generation tasks. Despite the tremendous success of LLMs in many downstream tasks,…

Computation and Language · Computer Science 2024-07-16 He Li , Haoang Chi , Mingyu Liu , Wenjing Yang

Hallucinations remain a persistent challenge for vision-language models (VLMs), which often describe nonexistent objects or fabricate facts. Existing detection methods typically operate after text generation, making intervention both costly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Sai Akhil Kogilathota , Sripadha Vallabha E G , Luzhe Sun , Jiawei Zhou

The rapid emergence of new entities -- driven by cultural shifts, evolving trends, and personalized user data -- poses a significant challenge for existing Speech Large Language Models (Speech LLMs). While these models excel at general…

Artificial Intelligence · Computer Science 2026-02-06 Peidong Wang

Leveraging large-scale Text-to-Image (TTI) models have become a common technique for generating exemplar or training dataset in the fields of image synthesis, video editing, 3D reconstruction. However, semantic structural visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Bumsoo Kim , Wonseop Shin , Kyuchul Lee , Yonghoon Jung , Sanghyun Seo