English
Related papers

Related papers: DiffSpot: Can VLMs Spot Fine-Grained Visual Differ…

200 papers

Few-shot semantic segmentation (FSS) aims to enable models to segment novel/unseen object classes using only a limited number of labeled examples. However, current FSS methods frequently struggle with generalization due to incomplete and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Amin Karimi , Charalambos Poullis

Understanding visual differences between dynamic scenes requires the comparative perception of compositional, spatial, and temporal changes--a capability that remains underexplored in existing vision-language systems. While prior work on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jiangtao Wu , Shihao Li , Zhaozhou Bian , Jialu Chen , Runzhe Wen , An Ping , Yiwen He , Jiakai Wang , Yuanxing Zhang , Jiaheng Liu

Vision-language models (VLMs) achieve strong performance on spatial reasoning benchmarks, yet it remains unclear whether this reflects structured 3D understanding or reliance on statistical shortcuts in natural images. We introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Cheolhong Min , Jaeyun Jung , Daeun Lee , Hyeonseong Jeon , Yu Su , Jonathan Tremblay , Chan Hee Song , Jaesik Park

The recent developments in deep learning led to the integration of natural language processing (NLP) with computer vision, resulting in powerful integrated Vision and Language Models (VLMs). Despite their remarkable capabilities, these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Harshit , Tolga Tasdizen

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in visual understanding and multimodal reasoning. However, LVLMs frequently exhibit hallucination phenomena, manifesting as the generated textual responses that…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Ziyun Dai , Xiaoqiang Li , Shaohua Zhang , Yuanchen Wu , Jide Li

Is basic visual understanding really solved in state-of-the-art VLMs? We present VisualOverload, a slightly different visual question answering (VQA) benchmark comprising 2,720 question-answer pairs, with privately held ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Paul Gavrikov , Wei Lin , M. Jehanzeb Mirza , Soumya Jahagirdar , Muhammad Huzaifa , Sivan Doveh , Serena Yeung-Levy , James Glass , Hilde Kuehne

With the rapid advancement of deep learning, the field of change detection (CD) in remote sensing imagery has achieved remarkable progress. Existing change detection methods primarily focus on achieving higher accuracy with increased…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Chenfeng Xu

This paper offers a mini review of Visual Word Sense Disambiguation (VWSD), which is a multimodal extension of traditional Word Sense Disambiguation (WSD). VWSD helps tackle lexical ambiguity in vision-language tasks. While conventional WSD…

Computation and Language · Computer Science 2026-02-03 Shashini Nilukshi , Deshan Sumanathilaka

When VLMs answer correctly, do they genuinely rely on visual information? We introduce a Tri-Layer Diagnostic Framework with three per-sample metrics: Latent Anomaly Detection, Visual Necessity Score, and Competition Score, which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Rui Hong , Shuxue Quan

Sign language translation (SLT) is challenging, as it involves converting sign language videos into natural language. Previous studies have prioritized accuracy over diversity. However, diversity is crucial for handling lexical and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 JiHwan Moon , Jihoon Park , Jungeun Kim , Jongseong Bae , Hyeongwoo Jeon , Ha Young Kim

When it comes to classifying child sexual abuse images, managing similar inter-class correlations and diverse intra-class correlations poses a significant challenge. Vision transformer models, unlike conventional deep convolutional network…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Hanxian He , Campbell Wilson , Thanh Thi Nguyen , Janis Dalins

Recent advances in Large Vision-Language Models (LVLMs) have significantly improve performance in image comprehension tasks, such as formatted charts and rich-content images. Yet, Graphical User Interface (GUI) pose a greater challenge due…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Ziyang Meng , Yu Dai , Zezheng Gong , Shaoxiong Guo , Minglong Tang , Tongquan Wei

The advancement of large language models (LLMs) has significantly broadened the scope of applications in natural language processing, with multi-modal LLMs extending these capabilities to integrate and interpret visual data. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Bingchen Zhao , Yongshuo Zong , Letian Zhang , Timothy Hospedales

Contrastively-trained Vision-Language Models (VLMs), such as CLIP, have become the standard approach for learning discriminative vision-language representations. However, these models often exhibit shallow language understanding,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Ioanna Ntinou , Alexandros Xenos , Yassine Ouali , Adrian Bulat , Georgios Tzimiropoulos

Large Vision-Language Models (LVLMs) have achieved impressive progress across various applications but remain vulnerable to malicious queries that exploit the visual modality. Existing alignment approaches typically fail to resist malicious…

Cryptography and Security · Computer Science 2025-11-18 Yitong Zhang , Jia Li , Liyi Cai , Ge Li

The growing sophistication of deepfakes presents substantial challenges to the integrity of media and the preservation of public trust. Concurrently, vision-language models (VLMs), large language models enhanced with visual reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shahroz Tariq , David Nguyen , M. A. P. Chamikara , Tingmin Wu , Alsharif Abuadbba , Kristen Moore

Recent advances in multimodal large language models (MLLMs) have enabled impressive progress in vision-language understanding, yet their high computational cost limits deployment in resource-constrained scenarios such as personal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Quoc-Huy Trinh , Mustapha Abdullahi , Bo Zhao , Debesh Jha

Humans develop perception through a bottom-up hierarchy: from basic primitives and Gestalt principles to high-level semantics. In contrast, current Multimodal Large Language Models (MLLMs) are trained directly on complex downstream tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jen-Tse Huang , Dasen Dai , Jen-Yuan Huang , Youliang Yuan , Xiaoyuan Liu , Wenxuan Wang , Wenxiang Jiao , Pinjia He , Zhaopeng Tu , Haodong Duan

Multimodal large language models (MLLMs) typically extract visual features from the final layers of a pretrained Vision Transformer (ViT). This widespread deep-layer bias, however, is largely driven by empirical convention rather than…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Haoran Chen , Junyan Lin , Xinghao Chen , Yue Fan , Jianfeng Dong , Xin Jin , Hui Su , Jinlan Fu , Xiaoyu Shen

Diffusion models have significantly improved text-to-image generation, producing high-quality, realistic images from textual descriptions. Beyond generation, object-level image editing remains a challenging problem, requiring precise…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Marco Schouten , Mehmet Onurcan Kaya , Serge Belongie , Dim P. Papadopoulos