English
Related papers

Related papers: Enhancing Abnormality Grounding for Vision Languag…

200 papers

Large Vision Language Models (LVLMs) excel in various vision-language tasks. Yet, their robustness to visual variations in position, scale, orientation, and context that objects in natural scenes inevitably exhibit due to changes in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zhiyuan Fan , Yumeng Wang , Sandeep Polisetty , Yi R. Fung

Vision-language models (VLMs) have shown promise in 2D medical image analysis, but extending them to 3D remains challenging due to the high computational demands of volumetric data and the difficulty of aligning 3D spatial features with…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Yu Xin , Gorkem Can Ates , Kuang Gong , Wei Shao

Vision-Language Models (VLMs) excel at high-level scene understanding but falter on fine-grained perception tasks requiring precise localization. This failure stems from a fundamental mismatch, as generating exact numerical coordinates is a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Peng Liu , Haozhan Shen , Chunxin Fang , Zhicheng Sun , Jiajia Liao , Tiancheng Zhao

Material classification has emerged as a critical task in computer vision and graphics, supporting the assignment of accurate material properties to a wide range of digital and real-world applications. While traditionally framed as an image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Qingran Lin , Fengwei Yang , Chaolun Zhu

Automated radiology report generation is key for reducing radiologist workload and improving diagnostic consistency, yet generating accurate reports for 3D medical imaging remains challenging. Existing vision-language models face two…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Pengcheng Shi , Minghui Zhang , Kehan Song , Jiaqi Liu , Yun Gu , Xinglin Zhang

Vision Language Models (VLMs) have shown promise in automating image diagnosis and interpretation in clinical settings. However, developing specialist medical VLMs requires substantial computational resources and carefully curated datasets,…

Image and Video Processing · Electrical Eng. & Systems 2026-03-31 Yuan Zhong , Ruinan Jin , Qi Dou , Xiaoxiao Li

Multimodal Large Language Models (MLLMs) have demonstrated impressive progress in single-image grounding and general multi-image understanding. Recently, some methods begin to address multi-image grounding. However, they are constrained by…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Shurong Zheng , Yousong Zhu , Hongyin Zhao , Fan Yang , Yufei Zhan , Ming Tang , Jinqiao Wang

Despite the impressive performance of vision-language models (VLMs) on downstream tasks, their ability to understand and reason about causal relationships in visual inputs remains unclear. Robust causal reasoning is fundamental to solving…

Computation and Language · Computer Science 2026-02-05 Zhaotian Weng , Haoxuan Li , Xin Eric Wang , Kuan-Hao Huang , Jieyu Zhao

Vision Language Models (VLMs) perform well on standard video tasks but struggle with physics-related reasoning involving motion dynamics and spatial interactions. We present a novel approach to address this gap by translating physical-world…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xiyang Wu , Zongxia Li , Jihui Jin , Guangyao Shi , Gouthaman KV , Vishnu Raj , Nilotpal Sinha , Jingxi Chen , Fan Du , Dinesh Manocha

Large Vision and Language Models (LVLMs) have shown strong performance across various vision-language tasks in natural image domains. However, their application to remote sensing (RS) remains underexplored due to significant domain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Sungjune Park , Yeongyun Kim , Se Yeon Kim , Yong Man Ro

Clinical abnormality grounding for rare diseases is often hindered by data scarcity, making supervised fine-tuning impractical and single-pass inference highly unstable. We propose Dynamic Decision Learning (DDL), a framework that enables…

Computation and Language · Computer Science 2026-04-29 Jun Li , Mingxuan Liu , Jiazhen Pan , Che Liu , Wenjia Bai , Cosmin I. Bercea , Julia A. Schnabel

Vision-language models typically reason over post-ISP RGB images, although RGB rendering can clip, suppress, or quantize sensor evidence before inference. We study whether grounding improves when the visual interface is moved closer to the…

Artificial Intelligence · Computer Science 2026-05-13 Kepeng Xu , Li Xu , Gang He , Wenxin Yu

Safe autonomous systems in complex environments require robust road anomaly segmentation to identify unknown obstacles. However, existing approaches often rely on pixel-level statistics to determine whether a region appears anomalous. This…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhuolin He , Jiacheng Tang , Jian Pu , Xiangyang Xue

Deploying vision-language models (VLMs) in clinical settings demands auditable behavior under realistic failure conditions, yet the failure landscape of frontier VLMs on specialized medical inputs is poorly characterized. We audit five…

Artificial Intelligence · Computer Science 2026-05-01 Xupeng Chen , Binbin Shi , Chenqian Le , Qifu Yin , Lang Lin , Haowei Ni , Ran Gong , Panfeng Li

The rapid development of Large Multimodal Models (LMMs) has significantly advanced multimodal understanding by harnessing the language abilities of Large Language Models (LLMs) and integrating modality-specific encoders. However, LMMs are…

Computation and Language · Computer Science 2025-02-20 Anirudh Phukan , Divyansh , Harshit Kumar Morj , Vaishnavi , Apoorv Saxena , Koustava Goswami

Enhancing semantic grounding abilities in Vision-Language Models (VLMs) often involves collecting domain-specific training data, refining the network architectures, or modifying the training recipes. In this work, we venture into an…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yuan-Hong Liao , Rafid Mahmood , Sanja Fidler , David Acuna

Large Vision-Language Models (VLMs) rely on effective multimodal alignment between pre-trained vision encoders and Large Language Models (LLMs) to integrate visual and textual information. This paper presents a comprehensive analysis of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Shweta Mahajan , Hoang Le , Hyojin Park , Farzad Farhadzadeh , Munawar Hayat , Fatih Porikli

Iconicity, the resemblance between linguistic form and meaning, is pervasive in signed languages, offering a natural testbed for visual grounding. For vision-language models (VLMs), the challenge is to recover such essential mappings from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Onur Keleş , Aslı Özyürek , Gerardo Ortega , Kadir Gökgöz , Esam Ghaleb

Vision-Language Models (VLMs) have attained exceptional success across multimodal tasks such as image captioning and visual question answering. However, their robustness under noisy conditions remains unfamiliar. In this study, we present a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Purushoth , Alireza

Do vision--language models (VLMs) develop more human-like sensitivity to linguistic concreteness than text-only large language models (LLMs) when both are evaluated with text-only prompts? We study this question with a controlled comparison…

Computation and Language · Computer Science 2026-01-27 Aryan Roy , Zekun Wang , Christopher J. MacLellan