English
Related papers

Related papers: Do Vision-Language Models Respect Contextual Integ…

200 papers

Vision language models (VLMs) are designed to extract relevant visuospatial information from images. Some research suggests that VLMs can exhibit humanlike scene understanding, while other investigations reveal difficulties in their ability…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Sangeet Khemlani , Tyler Tran , Nathaniel Gyory , Anthony M. Harrison , Wallace E. Lawson , Ravenna Thielstrom , Hunter Thompson , Taaren Singh , J. Gregory Trafton

The advances in Vision-Language models (VLMs) offer exciting opportunities for robotic applications involving image geo-localization, the problem of identifying the geo-coordinates of a place based on visual data only. Recent research works…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Sania Waheed , Bruno Ferrarini , Michael Milford , Sarvapali D. Ramchurn , Shoaib Ehsan

The proliferation of visual sensors in smart home environments, particularly through wearable devices like smart glasses, introduces profound privacy challenges. Existing privacy controls are often static and coarse-grained, failing to…

Human-Computer Interaction · Computer Science 2025-08-04 Shuning Zhang , Ying Ma , Xin Yi , Hewu Li

Investigating value alignment in Large Language Models (LLMs) based on cultural context has become a critical area of research. However, similar biases have not been extensively explored in large vision-language models (VLMs). As the scale…

Computation and Language · Computer Science 2025-02-24 Srishti Yadav , Zhi Zhang , Daniel Hershcovich , Ekaterina Shutova

Vision-Language Models (VLMs) have demonstrated impressive capabilities across a range of tasks, yet concerns about their potential biases exist. This work investigates the extent to which prominent VLMs exhibit cultural biases by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ram Mohan Rao Kadiyala , Siddhant Gupta , Jebish Purbey , Srishti Yadav , Suman Debnath , Alejandro Salamanca , Desmond Elliott

Vision-Language Models (VLMs) have recently shown remarkable progress in multimodal reasoning, yet their applications in autonomous driving remain limited. In particular, the ability to understand road topology, a key requirement for safe…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Xin Chen , Jia He , Maozheng Li , Dongliang Xu , Tianyu Wang , Yixiao Chen , Zhixin Lin , Yue Yao

Vision-language models (VLMs) have advanced rapidly, yet their capacity for image-grounded geolocation in open-world conditions, a task that is challenging and of demand in real life, has not been comprehensively evaluated. We present…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Zhaofang Qian , Hardy Chen , Zeyu Wang , Li Zhang , Zijun Wang , Xiaoke Huang , Hui Liu , Xianfeng Tang , Zeyu Zheng , Haoqin Tu , Cihang Xie , Yuyin Zhou

The widespread use of cameras in our society has created an overwhelming amount of video data, far exceeding the capacity for human monitoring. This presents a critical challenge for public safety and security, as the timely detection of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Pascal Benschop , Cristian Meo , Justin Dauwels , Jelte P. Mense

Recent years have witnessed remarkable progress in developing Vision-Language Models (VLMs) capable of processing both textual and visual inputs. These models have demonstrated impressive performance, leading to their widespread adoption in…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 Hanene F. Z. Brachemi Meftah , Wassim Hamidouche , Sid Ahmed Fezza , Olivier Déforges

Vision-language models (VLMs) have demonstrated remarkable capabilities in understanding and reasoning about visual content, but significant challenges persist in tasks requiring cross-viewpoint understanding and spatial reasoning. We…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Dingming Li , Hongxing Li , Zixuan Wang , Yuchen Yan , Hang Zhang , Siqi Chen , Guiyang Hou , Shengpei Jiang , Wenqi Zhang , Yongliang Shen , Weiming Lu , Yueting Zhuang

Vision-Language Models (VLMs) have demonstrated strong capabilities in aligning visual and textual modalities, enabling a wide range of applications in multimodal understanding and generation. While they excel in zero-shot and transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Hao Dong , Moru Liu , Jian Liang , Eleni Chatzi , Olga Fink

This work tackles the problem of geo-localization with a new paradigm using a large vision-language model (LVLM) augmented with human inference knowledge. A primary challenge here is the scarcity of data for training the LVLM - existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Ling Li , Yu Ye , Yao Zhou , Bingchuan Jiang , Wei Zeng

Large Vision-Language Models (LVLMs) exhibit impressive potential across various tasks but also face significant privacy risks, limiting their practical applications. Current researches on privacy assessment for LVLMs is limited in scope,…

Cryptography and Security · Computer Science 2026-03-03 Jie Zhang , Xiangkui Cao , Zhouyu Han , Shiguang Shan , Xilin Chen

Image geolocalization, the task of identifying the geographic location depicted in an image, is important for applications in crisis response, digital forensics, and location-based intelligence. While recent advances in large language…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Lingyao Li , Runlong Yu , Qikai Hu , Bowei Li , Min Deng , Yang Zhou , Xiaowei Jia

Large-scale Vision Language Models (LVLMs) exhibit advanced capabilities in tasks that require visual information, including object detection. These capabilities have promising applications in various industrial domains, such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Haruki Sakajo , Hiroshi Takato , Hiroshi Tsutsui , Komei Soda , Hidetaka Kamigaito , Taro Watanabe

Recent advances in biometric systems have significantly improved the detection and prevention of fraudulent activities. However, as detection methods improve, attack techniques become increasingly sophisticated. Attacks on face recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Lazaro Janier Gonzalez-Soler , Maciej Salwowski , Christoph Busch

As Large Language Models (LLMs) are increasingly deployed in sensitive domains such as enterprise and government, ensuring that they adhere to user-defined security policies within context is critical-especially with respect to information…

Computation and Language · Computer Science 2025-09-17 Hwan Chang , Yumin Kim , Yonghyun Jun , Hwanhee Lee

Vision-Language Models (VLMs) are increasingly used as perceptual modules for visual content reasoning, including through captioning and DeepFake detection. In this work, we expose a critical vulnerability of VLMs when exposed to subtle,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Jordan Vice , Naveed Akhtar , Yansong Gao , Richard Hartley , Ajmal Mian

The development of Large Vision-Language Models (LVLMs) is striving to catch up with the success of Large Language Models (LLMs), yet it faces more challenges to be resolved. Very recent works enable LVLMs to localize object-level visual…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Zhipeng Huang , Zhizheng Zhang , Zheng-Jun Zha , Yan Lu , Baining Guo

Following the recent popularity of Large Language Models (LLMs), several attempts have been made to extend them to the visual domain. From having a visual assistant that could guide us through unfamiliar environments to generative models…