English
Related papers

Related papers: VIP: Visual Information Protection through Adversa…

200 papers

The robustness of Vision-Language Models (VLMs) such as CLIP is critical for their deployment in safety-critical applications like autonomous driving, healthcare diagnostics, and security systems, where accurate interpretation of visual and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yuhan Liang , Yijun Li , Yumeng Niu , Qianhe Shen , Hangyu Liu

Vision-Language Models (VLMs) have witnessed a surge in both research and real-world applications. However, as they are becoming increasingly prevalent, ensuring their robustness against adversarial attacks is paramount. This work…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Rishika Bhagwatkar , Shravan Nayak , Reza Bayat , Alexis Roger , Daniel Z Kaplan , Pouya Bashivan , Irina Rish

Deploying large vision-language models (LVLMs) introduces a unique vulnerability: susceptibility to malicious attacks via visual inputs. However, existing defense methods suffer from two key limitations: (1) They solely focus on textual…

Cryptography and Security · Computer Science 2025-03-17 Shuyang Hao , Yiwei Wang , Bryan Hooi , Ming-Hsuan Yang , Jun Liu , Chengcheng Tang , Zi Huang , Yujun Cai

On-device Vision-Language Models (VLMs) promise data privacy via local execution. However, we show that the architectural shift toward Dynamic High-Resolution preprocessing (e.g., AnyRes) introduces an inherent algorithmic side-channel.…

Cryptography and Security · Computer Science 2026-03-30 Eyal Hadad , Mordechai Guri

Intelligent Transportation Systems (ITS) rely on a variety of devices that frequently process privacy-sensitive data. Roadside units are important because they use AI-equipped cameras to detect traffic violations in Connected and Autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Abdolazim Rezaei , Mehdi Sookhak , Ahmad Patooghy , Shahab S. Band , Amir Mosavi

Vision-Language Models (VLMs) are increasingly deployed in real-world applications, but their high inference cost makes them vulnerable to resource consumption attacks. Prior attacks attempt to extend VLM output sequences by optimizing…

Cryptography and Security · Computer Science 2025-08-27 Rui Zhang , Zihan Wang , Tianli Yang , Hongwei Li , Wenbo Jiang , Qingchuan Zhao , Yang Liu , Guowen Xu

Vision Language Models (VLMs) are increasingly integrated into privacy-critical domains, yet existing evaluations of personally identifiable information (PII) leakage largely treat privacy as a static extraction task and ignore how a…

Artificial Intelligence · Computer Science 2026-01-12 G M Shahariar , Zabir Al Nazi , Md Olid Hasan Bhuiyan , Zhouxing Shi

Visual language pre-training (VLP) models have demonstrated significant success across various domains, yet they remain vulnerable to adversarial attacks. Addressing these adversarial vulnerabilities is crucial for enhancing security in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Dehong Kong , Siyuan Liang , Xiaopeng Zhu , Yuansheng Zhong , Wenqi Ren

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in processing and reasoning over diverse modalities, but their advanced abilities also raise significant privacy concerns, particularly regarding Personally…

Cryptography and Security · Computer Science 2025-10-01 Boyang Zhang , Istemi Ekin Akkus , Ruichuan Chen , Alice Dethise , Klaus Satzke , Ivica Rimac , Yang Zhang

Vision-language models (VLMs) are increasingly deployed as trusted authorities -- fact-checking images on social media, comparing products, and moderating content. Users implicitly trust that these systems perceive the same visual content…

Cryptography and Security · Computer Science 2026-05-07 Jie Zhang , Pura Peetathawatchai , Florian Tramèr , Avital Shafran

The emergence of Multimodal Large Language Models (MLLMs) and the widespread usage of MLLM cloud services such as GPT-4V raised great concerns about privacy leakage in visual data. As these models are typically deployed in cloud services,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xiaofei Hui , Qian Wu , Haoxuan Qu , Majid Mirmehdi , Hossein Rahmani , Jun Liu

Vision Large Language Models (VLLMs) are increasingly deployed to offer advanced capabilities on inputs comprising both text and images. While prior research has shown that adversarial attacks can transfer from open-source to proprietary…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Kai Hu , Weichen Yu , Li Zhang , Alexander Robey , Andy Zou , Chengming Xu , Haoqi Hu , Matt Fredrikson

In the age of agentic AI, the growing deployment of multi-modal models (MMs) has introduced new attack vectors that can leak sensitive training data in MMs, causing privacy leakage. This paper investigates a black-box privacy attack, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 David Amebley , Sayanton Dibbo

Vision-Language Models (VLMs) such as GPT-4o now demonstrate a remarkable ability to infer users' locations from public shared images, posing a substantial risk to geoprivacy. Although adversarial perturbations offer a potential defense,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xinwei Liu , Xiaojun Jia , Yuan Xun , Simeng Qin , Xiaochun Cao

Recent advances in biometric systems have significantly improved the detection and prevention of fraudulent activities. However, as detection methods improve, attack techniques become increasingly sophisticated. Attacks on face recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Lazaro Janier Gonzalez-Soler , Maciej Salwowski , Christoph Busch

Multimodal large language models (MLLMs), which bridge the gap between audio-visual and natural language processing, achieve state-of-the-art performance on several audio-visual tasks. Despite the superior performance of MLLMs, the scarcity…

Cryptography and Security · Computer Science 2025-06-16 Jinming Wen , Xinyi Wu , Shuai Zhao , Yanhao Jia , Yuwen Li

Fine-tuning pre-trained Vision-Language Models (VLMs) has shown remarkable capabilities in medical image and textual depiction synergy. Nevertheless, many pre-training datasets are restricted by patient privacy concerns, potentially…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Xu Han , Linghao Jin , Xuezhe Ma , Xiaofeng Liu

Large Language Models (LLMs) represent a transformative leap in artificial intelligence, enabling the comprehension, generation, and nuanced interaction with human language on an unparalleled scale. However, LLMs are increasingly vulnerable…

Cryptography and Security · Computer Science 2025-02-06 Nan Wang , Kane Walter , Yansong Gao , Alsharif Abuadbba

Vision-language models (VLMs) have demonstrated strong performance in image geolocation, a capability further sharpened by frontier multimodal large reasoning models (MLRMs). This poses a significant privacy risk, as these widely accessible…

Cryptography and Security · Computer Science 2026-02-19 Ruixin Yang , Ethan Mendes , Arthur Wang , James Hays , Sauvik Das , Wei Xu , Alan Ritter

The improved semantic understanding of vision-language pretrained (VLP) models has made it increasingly difficult to protect publicly posted images from being exploited by search engines and other similar tools. In this context, this paper…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Xuelin Shen , Jiayin Xu , Kangsheng Yin , Wenhan Yang