English
Related papers

Related papers: Model-agnostic Adversarial Attack and Defense for …

200 papers

Vision-Language (VL) pre-trained models have shown their superiority on many multimodal tasks. However, the adversarial robustness of such models has not been fully explored. Existing approaches mainly focus on exploring the adversarial…

Cryptography and Security · Computer Science 2024-02-07 Ziyi Yin , Muchao Ye , Tianrong Zhang , Tianyu Du , Jinguo Zhu , Han Liu , Jinghui Chen , Ting Wang , Fenglong Ma

With Vision-Language Pre-training (VLP) models demonstrating powerful multimodal interaction capabilities, the application scenarios of neural networks are no longer confined to unimodal domains but have expanded to more complex multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Haonan Zheng , Xinyang Deng , Wen Jiang , Wenrui Li

The widespread use of Vision Language Models (VLMs, e.g. CLIP) has raised concerns about their vulnerability to sophisticated and imperceptible adversarial attacks. These attacks could compromise model performance and system security in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Xiaowei Fu , Lei Zhang

Pre-trained vision-language models (VLMs) have showcased remarkable performance in image and natural language understanding, such as image captioning and response generation. As the practical applications of vision-language models become…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Peng Xie , Yequan Bie , Jianda Mao , Yangqiu Song , Yang Wang , Hao Chen , Kani Chen

Adversarial attacks have emerged as a critical threat to autonomous driving systems. These attacks exploit the underlying neural network, allowing small, almost invisible, perturbations to alter the behavior of such systems in potentially…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Richard E. Neddo , Emmanuel Atindama , Zander W. Blasingame , Chen Liu

Smart farming has emerged as a key technology for advancing modern agriculture through automation and intelligent control. However, systems relying on RGB cameras for perception and robotic manipulators for control, common in smart farming,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Ju-Young Kim , Ji-Hong Park , Myeongjun Kim , Gun-Woo Kim

Large Vision-Language Models (LVLMs), such as GPT-4o and LLaVA, have recently witnessed remarkable advancements and are increasingly being deployed in real-world applications. However, inheriting the sensitivity of visual neural networks,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Chaohu Liu , Tianyi Gui , Yu Liu , Linli Xu

Adversarial patch attacks pose a practical threat to deep learning models by forcing targeted misclassifications through localized perturbations, often realized in the physical world. Existing defenses typically assume prior knowledge of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ayushi Mehrotra , Derek Peng , Dipkamal Bhusal , Nidhi Rastogi

Vision-Language-Action (VLA) models are emerging as a unified substrate for embodied intelligence. This shift raises a new class of safety challenges, stemming from the embodied nature of VLA systems, including irreversible physical…

Robotics · Computer Science 2026-04-28 Qi Li , Bo Yin , Weiqi Huang , Ruhao Liu , Bojun Zou , Runpeng Yu , Jingwen Ye , Weihao Yu , Xinchao Wang

This paper investigates the robustness of vision-language models against adversarial visual perturbations and introduces a novel ``double visual defense" to enhance this robustness. Unlike previous approaches that resort to lightweight…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Zeyu Wang , Cihang Xie , Brian Bartoldson , Bhavya Kailkhura

Deep learning based image recognition systems have been widely deployed on mobile devices in today's world. In recent studies, however, deep learning models are shown vulnerable to adversarial examples. One variant of adversarial examples,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Tao Bai , Jinqi Luo , Jun Zhao

With the rapid development of deep learning, object detectors have demonstrated impressive performance; however, vulnerabilities still exist in certain scenarios. Current research exploring the vulnerabilities using adversarial patches…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Boming Miao , Chunxiao Li , Yao Zhu , Weixiang Sun , Zizhe Wang , Xiaoyi Wang , Chuanlong Xie

Vision-Language-Action (VLA) models have emerged as promising solutions for robotic manipulation, yet their robustness to real-world physical variations remains critically underexplored. To bridge this gap, we propose Eva-VLA, the first…

Robotics · Computer Science 2026-03-17 Hanqing Liu , Shouwei Ruan , Jiahuan Long , Junqi Wu , Jiacheng Hou , Huili Tang , Tingsong Jiang , Weien Zhou , Wen Yao

Vision-Language Models (VLMs), with their strong reasoning and planning capabilities, are widely used in embodied decision-making (EDM) tasks in embodied agents, such as autonomous driving and robotic manipulation. Recent research has…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yichen Wang , Hangtao Zhang , Hewen Pan , Ziqi Zhou , Xianlong Wang , Peijin Guo , Lulu Xue , Shengshan Hu , Minghui Li , Leo Yu Zhang

Deep neural networks have been proven to be vulnerable to adversarial examples and various methods have been proposed to defend against adversarial attacks for natural language processing tasks. However, previous defense methods have…

Machine Learning · Computer Science 2024-03-01 Fangyuan Zhang , Huichi Zhou , Shuangjiao Li , Hongtao Wang

Large vision-language models (LVLMs) have achieved impressive performance across multimodal tasks, but their reliance on visual inputs exposes them to adversarial threats. Encoder-based attacks provide an efficient alternative to end-to-end…

Cryptography and Security · Computer Science 2026-05-26 Xinwei Zhang , Li Bai , Tianwei Zhang , Youqian Zhang , Qingqing Ye , Yingnan Zhao , Ruochen Du , Haibo Hu

Autonomous vehicles (AVs) increasingly use DNN-based object detection models in vision-based perception. Correct detection and classification of obstacles is critical to ensure safe, trustworthy driving decisions. Adversarial patches aim to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Jaden Mu

The existence of real-world adversarial examples (commonly in the form of patches) poses a serious threat for the use of deep learning models in safety-critical computer vision tasks such as visual perception in autonomous driving. This…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Giulio Rossolini , Federico Nesti , Gianluca D'Amico , Saasha Nair , Alessandro Biondi , Giorgio Buttazzo

Recently demonstrated physical-world adversarial attacks have exposed vulnerabilities in perception systems that pose severe risks for safety-critical applications such as autonomous driving. These attacks place adversarial artifacts in the…

Machine Learning · Computer Science 2021-06-23 Jan Hendrik Metzen , Nicole Finnie , Robin Hutmacher

Adversarial patch attacks pose a major threat to vision systems by embedding localized perturbations that mislead deep models. Traditional defense methods often require retraining or fine-tuning, making them impractical for real-world…

Artificial Intelligence · Computer Science 2025-07-31 Roie Kazoom , Raz Lapid , Moshe Sipper , Ofer Hadar