English
Related papers

Related papers: Model-agnostic Adversarial Attack and Defense for …

200 papers

Deep learning drives major advances in autonomous driving (AD), where object detectors are central to perception. However, adversarial attacks pose significant threats to the reliability and safety of these systems, with physical…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zihui Zhu , Ziqi Zhou , Yichen Wang , Lulu Xue , Minghui Li , Shengshan Hu

While vision-language pre-training model (VLP) has shown revolutionary improvements on various vision-language (V+L) tasks, the studies regarding its adversarial robustness remain largely unexplored. This paper studied the adversarial…

Machine Learning · Computer Science 2022-10-21 Jiaming Zhang , Qi Yi , Jitao Sang

Vision-Language Models (VLMs) have emerged as a promising approach to address the data scarcity challenge in robotics, enabling the development of generalizable visuomotor control policies. While models like OpenVLA showcase the potential…

In typical multimodal tasks, such as Visual Question Answering (VQA), adversarial attacks targeting a specific image and question can lead large vision-language models (LVLMs) to provide incorrect answers. However, it is common for a single…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Yudong Zhang , Ruobing Xie , Jiansheng Chen , Xingwu Sun , Zhanhui Kang , Yu Wang

Embodied intelligence systems, which enhance agent capabilities through continuous environment interactions, have garnered significant attention from both academia and industry. Vision-Language-Action models, inspired by advancements in…

Robotics · Computer Science 2025-11-13 Haoran Li , Yuhui Chen , Wenbo Cui , Weiheng Liu , Kai Liu , Mingcai Zhou , Zhengtao Zhang , Dongbin Zhao

Current adversarial attacks for evaluating the robustness of vision-language pre-trained (VLP) models in multi-modal tasks suffer from limited transferability, where attacks crafted for a specific model often struggle to generalize…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Peng-Fei Zhang , Guangdong Bai , Zi Huang

Vision-language-action (VLA) models have shown strong performance in robotic manipulation, yet their robustness to physically realizable adversarial attacks remains underexplored. Existing studies reveal vulnerabilities through language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Jiawei Chen , Simin Huang , Jiawei Du , Shuaihang Chen , Yu Tian , Mingjie Wei , Chao Yu , Zhaoxia Yin

Multimodal Large Language Models (MLLMs), built upon LLMs, have recently gained attention for their capabilities in image recognition and understanding. However, while MLLMs are vulnerable to adversarial attacks, the transferability of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Chenhe Gu , Jindong Gu , Andong Hua , Yao Qin

Neural networks are vulnerable to adversarial attacks -- small visually imperceptible crafted noise which when added to the input drastically changes the output. The most effective method of defending against these adversarial attacks is to…

Large language models have become increasingly prominent, also signaling a shift towards multimodality as the next frontier in artificial intelligence, where their embeddings are harnessed as prompts to generate textual content.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiachen Sun , Changsheng Wang , Jiongxiao Wang , Yiwei Zhang , Chaowei Xiao

With the rapid advancement of multimodal learning, pre-trained Vision-Language Models (VLMs) such as CLIP have demonstrated remarkable capacities in bridging the gap between visual and language modalities. However, these models remain…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jiaming Zhang , Xingjun Ma , Xin Wang , Lingyu Qiu , Jiaqi Wang , Yu-Gang Jiang , Jitao Sang

Current vision-language-action (VLA) models, pre-trained on large-scale robotic data, exhibit strong multi-task capabilities and generalize well to variations in visual and language instructions for manipulation. However, their success rate…

Robotics · Computer Science 2025-10-17 Han Zhao , Jiaxuan Zhang , Wenxuan Song , Pengxiang Ding , Donglin Wang

Object detection techniques for Unmanned Aerial Vehicles (UAVs) rely on Deep Neural Networks (DNNs), which are vulnerable to adversarial attacks. Nonetheless, adversarial patches generated by existing algorithms in the UAV domain pay very…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Dehong Kong , Siyuan Liang , Wenqi Ren

Recent studies on AI security have highlighted the vulnerability of Vision-Language Pre-training (VLP) models to subtle yet intentionally designed perturbations in images and texts. Investigating multimodal systems' robustness via…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Haonan Zheng , Wen Jiang , Xinyang Deng , Wenrui Li

Safety alignment is critical in pre-training large language models (LLMs) to generate responses aligned with human values and refuse harmful queries. Unlike LLM, the current safety alignment of VLMs is often achieved with post-hoc safety…

Cryptography and Security · Computer Science 2025-02-18 Fenghua Weng , Jian Lou , Jun Feng , Minlie Huang , Wenjie Wang

DNNs are vulnerable to adversarial examples, which poses great security concerns for security-critical systems. In this paper, a novel adaptive-patch-based physical attack (AP-PA) framework is proposed, which aims to generate adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Jiawei Lian , Shaohui Mei , Shun Zhang , Mingyang Ma

Robotic systems are increasingly expected to operate in human-centered, unstructured environments where safety, adaptability, and generalization are essential. Vision-Language-Action (VLA) models have been proposed as a language guided…

Robotics · Computer Science 2025-10-21 Haochen Su , Cristian Meo , Francesco Stella , Andrea Peirone , Kai Junge , Josie Hughes

Visual language modeling for automated driving is emerging as a promising research direction with substantial improvements in multimodal reasoning capabilities. Despite its advanced reasoning abilities, VLM-AD remains vulnerable to serious…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Dehong Kong , Sifan Yu , Siyuan Liang , Jiawei Liang , Jianhou Gan , Aishan Liu , Wenqi Ren

The significant advancements in embodied vision navigation have raised concerns about its susceptibility to adversarial attacks exploiting deep neural networks. Investigating the adversarial robustness of embodied vision navigation is…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Meng Chen , Jiawei Tu , Chao Qi , Yonghao Dang , Feng Zhou , Wei Wei , Jianqin Yin

Adversarial attacks are known to succeed on classifiers, but it has been an open question whether more complex vision systems are vulnerable. In this paper, we study adversarial examples for vision and language models, which incorporate…

Artificial Intelligence · Computer Science 2018-04-09 Xiaojun Xu , Xinyun Chen , Chang Liu , Anna Rohrbach , Trevor Darrell , Dawn Song