English
Related papers

Related papers: When Robots Obey the Patch: Universal Transferable…

200 papers

Existing Vision-Language-Action (VLA) models often suffer from feature collapse and low training efficiency because they entangle high-level perception with sparse, embodiment-specific action supervision. Since these models typically rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Haitao Lin , Hanyang Yu , Jingshun Huang , He Zhang , Yonggen Ling , Ping Tan , Xiangyang Xue , Yanwei Fu

Vision-Language-Action (VLA) models demonstrate remarkable potential for generalizable robotic manipulation. The execution of complex multi-step behaviors in VLA models can be improved by robust instruction grounding, a critical component…

Vision-Language-Action (VLA) models are emerging as a unified substrate for embodied intelligence. This shift raises a new class of safety challenges, stemming from the embodied nature of VLA systems, including irreversible physical…

Robotics · Computer Science 2026-04-28 Qi Li , Bo Yin , Weiqi Huang , Ruhao Liu , Bojun Zou , Runpeng Yu , Jingwen Ye , Weihao Yu , Xinchao Wang

The latest generation of transformer-based vision models has proven to be superior to Convolutional Neural Network (CNN)-based models across several vision tasks, largely attributed to their remarkable prowess in relation modeling.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Quazi Mishkatul Alam , Bilel Tarchoun , Ihsen Alouani , Nael Abu-Ghazaleh

Several recent studies have demonstrated the promise of deep visuomotor policies for robot manipulator control. Despite impressive progress, these systems are known to be vulnerable to physical disturbances, such as accidental or…

Robotics · Computer Science 2018-11-30 Pooya Abolghasemi , Amir Mazaheri , Mubarak Shah , Ladislau Bölöni

Robots have limited adaptation ability compared to humans and animals in the case of damage. However, robot damages are prevalent in real-world applications, especially for robots deployed in extreme environments. The fragility of robots…

Robotics · Computer Science 2020-12-01 Fan Yang , Chao Yang , Di Guo , Huaping Liu , Fuchun Sun

Vision-Language-Action (VLA) models offer a compelling framework for tackling complex robotic manipulation tasks, but they are often expensive to train. In this paper, we propose a novel VLA approach that leverages the competitive…

Robotics · Computer Science 2025-12-23 Max Argus , Jelena Bratulic , Houman Masnavi , Maxim Velikanov , Nick Heppert , Abhinav Valada , Thomas Brox

Multimodal Large Language Models (MLLMs), built upon LLMs, have recently gained attention for their capabilities in image recognition and understanding. However, while MLLMs are vulnerable to adversarial attacks, the transferability of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Chenhe Gu , Jindong Gu , Andong Hua , Yao Qin

Neural network-based visuomotor policies enable robots to perform manipulation tasks but remain susceptible to perceptual attacks. For example, conventional 2D adversarial patches are effective under fixed-camera setups, where appearance is…

Robotics · Computer Science 2026-03-06 Chanmi Lee , Minsung Yoon , Woojae Kim , Sebin Lee , Sung-eui Yoon

Learning-based autonomous driving systems remain critically vulnerable to adversarial patches, posing serious safety and security risks in their real-world deployment. Black-box attacks, notable for their high attack success rate without…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Yuxin Cao , Yedi Zhang , Wentao He , Yifan Liao , Yan Xiao , Chang Li , Zhiyong Huang , Jin Song Dong

We propose an adaptation to the training of Vision Transformers (ViTs) that allows for an explicit modeling of objects during the attention computation. This is achieved by adding a new branch to selected attention layers that computes an…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Vivek Trivedy , Amani Almalki , Longin Jan Latecki

In dynamic environments such as warehouses, hospitals, and homes, robots must seamlessly transition between gross motion and precise manipulations to complete complex tasks. However, current Vision-Language-Action (VLA) frameworks, largely…

Face recognition (FR) technology plays a crucial role in various applications, but its vulnerability to adversarial attacks poses significant security concerns. Existing research primarily focuses on transferability to different FR models,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaoliang Liu , Furao Shen , Feng Han , Jian Zhao , Changhai Nie

The transferability of adversarial examples is a crucial aspect of evaluating the robustness of deep learning systems, particularly in black-box scenarios. Although several methods have been proposed to enhance cross-model transferability,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Tony Ma , Songze Li , Yisong Xiao , Shunchang Liu

Recent face anti-spoofing (FAS) methods have shown remarkable cross-domain performance by employing vision-language models like CLIP. However, existing CLIP-based FAS models do not fully exploit CLIP's patch embedding tokens, failing to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jeongmin Yu , Susang Kim , Kisu Lee , Taekyoung Kwon , Won-Yong Shin , Ha Young Kim

Robot action planning in the real world is challenging as it requires not only understanding the current state of the environment but also predicting how it will evolve in response to actions. Vision-language-action (VLA), which repurpose…

Vision-language pretraining (VLP) with transformers has demonstrated exceptional performance across numerous multimodal tasks. However, the adversarial robustness of these models has not been thoroughly investigated. Existing multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiwei Guan , Tianyu Ding , Longbing Cao , Lei Pan , Chen Wang , Xi Zheng

Vision-language pre-training (VLP) models demonstrate impressive abilities in processing both images and text. However, they are vulnerable to multi-modal adversarial examples (AEs). Investigating the generation of high-transferability…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Dongchen Han , Xiaojun Jia , Yang Bai , Jindong Gu , Yang Liu , Xiaochun Cao

Vision-Language-Action (VLA) models have shown great performance in robotic manipulation by mapping visual observations and language instructions directly to actions. However, they remain brittle under distribution shifts: when test…

Robotics · Computer Science 2025-12-09 Siyu Xu , Zijian Wang , Yunke Wang , Chenghao Xia , Tao Huang , Chang Xu

Advanced Patch Attacks (PAs) on object detection in natural images have pointed out the great safety vulnerability in methods based on deep neural networks. However, little attention has been paid to this topic in Optical Remote Sensing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Xuxiang Sun , Gong Cheng , Lei Pei , Hongda Li , Junwei Han