English
Related papers

Related papers: SABER: A Stealthy Agentic Black-Box Attack Framewo…

200 papers

Current Visual-Language Pre-training (VLP) models are vulnerable to adversarial examples. These adversarial examples present substantial security risks to VLP models, as they can leverage inherent weaknesses in the models, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Bangyan He , Xiaojun Jia , Siyuan Liang , Tianrui Lou , Yang Liu , Xiaochun Cao

Vision-Language-Action (VLA) models exhibit strong generalization in robotic manipulation, yet reinforcement learning (RL) fine-tuning often degrades robustness under spatial distribution shifts. For flow-matching VLA policies, this…

Robotics · Computer Science 2026-02-03 Xu Pan , Zhenglin Wan , Xingrui Yu , Xianwei Zheng , Youkai Ke , Ming Sun , Rui Wang , Ziwei Wang , Ivor Tsang

Vision-Language-Action (VLA) models are a promising paradigm for generalist robotic manipulation by grounding high-level semantic instructions into executable physical actions. However, prevailing approaches typically adopt a monolithic…

Robotics · Computer Science 2026-04-29 Yifei Wei , Linqing Zhong , Yi Liu , Yuxiang Lu , Xindong He , Maoqing Yao , Guanghui Ren

Vision-Language-Action (VLA) models have emerged as a popular paradigm for learning robot manipulation policies that can follow language instructions and generalize to novel scenarios. Recent works have begun to explore the incorporation of…

Vision-Language-Action (VLA) models enable robots to perform manipulation tasks directly from natural language instructions and are increasingly viewed as a foundation for generalist robotic policies. However, their reliability under…

Robotics · Computer Science 2026-03-09 Ninghao Zhang , Bin Zhu , Shijie Zhou , Jingjing Chen

Vision-Language-Action (VLA) models typically bridge the gap between perceptual and action spaces by pre-training a large-scale Vision-Language Model (VLM) on robotic data. While this approach greatly enhances performance, it also incurs…

Vision-Language-Action (VLA) models are vulnerable to adversarial attacks, yet universal and transferable attacks remain underexplored, as most existing patches overfit to a single model and fail in black-box settings. To address this gap,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Hui Lu , Yi Yu , Yiming Yang , Chenyu Yi , Qixin Zhang , Bingquan Shen , Alex C. Kot , Xudong Jiang

Recent advancements in Large Vision-Language Models (LVLMs) have shown groundbreaking capabilities across diverse multimodal tasks. However, these models remain vulnerable to adversarial jailbreak attacks, where adversaries craft subtle…

Cryptography and Security · Computer Science 2026-01-23 Jiwei Guan , Haibo Jin , Haohan Wang

Vision-Language-Action (VLA) models have shown promise in robot manipulation but often struggle to generalize to new instructions or complex multi-task scenarios. We identify a critical pathology in current training paradigms where…

Artificial Intelligence · Computer Science 2026-05-14 Shijie Lian , Bin Yu , Xiaopeng Lin , Laurence T. Yang , Zhaolong Shen , Changti Wu , Yuzhuo Miao , Cong Huang , Kai Chen

Recent studies have proposed integrating Chain-of-Thought (CoT) reasoning to further enhance the reliability of Code Language Models (CLMs) in generating code, a step-by-step approach that breaks down complex programming tasks into…

Software Engineering · Computer Science 2025-03-11 Naizhu Jin , Zhong Li , Yinggang Guo , Chao Su , Tian Zhang , Qingkai Zeng

Robotic assistance in scientific laboratories requires procedurally correct long-horizon manipulation, reliable execution under limited supervision, and robustness in low-demonstration regimes. Such conditions greatly challenge end-to-end…

Robotics · Computer Science 2026-02-11 Jinghan Yang , Jingyi Hou , Xinbo Yu , Wei He , Yifan Wu

While Vision-Language-Action (VLA) models have emerged as powerful generalist policies, their severe vulnerability to adversarial patches significantly hinders their deployment in safety-critical domains. Moreover, existing patch attacks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Jiyuan Fu , Kaixun Jiang , Jingkai Jia , Zhaoyu Chen , Xueyao Chen , Lingyi Hong , Shuyong Gao , Chenzhi Tan , Dingkang Yang , Wenqiang Zhang

Developing robust and correctable visuomotor policies for robotic manipulation is challenging due to the lack of self-recovery mechanisms from failures and the limitations of simple language instructions in guiding robot actions. To address…

Robotics · Computer Science 2024-09-24 Yinpei Dai , Jayjun Lee , Nima Fazeli , Joyce Chai

Recent high-capacity vision-language-action (VLA) models have demonstrated impressive performance on a range of robotic manipulation tasks by imitating human demonstrations. However, exploiting offline data with limited visited states will…

Robotics · Computer Science 2025-05-27 Guanxing Lu , Wenkai Guo , Chubin Zhang , Yuheng Zhou , Haonan Jiang , Zifeng Gao , Yansong Tang , Ziwei Wang

Vision-Language-Action (VLA) models combine perception, language, and motor control in a single architecture, yet how they translate multimodal inputs into actions remains poorly understood. We apply activation injection, sparse…

Robotics · Computer Science 2026-03-20 Bryce Grant , Xijia Zhao , Peng Wang

While vision-language-action (VLA) models for embodied agents integrate perception, reasoning, and control, they remain constrained by two critical weaknesses: first, during grasping tasks, the action tokens generated by the language model…

Robotics · Computer Science 2026-02-03 Wentao Zhang , Aolan Sun , Wentao Mo , Xiaoyang Qu , Yuxin Zheng , Jianzong Wang

One promise that Vision-Language-Action (VLA) models hold over traditional imitation learning for robotics is to leverage the broad generalization capabilities of large Vision-Language Models (VLMs) to produce versatile, "generalist" robot…

Robotics · Computer Science 2025-06-12 Irving Fang , Juexiao Zhang , Shengbang Tong , Chen Feng

Vision-language-action models (VLAs) show potential as generalist robot policies. However, these models pose extreme safety challenges during real-world deployment, including the risk of harm to the environment, the robot itself, and…

Robotics · Computer Science 2026-04-21 Borong Zhang , Yuhao Zhang , Jiaming Ji , Yingshan Lei , Yishuai Cai , Josef Dai , Yuanpei Chen , Yaodong Yang

Vision-Language-Action (VLA) models have shown remarkable progress in embodied tasks recently, but most methods process visual observations independently at each timestep. This history-agnostic design treats robot manipulation as a Markov…

Machine Learning · Computer Science 2026-04-13 Lei Xiao , Jifeng Li , Juntao Gao , Feiyang Ye , Yan Jin , Jingjing Qian , Jing Zhang , Yong Wu , Xiaoyuan Yu

Vision-Language-Action (VLA) models are widely deployed in safety-critical embodied AI applications such as robotics. However, their complex multimodal interactions also expose new security vulnerabilities. In this paper, we investigate a…

Cryptography and Security · Computer Science 2026-01-09 Ji Guo , Wenbo Jiang , Yansong Lin , Yijing Liu , Ruichen Zhang , Guomin Lu , Aiguo Chen , Xinshuo Han , Hongwei Li , Dusit Niyato