English
Related papers

Related papers: FlowHijack: A Dynamics-Aware Backdoor Attack on Fl…

200 papers

Modern vision-language-model (VLM) based graphical user interface (GUI) agents are expected not only to execute actions accurately but also to respond to user instructions with low latency. While existing research on GUI-agent security…

Cryptography and Security · Computer Science 2026-03-11 Junxian Li , Tu Lan , Haozhen Tan , Yan Meng , Haojin Zhu

Vision-Language-Action (VLA) models exhibit strong generalization in robotic manipulation, yet reinforcement learning (RL) fine-tuning often degrades robustness under spatial distribution shifts. For flow-matching VLA policies, this…

Robotics · Computer Science 2026-02-03 Xu Pan , Zhenglin Wan , Xingrui Yu , Xianwei Zheng , Youkai Ke , Ming Sun , Rui Wang , Ziwei Wang , Ivor Tsang

Recent studies have shown that cooperative multi-agent deep reinforcement learning (c-MADRL) is under the threat of backdoor attacks. Once a backdoor trigger is observed, it will perform abnormal actions leading to failures or malicious…

Artificial Intelligence · Computer Science 2024-09-13 Yinbo Yu , Saihao Yan , Jiajia Liu

Addressing the escalating security vulnerabilities in Vision-Language-Action (VLA) models, this study investigates backdoor attacks targeting the visual pathway. We identify a core obstacle causing the failure of traditional attack…

Robotics · Computer Science 2026-05-12 Kewei Chen , Yayu Long , Shuai Li , Mingsheng Shang

The emergence of Vision Language Models (VLMs) is a significant advancement in integrating computer vision with Large Language Models (LLMs) to produce detailed text descriptions based on visual inputs, yet it introduces new security…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Weimin Lyu , Lu Pang , Tengfei Ma , Haibin Ling , Chao Chen

Diffusion and flow matching models have emerged as powerful robot policies, enabling Vision-Language-Action (VLA) models to generalize across diverse scenes and instructions. Yet, when trained via imitation learning, their high generative…

Robotics · Computer Science 2026-03-26 Minho Park , Kinam Kim , Junha Hyung , Hyojin Jang , Hoiyeong Jin , Jooyeol Yun , Hojoon Lee , Jaegul Choo

Autoregressive Visual Language Models (VLMs) showcase impressive few-shot learning capabilities in a multimodal context. Recently, multimodal instruction tuning has been proposed to further enhance instruction-following abilities. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jiawei Liang , Siyuan Liang , Man Luo , Aishan Liu , Dongchen Han , Ee-Chien Chang , Xiaochun Cao

Recent studies have shown that cooperative multi-agent deep reinforcement learning (c-MADRL) is under the threat of backdoor attacks. Once a backdoor trigger is observed, it will perform malicious actions leading to failures or malicious…

Artificial Intelligence · Computer Science 2025-07-21 Jing Fang , Saihao Yan , Xueyu Yin , Yinbo Yu , Chunwei Tian , Jiajia Liu

Despite remarkable progress in Vision--Language--Action (VLA) models, a central bottleneck remains underexamined: the data infrastructure that underlies embodied learning. In this survey, we argue that future advances in VLA will depend…

Speech recognition systems driven by DNNs have revolutionized human-computer interaction through voice interfaces, which significantly facilitate our daily lives. However, the growing popularity of these systems also raises special concerns…

Cryptography and Security · Computer Science 2024-07-08 Jiahe Lan , Jie Wang , Baochen Yan , Zheng Yan , Elisa Bertino

Vision-Language-Action (VLA) models mark a transformative advancement in artificial intelligence, aiming to unify perception, natural language understanding, and embodied action within a single computational framework. This foundational…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Ranjan Sapkota , Yang Cao , Konstantinos I. Roumeliotis , Manoj Karkee

The success of deep learning has enabled advances in multimodal tasks that require non-trivial fusion of multiple input domains. Although multimodal models have shown potential in many problems, their increased complexity makes them more…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Matthew Walmer , Karan Sikka , Indranil Sur , Abhinav Shrivastava , Susmit Jha

Black-box adversarial attack on vision-language pre-trained models is a practical and challenging task, as text and image perturbations need to be considered simultaneously, and only the predicted results are accessible. Research on this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Han Liu , Jiaqi Li , Zhi Xu , Xiaotong Zhang , Xiaoming Xu , Fenglong Ma , Yuanman Li , Hong Yu

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for embodied intelligence, enabling robots to perform tasks based on natural language instructions and current visual input. However, existing VLA models struggle with…

Robotic manipulation policies are increasingly empowered by \textit{large language models} (LLMs) and \textit{vision-language models} (VLMs), leveraging their understanding and perception capabilities. Recently, inference-time attacks…

Federated learning (FL) is vulnerable to backdoor attacks, yet most existing methods are limited by fixed-pattern or single-target triggers, making them inflexible and easier to detect. We propose FLAT (FL Arbitrary-Target Attack), a novel…

Machine Learning · Computer Science 2025-08-07 Tuan Nguyen , Khoa D Doan , Kok-Seng Wong

Vision Language Action (VLA) models represent a transformative shift in robotics, with the aim of unifying visual perception, natural language understanding, and embodied control within a single learning framework. This review presents a…

Robotics · Computer Science 2026-01-21 Muhayy Ud Din , Waseem Akram , Lyes Saad Saoud , Jan Rosell , Irfan Hussain

Recent Vision-Language-Action (VLA) models equipped with Flow Matching (FM) action heads achieve state-of-the-art performance in complex robot manipulation. However, the multi-step iterative ODE solving required by FM introduces inference…

Robotics · Computer Science 2026-03-19 Zhou Fang , Jiaqi Wang , Yi Zhou , Qiongfeng Shi

Vision-Language-Action (VLA) models have emerged as a popular paradigm for learning robot manipulation policies that can follow language instructions and generalize to novel scenarios. Recent works have begun to explore the incorporation of…

Vision-Language-Action (VLA) models have demonstrated strong multi-modal reasoning capabilities, enabling direct action generation from visual perception and language instructions in an end-to-end manner. However, their substantial…

Robotics · Computer Science 2025-10-22 Siyu Xu , Yunke Wang , Chenghao Xia , Dihao Zhu , Tao Huang , Chang Xu