中文
相关论文

相关论文: FlowHijack: A Dynamics-Aware Backdoor Attack on Fl…

200 篇论文

Modern vision-language-model (VLM) based graphical user interface (GUI) agents are expected not only to execute actions accurately but also to respond to user instructions with low latency. While existing research on GUI-agent security…

密码学与安全 · 计算机科学 2026-03-11 Junxian Li , Tu Lan , Haozhen Tan , Yan Meng , Haojin Zhu

Vision-Language-Action (VLA) models exhibit strong generalization in robotic manipulation, yet reinforcement learning (RL) fine-tuning often degrades robustness under spatial distribution shifts. For flow-matching VLA policies, this…

机器人学 · 计算机科学 2026-02-03 Xu Pan , Zhenglin Wan , Xingrui Yu , Xianwei Zheng , Youkai Ke , Ming Sun , Rui Wang , Ziwei Wang , Ivor Tsang

Recent studies have shown that cooperative multi-agent deep reinforcement learning (c-MADRL) is under the threat of backdoor attacks. Once a backdoor trigger is observed, it will perform abnormal actions leading to failures or malicious…

人工智能 · 计算机科学 2024-09-13 Yinbo Yu , Saihao Yan , Jiajia Liu

Addressing the escalating security vulnerabilities in Vision-Language-Action (VLA) models, this study investigates backdoor attacks targeting the visual pathway. We identify a core obstacle causing the failure of traditional attack…

机器人学 · 计算机科学 2026-05-12 Kewei Chen , Yayu Long , Shuai Li , Mingsheng Shang

The emergence of Vision Language Models (VLMs) is a significant advancement in integrating computer vision with Large Language Models (LLMs) to produce detailed text descriptions based on visual inputs, yet it introduces new security…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Weimin Lyu , Lu Pang , Tengfei Ma , Haibin Ling , Chao Chen

Diffusion and flow matching models have emerged as powerful robot policies, enabling Vision-Language-Action (VLA) models to generalize across diverse scenes and instructions. Yet, when trained via imitation learning, their high generative…

机器人学 · 计算机科学 2026-03-26 Minho Park , Kinam Kim , Junha Hyung , Hyojin Jang , Hoiyeong Jin , Jooyeol Yun , Hojoon Lee , Jaegul Choo

Autoregressive Visual Language Models (VLMs) showcase impressive few-shot learning capabilities in a multimodal context. Recently, multimodal instruction tuning has been proposed to further enhance instruction-following abilities. However,…

计算机视觉与模式识别 · 计算机科学 2024-02-22 Jiawei Liang , Siyuan Liang , Man Luo , Aishan Liu , Dongchen Han , Ee-Chien Chang , Xiaochun Cao

Recent studies have shown that cooperative multi-agent deep reinforcement learning (c-MADRL) is under the threat of backdoor attacks. Once a backdoor trigger is observed, it will perform malicious actions leading to failures or malicious…

人工智能 · 计算机科学 2025-07-21 Jing Fang , Saihao Yan , Xueyu Yin , Yinbo Yu , Chunwei Tian , Jiajia Liu

Despite remarkable progress in Vision--Language--Action (VLA) models, a central bottleneck remains underexamined: the data infrastructure that underlies embodied learning. In this survey, we argue that future advances in VLA will depend…

机器人学 · 计算机科学 2026-04-28 Ziyao Wang , Bingying Wang , Hanrong Zhang , Tingting Du , Tianyang Chen , Guoheng Sun , Yexiao He , Zheyu Shen , Wanghao Ye , Ang Li

Speech recognition systems driven by DNNs have revolutionized human-computer interaction through voice interfaces, which significantly facilitate our daily lives. However, the growing popularity of these systems also raises special concerns…

密码学与安全 · 计算机科学 2024-07-08 Jiahe Lan , Jie Wang , Baochen Yan , Zheng Yan , Elisa Bertino

Vision-Language-Action (VLA) models mark a transformative advancement in artificial intelligence, aiming to unify perception, natural language understanding, and embodied action within a single computational framework. This foundational…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Ranjan Sapkota , Yang Cao , Konstantinos I. Roumeliotis , Manoj Karkee

The success of deep learning has enabled advances in multimodal tasks that require non-trivial fusion of multiple input domains. Although multimodal models have shown potential in many problems, their increased complexity makes them more…

计算机视觉与模式识别 · 计算机科学 2022-04-20 Matthew Walmer , Karan Sikka , Indranil Sur , Abhinav Shrivastava , Susmit Jha

Black-box adversarial attack on vision-language pre-trained models is a practical and challenging task, as text and image perturbations need to be considered simultaneously, and only the predicted results are accessible. Research on this…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Han Liu , Jiaqi Li , Zhi Xu , Xiaotong Zhang , Xiaoming Xu , Fenglong Ma , Yuanman Li , Hong Yu

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for embodied intelligence, enabling robots to perform tasks based on natural language instructions and current visual input. However, existing VLA models struggle with…

Robotic manipulation policies are increasingly empowered by \textit{large language models} (LLMs) and \textit{vision-language models} (VLMs), leveraging their understanding and perception capabilities. Recently, inference-time attacks…

Federated learning (FL) is vulnerable to backdoor attacks, yet most existing methods are limited by fixed-pattern or single-target triggers, making them inflexible and easier to detect. We propose FLAT (FL Arbitrary-Target Attack), a novel…

机器学习 · 计算机科学 2025-08-07 Tuan Nguyen , Khoa D Doan , Kok-Seng Wong

Vision Language Action (VLA) models represent a transformative shift in robotics, with the aim of unifying visual perception, natural language understanding, and embodied control within a single learning framework. This review presents a…

机器人学 · 计算机科学 2026-01-21 Muhayy Ud Din , Waseem Akram , Lyes Saad Saoud , Jan Rosell , Irfan Hussain

Recent Vision-Language-Action (VLA) models equipped with Flow Matching (FM) action heads achieve state-of-the-art performance in complex robot manipulation. However, the multi-step iterative ODE solving required by FM introduces inference…

机器人学 · 计算机科学 2026-03-19 Zhou Fang , Jiaqi Wang , Yi Zhou , Qiongfeng Shi

Vision-Language-Action (VLA) models have emerged as a popular paradigm for learning robot manipulation policies that can follow language instructions and generalize to novel scenarios. Recent works have begun to explore the incorporation of…

Vision-Language-Action (VLA) models have demonstrated strong multi-modal reasoning capabilities, enabling direct action generation from visual perception and language instructions in an end-to-end manner. However, their substantial…

机器人学 · 计算机科学 2025-10-22 Siyu Xu , Yunke Wang , Chenghao Xia , Dihao Zhu , Tao Huang , Chang Xu