中文
相关论文

相关论文: BadVLA: Towards Backdoor Attacks on Vision-Languag…

200 篇论文

The growing misuse of Vision-Language Models (VLMs) has led providers to deploy multiple safeguards, including alignment tuning, system prompts, and content moderation. However, the real-world robustness of these defenses against…

密码学与安全 · 计算机科学 2025-11-21 Yijun Yang , Lichao Wang , Jianping Zhang , Chi Harold Liu , Lanqing Hong , Qiang Xu

Vision-Language-Action (VLA) models aim to control robots for manipulation from visual observations and natural-language instructions. However, existing hierarchical and autoregressive paradigms often introduce architectural overhead,…

Federated learning is a promising approach for training machine learning models while preserving data privacy. However, its distributed nature makes it vulnerable to backdoor attacks, particularly in NLP tasks, where related research…

机器学习 · 计算机科学 2025-07-31 Minyeong Choe , Cheolhee Park , Changho Seo , Hyunil Kim

Backdoor attacks pose a serious threat to deep learning models by allowing adversaries to implant hidden behaviors that remain dormant on clean inputs but are maliciously triggered at inference. Existing backdoor attack methods typically…

密码学与安全 · 计算机科学 2025-11-18 Lijie Hu , Junchi Liao , Weimin Lyu , Shaopeng Fu , Tianhao Huang , Shu Yang , Guimin Hu , Di Wang

The emergence of Vision Language Models (VLMs) is a significant advancement in integrating computer vision with Large Language Models (LLMs) to produce detailed text descriptions based on visual inputs, yet it introduces new security…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Weimin Lyu , Lu Pang , Tengfei Ma , Haibin Ling , Chao Chen

Recent researches have shown that Large Language Models (LLMs) are susceptible to a security threat known as Backdoor Attack. The backdoored model will behave well in normal cases but exhibit malicious behaviours on inputs inserted with a…

密码学与安全 · 计算机科学 2024-04-04 Yunzhuo Hao , Wenkai Yang , Yankai Lin

Visual Foresight VLA (VF-VLA) has become a prominent architectural choice in the recent VLA due to its impressive performance. Nevertheless, the inherent design of VF-VLA makes it particularly vulnerable to out-of-distribution (OOD) shifts.…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Sangwu Park , Wonjoong Kim , Yeonjun In , Sein Kim , Hongseok Kang , Chanyoung Park

Vision-Language-Action (VLA) models have shown strong potential for general-purpose robotic manipulation by leveraging large pretrained vision-language backbones. However, most existing VLAs rely primarily on 2D visual representations,…

机器人学 · 计算机科学 2026-05-21 Shizhe Chen , Paul Pacaud , Cordelia Schmid

Mainstream backdoor attack methods typically demand substantial tuning data for poisoning, limiting their practicality and potentially degrading the overall performance when applied to Large Language Models (LLMs). To address these issues,…

密码学与安全 · 计算机科学 2024-03-21 Yanzhou Li , Tianlin Li , Kangjie Chen , Jian Zhang , Shangqing Liu , Wenhan Wang , Tianwei Zhang , Yang Liu

Vision-Language-Action (VLA) models, which integrate pretrained large Vision-Language Models (VLM) into their policy backbone, are gaining significant attention for their promising generalization capabilities. This paper revisits a…

计算机视觉与模式识别 · 计算机科学 2026-01-08 Jianke Zhang , Xiaoyu Chen , Qiuyue Wang , Mingsheng Li , Yanjiang Guo , Yucheng Hu , Jiajun Zhang , Shuai Bai , Junyang Lin , Jianyu Chen

Vision-Language-Action (VLA) models have recently emerged as a promising paradigm for robotic manipulation, in which reliable action prediction critically depends on accurately interpreting and integrating visual observations conditioned on…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Yulin Luo , Hao Chen , Zhuangzhe Wu , Bowen Sui , Jiaming Liu , Chenyang Gu , Zhuoyang Liu , Qiuxuan Feng , Jiale Yu , Shuo Gu , Peng Jia , Pheng-Ann Heng , Shanghang Zhang

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for embodied intelligence, enabling robots to perform tasks based on natural language instructions and current visual input. However, existing VLA models struggle with…

Vision-Language-Action (VLA) models have achieved remarkable success in robotic manipulation. However, their robustness to linguistic nuances remains a critical, under-explored safety concern, posing a significant safety risk to real-world…

机器人学 · 计算机科学 2026-04-08 Baoshun Tong , Haoran He , Ling Pan , Yang Liu , Liang Lin

Vision-Language-Action (VLA) models have emerged as a promising framework for enabling generalist robots capable of perceiving, reasoning, and acting in the real world. These models usually build upon pretrained Vision-Language Models…

机器人学 · 计算机科学 2025-11-25 Tao Lin , Gen Li , Yilei Zhong , Yanwen Zou , Yuxin Du , Jiting Liu , Encheng Gu , Bo Zhao

Vision-Language-Action (VLA) models are a promising paradigm for generalist robotic manipulation by grounding high-level semantic instructions into executable physical actions. However, prevailing approaches typically adopt a monolithic…

机器人学 · 计算机科学 2026-04-29 Yifei Wei , Linqing Zhong , Yi Liu , Yuxiang Lu , Xindong He , Maoqing Yao , Guanghui Ren

Large pre-trained models have achieved notable success across a range of downstream tasks. However, recent research shows that a type of adversarial attack ($\textit{i.e.,}$ backdoor attack) can manipulate the behavior of machine learning…

人工智能 · 计算机科学 2024-10-29 Dongliang Guo , Mengxuan Hu , Zihan Guan , Junfeng Guo , Thomas Hartvigsen , Sheng Li

Tactile feedback is generally recognized to be crucial for effective interaction with the physical world. However, state-of-the-art Vision-Language-Action (VLA) models lack the ability to interpret and use tactile signals, limiting their…

机器人学 · 计算机科学 2025-07-30 Jianxin Bi , Kevin Yuchen Ma , Ce Hao , Mike Zheng Shou , Harold Soh

Vision-Language-Action (VLA) models have emerged as a promising paradigm for general-purpose robotic manipulation, leveraging large-scale pre-training to achieve strong performance. The field has rapidly evolved with additional spatial…

机器人学 · 计算机科学 2026-02-23 Yuankai Luo , Woping Chen , Tong Liang , Baiqiao Wang , Zhenguo Li

Visual-Language-Action (VLA) models represent a paradigm shift in embodied AI, yet existing frameworks often struggle with imprecise spatial perception, suboptimal multimodal fusion, and instability in reinforcement learning. To bridge…

机器人学 · 计算机科学 2026-04-27 Haoxiang Jie , Yaoyuan Yan , Xiangyu Wei , Kailin Wang , Hongjie Yan , Zhiyou Heng , Daocheng Chen

Vision-language-action models (VLAs) have become increasingly popular in robot manipulation for their end-to-end design and remarkable performance. However, existing VLAs rely heavily on vision-language models (VLMs) that only support…

机器人学 · 计算机科学 2025-02-24 Wei Zhao , Pengxiang Ding , Min Zhang , Zhefei Gong , Shuanghao Bai , Han Zhao , Donglin Wang