中文
相关论文

相关论文: VLA-Hijack: A Transferable Patch Attack against Vi…

200 篇论文

Recent studies on Vision-Language-Action (VLA) models have shifted from the end-to-end action-generation paradigm toward a pipeline involving task planning followed by action generation, demonstrating improved performance on various…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Chongkai Gao , Zixuan Liu , Zhenghao Chi , Junshan Huang , Xin Fei , Yiwen Hou , Yuxuan Zhang , Yudi Lin , Zhirui Fang , Zeyu Jiang , Lin Shao

Vision-language-action (VLA) models typically inject proprioception only as a late conditioning signal, which prevents robot state from shaping instruction understanding and from influencing which visual tokens are attended throughout the…

机器人学 · 计算机科学 2026-02-09 Fangyuan Wang , Peng Zhou , Jiaming Qi , Shipeng Lyu , David Navarro-Alarcon , Guodong Guo

Recent advances in Vision-Language-Action (VLA) models have shown strong potential for general-purpose robotic manipulation. However, the visual representations of most VLA models are often dominated by global object appearance and struggle…

机器人学 · 计算机科学 2026-05-19 Weijie Kong , Zhian Su , Wei Yu , Huixu Dong

Large vision-language models (LVLMs) have achieved impressive performance across multimodal tasks, but their reliance on visual inputs exposes them to adversarial threats. Encoder-based attacks provide an efficient alternative to end-to-end…

密码学与安全 · 计算机科学 2026-05-26 Xinwei Zhang , Li Bai , Tianwei Zhang , Youqian Zhang , Qingqing Ye , Yingnan Zhao , Ruochen Du , Haibo Hu

Vision-Language-Action (VLA) models are an emerging class of workloads critical for robotics and embodied AI at the edge. As these models scale, they demonstrate significant capability gains, yet they must be deployed locally to meet the…

性能 · 计算机科学 2026-03-04 Manoj Vishwanathan , Suvinay Subramanian , Anand Raghunathan

Vision-language pre-training (VLP) models exhibit remarkable capabilities in comprehending both images and text, yet they remain susceptible to multimodal adversarial examples (AEs). Strengthening attacks and uncovering vulnerabilities,…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Sensen Gao , Xiaojun Jia , Xuhong Ren , Ivor Tsang , Qing Guo

Generalization remains a fundamental challenge in robotic manipulation. To tackle this challenge, recent Vision-Language-Action (VLA) models build policies on top of Vision-Language Models (VLMs), seeking to transfer their open-world…

Vision-Language-Action (VLA) models combine perception, language, and motor control in a single architecture, yet how they translate multimodal inputs into actions remains poorly understood. We apply activation injection, sparse…

机器人学 · 计算机科学 2026-03-20 Bryce Grant , Xijia Zhao , Peng Wang

Vision-language-action (VLA) models enable robots to follow natural-language instructions grounded in visual observations, but the instruction channel also introduces a critical vulnerability: small textual perturbations can alter…

机器人学 · 计算机科学 2026-04-08 Xiyang Wu , Guangyao Shi , Qingzi Wang , Zongxia Li , Amrit Singh Bedi , Dinesh Manocha

While leveraging abundant human videos and simulated robot data poses a scalable solution to the scarcity of real-world robot data, the generalization capability of existing vision-language-action models (VLAs) remains limited by mismatches…

Vision-language-action (VLA) models represent a promising direction for developing general-purpose robotic systems, demonstrating the ability to combine visual understanding, language comprehension, and action generation. However,…

机器人学 · 计算机科学 2024-12-10 Pranav Guruprasad , Harshvardhan Sikka , Jaewoo Song , Yangyue Wang , Paul Pu Liang

Vision-Language-Action (VLA) models have shown remarkable generalization by mapping web-scale knowledge to robotic control, yet they remain blind to physical contact. Consequently, they struggle with contact-rich manipulation tasks that…

机器人学 · 计算机科学 2026-05-07 Guo Ye , Zexi Zhang , Xu Zhao , Shang Wu , Haoran Lu , Shihan Lu , Han Liu

Despite the substantial advancements in Vision-Language Pre-training (VLP) models, their susceptibility to adversarial attacks poses a significant challenge. Existing work rarely studies the transferability of attacks on VLP models,…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Jiyuan Fu , Zhaoyu Chen , Kaixun Jiang , Haijing Guo , Jiafeng Wang , Shuyong Gao , Wenqiang Zhang

In dynamic environments such as warehouses, hospitals, and homes, robots must seamlessly transition between gross motion and precise manipulations to complete complex tasks. However, current Vision-Language-Action (VLA) frameworks, largely…

机器人学 · 计算机科学 2026-03-03 Xiongfeng Peng , Jiaqian Yu , Dingzhe Li , Yixiang Jin , Lu Xu , Yamin Mao , Chao Zhang , Weiming Li , Sujin Jang , Dongwook Lee , Daehyun Ji

Vision-Language-Action (VLA) models map multimodal perception and language instructions to executable robot actions, making them particularly vulnerable to behavioral backdoor manipulation: a hidden trigger introduced during training can…

密码学与安全 · 计算机科学 2026-03-10 Zonghuan Xu , Jiayu Li , Yunhan Zhao , Xiang Zheng , Xingjun Ma , Yu-Gang Jiang

Vision-language-action (VLA) models show potential for general robotic tasks, but remain challenging in spatiotemporally coherent manipulation, which requires fine-grained representations. Typically, existing methods embed 3D positions into…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Hanyu Zhou , Chuanhao Ma , Gim Hee Lee

While vision-language-action (VLA) models have shown great promise for robot manipulation, their deployment on rigid industrial robots remains challenging due to the inherent trade-off between compliance and responsiveness. Standard…

机器人学 · 计算机科学 2026-03-18 Johannes Hechtl , Philipp Schmitt , Georg von Wichert , Wolfram Burgard

Vision-Language-Action (VLA) models have emerged as a promising paradigm for generalist robotic manipulation. A common design in current architectures maps language instructions and visual observations to actions in a single forward pass.…

机器人学 · 计算机科学 2026-05-26 Weilong Guo , Yuchen Wang , Renping Zhou , Yunfeng Zhang , Rui Fang , Yuyang Pang , Wenda Xu , Gao Huang

Vision Language Action (VLA) models represent a transformative shift in robotics, with the aim of unifying visual perception, natural language understanding, and embodied control within a single learning framework. This review presents a…

机器人学 · 计算机科学 2026-01-21 Muhayy Ud Din , Waseem Akram , Lyes Saad Saoud , Jan Rosell , Irfan Hussain

While end-to-end Vision-Language-Action (VLA) models offer a promising paradigm for robotic manipulation, fine-tuning them on narrow control data often compromises the profound reasoning capabilities inherited from their base…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Tianshuo Yang , Guanyu Chen , Yutian Chen , Zhixuan Liang , Yitian Liu , Zanxin Chen , Chunpu Xu , Haotian Liang , Jiangmiao Pang , Yao Mu , Ping Luo