中文
相关论文

相关论文: Explainable Adversarial-Robust Vision-Language-Act…

200 篇论文

Vision-Language-Action (VLA) models have recently emerged as a promising paradigm for robotic manipulation, in which reliable action prediction critically depends on accurately interpreting and integrating visual observations conditioned on…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Yulin Luo , Hao Chen , Zhuangzhe Wu , Bowen Sui , Jiaming Liu , Chenyang Gu , Zhuoyang Liu , Qiuxuan Feng , Jiale Yu , Shuo Gu , Peng Jia , Pheng-Ann Heng , Shanghang Zhang

Vision-Language Models (VLMs) have emerged as a promising approach to address the data scarcity challenge in robotics, enabling the development of generalizable visuomotor control policies. While models like OpenVLA showcase the potential…

Vision-language pre-training (VLP) models demonstrate impressive abilities in processing both images and text. However, they are vulnerable to multi-modal adversarial examples (AEs). Investigating the generation of high-transferability…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Dongchen Han , Xiaojun Jia , Yang Bai , Jindong Gu , Yang Liu , Xiaochun Cao

Vision-Language-Action (VLA) models have recently made significant advance in multi-task, end-to-end robotic control, due to the strong generalization capabilities of Vision-Language Models (VLMs). A fundamental challenge in developing such…

机器人学 · 计算机科学 2025-06-17 Yuqing Wen , Kefan Gu , Haoxuan Liu , Yucheng Zhao , Tiancai Wang , Haoqiang Fan , Xiaoyan Sun

Vision-Language-Action (VLA) models mark a transformative advancement in artificial intelligence, aiming to unify perception, natural language understanding, and embodied action within a single computational framework. This foundational…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Ranjan Sapkota , Yang Cao , Konstantinos I. Roumeliotis , Manoj Karkee

Vision-Language-Action (VLA) models have demonstrated strong performance across a wide range of robotic manipulation tasks. Despite the success, extending large pretrained Vision-Language Models (VLMs) to the action space can induce…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Yiye Chen , Yanan Jian , Xiaoyi Dong , Shuxin Cao , Jing Wu , Patricio Vela , Benjamin E. Lundell , Dongdong Chen

Recent advances in Vision-Language-Action models (VLAs) have expanded the capabilities of embodied intelligence. However, significant challenges remain in real-time decision-making in complex 3D environments, which demand second-level…

计算机视觉与模式识别 · 计算机科学 2026-01-12 Peng Chen , Pi Bu , Yingyao Wang , Xinyi Wang , Ziming Wang , Jie Guo , Yingxiu Zhao , Qi Zhu , Jun Song , Siran Yang , Jiamang Wang , Bo Zheng

Language Model Agents (LMAs) are emerging as a powerful primitive for augmenting red-team operations. They can support attack planning, adversary emulation, and the orchestration of multi-step activity such as lateral movement, a core…

密码学与安全 · 计算机科学 2026-05-08 Mohammad Mamun , Mohamed Gaber , Scott Buffett , Sherif Saad

Vision-language-action models (VLAs) have shown generalization capabilities in robotic manipulation tasks by inheriting from vision-language models (VLMs) and learning action generation. Most VLA models focus on interpreting vision and…

We adapt a pre-trained Vision-Language-Action (VLA) model (Open-VLA) for dexterous human-robot collaboration with minimal language prompting. Our approach adds (i) FiLM conditioning to visual backbones for task-aware perception, (ii) an…

机器人学 · 计算机科学 2025-10-30 Boshi An , Chenyu Yang , Robert Katzschmann

In this work, we present CollabVLA, a self-reflective vision-language-action framework that transforms a standard visuomotor policy into a collaborative assistant. CollabVLA tackles key limitations of prior VLAs, including domain…

机器人学 · 计算机科学 2025-09-19 Nan Sun , Yongchang Li , Chenxu Wang , Huiying Li , Huaping Liu

The growing success of Vision-Language-Action (VLA) models stems from the promise that pretrained Vision-Language Models (VLMs) can endow agents with transferable world knowledge and vision-language (VL) grounding, laying a foundation for…

机器学习 · 计算机科学 2025-10-30 Nikita Kachaev , Mikhail Kolosov , Daniil Zelezetsky , Alexey K. Kovalev , Aleksandr I. Panov

In this study, we address the problem of language-guided robotic manipulation, where a robot is required to manipulate a wide range of objects based on visual observations and natural language instructions. This task is essential for…

机器人学 · 计算机科学 2026-03-17 Yusuke Takagi , Motonari Kambara , Daichi Yashima , Koki Seno , Kento Tokura , Komei Sugiura

Vision-Language-Action (VLA) models have shown remarkable potential in visuomotor control and instruction comprehension through end-to-end learning processes. However, current VLA models face significant challenges: they are slow during…

机器人学 · 计算机科学 2025-05-14 Junjie Wen , Yichen Zhu , Jinming Li , Minjie Zhu , Kun Wu , Zhiyuan Xu , Ning Liu , Ran Cheng , Chaomin Shen , Yaxin Peng , Feifei Feng , Jian Tang

This paper tackles spatial perception and manipulation challenges in Vision-Language-Action (VLA) models. To address depth ambiguity from monocular input, we leverage a pre-trained multi-view diffusion model to synthesize latent novel views…

Vision-Language-Action (VLA) models have gained much attention from the research community thanks to their strength in translating multimodal observations with linguistic instructions into desired robotic actions. Despite their…

机器人学 · 计算机科学 2026-04-21 Tuan Van Vo , Tan Q. Nguyen , Khang Nguyen , Nhat Xuan Tran , Duy H. M. Nguyen , An T. Le , Ngo Anh Vien , Minh Nhat Vu

While vision-language pre-training model (VLP) has shown revolutionary improvements on various vision-language (V+L) tasks, the studies regarding its adversarial robustness remain largely unexplored. This paper studied the adversarial…

机器学习 · 计算机科学 2022-10-21 Jiaming Zhang , Qi Yi , Jitao Sang

Recent advances in vision-language-action (VLA) models have shown promise in integrating image generation with action prediction to improve generalization and reasoning in robot manipulation. However, existing methods are limited to…

计算机视觉与模式识别 · 计算机科学 2025-08-27 Wenyao Zhang , Hongsi Liu , Zekun Qi , Yunnan Wang , Xinqiang Yu , Jiazhao Zhang , Runpei Dong , Jiawei He , Fan Lu , He Wang , Zhizheng Zhang , Li Yi , Wenjun Zeng , Xin Jin

Vision-Language-Action (VLA) models have emerged as a promising paradigm for generalist robotic manipulation. A common design in current architectures maps language instructions and visual observations to actions in a single forward pass.…

机器人学 · 计算机科学 2026-05-26 Weilong Guo , Yuchen Wang , Renping Zhou , Yunfeng Zhang , Rui Fang , Yuyang Pang , Wenda Xu , Gao Huang

Building on the unprecedented capabilities of large language models for command understanding and zero-shot recognition of multi-modal vision-language transformers, visual language navigation (VLN) has emerged as an effective way to address…

机器人学 · 计算机科学 2024-07-11 Chashi Mahiul Islam , Shaeke Salman , Montasir Shams , Xiuwen Liu , Piyush Kumar