中文
相关论文

相关论文: When Robots Obey the Patch: Universal Transferable…

200 篇论文

As deep neural networks (DNNs) are widely applied in the physical world, many researches are focusing on physical-world adversarial examples (PAEs), which introduce perturbations to inputs and cause the model's incorrect outputs. However,…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Yichen Wang , Yuxuan Chou , Ziqi Zhou , Hangtao Zhang , Wei Wan , Shengshan Hu , Minghui Li

With Vision-Language Pre-training (VLP) models demonstrating powerful multimodal interaction capabilities, the application scenarios of neural networks are no longer confined to unimodal domains but have expanded to more complex multimodal…

计算机视觉与模式识别 · 计算机科学 2024-07-26 Haonan Zheng , Xinyang Deng , Wen Jiang , Wenrui Li

Reinforcement learning (RL) fine-tuning has shown promise for Vision-Language-Action (VLA) models in robotic manipulation, but deployment-time visual shifts pose practical challenges. A key difficulty is that standard task rewards supervise…

机器人学 · 计算机科学 2026-05-14 Yuanfang Peng , Jingjing Fu , Chuheng Zhang , Li Zhao , Jiang Bian , Mingyu Liu , Ling Zhang , Jun Zhang , Rui Wang

A generalist robot should perform effectively across various environments. However, most existing approaches heavily rely on scaling action-annotated data to enhance their capabilities. Consequently, they are often limited to single…

机器人学 · 计算机科学 2025-11-04 Qingwen Bu , Yanting Yang , Jisong Cai , Shenyuan Gao , Guanghui Ren , Maoqing Yao , Ping Luo , Hongyang Li

Vision-Language-Action (VLA) models have recently advanced robotic manipulation by translating natural-language instructions and visual observations into control actions. However, existing VLAs are primarily trained on successful expert…

机器人学 · 计算机科学 2026-03-24 Zewei Ye , Weifeng Lu , Minghao Ye , Tao Lin , Shuo Yang , Junchi Yan , Bo Zhao

Robotic systems are increasingly expected to operate in human-centered, unstructured environments where safety, adaptability, and generalization are essential. Vision-Language-Action (VLA) models have been proposed as a language guided…

机器人学 · 计算机科学 2025-10-21 Haochen Su , Cristian Meo , Francesco Stella , Andrea Peirone , Kai Junge , Josie Hughes

Recent advances in Vision-Language-Action (VLA) models have enabled robotic agents to integrate multimodal understanding with action execution. However, our empirical analysis reveals that current VLAs struggle to allocate visual attention…

Vision-language pre-training (VLP) models have shown vulnerability to adversarial examples in multimodal tasks. Furthermore, malicious adversaries can be deliberately transferred to attack other black-box models. However, existing work has…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Dong Lu , Zhiqiang Wang , Teng Wang , Weili Guan , Hongchang Gao , Feng Zheng

Multimodal Large Language Models (MLLMs) are becoming integral to autonomous driving (AD) systems due to their strong vision-language reasoning capabilities. However, MLLMs are vulnerable to adversarial attacks, particularly adversarial…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Qi Guo , Xiaojun Jia , Shanmin Pang , Simeng Qin , Lin Wang , Ju Jia , Yang Liu , Qing Guo

Amid growing efforts to leverage advances in large language models (LLMs) and vision-language models (VLMs) for robotics, Vision-Language-Action (VLA) models have recently gained significant attention. By unifying vision, language, and…

机器人学 · 计算机科学 2025-10-09 Kento Kawaharazuka , Jihoon Oh , Jun Yamada , Ingmar Posner , Yuke Zhu

Smart farming has emerged as a key technology for advancing modern agriculture through automation and intelligent control. However, systems relying on RGB cameras for perception and robotic manipulators for control, common in smart farming,…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Ju-Young Kim , Ji-Hong Park , Myeongjun Kim , Gun-Woo Kim

Despite advances in Vision-Language-Action (VLA) models, robotic manipulation struggles with fine-grained tasks because current models lack mechanisms for active visual attention allocation. Human gaze naturally encodes intent, planning,…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Anupam Pani , Yanchao Yang

Adversarial examples have revealed the vulnerability of deep learning models and raised serious concerns about information security. The transfer-based attack is a hot topic in black-box attacks that are practical to real-world scenarios…

计算机视觉与模式识别 · 计算机科学 2025-05-07 Jian-Wei Li , Wen-Ze Shao

Vision-language models are emerging for autonomous driving, yet their robustness to physical adversarial attacks remains unexplored. This paper presents a systematic framework for comparative adversarial evaluation across three VLM…

计算机视觉与模式识别 · 计算机科学 2026-03-11 David Fernandez , Pedram MohajerAnsari , Amir Salarpour , Long Cheng , Abolfazl Razi , Mert D. Pesé

Multimodal Large Language Models (MLLMs) have achieved remarkable performance across vision-language tasks. Recent advancements allow these models to process multiple images as inputs. However, the vulnerabilities of multi-image MLLMs…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Alvi Md Ishmam , Najibul Haque Sarker , Zaber Ibn Abdul Hakim , Chris Thomas

We introduce Universal and Transferable Adversarial Perturbations (UTAP) for pathology foundation models that reveal critical vulnerabilities in their capabilities. Optimized using deep learning, UTAP comprises a fixed and weak noise…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Yuntian Wang , Xilin Yang , Che-Yung Shen , Nir Pillar , Aydogan Ozcan

Current vision-language-action (VLA) models, pre-trained on large-scale robotic data, exhibit strong multi-task capabilities and generalize well to variations in visual and language instructions for manipulation. However, their success rate…

机器人学 · 计算机科学 2025-10-17 Han Zhao , Jiaxuan Zhang , Wenxuan Song , Pengxiang Ding , Donglin Wang

Recently demonstrated physical-world adversarial attacks have exposed vulnerabilities in perception systems that pose severe risks for safety-critical applications such as autonomous driving. These attacks place adversarial artifacts in the…

机器学习 · 计算机科学 2021-06-23 Jan Hendrik Metzen , Nicole Finnie , Robin Hutmacher

Robust semantic segmentation is crucial for safe autonomous driving, yet deployed models remain vulnerable to black-box adversarial attacks when target weights are unknown. Most existing approaches either craft image-wide perturbations or…

机器学习 · 计算机科学 2026-03-24 Aarush Aggarwal , Akshat Tomar , Amritanshu Tiwari , Sargam Goyal

Pre-trained vision-language models (VLMs) have showcased remarkable performance in image and natural language understanding, such as image captioning and response generation. As the practical applications of vision-language models become…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Peng Xie , Yequan Bie , Jianda Mao , Yangqiu Song , Yang Wang , Hao Chen , Kani Chen