中文
相关论文

相关论文: Towards Transferable Attacks Against Vision-LLMs i…

200 篇论文

In autonomous driving (AD), accurate perception is indispensable to achieving safe and secure driving. Due to its safety-criticality, the security of AD perception has been widely studied. Among different attacks on AD perception, the…

密码学与安全 · 计算机科学 2023-08-24 Ningfei Wang , Yunpeng Luo , Takami Sato , Kaidi Xu , Qi Alfred Chen

Vision-Language-Action (VLA) models are emerging as a unified substrate for embodied intelligence. This shift raises a new class of safety challenges, stemming from the embodied nature of VLA systems, including irreversible physical…

机器人学 · 计算机科学 2026-04-28 Qi Li , Bo Yin , Weiqi Huang , Ruhao Liu , Bojun Zou , Runpeng Yu , Jingwen Ye , Weihao Yu , Xinchao Wang

Current Cross-Modality Generation Models (GMs) demonstrate remarkable capabilities in various generative tasks. Given the ubiquity and information richness of vision modality inputs in real-world scenarios, Cross-Vision tasks, encompassing…

计算机视觉与模式识别 · 计算机科学 2025-11-06 Hao Cheng , Erjia Xiao , Yichi Wang , Lingfeng Zhang , Qiang Zhang , Jiahang Cao , Kaidi Xu , Mengshu Sun , Xiaoshuai Hao , Jindong Gu , Renjing Xu

The growing misuse of Vision-Language Models (VLMs) has led providers to deploy multiple safeguards, including alignment tuning, system prompts, and content moderation. However, the real-world robustness of these defenses against…

密码学与安全 · 计算机科学 2025-11-21 Yijun Yang , Lichao Wang , Jianping Zhang , Chi Harold Liu , Lanqing Hong , Qiang Xu

Assessing the safety of autonomous driving (AD) systems against security threats, particularly backdoor attacks, is a stepping stone for real-world deployment. However, existing works mainly focus on pixel-level triggers that are…

密码学与安全 · 计算机科学 2025-10-14 Xuan Chen , Shiwei Feng , Zikang Xiong , Shengwei An , Yunshu Mao , Lu Yan , Guanhong Tao , Wenbo Guo , Xiangyu Zhang

Large Language Models (LLMs), characterized by being trained on broad amounts of data in a self-supervised manner, have shown impressive performance across a wide range of tasks. Indeed, their generative abilities have aroused interest on…

机器学习 · 计算机科学 2024-07-30 Jorge García-Carrasco , Alejandro Maté , Juan Trujillo

Vision-Language-Action (VLA) models revolutionize robotic systems by enabling end-to-end perception-to-action pipelines that integrate multiple sensory modalities, such as visual signals processed by cameras and auditory signals captured by…

机器人学 · 计算机科学 2025-12-22 Xuancun Lu , Jiaxiang Chen , Shilin Xiao , Zizhi Jin , Zhangrui Chen , Hanwen Yu , Bohan Qian , Ruochen Zhou , Xiaoyu Ji , Wenyuan Xu

Large Language Models (LLMs) remain vulnerable to jailbreaking attacks where adversarial prompts elicit harmful outputs. Yet most evaluations focus on single-turn interactions while real-world attacks unfold through adaptive multi-turn…

计算与语言 · 计算机科学 2025-12-23 Aashray Reddy , Andrew Zagula , Nicholas Saban

Large Language Models (LLMs) have shown significant promise in real-world decision-making tasks for embodied artificial intelligence, especially when fine-tuned to leverage their inherent common sense and reasoning abilities while being…

密码学与安全 · 计算机科学 2025-05-01 Ruochen Jiao , Shaoyuan Xie , Justin Yue , Takami Sato , Lixu Wang , Yixuan Wang , Qi Alfred Chen , Qi Zhu

Artificial intelligence (AI) plays a crucial role in autonomous driving (AD) research, propelling its development towards intelligence and efficiency. Currently, the development of AD technology follows two main technical paths:…

人工智能 · 计算机科学 2024-12-03 Yuxuan Zhu , Shiyi Wang , Wenqing Zhong , Nianchen Shen , Yunqi Li , Siqi Wang , Zhiheng Li , Cathy Wu , Zhengbing He , Li Li

Vision-Language-Action (VLA) models have recently shown strong decision-making capabilities in autonomous driving. However, existing VLAs often struggle with achieving efficient inference and generalizing to novel autonomous vehicle…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Dapeng Zhang , Zhenlong Yuan , Zhangquan Chen , Chih-Ting Liao , Yinda Chen , Fei Shen , Qingguo Zhou , Tat-Seng Chua

Due to their multimodal capabilities, Vision-Language Models (VLMs) have found numerous impactful applications in real-world scenarios. However, recent studies have revealed that VLMs are vulnerable to image-based adversarial attacks.…

机器学习 · 计算机科学 2025-03-31 Jiaming Zhang , Junhong Ye , Xingjun Ma , Yige Li , Yunfan Yang , Yunhao Chen , Jitao Sang , Dit-Yan Yeung

Vision-Language-Action Models (VLAs) have shown remarkable progress towards embodied intelligence. While their architecture partially resembles that of Large Language Models (LLMs), VLAs exhibit higher complexity due to their multi-modal…

机器人学 · 计算机科学 2026-03-06 Hugo Buurmeijer , Carmen Amo Alonso , Aiden Swann , Marco Pavone

Recently, autonomous agents built on large language models (LLMs) have experienced significant development and are being deployed in real-world applications. These agents can extend the base LLM's capabilities in multiple ways. For example,…

密码学与安全 · 计算机科学 2024-07-31 Boyang Zhang , Yicong Tan , Yun Shen , Ahmed Salem , Michael Backes , Savvas Zannettou , Yang Zhang

Vision-language models (VLMs) are vulnerable to adversarial image perturbations. Existing works based on adversarial training against task-specific adversarial examples are computationally expensive and often fail to generalize to unseen…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Jingning Xu , Haochen Luo , Chen Liu

Multimodal Large Language Models (MLLMs) are widely used in various fields due to their powerful cross-modal comprehension and generation capabilities. However, more modalities bring more vulnerabilities to being utilized for jailbreak…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Shiji Zhao , Shukun Xiong , Yao Huang , Yan Jin , Zhenyu Wu , Jiyang Guan , Ranjie Duan , Jialing Tao , Hui Xue , Xingxing Wei

In typical multimodal tasks, such as Visual Question Answering (VQA), adversarial attacks targeting a specific image and question can lead large vision-language models (LVLMs) to provide incorrect answers. However, it is common for a single…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Yudong Zhang , Ruobing Xie , Jiansheng Chen , Xingwu Sun , Zhanhui Kang , Yu Wang

While Vision-Language Models (VLMs) show significant promise for end-to-end autonomous driving by leveraging the common sense embedded in language models, their reliance on 2D image cues for complex scene understanding and decision-making…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Weijie Wei , Zhipeng Luo , Ling Feng , Venice Erin Liong

On-device Vision-Language Models (VLMs) promise data privacy via local execution. However, we show that the architectural shift toward Dynamic High-Resolution preprocessing (e.g., AnyRes) introduces an inherent algorithmic side-channel.…

密码学与安全 · 计算机科学 2026-03-30 Eyal Hadad , Mordechai Guri

Autonomous driving represents a prominent application of artificial intelligence. Recent approaches have shifted from focusing solely on common scenarios to addressing complex, long-tail situations such as subtle human behaviors, traffic…

机器人学 · 计算机科学 2025-11-26 Dapeng Zhang , Fei Shen , Rui Zhao , Yinda Chen , Peng Zhi , Chenyang Li , Rui Zhou , Qingguo Zhou