English
Related papers

Related papers: Black-Box Adversarial Attack on Vision Language Mo…

200 papers

At present, Connected Autonomous Vehicles (CAVs) have begun to open road testing around the world, but their safety and efficiency performance in complex scenarios is still not satisfactory. Cooperative driving leverages the connectivity…

Robotics · Computer Science 2025-09-22 Shiyu Fang , Jiaqi Liu , Mingyu Ding , Yiming Cui , Chen Lv , Peng Hang , Jian Sun

In typical multimodal tasks, such as Visual Question Answering (VQA), adversarial attacks targeting a specific image and question can lead large vision-language models (LVLMs) to provide incorrect answers. However, it is common for a single…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Yudong Zhang , Ruobing Xie , Jiansheng Chen , Xingwu Sun , Zhanhui Kang , Yu Wang

This paper introduces an attacking mechanism to challenge the resilience of autonomous driving systems. Specifically, we manipulate the decision-making processes of an autonomous vehicle by dynamically displaying adversarial patches on a…

Robotics · Computer Science 2024-12-04 Amirhosein Chahe , Chenan Wang , Abhishek Jeyapratap , Kaidi Xu , Lifeng Zhou

Modern autonomous driving (AD) systems leverage 3D object detection to perceive foreground objects in 3D environments for subsequent prediction and planning. Visual 3D detection based on RGB cameras provides a cost-effective solution…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Jian Wang , Lijun He , Yixing Yong , Haixia Bi , Fan Li

Adversarial attacks constitute a notable threat to machine learning systems, given their potential to induce erroneous predictions and classifications. However, within real-world contexts, the essential specifics of the deployed model are…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Jingwen Ye , Ruonan Yu , Songhua Liu , Xinchao Wang

The robustness of Vision-Language Models (VLMs) such as CLIP is critical for their deployment in safety-critical applications like autonomous driving, healthcare diagnostics, and security systems, where accurate interpretation of visual and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yuhan Liang , Yijun Li , Yumeng Niu , Qianhe Shen , Hangyu Liu

Deep neural networks (DNNs) have been widely used in many fields such as images processing, speech recognition; however, they are vulnerable to adversarial examples, and this is a security issue worthy of attention. Because the training…

Cryptography and Security · Computer Science 2019-08-08 Wenjian Luo , Chenwang Wu , Nan Zhou , Li Ni

While image-to-text models have demonstrated significant advancements in various vision-language tasks, they remain susceptible to adversarial attacks. Existing white-box attacks on image-to-text models require access to the architecture,…

Artificial Intelligence · Computer Science 2024-08-20 Qingyuan Zeng , Zhenzhong Wang , Yiu-ming Cheung , Min Jiang

Deep neural networks provide unprecedented performance in all image classification problems, taking advantage of huge amounts of data available for training. Recent studies, however, have shown their vulnerability to adversarial attacks,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Diego Gragnaniello , Francesco Marra , Giovanni Poggi , Luisa Verdoliva

Existing learning-based autonomous driving (AD) systems face challenges in comprehending high-level information, generalizing to rare events, and providing interpretability. To address these problems, this work employs Large Language Models…

Robotics · Computer Science 2025-04-16 Hao Sha , Yao Mu , Yuxuan Jiang , Li Chen , Chenfeng Xu , Ping Luo , Shengbo Eben Li , Masayoshi Tomizuka , Wei Zhan , Mingyu Ding

The safe deployment of autonomous driving (AD) systems is fundamentally hindered by the long-tail problem, where rare yet critical driving scenarios are severely underrepresented in real-world data. Existing solutions including…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Qimao Chen , Fang Li , Shaoqing Xu , Zhiyi Lai , Zixun Xie , Yuechen Luo , Shengyin Jiang , Hanbing Li , Long Chen , Bing Wang , Yi Zhang , Zhi-Xin Yang

While Vision-Language Models (VLMs) show significant promise for end-to-end autonomous driving by leveraging the common sense embedded in language models, their reliance on 2D image cues for complex scene understanding and decision-making…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Weijie Wei , Zhipeng Luo , Ling Feng , Venice Erin Liong

In response to the rapidly evolving nature of adversarial attacks against visual classifiers, numerous defenses have been proposed to generalize against as many known attacks as possible. However, designing a defense method that generalizes…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Qian Wang , Hefei Ling , Yingwei Li , Qihao Liu , Ruoxi Jia , Ning Yu

Autonomous vehicles (AVs) increasingly use DNN-based object detection models in vision-based perception. Correct detection and classification of obstacles is critical to ensure safe, trustworthy driving decisions. Adversarial patches aim to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Jaden Mu

The safe deployment of autonomous driving systems (ADSs) relies on comprehensive testing and evaluation. However, safety-critical scenarios that can effectively expose system vulnerabilities are extremely sparse in the real world. Existing…

Robotics · Computer Science 2025-12-03 Xinzheng Wu , Junyi Chen , Naiting Zhong , Yong Shen

Assessing the safety of autonomous driving (AD) systems against security threats, particularly backdoor attacks, is a stepping stone for real-world deployment. However, existing works mainly focus on pixel-level triggers that are…

Cryptography and Security · Computer Science 2025-10-14 Xuan Chen , Shiwei Feng , Zikang Xiong , Shengwei An , Yunshu Mao , Lu Yan , Guanhong Tao , Wenbo Guo , Xiangyu Zhang

Deep neural networks are vulnerable to adversarial examples, even in the black-box setting where the attacker is only accessible to the model output. Recent studies have devised effective black-box attacks with high query efficiency.…

Machine Learning · Computer Science 2022-06-07 Zeyu Dai , Shengcai Liu , Ke Tang , Qing Li

Adversarial machine learning (AML) studies attacks that can fool machine learning algorithms into generating incorrect outcomes as well as the defenses against worst-case attacks to strengthen model robustness. Specifically for image…

Human-Computer Interaction · Computer Science 2024-10-08 Yuzhe You , Jarvis Tse , Jian Zhao

Recent advancements in Large Vision-Language Models (LVLMs) have shown groundbreaking capabilities across diverse multimodal tasks. However, these models remain vulnerable to adversarial jailbreak attacks, where adversaries craft subtle…

Cryptography and Security · Computer Science 2026-01-23 Jiwei Guan , Haibo Jin , Haohan Wang

Video Anomaly Detection (VAD) has traditionally been framed as binary classification or outlier detection, providing neither interpretable reasoning nor precise spatial localization of anomalous events. While Vision-Language Models (VLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Sakshi Agarwal , Aishik Konwer , Ankit Parag Shah