English
Related papers

Related papers: Query-Efficient Black-box Adversarial Attacks Guid…

200 papers

Adversarial training and adversarial purification are two widely used defense strategies for enhancing model robustness against adversarial attacks. However, adversarial training requires costly retraining, while adversarial purification…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Xuelong Dai , Dong Wang , Xiuzhen Cheng , Bin Xiao

In recent years, visual tracking methods based on convolutional neural networks and Transformers have achieved remarkable performance and have been successfully applied in fields such as autonomous driving. However, the numerous security…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Wei-Long Tian , Peng Gao , Xiao Liu , Long Xu , Hamido Fujita , Hanan Aljuai , Mao-Li Wang

We study the problem of attacking a machine learning model in the hard-label black-box setting, where no model information is revealed except that the attacker can make queries to probe the corresponding hard-label decisions. This is a very…

Machine Learning · Computer Science 2018-07-13 Minhao Cheng , Thong Le , Pin-Yu Chen , Jinfeng Yi , Huan Zhang , Cho-Jui Hsieh

Deep neural networks have been demonstrated to be vulnerable to adversarial attacks: subtle perturbation can completely change prediction result. The vulnerability has led to a surge of research in this direction, including adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Quanyu Liao , Xin Wang , Bin Kong , Siwei Lyu , Bin Zhu , Youbing Yin , Qi Song , Xi Wu

We investigate how an adversary can optimally use its query budget for targeted evasion attacks against deep neural networks in a black-box setting. We formalize the problem setting and systematically evaluate what benefits the adversary…

Machine Learning · Computer Science 2020-10-23 Mika Juuti , Buse Gul Atli , N. Asokan

The application of deep recurrent networks to audio transcription has led to impressive gains in automatic speech recognition (ASR) systems. Many have demonstrated that small adversarial perturbations can fool deep neural networks into…

Machine Learning · Computer Science 2019-08-21 Rohan Taori , Amog Kamsetty , Brenton Chu , Nikita Vemuri

In recent years, extensive research has been conducted on the vulnerability of ASR systems, revealing that black-box adversarial example attacks pose significant threats to real-world ASR systems. However, most existing black-box attacks…

Cryptography and Security · Computer Science 2024-06-28 Zheng Fang , Tao Wang , Lingchen Zhao , Shenyi Zhang , Bowen Li , Yunjie Ge , Qi Li , Chao Shen , Qian Wang

Language Language Models (LLMs) face safety concerns due to potential misuse by malicious users. Recent red-teaming efforts have identified adversarial suffixes capable of jailbreaking LLMs using the gradient-based search algorithm Greedy…

Computation and Language · Computer Science 2024-10-08 Hongfu Liu , Yuxi Xie , Ye Wang , Michael Shieh

Adversarial attacks expose important vulnerabilities of deep learning models, yet little attention has been paid to settings where data arrives as a stream. In this paper, we formalize the online adversarial attack problem, emphasizing two…

The vulnerability of deep neural networks (DNNs) to adversarial examples has drawn great attention from the community. In this paper, we study the transferability of such examples, which lays the foundation of many black-box attacks on…

Machine Learning · Computer Science 2020-12-08 Yiwen Guo , Qizhang Li , Hao Chen

Despite the rapid development of adversarial machine learning, most adversarial attack and defense researches mainly focus on the perturbation-based adversarial examples, which is constrained by the input images. In comparison with existing…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Xiaosen Wang , Kun He , Chuanbiao Song , Liwei Wang , John E. Hopcroft

In this paper, we present a generic, query-efficient black-box attack against API call-based machine learning malware classifiers. We generate adversarial examples by modifying the malware's API call sequences and non-sequential features…

Cryptography and Security · Computer Science 2020-10-06 Ishai Rosenberg , Asaf Shabtai , Yuval Elovici , Lior Rokach

It has been shown that adversaries can craft example inputs to neural networks which are similar to legitimate inputs but have been created to purposely cause the neural network to misclassify the input. These adversarial examples are…

Machine Learning · Computer Science 2018-10-25 Mohammad Hashemi , Greg Cusack , Eric Keller

The transferability of adversarial examples across deep neural network (DNN) models is the crux of a spectrum of black-box attacks. In this paper, we propose a novel method to enhance the black-box transferability of baseline adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Qizhang Li , Yiwen Guo , Hao Chen

Transferable adversarial attacks optimize adversaries from a pretrained surrogate model and known label space to fool the unknown black-box models. Therefore, these attacks are restricted by the availability of an effective surrogate model.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Hashmat Shadab Malik , Shahina K Kunhimon , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan

The presence of adversarial examples poses a significant threat to deep learning models and their applications. Existing defense methods provide certain resilience against adversarial examples, but often suffer from decreased accuracy and…

Cryptography and Security · Computer Science 2023-11-27 Jiahao Chen , Diqun Yan , Li Dong

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

Machine Learning · Computer Science 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

To launch black-box attacks against a Deep Neural Network (DNN) based Face Recognition (FR) system, one needs to build \textit{substitute} models to simulate the target model, so the adversarial examples discovered from substitute models…

Machine Learning · Computer Science 2018-08-23 Di Tang , XiaoFeng Wang , Kehuan Zhang

Blackbox adversarial attacks can be categorized into transfer- and query-based attacks. Transfer methods do not require any feedback from the victim model, but provide lower success rates compared to query-based methods. Query attacks often…

Machine Learning · Computer Science 2022-11-28 Zikui Cai , Chengyu Song , Srikanth Krishnamurthy , Amit Roy-Chowdhury , M. Salman Asif

Deep learning systems are known to be vulnerable to adversarial examples. In particular, query-based black-box attacks do not require knowledge of the deep learning model, but can compute adversarial examples over the network by submitting…

Cryptography and Security · Computer Science 2022-06-10 Huiying Li , Shawn Shan , Emily Wenger , Jiayun Zhang , Haitao Zheng , Ben Y. Zhao