English
Related papers

Related papers: Projection & Probability-Driven Black-Box Attack

200 papers

We focus on the problem of black-box adversarial attacks, where the aim is to generate adversarial examples for deep learning models solely based on information limited to output label~(hard label) to a queried data input. We propose a…

Machine Learning · Computer Science 2021-06-14 Satya Narayan Shukla , Anit Kumar Sahu , Devin Willmott , J. Zico Kolter

Decision-based attack poses a severe threat to real-world applications since it regards the target model as a black box and only accesses the hard prediction label. Great efforts have been made recently to decrease the number of queries;…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Xiaosen Wang , Zeliang Zhang , Kangheng Tong , Dihong Gong , Kun He , Zhifeng Li , Wei Liu

Deep learning models are used in safety-critical tasks such as automated driving and face recognition. However, small perturbations in the model input can significantly change the predictions. Adversarial attacks are used to identify small…

Cryptography and Security · Computer Science 2025-12-03 Issa Oe , Keiichiro Yamamura , Hiroki Ishikura , Ryo Hamahira , Katsuki Fujisawa

Adversarial black-box attacks aim to craft adversarial perturbations by querying input-output pairs of machine learning models. They are widely used to evaluate the robustness of pre-trained models. However, black-box attacks often suffer…

Machine Learning · Computer Science 2020-11-11 Lu Wang , Huan Zhang , Jinfeng Yi , Cho-Jui Hsieh , Yuan Jiang

Deep neural networks provide unprecedented performance in all image classification problems, taking advantage of huge amounts of data available for training. Recent studies, however, have shown their vulnerability to adversarial attacks,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Diego Gragnaniello , Francesco Marra , Giovanni Poggi , Luisa Verdoliva

Blackbox adversarial attacks can be categorized into transfer- and query-based attacks. Transfer methods do not require any feedback from the victim model, but provide lower success rates compared to query-based methods. Query attacks often…

Machine Learning · Computer Science 2022-11-28 Zikui Cai , Chengyu Song , Srikanth Krishnamurthy , Amit Roy-Chowdhury , M. Salman Asif

Current black-box adversarial attacks either require multiple queries or diffusion models to produce adversarial samples that can impair the target model performance. However, these methods require training a surrogate loss or diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Joana C. Costa , Tiago Roxo , Hugo Proença , Pedro R. M. Inácio

The vulnerability of the high-performance machine learning models implies a security risk in applications with real-world consequences. Research on adversarial attacks is beneficial in guiding the development of machine learning models on…

Machine Learning · Computer Science 2022-11-16 Yiran Huang , Yexu Zhou , Michael Hefenbrock , Till Riedel , Likun Fang , Michael Beigl

Machine learning (ML), especially deep neural networks (DNNs) have been widely used in various applications, including several safety-critical ones (e.g. autonomous driving). As a result, recent research about adversarial examples has…

Machine Learning · Computer Science 2020-05-29 Huichen Li , Xiaojun Xu , Xiaolu Zhang , Shuang Yang , Bo Li

Deep Neural Networks can be easily fooled by small and imperceptible perturbations. The query-based black-box attack (QBBA) is able to create the perturbations using model output probabilities of image queries requiring no access to the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Jindong Gu , Fangyun Wei , Philip Torr , Han Hu

This paper addresses the challenging black-box adversarial attack problem, where only classification confidence of a victim model is available. Inspired by consistency of visual saliency between different vision models, a surrogate model is…

Cryptography and Security · Computer Science 2020-10-23 Jiancheng Yang , Yangzhou Jiang , Xiaoyang Huang , Bingbing Ni , Chenglong Zhao

Adversarial example generation becomes a viable method for evaluating the robustness of a machine learning model. In this paper, we consider hard-label black-box attacks (a.k.a. decision-based attacks), which is a challenging setting that…

Machine Learning · Computer Science 2019-10-15 Zhenxin Xiao , Puyudi Yang , Yuchen Jiang , Kai-Wei Chang , Cho-Jui Hsieh

Enhancing our understanding of adversarial examples is crucial for the secure application of machine learning models in real-world scenarios. A prevalent method for analyzing adversarial examples is through a frequency-based approach.…

Machine Learning · Computer Science 2024-04-17 Zhun Zhang , Yi Zeng , Qihe Liu , Shijie Zhou

Adversarial perturbations are a useful way to expose vulnerabilities in object detectors. Existing perturbation methods are frequently white-box, architecture specific and use a loss function. More importantly, while they are often…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Melane Navaratnarajah , David A. Kelly , Hana Chockler

Gradient estimation and vector space projection have been studied as two distinct topics. We aim to bridge the gap between the two by investigating how to efficiently estimate gradient based on a projected low-dimensional space. We first…

Machine Learning · Computer Science 2021-04-30 Huichen Li , Linyi Li , Xiaojun Xu , Xiaolu Zhang , Shuang Yang , Bo Li

We study an important and challenging task of attacking natural language processing models in a hard label black box setting. We propose a decision-based attack strategy that crafts high quality adversarial examples on text classification…

Computation and Language · Computer Science 2021-04-30 Rishabh Maheshwary , Saket Maheshwary , Vikram Pudi

Adversarial patch is an important form of real-world adversarial attack that brings serious risks to the robustness of deep neural networks. Previous methods generate adversarial patches by either optimizing their perturbation values while…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Xingxing Wei , Ying Guo , Jie Yu , Bo Zhang

Black-box policy optimization is a class of reinforcement learning algorithms that explores and updates the policies at the parameter level. This class of algorithms is widely applied in robotics with movement primitives or…

Machine Learning · Computer Science 2022-03-22 Marius Memmel , Puze Liu , Davide Tateo , Jan Peters

The adversarial attack can force a CNN-based model to produce an incorrect output by craftily manipulating human-imperceptible input. Exploring such perturbations can help us gain a deeper understanding of the vulnerability of neural…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Xiangyu Yin , Wenjie Ruan , Jonathan Fieldsend

Note that this paper is superceded by "Black-Box Adversarial Attacks with Limited Queries and Information." Current neural network-based image classifiers are susceptible to adversarial examples, even in the black-box setting, where the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-09 Andrew Ilyas , Logan Engstrom , Anish Athalye , Jessy Lin