English
Related papers

Related papers: Black-box Adversarial Attacks with Limited Queries…

200 papers

Adversarial attacks have emerged as a major challenge to the trustworthy deployment of machine learning models, particularly in computer vision applications. These attacks have a varied level of potency and can be implemented in both white…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Nandish Chattopadhyay , Abdul Basit , Bassem Ouni , Muhammad Shafique

Adversarial attacks on graphs have attracted considerable research interests. Existing works assume the attacker is either (partly) aware of the victim model, or able to send queries to it. These assumptions are, however, unrealistic. To…

Machine Learning · Computer Science 2021-09-01 Jiarong Xu , Yizhou Sun , Xin Jiang , Yanhao Wang , Yang Yang , Chunping Wang , Jiangang Lu

In the last decade, deep neural networks have proven to be very powerful in computer vision tasks, starting a revolution in the computer vision and machine learning fields. However, deep neural networks, usually, are not robust to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Hao Qiu , Leonardo Lucio Custode , Giovanni Iacca

Adversarial images aim to change a target model's decision by minimally perturbing a target image. In the black-box setting, the absence of gradient information often renders this search problem costly in terms of query complexity. In this…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Chuan Guo , Jared S. Frank , Kilian Q. Weinberger

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

Many machine learning algorithms are vulnerable to almost imperceptible perturbations of their inputs. So far it was unclear how much risk adversarial perturbations carry for the safety of real-world machine learning applications because…

Machine Learning · Statistics 2018-02-19 Wieland Brendel , Jonas Rauber , Matthias Bethge

The incremental diffusion of machine learning algorithms in supporting cybersecurity is creating novel defensive opportunities but also new types of risks. Multiple researches have shown that machine learning methods are vulnerable to…

Cryptography and Security · Computer Science 2021-06-18 Giovanni Apruzzese , Mauro Andreolini , Luca Ferretti , Mirco Marchetti , Michele Colajanni

Sentence-level attacks craft adversarial sentences that are synonymous with correctly-classified sentences but are misclassified by the text classifiers. Under the black-box setting, classifiers are only accessible through their feedback to…

Computation and Language · Computer Science 2024-02-22 Raha Moraffah , Huan Liu

Neural networks have been proven to be vulnerable to a variety of adversarial attacks. From a safety perspective, highly sparse adversarial attacks are particularly dangerous. On the other hand the pixelwise perturbations of sparse attacks…

Machine Learning · Computer Science 2019-09-12 Francesco Croce , Matthias Hein

Deep learning models suffer from a phenomenon called adversarial attacks: we can apply minor changes to the model input to fool a classifier for a particular example. The literature mostly considers adversarial attacks on models with images…

Machine Learning · Computer Science 2020-10-13 Ivan Fursov , Alexey Zaytsev , Nikita Kluchnikov , Andrey Kravchenko , Evgeny Burnaev

Deep neural networks for image classification remain vulnerable to adversarial examples -- small, imperceptible perturbations that induce misclassifications. In black-box settings, where only the final prediction is accessible, crafting…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Arjhun Swaminathan , Mete Akgün

The attacks on the neural-network-based classifiers using adversarial images have gained a lot of attention recently. An adversary can purposely generate an image that is indistinguishable from a innocent image for a human being but is…

Cryptography and Security · Computer Science 2019-07-02 Nir Morgulis , Alexander Kreines , Shachar Mendelowitz , Yuval Weisglass

We consider the hard label based black box adversarial attack setting which solely observes predicted classes from the target model. Most of the attack methods in this setting suffer from impractical number of queries required to achieve a…

Machine Learning · Computer Science 2024-03-12 Jeonghwan Park , Paul Miller , Niall McLaughlin

Neural networks are known to be vulnerable to carefully crafted adversarial examples, and these malicious samples often transfer, i.e., they remain adversarial even against other models. Although great efforts have been delved into the…

Image and Video Processing · Electrical Eng. & Systems 2019-11-27 Yantao Lu , Yunhan Jia , Jianyu Wang , Bai Li , Weiheng Chai , Lawrence Carin , Senem Velipasalar

We present a new method for black-box adversarial attack. Unlike previous methods that combined transfer-based and scored-based methods by using the gradient or initialization of a surrogate white-box model, this new method tries to learn a…

Machine Learning · Computer Science 2020-01-07 Zhichao Huang , Tong Zhang

The problem of adversarial examples, evasion attacks on machine learning classifiers, has proven extremely difficult to solve. This is true even when, as is the case in many practical settings, the classifier is hosted as a remote service…

Cryptography and Security · Computer Science 2019-07-15 Steven Chen , Nicholas Carlini , David Wagner

The study of adversarial vulnerabilities of deep neural networks (DNNs) has progressed rapidly. Existing attacks require either internal access (to the architecture, parameters, or training set of the victim model) or external access (to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Qizhang Li , Yiwen Guo , Hao Chen

Unlike the white-box counterparts that are widely studied and readily accessible, adversarial examples in black-box settings are generally more Herculean on account of the difficulty of estimating gradients. Many methods achieve the task by…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Ziang Yan , Yiwen Guo , Changshui Zhang

Deep neural network classifiers suffer from adversarial vulnerability: well-crafted, unnoticeable changes to the input data can affect the classifier decision. In this regard, the study of powerful adversarial attacks can help shed light on…

Machine Learning · Computer Science 2020-07-07 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Black-Box attacks on machine learning models occur when an attacker, despite having no access to the inner workings of a model, can successfully craft an attack by means of model theft. The attacker will train an own substitute model that…

Machine Learning · Computer Science 2017-11-16 Yannic Kilcher , Thomas Hofmann