English
Related papers

Related papers: Boundary on the Table: Efficient Black-Box Decisio…

200 papers

Traditional white-box methods for creating adversarial perturbations against LLMs typically rely only on gradient computation from the targeted model, ignoring the internal mechanisms responsible for attack success or failure. Conversely,…

Machine Learning · Computer Science 2025-05-07 Thomas Winninger , Boussad Addad , Katarzyna Kapusta

We propose the Square Attack, a score-based black-box $l_2$- and $l_\infty$-adversarial attack that does not rely on local gradient information and thus is not affected by gradient masking. Square Attack is based on a randomized search…

Machine Learning · Computer Science 2020-07-30 Maksym Andriushchenko , Francesco Croce , Nicolas Flammarion , Matthias Hein

Control policies, trained using the Deep Reinforcement Learning, have been recently shown to be vulnerable to adversarial attacks introducing even very small perturbations to the policy input. The attacks proposed so far have been designed…

Machine Learning · Computer Science 2019-08-02 Alessio Russo , Alexandre Proutiere

In generating adversarial examples, the conventional black-box attack methods rely on sufficient feedback from the to-be-attacked models by repeatedly querying until the attack is successful, which usually results in thousands of trials…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Renyang Liu , Wei Zhou , Xin Jin , Song Gao , Yuanyu Wang , Ruxin Wang

Adversarial examples are important for understanding the behavior of neural models, and can improve their robustness through adversarial training. Recent work in natural language processing generated adversarial examples by assuming…

Machine Learning · Computer Science 2019-04-05 Yotam Gil , Yoav Chai , Or Gorodissky , Jonathan Berant

A distribution inference attack aims to infer statistical properties of data used to train machine learning models. These attacks are sometimes surprisingly potent, but the factors that impact distribution inference risk are not well…

Machine Learning · Computer Science 2024-04-09 Anshuman Suri , Yifu Lu , Yanjin Chen , David Evans

We study the adversarial robustness of information bottleneck models for classification. Previous works showed that the robustness of models trained with information bottlenecks can improve upon adversarial training. Our evaluation under a…

Machine Learning · Computer Science 2021-07-14 Iryna Korshunova , David Stutz , Alexander A. Alemi , Olivia Wiles , Sven Gowal

In this study, we delve into the robustness of neural network-based LiDAR point cloud tracking models under adversarial attacks, a critical aspect often overlooked in favor of performance enhancement. These models, despite incorporating…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Shengjing Tian , Xiantong Zhao , Yuhao Bian , Yinan Han , Bin Liu

Neural networks have been proven to be vulnerable to a variety of adversarial attacks. From a safety perspective, highly sparse adversarial attacks are particularly dangerous. On the other hand the pixelwise perturbations of sparse attacks…

Machine Learning · Computer Science 2019-09-12 Francesco Croce , Matthias Hein

Although deep neural networks have been very successful in image-classification tasks, they are prone to adversarial attacks. To generate adversarial inputs, there has emerged a wide variety of techniques, such as black- and whitebox…

Machine Learning · Computer Science 2020-08-18 Fuyuan Zhang , Sankalan Pal Chowdhury , Maria Christakis

Adversarial samples are perturbed inputs crafted to mislead the machine learning systems. A training mechanism, called adversarial training, which presents adversarial samples along with clean samples has been introduced to learn robust…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Vivek B. S. , Konda Reddy Mopuri , R. Venkatesh Babu

Neural networks have become pervasive across various applications, including security-related products. However, their widespread adoption has heightened concerns regarding vulnerability to adversarial attacks. With emerging regulations and…

Cryptography and Security · Computer Science 2025-11-10 Disesdi Susanna Cox , Niklas Bunzel

Adversarial examples pose a threat to deep neural network models in a variety of scenarios, from settings where the adversary has complete knowledge of the model and to the opposite "black box" setting. Black box attacks are particularly…

Machine Learning · Computer Science 2019-05-27 Haidar Khan , Daniel Park , Azer Khan , Bülent Yener

In this paper, we study the problem of how to defend classifiers against adversarial attacks that fool the classifiers using subtly modified input data. In contrast to previous works, here we focus on the white-box adversarial defense where…

Machine Learning · Computer Science 2019-09-16 Zudi Lin , Hanspeter Pfister , Ziming Zhang

Decision-based evasion attacks repeatedly query a black-box classifier to generate adversarial examples. Prior work measures the cost of such attacks by the total number of queries made to the classifier. We argue this metric is flawed.…

Cryptography and Security · Computer Science 2024-02-15 Edoardo Debenedetti , Nicholas Carlini , Florian Tramèr

Designing deep networks robust to adversarial examples remains an open problem. Likewise, recent zeroth order hard-label attacks on image classification models have shown comparable performance to their first-order, gradient-level…

Machine Learning · Computer Science 2021-03-08 Washington Garcia , Pin-Yu Chen , Somesh Jha , Scott Clouse , Kevin R. B. Butler

Deep learning (DL) is becoming popular as a new tool for many applications in wireless communication systems. However, for many classification tasks (e.g., modulation classification) it has been shown that DL-based wireless systems are…

Information Theory · Computer Science 2021-01-29 B. R. Manoj , Meysam Sadeghi , Erik G. Larsson

Deep neural network classifiers suffer from adversarial vulnerability: well-crafted, unnoticeable changes to the input data can affect the classifier decision. In this regard, the study of powerful adversarial attacks can help shed light on…

Machine Learning · Computer Science 2020-07-07 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

We propose a novel genetic-algorithm technique that generates black-box adversarial examples which successfully fool neural network based text classifiers. We perform a genetic search with multi-objective optimization guided by deep…

Artificial Intelligence · Computer Science 2020-11-11 Alex Mathai , Shreya Khare , Srikanth Tamilselvam , Senthil Mani

Patch-based adversarial attacks introduce a perceptible but localized change to the input that induces misclassification. While progress has been made in defending against imperceptible attacks, it remains unclear how patch-based attacks…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Christian Cosgrove , Adam Kortylewski , Chenglin Yang , Alan Yuille