English
Related papers

Related papers: A Note on Implementation Errors in Recent Adaptive…

200 papers

Ensemble defenses, are widely employed in various security-related applications to enhance model performance and robustness. The widespread adoption of these techniques also raises many questions: Are general ensembles defenses guaranteed…

Cryptography and Security · Computer Science 2024-01-23 Hangsheng Zhang , Jiqiang Liu , Jinsong Dong

Despite the significant advances in deep learning over the past decade, a major challenge that limits the wide-spread adoption of deep learning has been their fragility to adversarial attacks. This sensitivity to making erroneous…

Machine Learning · Computer Science 2021-06-21 Hossein Aboutalebi , Mohammad Javad Shafiee , Michelle Karg , Christian Scharfenberger , Alexander Wong

Evaluating adversarial robustness amounts to finding the minimum perturbation needed to have an input sample misclassified. The inherent complexity of the underlying optimization requires current gradient-based attacks to be carefully…

Machine Learning · Computer Science 2021-11-22 Maura Pintor , Fabio Roli , Wieland Brendel , Battista Biggio

Neural networks are prone to misclassify slightly modified input images. Recently, many defences have been proposed, but none have improved the robustness of neural networks consistently. Here, we propose to use adversarial attacks as a…

Neural and Evolutionary Computing · Computer Science 2021-06-11 Shashank Kotyan , Danilo Vasconcellos Vargas

Recent works have shown that the input domain of any machine learning classifier is bound to contain adversarial examples. Thus we can no longer hope to immune classifiers against adversarial examples and instead can only aim to achieve the…

Machine Learning · Computer Science 2020-09-25 Gil Fidel , Ron Bitton , Ziv Katzir , Asaf Shabtai

It is well known that adversarial attacks can fool deep neural networks with imperceptible perturbations. Although adversarial training significantly improves model robustness, failure cases of defense still broadly exist. In this work, we…

Machine Learning · Computer Science 2021-06-10 Boxi Wu , Heng Pan , Li Shen , Jindong Gu , Shuai Zhao , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu

With the increasing adoption of Large Language Models (LLMs), more customization is needed to ensure privacy-preserving and safe generation. We address this objective from two critical aspects: unlearning of sensitive information and…

Machine Learning · Computer Science 2025-10-17 Fatmazohra Rezkellah , Ramzi Dakhmouche

Convolutional neural networks are currently the state-of-the-art algorithms for many remote sensing applications such as semantic segmentation or object detection. However, these algorithms are extremely sensitive to over-fitting, domain…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Adrien Chan-Hon-Tong , Gaston Lenczner , Aurelien Plyer

A necessary characteristic for the deployment of deep learning models in real world applications is resistance to small adversarial perturbations while maintaining accuracy on non-malicious inputs. While robust training provides models that…

Machine Learning · Statistics 2020-02-27 Aditya Saligrama , Guillaume Leclerc

Hundreds of defenses have been proposed to make deep neural networks robust against minimal (adversarial) input perturbations. However, only a handful of these defenses held up their claims because correctly evaluating robustness is…

Machine Learning · Computer Science 2022-06-29 Roland S. Zimmermann , Wieland Brendel , Florian Tramer , Nicholas Carlini

Adversarial Training (AT) has been demonstrated as one of the most effective methods against adversarial examples. While most existing works focus on AT with a single type of perturbation e.g., the $\ell_\infty$ attacks), DNNs are facing…

Machine Learning · Computer Science 2022-10-04 Jiancong Xiao , Zeyu Qin , Yanbo Fan , Baoyuan Wu , Jue Wang , Zhi-Quan Luo

Defenses against adversarial examples, such as adversarial training, are typically tailored to a single perturbation type (e.g., small $\ell_\infty$-noise). For other perturbations, these defenses offer no guarantees and, at times, even…

Machine Learning · Computer Science 2019-10-21 Florian Tramèr , Dan Boneh

As a new programming paradigm, deep learning has expanded its application to many real-world problems. At the same time, deep learning based software are found to be vulnerable to adversarial attacks. Though various defense mechanisms have…

Cryptography and Security · Computer Science 2021-03-16 Zhe Zhao , Guangke Chen , Jingyi Wang , Yiwei Yang , Fu Song , Jun Sun

We study the achievable performance of adaptive query procedures for the noisy 20 questions problem with measurement-dependent noise over a unit cube of finite dimension. The performance criterion that we consider is the minimal resolution,…

Information Theory · Computer Science 2021-05-04 Lin Zhou , Alfred Hero

Recent research shows the susceptibility of machine learning models to adversarial attacks, wherein minor but maliciously chosen perturbations of the input can significantly degrade model performance. In this paper, we theoretically analyse…

Statistics Theory · Mathematics 2025-05-14 Jingfu Peng , Yuhong Yang

Robustness to adversarial attacks is typically evaluated with adversarial accuracy. While essential, this metric does not capture all aspects of robustness and in particular leaves out the question of how many perturbations can be found for…

Machine Learning · Computer Science 2023-08-14 Raphael Olivier , Bhiksha Raj

Deep neural networks have been known to be vulnerable to adversarial examples, which are inputs that are modified slightly to fool the network into making incorrect predictions. This has led to a significant amount of research on evaluating…

Machine Learning · Computer Science 2024-12-10 Alireza Abdollahpoorrostam , Mahed Abroshan , Seyed-Mohsen Moosavi-Dezfooli

Adaptive defenses, which optimize at test time, promise to improve adversarial robustness. We categorize such adaptive test-time defenses, explain their potential benefits and drawbacks, and evaluate a representative variety of the latest…

Machine Learning · Computer Science 2022-07-14 Francesco Croce , Sven Gowal , Thomas Brunner , Evan Shelhamer , Matthias Hein , Taylan Cemgil

Recent work has extensively shown that randomized perturbations of neural networks can improve robustness to adversarial attacks. The literature is, however, lacking a detailed compare-and-contrast of the latest proposals to understand what…

Machine Learning · Computer Science 2020-06-09 Adam Dziedzic , Sanjay Krishnan

Machine-learning architectures, such as Convolutional Neural Networks (CNNs) are vulnerable to adversarial attacks: inputs crafted carefully to force the system output to a wrong label. Since machine-learning is being deployed in…

Cryptography and Security · Computer Science 2022-11-03 Amira Guesmi , Ihsen Alouani , Khaled N. Khasawneh , Mouna Baklouti , Tarek Frikha , Mohamed Abid , Nael Abu-Ghazaleh