English
Related papers

Related papers: Fundamental Tradeoffs between Invariance and Sensi…

200 papers

Fundamental questions remain about when and why adversarial examples arise in neural networks, with competing views characterising them either as artifacts of the irregularities in the decision landscape or as products of sensitivity to…

Machine Learning · Computer Science 2025-10-14 Edward Stevinson , Lucas Prieto , Melih Barsbey , Tolga Birdal

Several existing works study either adversarial or natural distributional robustness of deep neural networks separately. In practice, however, models need to enjoy both types of robustness to ensure reliability. In this work, we bridge this…

Machine Learning · Computer Science 2022-09-19 Mazda Moayeri , Kiarash Banihashem , Soheil Feizi

Adversarial perturbations are imperceptible changes to input pixels that can change the prediction of deep learning models. Learned weights of models robust to such perturbations are previously found to be transferable across different…

Machine Learning · Computer Science 2020-10-30 Alvin Chan , Yi Tay , Yew-Soon Ong

Adversarial robustness evaluates the worst-case performance scenario of a machine learning model to ensure its safety and reliability. This study is the first to investigate the robustness of visually grounded dialog models towards textual…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Lu Yu , Verena Rieser

Adversarial examples are inputs to a machine learning system intentionally crafted by an attacker to fool the model into producing an incorrect output. These examples have achieved a great deal of success in several domains such as image…

Cryptography and Security · Computer Science 2020-04-28 Elie Alhajjar , Paul Maxwell , Nathaniel D. Bastian

The burgeoning success of deep learning has raised the security and privacy concerns as more and more tasks are accompanied with sensitive data. Adversarial attacks in deep learning have emerged as one of the dominating security threat to a…

Machine Learning · Computer Science 2019-01-01 Wenqi Wei , Ling Liu , Margaret Loper , Stacey Truex , Lei Yu , Mehmet Emre Gursoy , Yanzhao Wu

Machine learning models have demonstrated vulnerability to adversarial attacks, more specifically misclassification of adversarial examples. In this paper, we propose a one-off and attack-agnostic Feature Manipulation (FM)-Defense to detect…

Machine Learning · Computer Science 2020-04-23 Shuo Wang , Tianle Chen , Surya Nepal , Carsten Rudolph , Marthie Grobler , Shangyu Chen

Current reading comprehension models generalise well to in-distribution test sets, yet perform poorly on adversarially selected inputs. Most prior work on adversarial inputs studies oversensitivity: semantically invariant text perturbations…

Computation and Language · Computer Science 2020-03-11 Johannes Welbl , Pasquale Minervini , Max Bartolo , Pontus Stenetorp , Sebastian Riedel

Motivated by safety-critical classification problems, we investigate adversarial attacks against cost-sensitive classifiers. We use current state-of-the-art adversarially-resistant neural network classifiers [1] as the underlying models.…

Machine Learning · Statistics 2019-10-08 Gavin S. Hartnett , Andrew J. Lohn , Alexander P. Sedlack

As machine learning systems become more widely used, especially for safety critical applications, there is a growing need to ensure that these systems behave as intended, even in the face of adversarial examples. Adversarial examples are…

Computation and Language · Computer Science 2024-08-19 Anahita Samadi , Allison Sullivan

Deep Neural Networks (DNNs) have shown remarkable performance in a diverse range of machine learning applications. However, it is widely known that DNNs are vulnerable to simple adversarial perturbations, which causes the model to…

Machine Learning · Computer Science 2021-07-23 Gihyuk Ko , Gyumin Lim

Although deep learning has shown great success in recent years, researchers have discovered a critical flaw where small, imperceptible changes in the input to the system can drastically change the output classification. These attacks are…

Machine Learning · Computer Science 2018-11-21 Jacob M. Springer , Charles S. Strauss , Austin M. Thresher , Edward Kim , Garrett T. Kenyon

While $\mathcal{H}_\infty$ methods can introduce robustness against worst-case perturbations, their nominal performance under conventional stochastic disturbances is often drastically reduced. Though this fundamental tradeoff between…

Systems and Control · Electrical Eng. & Systems 2023-05-29 Bruce D. Lee , Thomas T. C. K. Zhang , Hamed Hassani , Nikolai Matni

Adversarial examples are malicious inputs designed to fool machine learning models. They often transfer from one model to another, allowing attackers to mount black box attacks without knowledge of the target model's parameters. Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Alexey Kurakin , Ian Goodfellow , Samy Bengio

Adversarial machine learning, i.e., increasing the robustness of machine learning algorithms against so-called adversarial examples, is now an established field. Yet, newly proposed methods are evaluated and compared under unrealistic…

Machine Learning · Computer Science 2021-09-28 Maximilian Samsinger , Florian Merkle , Pascal Schöttle , Tomas Pevny

Despite the great progress of neural network-based (NN-based) machinery fault diagnosis methods, their robustness has been largely neglected, for they can be easily fooled through adding imperceptible perturbation to the input. For fault…

Cryptography and Security · Computer Science 2022-03-11 Jiahao Chen , Diqun Yan

Adversarial examples are inputs intentionally perturbed with the aim of forcing a machine learning model to produce a wrong prediction, while the changes are not easily detectable by a human. Although this topic has been intensively studied…

Machine Learning · Computer Science 2021-02-16 Jon Vadillo , Roberto Santana

The field of adversarial robustness has attracted significant attention in machine learning. Contrary to the common approach of training models that are accurate in average case, it aims at training models that are accurate for worst case…

Machine Learning · Computer Science 2020-10-12 Oriol Barbany Mayor

Classifiers such as deep neural networks have been shown to be vulnerable against adversarial perturbations on problems with high-dimensional input space. While adversarial training improves the robustness of image classifiers against such…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Chaithanya Kumar Mummadi , Thomas Brox , Jan Hendrik Metzen

Neural networks have demonstrated state-of-the-art performance in various machine learning fields. However, the introduction of malicious perturbations in input data, known as adversarial examples, has been shown to deceive neural network…

Machine Learning · Computer Science 2023-02-06 Dennis Y. Menn , Tzu-hsun Feng , Hung-yi Lee