English
Related papers

Related papers: Indicators of Attack Failure: Debugging and Improv…

200 papers

Machine-learning models demand periodic updates to improve their average accuracy, exploiting novel architectures and additional data. However, a newly updated model may commit mistakes the previous model did not make. Such…

Machine Learning · Computer Science 2025-05-30 Daniele Angioni , Luca Demetrio , Maura Pintor , Luca Oneto , Davide Anguita , Battista Biggio , Fabio Roli

Machine learning and deep learning in particular has been recently used to successfully address many tasks in the domain of code such as finding and fixing bugs, code completion, decompilation, type inference and many others. However, the…

Machine Learning · Computer Science 2020-08-18 Pavol Bielik , Martin Vechev

Recent breakthroughs in defenses against adversarial examples, like adversarial training, make the neural networks robust against various classes of attackers (e.g., first-order gradient-based attacks). However, it is an open question…

Machine Learning · Computer Science 2019-06-07 Shiqi Wang , Yizheng Chen , Ahmed Abdou , Suman Jana

One popular group of defense techniques against adversarial attacks is based on injecting stochastic noise into the network. The main source of robustness of such stochastic defenses however is often due to the obfuscation of the gradients,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Nikola Popovic , Danda Pani Paudel , Thomas Probst , Luc Van Gool

Adversarial examples are inputs to machine learning models that an attacker has intentionally designed to confuse the model into making a mistake. Such examples pose a serious threat to the applicability of machine-learning-based systems,…

Machine Learning · Computer Science 2023-10-18 Peiyu Xiong , Michael Tegegn , Jaskeerat Singh Sarin , Shubhraneel Pal , Julia Rubin

Modern applications of artificial neural networks have yielded remarkable performance gains in a wide range of tasks. However, recent studies have discovered that such modelling strategy is vulnerable to Adversarial Examples, i.e. examples…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 João Monteiro , Isabela Albuquerque , Zahid Akhtar , Tiago H. Falk

The widespread adoption of smartphones dramatically increases the risk of attacks and the spread of mobile malware, especially on the Android platform. Machine learning-based solutions have been already used as a tool to supersede…

Cryptography and Security · Computer Science 2020-03-03 Rahim Taheri , Reza Javidan , Mohammad Shojafar , Vinod P , Mauro Conti

Adaptive attacks have (rightfully) become the de facto standard for evaluating defenses to adversarial examples. We find, however, that typical adaptive evaluations are incomplete. We demonstrate that thirteen defenses recently published at…

Machine Learning · Computer Science 2020-10-26 Florian Tramer , Nicholas Carlini , Wieland Brendel , Aleksander Madry

The landscape of adversarial attacks against text classifiers continues to grow, with new attacks developed every year and many of them available in standard toolkits, such as TextAttack and OpenAttack. In response, there is a growing body…

Computation and Language · Computer Science 2022-01-24 Zhouhang Xie , Jonathan Brophy , Adam Noack , Wencong You , Kalyani Asthana , Carter Perkins , Sabrina Reis , Sameer Singh , Daniel Lowd

Machine learning models are usually evaluated according to the average case performance on the test set. However, this is not always ideal, because in some sensitive domains (e.g. autonomous driving), it is the worst case performance that…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Michelle Shu , Chenxi Liu , Weichao Qiu , Alan Yuille

Recent research studies revealed that neural networks are vulnerable to adversarial attacks. State-of-the-art defensive techniques add various adversarial examples in training to improve models' adversarial robustness. However, these…

Machine Learning · Computer Science 2019-09-13 Chang Song , Zuoguan Wang , Hai Li

Owing to security implications of adversarial vulnerability, adversarial robustness of deep metric learning models has to be improved. In order to avoid model collapse due to excessively hard examples, the existing defenses dismiss the…

Machine Learning · Computer Science 2022-03-04 Mo Zhou , Vishal M. Patel

Adversarial robustness studies the worst-case performance of a machine learning model to ensure safety and reliability. With the proliferation of deep-learning-based technology, the potential risks associated with model development and…

Machine Learning · Computer Science 2023-01-06 Pin-Yu Chen , Sijia Liu

Robustness is critical for machine learning (ML) classifiers to ensure consistent performance in real-world applications where models may encounter corrupted or adversarial inputs. In particular, assessing the robustness of classifiers to…

Machine Learning · Computer Science 2024-09-06 Georg Siedel , Ekagra Gupta , Andrey Morozov

Neural networks are prone to misclassify slightly modified input images. Recently, many defences have been proposed, but none have improved the robustness of neural networks consistently. Here, we propose to use adversarial attacks as a…

Neural and Evolutionary Computing · Computer Science 2021-06-11 Shashank Kotyan , Danilo Vasconcellos Vargas

Deep neural networks (DNNs) have achieved remarkable performance across a wide range of applications, while they are vulnerable to adversarial examples, which motivates the evaluation and benchmark of model robustness. However, current…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Jun Guo , Wei Bao , Jiakai Wang , Yuqing Ma , Xinghai Gao , Gang Xiao , Aishan Liu , Jian Dong , Xianglong Liu , Wenjun Wu

Ideally, what confuses neural network should be confusing to humans. However, recent experiments have shown that small, imperceptible perturbations can change the network prediction. To address this gap in perception, we propose a novel…

Machine Learning · Computer Science 2018-10-31 Alexander Matyasko , Lap-Pui Chau

Reliable evaluation of adversarial defenses is a challenging task, currently limited to an expert who manually crafts attacks that exploit the defense's inner workings or approaches based on an ensemble of fixed attacks, none of which may…

Machine Learning · Computer Science 2021-10-28 Chengyuan Yao , Pavol Bielik , Petar Tsankov , Martin Vechev

Adversarial attacks and defenses are currently active areas of research for the deep learning community. A recent review paper divided the defense approaches into three categories; gradient masking, robust optimization, and adversarial…

Machine Learning · Computer Science 2019-10-24 Leslie N. Smith

Attribution methods have been developed to explain the decision of a machine learning model on a given input. We use the Integrated Gradient method for finding attributions to define the causal neighborhood of an input by incrementally…