English
Related papers

Related papers: What Do Adversarially Robust Models Look At?

200 papers

Performance-critical machine learning models should be robust to input perturbations not seen during training. Adversarial training is a method for improving a model's robustness to some perturbations by including them in the training…

Machine Learning · Computer Science 2018-07-24 Angus Galloway , Thomas Tanay , Graham W. Taylor

The escalating threat of adversarial attacks on deep learning models, particularly in security-critical fields, has underscored the need for robust deep learning systems. Conventional robustness evaluations have relied on adversarial…

Cryptography and Security · Computer Science 2024-11-19 Ping Guo , Cheng Gong , Xi Lin , Zhiyuan Yang , Qingfu Zhang

Neural Networks have been shown to be sensitive to common perturbations such as blur, Gaussian noise, rotations, etc. They are also vulnerable to some artificial malicious corruptions called adversarial examples. The adversarial examples…

Machine Learning · Computer Science 2019-10-10 Alfred Laugros , Alice Caplier , Matthieu Ospici

Existing works have shown that fine-tuned textual transformer models achieve state-of-the-art prediction performances but are also vulnerable to adversarial text perturbations. Traditional adversarial evaluation is often done \textit{only…

Machine Learning · Computer Science 2024-07-03 Cuong Dang , Dung D. Le , Thai Le

Multiple intriguing problems are hovering in adversarial training, including robust overfitting, robustness overestimation, and robustness-accuracy trade-off. These problems pose great challenges to both reliable evaluation and practical…

Machine Learning · Computer Science 2021-10-08 Chengyu Dong , Liyuan Liu , Jingbo Shang

Adversarial training is a powerful type of defense against adversarial examples. Previous empirical results suggest that adversarial training requires wider networks for better performances. However, it remains elusive how neural network…

Machine Learning · Computer Science 2021-08-17 Boxi Wu , Jinghui Chen , Deng Cai , Xiaofei He , Quanquan Gu

Machine learning and deep learning in particular has been recently used to successfully address many tasks in the domain of code such as finding and fixing bugs, code completion, decompilation, type inference and many others. However, the…

Machine Learning · Computer Science 2020-08-18 Pavol Bielik , Martin Vechev

While it has long been empirically observed that adversarial robustness may be at odds with standard accuracy and may have further disparate impacts on different classes, it remains an open question to what extent such observations hold and…

Machine Learning · Computer Science 2023-05-30 Yuzheng Hu , Fan Wu , Hongyang Zhang , Han Zhao

Increasing the model capacity is a known approach to enhance the adversarial robustness of deep learning networks. On the other hand, various model compression techniques, including pruning and quantization, can reduce the size of the…

Machine Learning · Computer Science 2023-11-28 Svetlana Pavlitska , Hannes Grolig , J. Marius Zöllner

Like many other tasks involving neural networks, Speech Recognition models are vulnerable to adversarial attacks. However recent research has pointed out differences between attacks and defenses on ASR models compared to image models.…

Cryptography and Security · Computer Science 2022-04-06 Raphael Olivier , Bhiksha Raj

Deep neural networks are at the forefront of machine learning research. However, despite achieving impressive performance on complex tasks, they can be very sensitive: Small perturbations of inputs can be sufficient to induce incorrect…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Alex Serban , Erik Poll , Joost Visser

Adversarial training has been successfully applied to build robust models at a certain cost. While the robustness of a model increases, the standard classification accuracy declines. This phenomenon is suggested to be an inherent trade-off.…

Machine Learning · Computer Science 2019-08-14 Chihuang Liu , Joseph JaJa

Adversarial robust models have been shown to learn more robust and interpretable features than standard trained models. As shown in [\cite{tsipras2018robustness}], such robust models inherit useful interpretable properties where the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Gunjan Aggarwal , Abhishek Sinha , Nupur Kumari , Mayank Singh

Pretrained models from self-supervision are prevalently used in fine-tuning downstream tasks faster or for better accuracy. However, gaining robustness from pretraining is left unexplored. We introduce adversarial training into…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Tianlong Chen , Sijia Liu , Shiyu Chang , Yu Cheng , Lisa Amini , Zhangyang Wang

Adversarial training has been shown to be reliable in improving robustness against adversarial samples. However, the problem of adversarial training in terms of fairness has not yet been properly studied, and the relationship between…

Machine Learning · Computer Science 2023-04-04 Junyi Chai , Xiaoqian Wang

Adversarial examples are a pervasive phenomenon of machine learning models where seemingly imperceptible perturbations to the input lead to misclassifications for otherwise statistically accurate models. In this paper we study how the…

Machine Learning · Computer Science 2020-02-11 Marc Khoury

Deep neural networks (DNNs) are known to have a fundamental sensitivity to adversarial attacks, perturbations of the input that are imperceptible to humans yet powerful enough to change the visual decision of a model. Adversarial attacks…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Drew Linsley , Pinyuan Feng , Thibaut Boissin , Alekh Karkada Ashok , Thomas Fel , Stephanie Olaiya , Thomas Serre

Achieving robustness against adversarial input perturbation is an important and intriguing problem in machine learning. In the area of semantic image segmentation, a number of adversarial training approaches have been proposed as a defense…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Levente Halmosi , Mark Jelasity

The trade-off between robustness and accuracy has been widely studied in the adversarial literature. Although still controversial, the prevailing view is that this trade-off is inherent, either empirically or theoretically. Thus, we dig for…

Machine Learning · Computer Science 2022-06-17 Tianyu Pang , Min Lin , Xiao Yang , Jun Zhu , Shuicheng Yan

Adversarial examples mainly exploit changes to input pixels to which humans are not sensitive to, and arise from the fact that models make decisions based on uninterpretable features. Interestingly, cognitive science reports that the…