English
Related papers

Related papers: Improving DNN Robustness to Adversarial Attacks us…

200 papers

Neural networks are known to be vulnerable to adversarial attacks -- slight but carefully constructed perturbations of the inputs which can drastically impair the network's performance. Many defense methods have been proposed for improving…

Recent studies on the adversarial vulnerability of neural networks have shown that models trained with the objective of minimizing an upper bound on the worst-case loss over all possible adversarial perturbations improve robustness against…

Machine Learning · Computer Science 2019-10-22 Anindya Sarkar , Nikhil Kumar Gupta , Raghu Iyengar

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

In this work we study input gradient regularization of deep neural networks, and demonstrate that such regularization leads to generalization proofs and improved adversarial robustness. The proof of generalization does not overcome the…

Machine Learning · Computer Science 2019-09-13 Chris Finlay , Jeff Calder , Bilal Abbasi , Adam Oberman

Deep neural networks have proven remarkably effective at solving many classification problems, but have been criticized recently for two major weaknesses: the reasons behind their predictions are uninterpretable, and the predictions…

Machine Learning · Computer Science 2017-11-28 Andrew Slavin Ross , Finale Doshi-Velez

Despite the growing prevalence of artificial neural networks in real-world applications, their vulnerability to adversarial attacks remains a significant concern, which motivates us to investigate the robustness of machine learning models.…

Machine Learning · Computer Science 2024-08-23 Jie Wang , Rui Gao , Yao Xie

We study the use of feedforward neural networks (FNN) to develop models of nonlinear dynamical systems from data. Emphasis is placed on predictions at long times, with limited data availability. Inspired by global stability analysis, and…

Machine Learning · Statistics 2020-06-16 Shaowu Pan , Karthik Duraisamy

Deep neural networks are easily fooled by small perturbations known as adversarial attacks. Adversarial Training (AT) is a technique aimed at learning features robust to such attacks and is widely regarded as a very effective defense.…

Machine Learning · Computer Science 2020-09-11 Theodoros Tsiligkaridis , Jay Roberts

Deep neural networks (DNNs) are known to be vulnerable to adversarial attacks. A range of defense methods have been proposed to train adversarially robust DNNs, among which adversarial training has demonstrated promising results. However,…

Machine Learning · Computer Science 2022-01-25 Hanxun Huang , Yisen Wang , Sarah Monazam Erfani , Quanquan Gu , James Bailey , Xingjun Ma

In practice it is often found that large over-parameterized neural networks generalize better than their smaller counterparts, an observation that appears to conflict with classical notions of function complexity, which typically favor…

Machine Learning · Statistics 2018-06-20 Roman Novak , Yasaman Bahri , Daniel A. Abolafia , Jeffrey Pennington , Jascha Sohl-Dickstein

Regularizing the input gradient has shown to be effective in promoting the robustness of neural networks. The regularization of the input's Hessian is therefore a natural next step. A key challenge here is the computational complexity.…

Machine Learning · Computer Science 2020-09-15 Waleed Mustafa , Robert A. Vandermeulen , Marius Kloft

Neural networks have been widely applied in security applications such as spam and phishing detection, intrusion prevention, and malware detection. This black-box method, however, often has uncertainty and poor explainability in…

Cryptography and Security · Computer Science 2022-10-12 Mark Huasong Meng , Guangdong Bai , Sin Gee Teo , Zhe Hou , Yan Xiao , Yun Lin , Jin Song Dong

Adversarial robustness corresponds to the susceptibility of deep neural networks to imperceptible perturbations made at test time. In the context of image tasks, many algorithms have been proposed to make neural networks robust to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Pranjal Awasthi , George Yu , Chun-Sung Ferng , Andrew Tomkins , Da-Cheng Juan

Deep neural network (DNN) architecture based models have high expressive power and learning capacity. However, they are essentially a black box method since it is not easy to mathematically formulate the functions that are learned within…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Gaurav Goswami , Nalini Ratha , Akshay Agarwal , Richa Singh , Mayank Vatsa

Deep Neural Networks are built to generalize outside of training set in mind by using techniques such as regularization, early stopping and dropout. But considerations to make them more resilient to adversarial examples are rarely taken. As…

Machine Learning · Computer Science 2017-12-27 Arkar Min Aung , Yousef Fadila , Radian Gondokaryono , Luis Gonzalez

This tutorial aims to introduce the fundamentals of adversarial robustness of deep learning, presenting a well-structured review of up-to-date techniques to assess the vulnerability of various types of deep learning models to adversarial…

Machine Learning · Computer Science 2021-08-25 Wenjie Ruan , Xinping Yi , Xiaowei Huang

As humans, we inherently perceive images based on their predominant features, and ignore noise embedded within lower bit planes. On the contrary, Deep Neural Networks are known to confidently misclassify images corrupted with meticulously…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Sravanti Addepalli , Vivek B. S. , Arya Baburaj , Gaurang Sriramanan , R. Venkatesh Babu

In the past five years, deep learning methods have become state-of-the-art in solving various inverse problems. Before such approaches can find application in safety-critical fields, a verification of their reliability appears mandatory.…

Machine Learning · Computer Science 2023-01-18 Martin Genzel , Jan Macdonald , Maximilian März

Deep Neural Networks (DNNs) are vulnerable to invisible perturbations on the images generated by adversarial attacks, which raises researches on the adversarial robustness of DNNs. A series of methods represented by the adversarial training…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Kun Fang , Qinghua Tao , Yingwen Wu , Tao Li , Jia Cai , Feipeng Cai , Xiaolin Huang , Jie Yang

Regularizing the gradient norm of the output of a neural network with respect to its inputs is a powerful technique, rediscovered several times. This paper presents evidence that gradient regularization can consistently improve…

Machine Learning · Computer Science 2018-05-28 Dániel Varga , Adrián Csiszárik , Zsolt Zombori