English
Related papers

Related papers: Adversarial Weight Perturbation Helps Robust Gener…

200 papers

Adversarial training (AT) is currently one of the most effective ways to obtain the robustness of deep neural networks against adversarial attacks. However, most AT methods suffer from robust overfitting, i.e., a significant generalization…

Machine Learning · Computer Science 2024-03-15 Daiwei Yu , Zhuorong Li , Lina Wei , Canghong Jin , Yun Zhang , Sixian Chan

It has been demonstrated that deep neural networks are prone to noisy examples particular adversarial samples during inference process. The gap between robust deep learning systems in real world applications and vulnerable neural networks…

Machine Learning · Computer Science 2018-07-03 Xinhan Di , Pengqian Yu , Meng Tian

The pursuit of explaining and improving generalization in deep learning has elicited efforts both in regularization techniques as well as visualization techniques of the loss surface geometry. The latter is related to the intuition…

Machine Learning · Computer Science 2019-07-23 Vinay Uday Prabhu , Dian Ang Yap , Joyce Xu , John Whaley

Implicit Neural Representations (INRs) have been recently garnering increasing interest in various research fields, mainly due to their ability to represent large, complex data in a compact, continuous manner. Past work further showed that…

Machine Learning · Computer Science 2026-03-04 Tamir Shor , Ethan Fetaya , Chaim Baskin , Alex Bronstein

While deep neural networks have been achieving state-of-the-art performance across a wide variety of applications, their vulnerability to adversarial attacks limits their widespread deployment for safety-critical applications. Alongside…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Ahmadreza Jeddi , Mohammad Javad Shafiee , Michelle Karg , Christian Scharfenberger , Alexander Wong

Adversarial attacks and robustness in Deep Reinforcement Learning (DRL) have been widely studied in various threat models; however, few consider environmental state perturbations, which are natural in embodied scenarios. To improve the…

Machine Learning · Computer Science 2025-06-11 Chenxu Wang , Huaping Liu

Neural networks are vulnerable to adversarial attacks -- small visually imperceptible crafted noise which when added to the input drastically changes the output. The most effective method of defending against these adversarial attacks is to…

Adversarial training is one of the main defenses against adversarial attacks. In this paper, we provide the first rigorous study on diagnosing elements of adversarial training, which reveals two intriguing properties. First, we study the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Cihang Xie , Alan Yuille

Recently, Neural networks have seen a huge surge in its adoption due to their ability to provide high accuracy on various tasks. On the other hand, the existence of adversarial examples have raised suspicions regarding the generalization…

Machine Learning · Computer Science 2018-01-04 Mayank Singh , Abhishek Sinha , Balaji Krishnamurthy

Assigning importance weights to adversarial data has achieved great success in training adversarially robust networks under limited model capacity. However, existing instance-reweighted adversarial training (AT) methods heavily depend on…

Machine Learning · Computer Science 2023-08-02 Daouda Sow , Sen Lin , Zhangyang Wang , Yingbin Liang

Adversarial robustness has become a central goal in deep learning, both in the theory and the practice. However, successful methods to improve the adversarial robustness (such as adversarial training) greatly hurt generalization performance…

Machine Learning · Statistics 2022-10-20 Alex Lamb , Vikas Verma , Kenji Kawaguchi , Alexander Matyasko , Savya Khosla , Juho Kannala , Yoshua Bengio

The problem of adversarial examples has shown that modern Neural Network (NN) models could be rather fragile. Among the more established techniques to solve the problem, one is to require the model to be {\it $\epsilon$-adversarially…

Machine Learning · Computer Science 2020-11-17 Yuxin Wen , Shuai Li , Kui Jia

Despite the remarkable success of deep neural networks, significant concerns have emerged about their robustness to adversarial perturbations to inputs. While most attacks aim to ensure that these are imperceptible, physical perturbation…

Machine Learning · Computer Science 2020-10-09 Liang Tong , Minzhe Guo , Atul Prakash , Yevgeniy Vorobeychik

While deep learning has resulted in major breakthroughs in many application domains, the frameworks commonly used in deep learning remain fragile to artificially-crafted and imperceptible changes in the data. In response to this fragility,…

Machine Learning · Computer Science 2020-11-03 Alexander Robey , Hamed Hassani , George J. Pappas

Adversarial training deep neural networks often experience serious overfitting problem. Recently, it is explained that the overfitting happens because the sample complexity of training data is insufficient to generalize robustness. In…

Machine Learning · Computer Science 2020-09-23 Joong-Won Hwang , Youngwan Lee , Sungchan Oh , Yuseok Bae

Despite the empirical success of using Adversarial Training to defend deep learning models against adversarial perturbations, so far, it still remains rather unclear what the principles are behind the existence of adversarial perturbations,…

Machine Learning · Computer Science 2022-06-14 Zeyuan Allen-Zhu , Yuanzhi Li

Despite their empirical success, neural networks remain vulnerable to small, adversarial perturbations. A longstanding hypothesis suggests that flat minima, regions of low curvature in the loss landscape, offer increased robustness. While…

Machine Learning · Computer Science 2025-10-17 Nils Philipp Walter , Linara Adilova , Jilles Vreeken , Michael Kamp

Despite its popularity, deep neural networks are easily fooled. To alleviate this deficiency, researchers are actively developing new training strategies, which encourage models that are robust to small input perturbations. Several…

Machine Learning · Computer Science 2021-10-28 Jingyue Lu , M. Pawan Kumar

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

Machine Learning · Computer Science 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

Adversarial training for neural networks has been in the limelight in recent years. The advancement in neural network architectures over the last decade has led to significant improvement in their performance. It sparked an interest in…

Machine Learning · Computer Science 2022-06-07 Abhijith Sharma , Apurva Narayan