English
Related papers

Related papers: Understanding Adversarial Training: Increasing Loc…

200 papers

Adversarial training is a common approach to improving the robustness of deep neural networks against adversarial examples. In this work, we propose a novel regularization approach as an alternative. To derive the regularizer, we formulate…

Machine Learning · Computer Science 2021-02-09 Avery Ma , Fartash Faghri , Nicolas Papernot , Amir-massoud Farahmand

State-of-the-art classifiers have been shown to be largely vulnerable to adversarial perturbations. One of the most effective strategies to improve robustness is adversarial training. In this paper, we investigate the effect of adversarial…

Machine Learning · Computer Science 2018-11-27 Seyed-Mohsen Moosavi-Dezfooli , Alhussein Fawzi , Jonathan Uesato , Pascal Frossard

Many state-of-the-art adversarial training methods for deep learning leverage upper bounds of the adversarial loss to provide security guarantees against adversarial attacks. Yet, these methods rely on convex relaxations to propagate lower…

Machine Learning · Computer Science 2023-04-07 Dimitris Bertsimas , Xavier Boix , Kimberly Villalobos Carballo , Dick den Hertog

Deep Neural Networks (DNN) have been shown to be vulnerable to adversarial examples. Adversarial training (AT) is a popular and effective strategy to defend against adversarial attacks. Recent works (Benz et al., 2020; Xu et al., 2021; Tian…

Machine Learning · Computer Science 2023-02-09 Boqi Li , Weiwei Liu

Adversarial training (AT) has proven to be one of the most effective ways to defend Deep Neural Networks (DNNs) against adversarial attacks. However, the phenomenon of robust overfitting, i.e., the robustness will drop sharply at a certain…

Machine Learning · Computer Science 2022-05-25 Shudong Zhang , Haichang Gao , Tianwei Zhang , Yunyi Zhou , Zihui Wu

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

Machine Learning · Computer Science 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Deep neural networks are easily fooled by small perturbations known as adversarial attacks. Adversarial Training (AT) is a technique aimed at learning features robust to such attacks and is widely regarded as a very effective defense.…

Machine Learning · Computer Science 2020-09-11 Theodoros Tsiligkaridis , Jay Roberts

Training modern neural networks is increasingly fragile, with rare but severe destabilizing updates often causing irreversible divergence or silent performance degradation. Existing optimization methods primarily rely on preventive…

Machine Learning · Computer Science 2026-01-27 Barak Or

Network Embedding is the task of learning continuous node representations for networks, which has been shown effective in a variety of tasks such as link prediction and node classification. Most of existing works aim to preserve different…

Machine Learning · Computer Science 2019-09-02 Quanyu Dai , Xiao Shen , Liang Zhang , Qiang Li , Dan Wang

Adversarial Training (AT) has been demonstrated to improve the robustness of deep neural networks (DNNs) against adversarial attacks. AT is a min-max optimization procedure where in adversarial examples are generated to train a more robust…

Machine Learning · Computer Science 2024-12-31 Olukorede Fakorede , Modeste Atsague , Jin Tian

Adversarial Training is the most effective approach for improving the robustness of Deep Neural Networks (DNNs). However, compared to the large body of research in optimizing the adversarial training process, there are few investigations…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 ShengYun Peng , Weilin Xu , Cory Cornelius , Kevin Li , Rahul Duggal , Duen Horng Chau , Jason Martin

Neural networks are getting better accuracy with higher energy and computational cost. After quantization, the cost can be greatly saved, and the quantized models are more hardware friendly with acceptable accuracy loss. On the other hand,…

Machine Learning · Computer Science 2021-10-26 Chang Song , Riya Ranjan , Hai Li

We propose two training techniques for improving the robustness of Neural Networks to adversarial attacks, i.e. manipulations of the inputs that are maliciously crafted to fool networks into incorrect predictions. Both methods are…

Machine Learning · Computer Science 2021-04-28 Ginevra Carbone , Guido Sanguinetti , Luca Bortolussi

Although Deep Neural Networks (DNNs) achieve excellent performance on many real-world tasks, they are highly vulnerable to adversarial attacks. A leading defense against such attacks is adversarial training, a technique in which a DNN is…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Gilad Cohen , Raja Giryes

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

The vulnerability of deep neural networks (DNNs) to adversarial examples has attracted great attention in the machine learning community. The problem is related to non-flatness and non-smoothness of normally obtained loss landscapes.…

Machine Learning · Computer Science 2023-02-13 Qizhang Li , Yiwen Guo , Wangmeng Zuo , Hao Chen

While adversarial training methods have significantly improved the robustness of deep neural networks against norm-bounded adversarial perturbations, the generalization gap between their performance on training and test data is considerably…

Machine Learning · Computer Science 2025-01-08 Xiwei Cheng , Kexin Fu , Farzan Farnia

We study the model robustness against adversarial examples, referred to as small perturbed input data that may however fool many state-of-the-art deep learning models. Unlike previous research, we establish a novel theory addressing the…

Machine Learning · Computer Science 2020-06-11 Shufei Zhang , Kaizhu Huang , Zenglin Xu

The existence of adversarial data examples has drawn significant attention in the deep-learning community; such data are seemingly minimally perturbed relative to the original data, but lead to very different outputs from a deep-learning…

Machine Learning · Computer Science 2019-11-12 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

Adversarial training can considerably robustify deep neural networks to resist adversarial attacks. However, some works suggested that adversarial training might comprise the privacy-preserving and generalization abilities. This paper…

Machine Learning · Computer Science 2020-12-29 Fengxiang He , Shaopeng Fu , Bohan Wang , Dacheng Tao