English
Related papers

Related papers: Robust Weight Perturbation for Adversarial Trainin…

200 papers

Questions remain on the robustness of data-driven learning methods when crossing the gap from simulation to reality. We utilize weight anchoring, a method known from continual learning, to cultivate and fixate desired behavior in Neural…

Machine Learning · Computer Science 2023-04-21 Steffen Gracla , Edgar Beck , Carsten Bockelmann , Armin Dekorsy

Stochastic Neural Networks (SNNs) that inject noise into their hidden layers have recently been shown to achieve strong robustness against adversarial attacks. However, existing SNNs are usually heuristically motivated, and often rely on…

Machine Learning · Computer Science 2021-05-27 Panagiotis Eustratiadis , Henry Gouk , Da Li , Timothy Hospedales

The goal of this paper is to analyze an intriguing phenomenon recently discovered in deep networks, namely their instability to adversarial perturbations (Szegedy et. al., 2014). We provide a theoretical framework for analyzing the…

Machine Learning · Computer Science 2016-03-30 Alhussein Fawzi , Omar Fawzi , Pascal Frossard

Traditional classification algorithms assume that training and test data come from similar distributions. This assumption is violated in adversarial settings, where malicious actors modify instances to evade detection. A number of custom…

Computer Science and Game Theory · Computer Science 2016-11-29 Bo Li , Yevgeniy Vorobeychik , Xinyun Chen

Deep neural networks are easily fooled by small perturbations known as adversarial attacks. Adversarial Training (AT) is a technique that approximately solves a robust optimization problem to minimize the worst-case loss and is widely…

Machine Learning · Computer Science 2022-03-28 Theodoros Tsiligkaridis , Jay Roberts

Robustness to adversarial attacks is typically evaluated with adversarial accuracy. While essential, this metric does not capture all aspects of robustness and in particular leaves out the question of how many perturbations can be found for…

Machine Learning · Computer Science 2023-08-14 Raphael Olivier , Bhiksha Raj

Multiple intriguing problems are hovering in adversarial training, including robust overfitting, robustness overestimation, and robustness-accuracy trade-off. These problems pose great challenges to both reliable evaluation and practical…

Machine Learning · Computer Science 2021-10-08 Chengyu Dong , Liyuan Liu , Jingbo Shang

We propose a novel data-dependent structured gradient regularizer to increase the robustness of neural networks vis-a-vis adversarial perturbations. Our regularizer can be derived as a controlled approximation from first principles,…

Machine Learning · Statistics 2018-05-23 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

As deep learning (DL) models are increasingly being integrated into our everyday lives, ensuring their safety by making them robust against adversarial attacks has become increasingly critical. DL models have been found to be susceptible to…

Machine Learning · Computer Science 2026-05-29 Hallgrimur Thorsteinsson , Valdemar J Henriksen , Daniel I R Cruz , Raghavendra Selvan , Tong Chen

Studying the sensitivity of weight perturbation in neural networks and its impacts on model performance, including generalization and robustness, is an active research topic due to its implications on a wide range of machine learning tasks…

Machine Learning · Computer Science 2021-12-20 Yu-Lin Tsai , Chia-Yi Hsu , Chia-Mu Yu , Pin-Yu Chen

Network Embedding is the task of learning continuous node representations for networks, which has been shown effective in a variety of tasks such as link prediction and node classification. Most of existing works aim to preserve different…

Machine Learning · Computer Science 2019-09-02 Quanyu Dai , Xiao Shen , Liang Zhang , Qiang Li , Dan Wang

Neural networks are vulnerable to small adversarial perturbations. Existing literature largely focused on understanding and mitigating the vulnerability of learned models. In this paper, we demonstrate an intriguing phenomenon about the…

Machine Learning · Computer Science 2019-02-25 Gavin Weiguang Ding , Kry Yik Chau Lui , Xiaomeng Jin , Luyu Wang , Ruitong Huang

Deep learning models can be fooled by small $l_p$-norm adversarial perturbations and natural perturbations in terms of attributes. Although the robustness against each perturbation has been explored, it remains a challenge to address the…

Machine Learning · Computer Science 2023-04-11 Dashan Gao , Yunce Zhao , Yinghua Yao , Zeqi Zhang , Bifei Mao , Xin Yao

Deep neural network image classifiers are reported to be susceptible to adversarial evasion attacks, which use carefully crafted images created to mislead a classifier. Recently, various kinds of adversarial attack methods have been…

Machine Learning · Computer Science 2019-10-04 He Zhao , Trung Le , Paul Montague , Olivier De Vel , Tamas Abraham , Dinh Phung

It has been demonstrated that deep neural networks are prone to noisy examples particular adversarial samples during inference process. The gap between robust deep learning systems in real world applications and vulnerable neural networks…

Machine Learning · Computer Science 2018-07-03 Xinhan Di , Pengqian Yu , Meng Tian

We propose a new adversarial training approach for injecting robustness when designing controllers for upcoming cyber-physical power systems. Previous approaches relying deeply on simulations are not able to cope with the rising complexity…

Machine Learning · Statistics 2021-04-19 Loïc Omnes , Antoine Marot , Benjamin Donnot

Adversarial robustness is essential for security and reliability of machine learning systems. However, adversarial robustness enhanced by defense algorithms is easily erased as the neural network's weights update to learn new tasks. To…

Machine Learning · Computer Science 2024-08-14 Xiaolei Ru , Xiaowei Cao , Zijia Liu , Jack Murdoch Moore , Xin-Ya Zhang , Xia Zhu , Wenjia Wei , Gang Yan

To improve policy robustness of deep reinforcement learning agents, a line of recent works focus on producing disturbances of the environment. Existing approaches of the literature to generate meaningful disturbances of the environment are…

Machine Learning · Computer Science 2022-10-04 Lucas Schott , Hatem Hajri , Sylvain Lamprier

Though deep neural networks exhibit superior performance on various tasks, they are still plagued by adversarial examples. Adversarial training has been demonstrated to be the most effective method to defend against adversarial attacks.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xin Liu , Yichen Yang , Kun He , John E. Hopcroft

Adversarial training provides a means of regularizing supervised learning algorithms while virtual adversarial training is able to extend supervised learning algorithms to the semi-supervised setting. However, both methods require making…

Machine Learning · Statistics 2021-11-17 Takeru Miyato , Andrew M. Dai , Ian Goodfellow