English
Related papers

Related papers: Gradient Adversarial Training of Neural Networks

200 papers

This tutorial aims to introduce the fundamentals of adversarial robustness of deep learning, presenting a well-structured review of up-to-date techniques to assess the vulnerability of various types of deep learning models to adversarial…

Machine Learning · Computer Science 2021-08-25 Wenjie Ruan , Xinping Yi , Xiaowei Huang

Adversarial approach has been widely used for data generation in the last few years. However, this approach has not been extensively utilized for classifier training. In this paper, we propose an adversarial framework for classifier…

Machine Learning · Computer Science 2018-11-22 Ehsan Montahaei , Mahsa Ghorbani , Mahdieh Soleymani Baghshah , Hamid R. Rabiee

Transcribed datasets typically contain speaker identity for each instance in the data. We investigate two ways to incorporate this information during training: Multi-Task Learning and Adversarial Learning. In multi-task learning, the goal…

Machine Learning · Computer Science 2019-02-15 Yossi Adi , Neil Zeghidour , Ronan Collobert , Nicolas Usunier , Vitaliy Liptchinsky , Gabriel Synnaeve

Deep learning methods have shown state of the art performance in a range of tasks from computer vision to natural language processing. However, it is well known that such systems are vulnerable to attackers who craft inputs in order to…

Machine Learning · Computer Science 2020-09-29 Giulio Zizzo , Chris Hankin , Sergio Maffeis , Kevin Jones

Multiple different approaches of generating adversarial examples have been proposed to attack deep neural networks. These approaches involve either directly computing gradients with respect to the image pixels, or directly solving an…

Neural and Evolutionary Computing · Computer Science 2017-03-29 Shumeet Baluja , Ian Fischer

Deep Learning has empowered us to train neural networks for complex data with high performance. However, with the growing research, several vulnerabilities in neural networks have been exposed. A particular branch of research, Adversarial…

Machine Learning · Computer Science 2023-08-08 Shashank Kotyan

Despite its success in the image domain, adversarial training did not (yet) stand out as an effective defense for Graph Neural Networks (GNNs) against graph structure perturbations. In the pursuit of fixing adversarial training (1) we show…

Machine Learning · Computer Science 2023-12-05 Lukas Gosch , Simon Geisler , Daniel Sturm , Bertrand Charpentier , Daniel Zügner , Stephan Günnemann

We propose a new technique that boosts the convergence of training generative adversarial networks. Generally, the rate of training deep models reduces severely after multiple iterations. A key reason for this phenomenon is that a deep…

Machine Learning · Statistics 2018-06-15 Atsushi Nitanda , Taiji Suzuki

Upon the discovery of adversarial attacks, robust models have become obligatory for deep learning-based systems. Adversarial training with first-order attacks has been one of the most effective defenses against adversarial perturbations to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Inci M. Baytas , Debayan Deb

Despite the remarkable advances that have been made in continual learning, the adversarial vulnerability of such methods has not been fully discussed. We delve into the adversarial robustness of memory-based continual learning algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiaoyue Mi , Fan Tang , Zonghan Yang , Danding Wang , Juan Cao , Peng Li , Yang Liu

Adversarial attacks can generate adversarial inputs by applying small but intentionally worst-case perturbations to samples from the dataset, which leads to even state-of-the-art deep neural networks outputting incorrect answers with high…

Machine Learning · Computer Science 2024-01-08 Shorya Sharma

Although current deep learning techniques have yielded superior performance on various computer vision tasks, yet they are still vulnerable to adversarial examples. Adversarial training and its variants have been shown to be the most…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Junhao Dong , Seyed-Mohsen Moosavi-Dezfooli , Jianhuang Lai , Xiaohua Xie

The existence of adversarial examples points to a basic weakness of deep neural networks. One of the most effective defenses against such examples, adversarial training, entails training models with some degree of robustness, usually at the…

Machine Learning · Computer Science 2023-10-05 Matan Levi , Aryeh Kontorovich

Deep neural networks are known to be vulnerable to adversarial perturbations, which are small and carefully crafted inputs that lead to incorrect predictions. In this paper, we propose DeepDefense, a novel defense framework that applies…

Machine Learning · Computer Science 2025-11-19 Ci Lin , Tet Yeap , Iluju Kiringa , Biwei Zhang

Neural network compression has recently received much attention due to the computational requirements of modern deep models. In this work, our objective is to transfer knowledge from a deep and accurate model to a smaller one. Our…

Computer Vision and Pattern Recognition · Computer Science 2018-11-15 Vasileios Belagiannis , Azade Farshad , Fabio Galasso

Despite the efficacy on a variety of computer vision tasks, deep neural networks (DNNs) are vulnerable to adversarial attacks, limiting their applications in security-critical systems. Recent works have shown the possibility of generating…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Ziang Yan , Yiwen Guo , Changshui Zhang

Artificial neural networks in general and deep learning networks in particular established themselves as popular and powerful machine learning algorithms. While the often tremendous sizes of these networks are beneficial when solving…

Machine Learning · Computer Science 2020-05-28 Moritz Seiler , Heike Trautmann , Pascal Kerschke

Deep neural networks (DNNs) are vulnerable to adversarial examples where inputs with imperceptible perturbations mislead DNNs to incorrect results. Despite the potential risk they bring, adversarial examples are also valuable for providing…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Chongzhi Zhang , Aishan Liu , Xianglong Liu , Yitao Xu , Hang Yu , Yuqing Ma , Tianlin Li

The vulnerability of deep neural networks (DNNs) to adversarial examples has attracted great attention in the machine learning community. The problem is related to non-flatness and non-smoothness of normally obtained loss landscapes.…

Machine Learning · Computer Science 2023-02-13 Qizhang Li , Yiwen Guo , Wangmeng Zuo , Hao Chen

It has been shown that deep neural networks (DNNs) may be vulnerable to adversarial attacks, raising the concern on their robustness particularly for safety-critical applications. Recognizing the local nature and limitations of existing…

Machine Learning · Computer Science 2019-06-20 Hanbin Hu , Mit Shah , Jianhua Z. Huang , Peng Li