English
Related papers

Related papers: Group-Structured Adversarial Training

200 papers

We present batch virtual adversarial training (BVAT), a novel regularization method for graph convolutional networks (GCNs). BVAT addresses the shortcoming of GCNs that do not consider the smoothness of the model's output distribution…

Machine Learning · Computer Science 2019-05-27 Zhijie Deng , Yinpeng Dong , Jun Zhu

Adversarial training (AT) refers to integrating adversarial examples -- inputs altered with imperceptible perturbations that can significantly impact model predictions -- into the training process. Recent studies have demonstrated the…

Machine Learning · Computer Science 2024-10-22 Mengnan Zhao , Lihe Zhang , Jingwen Ye , Huchuan Lu , Baocai Yin , Xinchao Wang

Despite its success in the image domain, adversarial training did not (yet) stand out as an effective defense for Graph Neural Networks (GNNs) against graph structure perturbations. In the pursuit of fixing adversarial training (1) we show…

Machine Learning · Computer Science 2023-12-05 Lukas Gosch , Simon Geisler , Daniel Sturm , Bertrand Charpentier , Daniel Zügner , Stephan Günnemann

Despite impressive capability in learning over graph-structured data, graph neural networks (GNN) suffer from adversarial topology perturbation in both training and inference phases. While adversarial training has demonstrated remarkable…

Machine Learning · Computer Science 2024-12-30 Ganlin Liu , Ziling Liang , Xiaowei Huang , Xinping Yi , Shi Jin

The training of deep neural networks is inherently a nonconvex optimization problem, yet standard approaches such as stochastic gradient descent (SGD) require simultaneous updates to all parameters, often leading to unstable convergence and…

Machine Learning · Computer Science 2025-08-07 Chengcheng Yan , Jiawei Xu , Zheng Peng , Qingsong Wang

It is known that Deep Neural networks (DNNs) are vulnerable to adversarial attacks, and the adversarial robustness of DNNs could be improved by adding adversarial noises to training data (e.g., the standard adversarial training (SAT)).…

Image and Video Processing · Electrical Eng. & Systems 2022-06-23 Linhai Ma , Liang Liang

Despite strong performance in numerous applications, the fragility of deep learning to input perturbations has raised serious questions about its use in safety-critical domains. While adversarial training can mitigate this issue in…

Machine Learning · Statistics 2021-11-01 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani , Alejandro Ribeiro

Adversarial training serves as one of the most popular and effective methods to defend against adversarial perturbations. However, most defense mechanisms only consider a single type of perturbation while various attack methods might be…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Huihui Gong , Minjing Dong , Siqi Ma , Seyit Camtepe , Surya Nepal , Chang Xu

We present a novel method and analysis to train generative adversarial networks (GAN) in a stable manner. As shown in recent analysis, training is often undermined by the probability distribution of the data being zero on neighborhoods of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Simon Jenni , Paolo Favaro

Adversarial training has become one of the most effective methods for improving robustness of neural networks. However, it often suffers from poor generalization on both clean and perturbed data. In this paper, we propose a new algorithm,…

Machine Learning · Computer Science 2020-02-19 Minhao Cheng , Qi Lei , Pin-Yu Chen , Inderjit Dhillon , Cho-Jui Hsieh

Advances in the development of adversarial attacks have been fundamental to the progress of adversarial defense research. Efficient and effective attacks are crucial for reliable evaluation of defenses, and also for developing robust…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Gaurang Sriramanan , Sravanti Addepalli , Arya Baburaj , R. Venkatesh Babu

Adversarial training (AT) is always formulated as a minimax problem, of which the performance depends on the inner optimization that involves the generation of adversarial examples (AEs). Most previous methods adopt Projected Gradient…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Xiaojun Jia , Yong Zhang , Baoyuan Wu , Ke Ma , Jue Wang , Xiaochun Cao

To mitigate the susceptibility of neural networks to adversarial attacks, adversarial training has emerged as a prevalent and effective defense strategy. Intrinsically, this countermeasure incurs a trade-off, as it sacrifices the model's…

Machine Learning · Computer Science 2024-09-19 Hanyi Hu , Qiao Han , Kui Chen , Yao Yang

Machine learning models are vulnerable to adversarial attacks that can often cause misclassification by introducing small but well designed perturbations. In this paper, we explore, in the setting of classical composite hypothesis testing,…

Machine Learning · Statistics 2020-11-17 Bhagyashree Puranik , Upamanyu Madhow , Ramtin Pedarsani

Despite their overwhelming success on a wide range of applications, convolutional neural networks (CNNs) are widely recognized to be vulnerable to adversarial examples. This intriguing phenomenon led to a competition between adversarial…

Machine Learning · Computer Science 2021-04-08 Philipp Benz , Chaoning Zhang , Adil Karjauv , In So Kweon

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches in training robust models against…

Machine Learning · Computer Science 2022-07-20 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Adversarial Training (AT) with Projected Gradient Descent (PGD) is an effective approach for improving the robustness of the deep neural networks. However, PGD AT has been shown to suffer from two main limitations: i) high computational…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Ahmadreza Jeddi , Mohammad Javad Shafiee , Alexander Wong

The effectiveness of Graph Convolutional Networks (GCNs) has been demonstrated in a wide range of graph-based machine learning tasks. However, the update of parameters in GCNs is only from labeled nodes, lacking the utilization of unlabeled…

Machine Learning · Computer Science 2020-02-21 Ke Sun , Zhouchen Lin , Hantao Guo , Zhanxing Zhu

Adversarial Training (AT) is one of the most effective methods for developing robust deep neural networks (DNNs). However, AT faces a trade-off problem between clean accuracy and adversarial robustness. In this work, we reveal a surprising…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Yanyun Wang , Qingqing Ye , Li Liu , Zi Liang , Haibo Hu

Adversarial examples are perturbed inputs designed to fool machine learning models. Adversarial training injects such examples into training data to increase robustness. To scale this technique to large datasets, perturbations are crafted…

Machine Learning · Statistics 2020-04-28 Florian Tramèr , Alexey Kurakin , Nicolas Papernot , Ian Goodfellow , Dan Boneh , Patrick McDaniel