English
Related papers

Related papers: Rethinking Invariance Regularization in Adversaria…

200 papers

Adversarial Training (AT) has been demonstrated as one of the most effective methods against adversarial examples. While most existing works focus on AT with a single type of perturbation e.g., the $\ell_\infty$ attacks), DNNs are facing…

Machine Learning · Computer Science 2022-10-04 Jiancong Xiao , Zeyu Qin , Yanbo Fan , Baoyuan Wu , Jue Wang , Zhi-Quan Luo

Viewpoint invariance remains challenging for visual recognition in the 3D world, as altering the viewing directions can significantly impact predictions for the same object. While substantial efforts have been dedicated to making neural…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Shouwei Ruan , Yinpeng Dong , Hang Su , Jianteng Peng , Ning Chen , Xingxing Wei

Adversarial training has been actively studied in recent computer vision research to improve the robustness of models. However, due to the huge computational cost of generating adversarial samples, adversarial training methods are often…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Yihan Wu , Xinda Li , Florian Kerschbaum , Heng Huang , Hongyang Zhang

Adversarial training is one of the predominant techniques for training classifiers that are robust to adversarial attacks. Recent work, however has found that adversarial training, which makes the overall classifier robust, it does not…

Machine Learning · Computer Science 2024-11-22 Meiyu Zhong , Ravi Tandon

Deep neural networks (DNNs) are vulnerable to adversarial examples, in which DNNs are misled to false outputs due to inputs containing imperceptible perturbations. Adversarial training, a reliable and effective method of defense, may…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Zongyuan Zhang , Qingwen Bu , Tianyang Duan , Zheng Lin , Yuhao Qing , Zihan Fang , Heming Cui , Dong Huang

Adversarial Training (AT) has become arguably the state-of-the-art algorithm for extracting robust features. However, researchers recently notice that AT suffers from severe robust overfitting problems, particularly after learning rate (LR)…

Machine Learning · Computer Science 2023-10-31 Yifei Wang , Liangchen Li , Jiansheng Yang , Zhouchen Lin , Yisen Wang

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

Machine Learning · Computer Science 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Machine learning has achieved great success in electroencephalogram (EEG) based brain-computer interfaces (BCIs). Most existing BCI studies focused on improving the decoding accuracy, with only a few considering the adversarial security.…

Human-Computer Interaction · Computer Science 2024-11-05 Xiaoqing Chen , Ziwei Wang , Dongrui Wu

We augment adversarial training (AT) with worst case adversarial training (WCAT) which improves adversarial robustness by 11% over the current state-of-the-art result in the $\ell_2$ norm on CIFAR-10. We obtain verifiable average case and…

Machine Learning · Computer Science 2019-09-16 Chris Finlay , Adam Oberman , Bilal Abbasi

We address the challenge of finding algorithms for online allocation (i.e. bipartite matching) using a machine learning approach. In this paper, we focus on the AdWords problem, which is a classical online budgeted matching problem of both…

Machine Learning · Computer Science 2020-10-19 Goran Zuzic , Di Wang , Aranyak Mehta , D. Sivakumar

Deep reinforcement learning (DRL) algorithms can suffer from modeling errors between the simulation and the real world. Many studies use adversarial learning to generate perturbation during training process to model the discrepancy and…

Machine Learning · Computer Science 2024-05-21 Qianmei Liu , Yufei Kuang , Jie Wang

Adversarial defenses train deep neural networks to be invariant to the input perturbations from adversarial attacks. Almost all defense strategies achieve this invariance through adversarial training i.e. training on inputs with adversarial…

Machine Learning · Computer Science 2021-08-30 Landan Seguin , Anthony Ndirango , Neeli Mishra , SueYeon Chung , Tyler Lee

Recently proposed adversarial training methods show the robustness to both adversarial and original examples and achieve state-of-the-art results in supervised and semi-supervised learning. All the existing adversarial training methods…

Machine Learning · Computer Science 2019-11-15 Shufei Zhang , Kaizhu Huang , Jianke Zhu , Yang Liu

Many of the successes of machine learning are based on minimizing an averaged loss function. However, it is well-known that this paradigm suffers from robustness issues that hinder its applicability in safety-critical domains. These issues…

Machine Learning · Computer Science 2022-06-09 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani

While adversarial training can improve robust accuracy (against an adversary), it sometimes hurts standard accuracy (when there is no adversary). Previous work has studied this tradeoff between standard and robust accuracy, but only in the…

Machine Learning · Computer Science 2019-08-28 Aditi Raghunathan , Sang Michael Xie , Fanny Yang , John C. Duchi , Percy Liang

Sharpness-Aware Minimization (SAM) is an effective method for improving generalization ability by regularizing loss sharpness. In this paper, we explore SAM in the context of adversarial robustness. We find that using only SAM can achieve…

Machine Learning · Computer Science 2023-07-04 Zeming Wei , Jingyu Zhu , Yihao Zhang

Adversarial training (AT) is a simple yet effective defense against adversarial attacks to image classification systems, which is based on augmenting the training set with attacks that maximize the loss. However, the effectiveness of AT as…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Kaleab A. Kinfu , René Vidal

Adversarial robustness is essential for security and reliability of machine learning systems. However, adversarial robustness enhanced by defense algorithms is easily erased as the neural network's weights update to learn new tasks. To…

Machine Learning · Computer Science 2024-08-14 Xiaolei Ru , Xiaowei Cao , Zijia Liu , Jack Murdoch Moore , Xin-Ya Zhang , Xia Zhu , Wenjia Wei , Gang Yan

Domain adaptation is widely used in learning problems lacking labels. Recent studies show that deep adversarial domain adaptation models can make markable improvements in performance, which include symmetric and asymmetric architectures.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Guanyu Cai , Yuqin Wang , Mengchu Zhou , Lianghua He

Sensitivity to adversarial noise hinders deployment of machine learning algorithms in security-critical applications. Although many adversarial defenses have been proposed, robustness to adversarial noise remains an open problem. The most…

Machine Learning · Computer Science 2020-08-13 Alex Serban , Erik Poll , Joost Visser