English
Related papers

Related papers: Data Augmentation Alone Can Improve Adversarial Tr…

200 papers

Adversarial images are designed to mislead deep neural networks (DNNs), attracting great attention in recent years. Although several defense strategies achieved encouraging robustness against adversarial samples, most of them fail to…

Machine Learning · Computer Science 2020-02-25 Hang Yu , Aishan Liu , Xianglong Liu , Gengchao Li , Ping Luo , Ran Cheng , Jichen Yang , Chongzhi Zhang

Adversarial training augments the training set with perturbations to improve the robust error (over worst-case perturbations), but it often leads to an increase in the standard error (on unperturbed test inputs). Previous explanations for…

Machine Learning · Computer Science 2020-07-08 Aditi Raghunathan , Sang Michael Xie , Fanny Yang , John Duchi , Percy Liang

Successful deep learning models often involve training neural network architectures that contain more parameters than the number of training samples. Such overparametrized models have been extensively studied in recent years, and the…

Machine Learning · Computer Science 2024-02-02 Hamed Hassani , Adel Javanmard

Weak supervision combines the advantages of training on real data with the ability to exploit signal properties. However, training a neural network using weak supervision often requires an excessive amount of signal data, which severely…

High Energy Physics - Phenomenology · Physics 2024-12-23 Zong-En Chen , Cheng-Wei Chiang , Feng-Yang Hsieh

Adversarial Training (AT), which adversarially perturb the input samples during training, has been acknowledged as one of the most effective defenses against adversarial attacks, yet suffers from inevitably decreased clean accuracy. Instead…

Machine Learning · Computer Science 2024-06-06 Yihao Zhang , Hangzhou He , Jingyu Zhu , Huanran Chen , Yifei Wang , Zeming Wei

In the realm of visual recognition, data augmentation stands out as a pivotal technique to amplify model robustness. Yet, a considerable number of existing methodologies lean heavily on heuristic foundations, rendering their intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Zhendong Liu , Jie Zhang , Qiangqiang He , Chongjun Wang

Data augmentation methods have played an important role in the recent advance of deep learning models, and have become an indispensable component of state-of-the-art models in semi-supervised, self-supervised, and supervised training for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Emirhan Kurtulus , Zichao Li , Yann Dauphin , Ekin Dogus Cubuk

Fast adversarial training (FAT) is beneficial for improving the adversarial robustness of neural networks. However, previous FAT work has encountered a significant issue known as catastrophic overfitting when dealing with large perturbation…

Machine Learning · Computer Science 2023-08-25 Mengnan Zhao , Lihe Zhang , Yuqiu Kong , Baocai Yin

To help adversarial examples generalize from surrogate machine-learning (ML) models to targets, certain transferability-based black-box evasion attacks incorporate data augmentations (e.g., random resizing). Yet, prior work has explored…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Zebin Yun , Achi-Or Weingarten , Eyal Ronen , Mahmood Sharif

Despite its popularity, deep neural networks are easily fooled. To alleviate this deficiency, researchers are actively developing new training strategies, which encourage models that are robust to small input perturbations. Several…

Machine Learning · Computer Science 2021-10-28 Jingyue Lu , M. Pawan Kumar

Adversarial examples, or nearly indistinguishable inputs created by an attacker, significantly reduce machine learning accuracy. Theoretical evidence has shown that the high intrinsic dimensionality of datasets facilitates an adversary's…

Machine Learning · Computer Science 2021-12-13 Sheila Alemany , Niki Pissinou

The performance of generative adversarial networks (GANs) heavily deteriorates given a limited amount of training data. This is mainly because the discriminator is memorizing the exact training set. To combat it, we propose Differentiable…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Shengyu Zhao , Zhijian Liu , Ji Lin , Jun-Yan Zhu , Song Han

Adversarial training is an approach of increasing the robustness of models to adversarial attacks by including adversarial examples in the training set. One major challenge of producing adversarial examples is to contain sufficient…

Machine Learning · Computer Science 2021-10-13 Tianjin Huang , Vlado Menkovski , Yulong Pei , Mykola Pechenizkiy

Deep neural networks are easily fooled by small perturbations known as adversarial attacks. Adversarial Training (AT) is a technique that approximately solves a robust optimization problem to minimize the worst-case loss and is widely…

Machine Learning · Computer Science 2022-03-28 Theodoros Tsiligkaridis , Jay Roberts

Owing to security implications of adversarial vulnerability, adversarial robustness of deep metric learning models has to be improved. In order to avoid model collapse due to excessively hard examples, the existing defenses dismiss the…

Machine Learning · Computer Science 2022-03-04 Mo Zhou , Vishal M. Patel

Image augmentations applied during training are crucial for the generalization performance of image classifiers. Therefore, a large body of research has focused on finding the optimal augmentation policy for a given task. Yet, RandAugment…

Machine Learning · Computer Science 2021-12-06 Arno Blaas , Xavier Suau , Jason Ramapuram , Nicholas Apostoloff , Luca Zappella

Generative adversarial networks (GANs) typically require ample data for training in order to synthesize high-fidelity images. Recent studies have shown that training GANs with limited data remains formidable due to discriminator…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Liming Jiang , Bo Dai , Wayne Wu , Chen Change Loy

Data augmentation is a popular technique largely used to enhance the training of convolutional neural networks. Although many of its benefits are well known by deep learning researchers and practitioners, its implicit regularization…

Computer Vision and Pattern Recognition · Computer Science 2019-06-27 Alex Hernández-García , Peter König

Deep neural networks remain vulnerable to adversarial examples despite advances in architectures and training paradigms. We investigate how training data characteristics affect adversarial robustness across 36 state-of-the-art vision models…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Marco Zimmerli , Andreas Plesner , Till Aczel , Roger Wattenhofer

By injecting adversarial examples into training data, adversarial training is promising for improving the robustness of deep learning models. However, most existing adversarial training approaches are based on a specific type of adversarial…

Machine Learning · Computer Science 2019-03-18 Chuanbiao Song , Kun He , Liwei Wang , John E. Hopcroft