English
Related papers

Related papers: Virtual Adversarial Training: A Regularization Met…

200 papers

Gradient-based adversarial training is widely used in improving the robustness of neural networks, while it cannot be easily adapted to natural language processing tasks since the embedding space is discrete. In natural language processing…

Computation and Language · Computer Science 2020-12-07 Linyang Li , Xipeng Qiu

The robust self-training (RST) framework has emerged as a prominent approach for semi-supervised adversarial training. To explore the possibility of tackling more complicated tasks with even lower labeling budgets, unlike prior approaches…

Machine Learning · Computer Science 2024-09-20 Tsung-Han Wu , Hung-Ting Su , Shang-Tse Chen , Winston H. Hsu

Adversarial training (AT) has proven to be one of the most effective ways to defend Deep Neural Networks (DNNs) against adversarial attacks. However, the phenomenon of robust overfitting, i.e., the robustness will drop sharply at a certain…

Machine Learning · Computer Science 2022-05-25 Shudong Zhang , Haichang Gao , Tianwei Zhang , Yunyi Zhou , Zihui Wu

Adversarial examples have been shown to be the severe threat to deep neural networks (DNNs). One of the most effective adversarial defense methods is adversarial training (AT) through minimizing the adversarial risk $R_{adv}$, which…

Machine Learning · Computer Science 2020-06-17 Yiming Li , Baoyuan Wu , Yan Feng , Yanbo Fan , Yong Jiang , Zhifeng Li , Shutao Xia

Adversarial Training (AT) and Virtual Adversarial Training (VAT) are the regularization techniques that train Deep Neural Networks (DNNs) with adversarial examples generated by adding small but worst-case perturbations to input examples. In…

Machine Learning · Computer Science 2020-06-24 Xiulong Yang , Shihao Ji

Semi-supervised learning for medical image segmentation is an important area of research for alleviating the huge cost associated with the construction of reliable large-scale annotations in the medical domain. Recent semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Chae Eun Lee , Hyelim Park , Yeong-Gil Shin , Minyoung Chung

While adversarial training methods have significantly improved the robustness of deep neural networks against norm-bounded adversarial perturbations, the generalization gap between their performance on training and test data is considerably…

Machine Learning · Computer Science 2025-01-08 Xiwei Cheng , Kexin Fu , Farzan Farnia

Learning robust models under adversarial settings is widely recognized as requiring a considerably large number of training samples. Recent work proposes semi-supervised adversarial training (SSAT), which utilizes external unlabeled or…

Machine Learning · Computer Science 2026-03-10 Somrita Ghosh , Yuelin Xu , Xiao Zhang

Adversarial training has become one of the most effective methods for improving robustness of neural networks. However, it often suffers from poor generalization on both clean and perturbed data. In this paper, we propose a new algorithm,…

Machine Learning · Computer Science 2020-02-19 Minhao Cheng , Qi Lei , Pin-Yu Chen , Inderjit Dhillon , Cho-Jui Hsieh

Noisy labels often occur in vision datasets, especially when they are obtained from crowdsourcing or Web scraping. We propose a new regularization method, which enables learning robust classifiers in presence of noisy data. To achieve this…

Machine Learning · Computer Science 2021-06-30 Kilian Fatras , Bharath Bhushan Damodaran , Sylvain Lobry , Rémi Flamary , Devis Tuia , Nicolas Courty

Predicting the trajectories of surrounding objects is a critical task for self-driving vehicles and many other autonomous systems. Recent works demonstrate that adversarial attacks on trajectory prediction, where small crafted perturbations…

Machine Learning · Computer Science 2023-03-22 Ruochen Jiao , Xiangguo Liu , Takami Sato , Qi Alfred Chen , Qi Zhu

Adversarial training (AT) is among the most effective techniques to improve model robustness by augmenting training data with adversarial examples. However, most existing AT methods adopt a specific attack to craft adversarial examples,…

Machine Learning · Computer Science 2020-11-20 Yinpeng Dong , Zhijie Deng , Tianyu Pang , Hang Su , Jun Zhu

Active learning aims to develop label-efficient algorithms by sampling the most representative queries to be labeled by an oracle. We describe a pool-based semi-supervised active learning algorithm that implicitly learns this sampling…

Machine Learning · Computer Science 2019-10-30 Samarth Sinha , Sayna Ebrahimi , Trevor Darrell

To ensure that the data collected from human subjects is entrusted with a secret, rival labels are introduced to conceal the information provided by the participants on purpose. The corresponding learning task can be formulated as a noisy…

Machine Learning · Computer Science 2023-04-04 Cheng Chen , Yueming Lyu , Ivor W. Tsang

Despite the growing prevalence of artificial neural networks in real-world applications, their vulnerability to adversarial attacks remains a significant concern, which motivates us to investigate the robustness of machine learning models.…

Machine Learning · Computer Science 2024-08-23 Jie Wang , Rui Gao , Yao Xie

In this paper we propose a new family of algorithms, ATENT, for training adversarially robust deep neural networks. We formulate a new loss function that is equipped with an additional entropic regularization. Our loss function considers…

Machine Learning · Computer Science 2021-02-22 Gauri Jagatap , Ameya Joshi , Animesh Basak Chowdhury , Siddharth Garg , Chinmay Hegde

The successful application of large pre-trained models such as BERT in natural language processing has attracted more attention from researchers. Since the BERT typically acts as an end-to-end black box, classification systems based on it…

Computation and Language · Computer Science 2023-09-06 Shuai Jiang , Sayaka Kamei , Chen Li , Shengzhe Hou , Yasuhiko Morimoto

Adversarial Training (AT) has been demonstrated to improve the robustness of deep neural networks (DNNs) against adversarial attacks. AT is a min-max optimization procedure where in adversarial examples are generated to train a more robust…

Machine Learning · Computer Science 2024-12-31 Olukorede Fakorede , Modeste Atsague , Jin Tian

We propose a method for semi-supervised semantic segmentation using an adversarial network. While most existing discriminators are trained to classify input images as real or fake on the image level, we design a discriminator in a fully…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Wei-Chih Hung , Yi-Hsuan Tsai , Yan-Ting Liou , Yen-Yu Lin , Ming-Hsuan Yang

Virtual Adversarial Training has recently seen a lot of success in semi-supervised learning, as well as unsupervised Domain Adaptation. However, so far it has been used on input samples in the pixel space, whereas we propose to apply it…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Artjoms Gorpincenko , Geoffrey French , Michal Mackiewicz