English
Related papers

Related papers: Regularization with Latent Space Virtual Adversari…

200 papers

Recent years have witnessed the rapid progress of generative adversarial networks (GANs). However, the success of the GAN models hinges on a large amount of training data. This work proposes a regularization approach for training robust GAN…

Machine Learning · Computer Science 2021-04-08 Hung-Yu Tseng , Lu Jiang , Ce Liu , Ming-Hsuan Yang , Weilong Yang

Adversarial Training (AT) has been demonstrated to improve the robustness of deep neural networks (DNNs) against adversarial attacks. AT is a min-max optimization procedure where in adversarial examples are generated to train a more robust…

Machine Learning · Computer Science 2024-12-31 Olukorede Fakorede , Modeste Atsague , Jin Tian

While deep learning in the form of recurrent neural networks (RNNs) has caused a significant improvement in neural language modeling, the fact that they are extremely prone to overfitting is still a mainly unresolved issue. In this paper we…

Computation and Language · Computer Science 2022-11-18 Sajad Movahedi , Azadeh Shakery

Allowing effective inference of latent vectors while training GANs can greatly increase their applicability in various downstream tasks. Recent approaches, such as ALI and BiGAN frameworks, develop methods of inference of latent variables…

Machine Learning · Computer Science 2020-12-22 Yatin Dandi , Homanga Bharadhwaj , Abhishek Kumar , Piyush Rai

Previous robustness approaches for deep learning models such as data augmentation techniques via data transformation or adversarial training cannot capture real-world variations that preserve the semantics of the input, such as a change in…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Shuo Wang , Lingjuan Lyu , Surya Nepal , Carsten Rudolph , Marthie Grobler , Kristen Moore

We study the model robustness against adversarial examples, referred to as small perturbed input data that may however fool many state-of-the-art deep learning models. Unlike previous research, we establish a novel theory addressing the…

Machine Learning · Computer Science 2020-06-11 Shufei Zhang , Kaizhu Huang , Zenglin Xu

Adversarial examples are fabricated examples, indistinguishable from the original image that mislead neural networks and drastically lower their performance. Recently proposed AdvGAN, a GAN based approach, takes input image as a prior for…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Puneet Mangla , Surgan Jandial , Sakshi Varshney , Vineeth N Balasubramanian

Adversarial training often suffers from a robustness-accuracy trade-off, where achieving high robustness comes at the cost of accuracy. One approach to mitigate this trade-off is leveraging invariance regularization, which encourages model…

Machine Learning · Computer Science 2025-08-29 Futa Waseda , Ching-Chun Chang , Isao Echizen

With great progress in the development of Generative Adversarial Networks (GANs), in recent years, the quest for insights in understanding and manipulating the latent space of GAN has gained more and more attention due to its wide range of…

Machine Learning · Computer Science 2021-02-25 Toan Pham Van , Tam Minh Nguyen , Ngoc N. Tran , Hoai Viet Nguyen , Linh Bao Doan , Huy Quang Dao , Thanh Ta Minh

Visual recognition models are not invariant to viewpoint changes in the 3D world, as different viewing directions can dramatically affect the predictions given the same object. Although many efforts have been devoted to making neural…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Shouwei Ruan , Yinpeng Dong , Hang Su , Jianteng Peng , Ning Chen , Xingxing Wei

Self-supervised learning methods for computer vision have demonstrated the effectiveness of pre-training feature representations, resulting in well-generalizing Deep Neural Networks, even if the annotated data are limited. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Dmitrii Shubin , Danny Eytan , Sebastian D. Goodfellow

Despite its short history, Generative Adversarial Network (GAN) has been extensively studied and used for various tasks, including its original purpose, i.e., synthetic sample generation. However, applying GAN to different data types with…

Image and Video Processing · Electrical Eng. & Systems 2020-05-20 Minhyeok Lee , Junhee Seok

Adversarial training (AT) has proven to be one of the most effective ways to defend Deep Neural Networks (DNNs) against adversarial attacks. However, the phenomenon of robust overfitting, i.e., the robustness will drop sharply at a certain…

Machine Learning · Computer Science 2022-05-25 Shudong Zhang , Haichang Gao , Tianwei Zhang , Yunyi Zhou , Zihui Wu

Most existing zero-shot learning methods consider the problem as a visual semantic embedding one. Given the demonstrated capability of Generative Adversarial Networks(GANs) to generate images, we instead leverage GANs to imagine unseen…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Yizhe Zhu , Mohamed Elhoseiny , Bingchen Liu , Xi Peng , Ahmed Elgammal

Adversarial training methods are state-of-the-art (SOTA) empirical defense methods against adversarial examples. Many regularization methods have been proven to be effective with the combination of adversarial training. Nevertheless, such…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Jun Yan , Huilin Yin , Xiaoyang Deng , Ziming Zhao , Wancheng Ge , Hao Zhang , Gerhard Rigoll

Vision Transformers (ViTs) are becoming a very popular paradigm for vision tasks as they achieve state-of-the-art performance on image classification. However, although early works implied that this network structure had increased…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Hugo Lemarchant , Liangzi Li , Yiming Qian , Yuta Nakashima , Hajime Nagahara

Adversarial learning helps generative models translate MRI from source to target sequence when lacking paired samples. However, implementing MRI synthesis with adversarial learning in clinical settings is challenging due to training…

Image and Video Processing · Electrical Eng. & Systems 2024-07-04 Luyi Han , Tao Tan , Tianyu Zhang , Xin Wang , Yuan Gao , Chunyao Lu , Xinglong Liang , Haoran Dou , Yunzhi Huang , Ritse Mann

Deep neural networks suffer from over-fitting and catastrophic forgetting when trained with small data. One natural remedy for this problem is data augmentation, which has been recently shown to be effective. However, previous works either…

Machine Learning · Computer Science 2018-12-14 Hang Gao , Zheng Shou , Alireza Zareian , Hanwang Zhang , Shih-Fu Chang

Deep Neural Networks (DNNs) have recently achieved great success in many classification tasks. Unfortunately, they are vulnerable to adversarial attacks that generate adversarial examples with a small perturbation to fool DNN models,…

Machine Learning · Computer Science 2022-07-07 Xiaowei Zhou , Ivor W. Tsang , Jie Yin

In this paper we propose a new family of algorithms, ATENT, for training adversarially robust deep neural networks. We formulate a new loss function that is equipped with an additional entropic regularization. Our loss function considers…

Machine Learning · Computer Science 2021-02-22 Gauri Jagatap , Ameya Joshi , Animesh Basak Chowdhury , Siddharth Garg , Chinmay Hegde