English
Related papers

Related papers: Consistency Regularization for Generative Adversar…

200 papers

Adversarial training (AT) is currently one of the most successful methods to obtain the adversarial robustness of deep neural networks. However, the phenomenon of robust overfitting, i.e., the robustness starts to decrease significantly…

Machine Learning · Computer Science 2021-12-23 Jihoon Tack , Sihyun Yu , Jongheon Jeong , Minseon Kim , Sung Ju Hwang , Jinwoo Shin

Recent advances in Generative Adversarial Networks (GANs) have demonstrated their capability for producing high-quality images. However, a significant challenge remains mode collapse, which occurs when the generator produces a limited…

Machine Learning · Computer Science 2025-03-26 Osman Goni , Himadri Saha Arka , Mithun Halder , Mir Moynuddin Ahmed Shibly , Swakkhar Shatabda

Some of the most popular methods for improving the stability and performance of GANs involve constraining or regularizing the discriminator. In this paper we consider a largely overlooked regularization technique which we refer to as the…

Machine Learning · Computer Science 2020-12-10 Andreas Munk , William Harvey , Frank Wood

Unpaired image-to-image (I2I) translation has received considerable attention in pattern recognition and computer vision because of recent advancements in generative adversarial networks (GANs). However, due to the lack of explicit…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Takehiko Ohkawa , Naoto Inoue , Hirokatsu Kataoka , Nakamasa Inoue

Generative adversarial networks (GANs) have shown outstanding performance on a wide range of problems in computer vision, graphics, and machine learning, but often require numerous training data and heavy computational resources. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Sangwoo Mo , Minsu Cho , Jinwoo Shin

Generative adversarial networks (GANs) are a class of deep generative models which aim to learn a target distribution in an unsupervised fashion. While they were successfully applied to many problems, training a GAN is a notoriously…

Machine Learning · Computer Science 2019-05-15 Karol Kurach , Mario Lucic , Xiaohua Zhai , Marcin Michalski , Sylvain Gelly

Generative Adversarial Networks (GANs) have become a very popular tool for implicitly learning high-dimensional probability distributions. Several improvements have been made to the original GAN formulation to address some of its…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Parimala Kancharla , Sumohana S. Channappayya

In this paper, we propose a novel normalization method called penalty gradient normalization (PGN) to tackle the training instability of Generative Adversarial Networks (GANs) caused by the sharp gradient space. Unlike existing work such as…

Computer Vision and Pattern Recognition · Computer Science 2023-06-26 Tian Xia

Generative adversarial networks (GANs) are highly effective unsupervised learning frameworks that can generate very sharp data, even for data such as images with complex, highly multimodal distributions. However GANs are known to be very…

Machine Learning · Statistics 2017-12-05 Sitao Xiang , Hao Li

Generative adversarial networks (GANs) are powerful generative models, but usually suffer from instability and generalization problem which may lead to poor generations. Most existing works focus on stabilizing the training of the…

Machine Learning · Computer Science 2020-04-29 Shufei Zhang , Zhuang Qian , Kaizhu Huang , Jimin Xiao , Yuan He

Generative Adversarial Networks (GANs) have shown notable accomplishments in remote sensing domain. However, this paper reveals that their performance on remote sensing images falls short when compared to their impressive results with…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Xingzhe Su , Changwen Zheng , Wenwen Qiang , Fengge Wu , Junsuo Zhao , Fuchun Sun , Hui Xiong

Generative adversarial networks (GANs), famous for the capability of learning complex underlying data distribution, are however known to be tricky in the training process, which would probably result in mode collapse or performance…

Machine Learning · Computer Science 2020-04-23 Dong Wang , Xiaoqian Qin , Fengyi Song , Li Cheng

Generative Adversarial Networks (GANs), though powerful, is hard to train. Several recent works (brock2016neural,miyato2018spectral) suggest that controlling the spectra of weight matrices in the discriminator can significantly improve the…

Machine Learning · Computer Science 2019-03-05 Haoming Jiang , Zhehui Chen , Minshuo Chen , Feng Liu , Dingding Wang , Tuo Zhao

Deep neural networks are incredibly vulnerable to crafted, human-imperceptible adversarial perturbations. Although adversarial training (AT) has proven to be an effective defense approach, we find that the AT-trained models heavily rely on…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Binxiao Huang , Chaofan Tao , Rui Lin , Ngai Wong

We propose a method for semi-supervised training of structured-output neural networks. Inspired by the framework of Generative Adversarial Networks (GAN), we train a discriminator network to capture the notion of a quality of network…

Computer Vision and Pattern Recognition · Computer Science 2017-02-09 Mateusz Koziński , Loïc Simon , Frédéric Jurie

Generative Adversarial Networks (GANs) have been shown to be powerful and flexible priors when solving inverse problems. One challenge of using them is overcoming representation error, the fundamental limitation of the network in…

Machine Learning · Computer Science 2022-04-12 Sean Gunn , Jorio Cocola , Paul Hand

High cost of training time caused by multi-step adversarial example generation is a major challenge in adversarial training. Previous methods try to reduce the computational burden of adversarial training using single-step adversarial…

Machine Learning · Computer Science 2021-02-09 Lehui Xie , Yaopeng Wang , Jia-Li Yin , Ximeng Liu

We propose a novel technique to make neural network robust to adversarial examples using a generative adversarial network. We alternately train both classifier and generator networks. The generator network generates an adversarial…

Machine Learning · Computer Science 2023-07-06 Hyeungill Lee , Sungyeob Han , Jungwoo Lee

Consistency regularization is a commonly-used technique for semi-supervised and self-supervised learning. It is an auxiliary objective function that encourages the prediction of the network to be similar in the vicinity of the observed…

Machine Learning · Computer Science 2021-10-05 Erik Englesson , Hossein Azizpour

Despite being impactful on a variety of problems and applications, the generative adversarial nets (GANs) are remarkably difficult to train. This issue is formally analyzed by \cite{arjovsky2017towards}, who also propose an alternative…

Computer Vision and Pattern Recognition · Computer Science 2018-03-06 Xiang Wei , Boqing Gong , Zixia Liu , Wei Lu , Liqiang Wang