English
Related papers

Related papers: Spectral Regularization for Combating Mode Collaps…

200 papers

One of the challenges in the study of generative adversarial networks is the instability of its training. In this paper, we propose a novel weight normalization technique called spectral normalization to stabilize the training of the…

Machine Learning · Computer Science 2018-02-19 Takeru Miyato , Toshiki Kataoka , Masanori Koyama , Yuichi Yoshida

We introduce a method to stabilize Generative Adversarial Networks (GANs) by defining the generator objective with respect to an unrolled optimization of the discriminator. This allows training to be adjusted between using the optimal…

Machine Learning · Computer Science 2017-05-16 Luke Metz , Ben Poole , David Pfau , Jascha Sohl-Dickstein

Building on the success of deep learning, Generative Adversarial Networks (GANs) provide a modern approach to learn a probability distribution from observed samples. GANs are often formulated as a zero-sum game between two sets of…

Machine Learning · Computer Science 2020-09-28 Pirazh Khorramshahi , Hossein Souri , Rama Chellappa , Soheil Feizi

Recent advances in Generative Adversarial Networks (GANs) have demonstrated their capability for producing high-quality images. However, a significant challenge remains mode collapse, which occurs when the generator produces a limited…

Machine Learning · Computer Science 2025-03-26 Osman Goni , Himadri Saha Arka , Mithun Halder , Mir Moynuddin Ahmed Shibly , Swakkhar Shatabda

Generative adversarial networks (GANs) nowadays are capable of producing images of incredible realism. One concern raised is whether the state-of-the-art GAN's learned distribution still suffers from mode collapse, and what to do if so.…

Machine Learning · Computer Science 2021-07-27 Zhenyu Wu , Zhaowen Wang , Ye Yuan , Jianming Zhang , Zhangyang Wang , Hailin Jin

Generative Adversarial Networks (GANs) are known to be difficult to train, despite considerable research effort. Several regularization techniques for stabilizing training have been proposed, but they introduce non-trivial computational…

Machine Learning · Computer Science 2020-02-20 Han Zhang , Zizhao Zhang , Augustus Odena , Honglak Lee

Most conditional generation tasks expect diverse outputs given a single conditional context. However, conditional generative adversarial networks (cGANs) often focus on the prior conditional information and ignore the input noise vectors,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Qi Mao , Hsin-Ying Lee , Hung-Yu Tseng , Siwei Ma , Ming-Hsuan Yang

We propose two new techniques for training Generative Adversarial Networks (GANs). Our objectives are to alleviate mode collapse in GAN and improve the quality of the generated samples. First, we propose neighbor embedding, a manifold…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ngoc-Trung Tran , Tuan-Anh Bui , Ngai-Man Cheung

Generative Adversarial Networks (GANs) have shown compelling results in various tasks and applications in recent years. However, mode collapse remains a critical problem in GANs. In this paper, we propose a novel training pipeline to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Haozhe Liu , Bing Li , Haoqian Wu , Hanbang Liang , Yawen Huang , Yuexiang Li , Bernard Ghanem , Yefeng Zheng

Mode collapse remains a fundamental challenge in training generative adversarial networks (GANs). While existing works have primarily focused on inter-mode collapse, such as mode dropping, intra-mode collapse-where many latent variables map…

Machine Learning · Computer Science 2026-04-23 Kuan-Yu Lin , Yu-Chih Huang , Tie Liu

Generative Adversarial Networks (GANs), though powerful, is hard to train. Several recent works (brock2016neural,miyato2018spectral) suggest that controlling the spectra of weight matrices in the discriminator can significantly improve the…

Machine Learning · Computer Science 2019-03-05 Haoming Jiang , Zhehui Chen , Minshuo Chen , Feng Liu , Dingding Wang , Tuo Zhao

Despite the growing interest in generative adversarial networks (GANs), training GANs remains a challenging problem, both from a theoretical and a practical standpoint. To address this challenge, in this paper, we propose a novel way to…

Machine Learning · Computer Science 2018-11-27 Qunwei Li , Bhavya Kailkhura , Rushil Anirudh , Yi Zhou , Yingbin Liang , Pramod Varshney

We propose a simple yet highly effective method that addresses the mode-collapse problem in the Conditional Generative Adversarial Network (cGAN). Although conditional distributions are multi-modal (i.e., having many modes) in practice,…

Machine Learning · Computer Science 2019-01-28 Dingdong Yang , Seunghoon Hong , Yunseok Jang , Tianchen Zhao , Honglak Lee

Realistic hyperspectral image (HSI) super-resolution (SR) techniques aim to generate a high-resolution (HR) HSI with higher spectral and spatial fidelity from its low-resolution (LR) counterpart. The generative adversarial network (GAN) has…

Image and Video Processing · Electrical Eng. & Systems 2022-10-05 Yue Shi , Liangxiu Han , Lianghao Han , Sheng Chang , Tongle Hu , Darren Dancey

Deep generative models based on Generative Adversarial Networks (GANs) have demonstrated impressive sample quality but in order to work they require a careful choice of architecture, parameter initialization, and selection of…

Machine Learning · Computer Science 2017-11-08 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

Generative Adversarial Networks (GANs) based semi-supervised learning (SSL) approaches are shown to improve classification performance by utilizing a large number of unlabeled samples in conjunction with limited labeled samples. However,…

Machine Learning · Computer Science 2020-09-16 Zexi Chen , Bharathkumar Ramachandra , Ranga Raju Vatsavai

Although Generative Adversarial Networks achieve state-of-the-art results on a variety of generative tasks, they are regarded as highly unstable and prone to miss modes. We argue that these bad behaviors of GANs are due to the very…

Machine Learning · Computer Science 2017-03-03 Tong Che , Yanran Li , Athul Paul Jacob , Yoshua Bengio , Wenjie Li

The two key players in Generative Adversarial Networks (GANs), the discriminator and generator, are usually parameterized as deep neural networks (DNNs). On many generative tasks, GANs achieve state-of-the-art performance but are often…

Machine Learning · Computer Science 2019-01-31 Babajide O. Ayinde , Keishin Nishihama , Jacek M. Zurada

Spectral normalization (SN) is a widely-used technique for improving the stability and sample quality of Generative Adversarial Networks (GANs). However, there is currently limited understanding of why SN is effective. In this work, we show…

Machine Learning · Computer Science 2021-04-09 Zinan Lin , Vyas Sekar , Giulia Fanti

Mode collapse is a critical problem in training generative adversarial networks. To alleviate mode collapse, several recent studies introduce new objective functions, network architectures or alternative training schemes. However, their…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Duhyeon Bang , Hyunjung Shim
‹ Prev 1 2 3 10 Next ›