English
Related papers

Related papers: Distribution Fitting for Combating Mode Collapse i…

200 papers

Generative adversarial networks (GANs) are the state of the art in generative modeling. Unfortunately, most GAN methods are susceptible to mode collapse, meaning that they tend to capture only a subset of the modes of the true distribution.…

Machine Learning · Statistics 2019-07-10 Luca Ambrogioni , Umut Güçlü , Marcel van Gerven

Generative adversarial networks (GANs) provide state-of-the-art results in image generation. However, despite being so powerful, they still remain very challenging to train. This is in particular caused by their highly non-convex…

Machine Learning · Computer Science 2020-12-18 Ricard Durall , Avraam Chatzimichailidis , Peter Labus , Janis Keuper

Generative Adversarial Networks (GAN) is currently widely used as an unsupervised image generation method. Current state-of-the-art GANs can generate photorealistic images with high resolution. However, a large amount of data is required,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Pengwei Wang

We propose two new techniques for training Generative Adversarial Networks (GANs). Our objectives are to alleviate mode collapse in GAN and improve the quality of the generated samples. First, we propose neighbor embedding, a manifold…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ngoc-Trung Tran , Tuan-Anh Bui , Ngai-Man Cheung

Generative models have proven to be an outstanding tool for representing high-dimensional probability distributions and generating realistic-looking images. An essential characteristic of generative models is their ability to produce…

Machine Learning · Computer Science 2019-11-26 Mohamed Elfeki , Camille Couprie , Morgane Riviere , Mohamed Elhoseiny

In this work, we propose the Generative Latent Flow (GLF), an algorithm for generative modeling of the data distribution. GLF uses an Auto-encoder (AE) to learn latent representations of the data, and a normalizing flow to map the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Zhisheng Xiao , Qing Yan , Yali Amit

Many generative models have to combat $\textit{missing modes}$. The conventional wisdom to this end is by reducing through training a statistical distance (such as $f$-divergence) between the generated distribution and provided data…

Machine Learning · Statistics 2019-10-28 Peilin Zhong , Yuchen Mo , Chang Xiao , Pengyu Chen , Changxi Zheng

Dual discriminator generative adversarial networks (D2 GANs) were introduced to mitigate the problem of mode collapse in generative adversarial networks. In D2 GANs, two discriminators are employed alongside a generator: one discriminator…

Machine Learning · Computer Science 2025-07-24 Penukonda Naga Chandana , Tejas Srivastava , Gowtham R. Kurri , V. Lalitha

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Traditional generative adversarial networks (GAN) and many of its variants are trained by minimizing the KL or JS-divergence loss that measures how close the generated data distribution is from the true data distribution. A recent advance…

Computer Vision and Pattern Recognition · Computer Science 2017-04-18 Felix Juefei-Xu , Vishnu Naresh Boddeti , Marios Savvides

Generative adversarial networks (GANs) aim to generate realistic data from some prior distribution (e.g., Gaussian noises). However, such prior distribution is often independent of real data and thus may lose semantic information (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2018-06-15 Jiezhang Cao , Yong Guo , Qingyao Wu , Chunhua Shen , Junzhou Huang , Mingkui Tan

Deep generative models provide powerful tools for distributions over complicated manifolds, such as those of natural images. But many of these methods, including generative adversarial networks (GANs), can be difficult to train, in part…

Machine Learning · Statistics 2017-11-08 Akash Srivastava , Lazar Valkov , Chris Russell , Michael U. Gutmann , Charles Sutton

Standard adversarial training involves two agents, namely a generator and a discriminator, playing a mini-max game. However, even if the players converge to an equilibrium, the generator may only recover a part of the target data…

Machine Learning · Computer Science 2019-02-22 Botos Csaba , Adnane Boukhayma , Viveka Kulharia , András Horváth , Philip H. S. Torr

Generating diverse yet specific data is the goal of the generative adversarial network (GAN), but it suffers from the problem of mode collapse. We introduce the concept of normalized diversity which force the model to preserve the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Shaohui Liu , Xiao Zhang , Jianqiao Wangni , Jianbo Shi

A novel approach is suggested for improving the accuracy of fault detection in distribution networks. This technique combines adaptive probability learning and waveform decomposition to optimize the similarity of features. Its objective is…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Xinliang Ma , Weihua Liu , Bingying Jin

Generative Adversarial Networks (GANs) have become a popular method to learn a probability model from data. In this paper, we aim to provide an understanding of some of the basic issues surrounding GANs including their formulation,…

Machine Learning · Statistics 2018-10-23 Soheil Feizi , Farzan Farnia , Tony Ginart , David Tse

Generative adversarial networks have proven to be a powerful tool for learning complex and high-dimensional data distributions, but issues such as mode collapse have been shown to make it difficult to train them. This is an even harder…

Machine Learning · Computer Science 2022-11-01 Ebba Ekblom , Edvin Listo Zec , Olof Mogren

The training of Generative Adversarial Networks is a difficult task mainly due to the nature of the networks. One such issue is when the generator and discriminator start oscillating, rather than converging to a fixed point. Another case…

Machine Learning · Statistics 2018-02-08 Alexey Chaplygin , Joshua Chacksfield

A fundamental and still largely unsolved question in the context of Generative Adversarial Networks is whether they are truly able to capture the real data distribution and, consequently, to sample from it. In particular, the…

Machine Learning · Computer Science 2021-12-30 Ricard Durall , Janis Keuper

Performative Drift is a special type of Concept Drift that occurs when a model's predictions influence the future instances the model will encounter. In these settings, retraining is not always feasible. In this work, we instead focus on…

Machine Learning · Computer Science 2025-04-03 Maciej Makowski , Brandon Gower-Winter , Georg Krempl