English
Related papers

Related papers: Investigating Under and Overfitting in Wasserstein…

200 papers

Generative modelling is often cast as minimizing a similarity measure between a data distribution and a model distribution. Recently, a popular choice for the similarity measure has been the Wasserstein metric, which can be expressed in the…

Machine Learning · Computer Science 2019-10-10 Anton Mallasto , Guido Montúfar , Augusto Gerolin

Interpolations in the latent space of deep generative models is one of the standard tools to synthesize semantically meaningful mixtures of generated samples. As the generator function is non-linear, commonly used linear interpolations in…

Machine Learning · Computer Science 2022-03-03 Henning Petzka , Ted Kronvall , Cristian Sminchisescu

For the integration of renewable energy sources, power grid operators need realistic information about the effects of energy production and consumption to assess grid stability. Recently, research in scenario planning benefits from…

Machine Learning · Computer Science 2019-06-04 Jens Schreiber , Maik Jessulat , Bernhard Sick

Recently, generative adversarial networks (GANs) have shown promising performance in generating realistic images. However, they often struggle in learning complex underlying modalities in a given dataset, resulting in poor-quality generated…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 David Keetae Park , Seungjoo Yoo , Hyojin Bahng , Jaegul Choo , Noseong Park

Generative Adversarial Nets (GANs) have shown promise in image generation and semi-supervised learning (SSL). However, existing GANs in SSL have two problems: (1) the generator and the discriminator (i.e. the classifier) may not be optimal…

Machine Learning · Computer Science 2017-11-07 Chongxuan Li , Kun Xu , Jun Zhu , Bo Zhang

Generative Adversarial Networks (GANs) have become a powerful framework to learn generative models that arise across a wide variety of domains. While there has been a recent surge in the development of numerous GAN architectures with…

Information Theory · Computer Science 2019-08-13 Jaewoong Cho , Changho Suh

Class imbalance is a common problem in supervised learning and impedes the predictive performance of classification models. Popular countermeasures include oversampling the minority class. Standard methods like SMOTE rely on finding nearest…

Machine Learning · Computer Science 2020-08-24 Justin Engelmann , Stefan Lessmann

Training generative adversarial networks (GAN) using too little data typically leads to discriminator overfitting, causing training to diverge. We propose an adaptive discriminator augmentation mechanism that significantly stabilizes…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Tero Karras , Miika Aittala , Janne Hellsten , Samuli Laine , Jaakko Lehtinen , Timo Aila

Generative-adversarial networks (GANs) have been used to produce data closely resembling example data in a compressed, latent space that is close to sufficient for reconstruction in the original vector space. The Wasserstein metric has been…

Machine Learning · Statistics 2022-10-10 Oliver Serang

Generative adversarial networks (GANs) are deep neural networks that allow us to sample from an arbitrary probability distribution without explicitly estimating the distribution. There is a generator that takes a latent vector as input and…

Machine Learning · Computer Science 2021-06-22 Alper Ahmetoğlu , Ethem Alpaydın

Generative Adversarial Networks (GANs) have been impactful on many problems and applications but suffer from unstable training. The Wasserstein GAN (WGAN) leverages the Wasserstein distance to avoid the caveats in the minmax two-player…

Machine Learning · Statistics 2021-09-14 Yao Chen , Qingyi Gao , Xiao Wang

Training generative adversarial networks is unstable in high-dimensions as the true data distribution tends to be concentrated in a small fraction of the ambient space. The discriminator is then quickly able to classify nearly all generated…

Machine Learning · Computer Science 2018-06-26 Behnam Neyshabur , Srinadh Bhojanapalli , Ayan Chakrabarti

A broad class of unsupervised deep learning methods such as Generative Adversarial Networks (GANs) involve training of overparameterized models where the number of parameters of the model exceeds a certain threshold. A large body of work in…

We study how well generative adversarial networks (GAN) learn probability distributions from finite samples by analyzing the convergence rates of these models. Our analysis is based on a new oracle inequality that decomposes the estimation…

Machine Learning · Computer Science 2022-05-26 Yunfei Yang

In recent years, Generative Adversarial Networks (GANs) have become a hot topic among researchers and engineers that work with deep learning. It has been a ground-breaking technique which can generate new pieces of content of data in a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Parthak Mehta , Sarthak Mishra , Nikhil Chouhan , Neel Pethani , Ishani Saha

Although deep neural networks are effective on supervised learning tasks, they have been shown to be brittle. They are prone to overfitting on their training distribution and are easily fooled by small adversarial perturbations. In this…

Machine Learning · Computer Science 2020-10-07 Laëtitia Shao , Yang Song , Stefano Ermon

Generative adversarial networks (GANs) are a widely used framework for learning generative models. Wasserstein GANs (WGANs), one of the most successful variants of GANs, require solving a minmax optimization problem to global optimality,…

Machine Learning · Computer Science 2020-07-03 Qi Lei , Jason D. Lee , Alexandros G. Dimakis , Constantinos Daskalakis

Despite being impactful on a variety of problems and applications, the generative adversarial nets (GANs) are remarkably difficult to train. This issue is formally analyzed by \cite{arjovsky2017towards}, who also propose an alternative…

Computer Vision and Pattern Recognition · Computer Science 2018-03-06 Xiang Wei , Boqing Gong , Zixia Liu , Wei Lu , Liqiang Wang

The problem of anomaly detection in astronomical surveys is becoming increasingly important as data sets grow in size. We present the results of an unsupervised anomaly detection method using a Wasserstein generative adversarial network…

In recent years, Generative Adversarial Networks (GANs) have drawn a lot of attentions for learning the underlying distribution of data in various applications. Despite their wide applicability, training GANs is notoriously difficult. This…

Machine Learning · Computer Science 2019-04-23 Babak Barazandeh , Meisam Razaviyayn , Maziar Sanjabi