English
Related papers

Related papers: Generalization and Equilibrium in Generative Adver…

200 papers

Despite the growing interest in generative adversarial networks (GANs), training GANs remains a challenging problem, both from a theoretical and a practical standpoint. To address this challenge, in this paper, we propose a novel way to…

Machine Learning · Computer Science 2018-11-27 Qunwei Li , Bhavya Kailkhura , Rushil Anirudh , Yi Zhou , Yingbin Liang , Pramod Varshney

Generative adversarial networks (GANs) are pow- erful generative models based on providing feed- back to a generative network via a discriminator network. However, the discriminator usually as- sesses individual samples. This prevents the…

Machine Learning · Computer Science 2018-06-20 Thomas Lucas , Corentin Tallec , Jakob Verbeek , Yann Ollivier

The Generative Adversarial Network (GAN) was recently introduced in the literature as a novel machine learning method for training generative models. It has many applications in statistics such as nonparametric clustering and nonparametric…

Machine Learning · Statistics 2023-06-26 Sehwan Kim , Qifan Song , Faming Liang

Besides the well-known classification task, these days neural networks are frequently being applied to generate or transform data, such as images and audio signals. In such tasks, the conventional loss functions like the mean squared error…

Generative Adversarial Networks (GANs) are a type of generative model which have received much attention due to their ability to model complex real-world data. Despite their recent successes, the process of training GANs remains…

Machine Learning · Computer Science 2020-03-26 Maciej Wiatrak , Stefano V. Albrecht , Andrew Nystrom

Generative adversarial networks (GANs) form a generative modeling approach known for producing appealing samples, but they are notably difficult to train. One common way to tackle this issue has been to propose new formulations of the GAN…

Machine Learning · Computer Science 2020-09-01 Gauthier Gidel , Hugo Berard , Gaëtan Vignoud , Pascal Vincent , Simon Lacoste-Julien

Do GANS (Generative Adversarial Nets) actually learn the target distribution? The foundational paper of (Goodfellow et al 2014) suggested they do, if they were given sufficiently large deep nets, sample size, and computation time. A recent…

Machine Learning · Computer Science 2017-07-04 Sanjeev Arora , Yi Zhang

Generative Adversarial Networks have become one of the most studied frameworks for unsupervised learning due to their intuitive formulation. They have also been shown to be capable of generating convincing examples in limited domains, such…

Machine Learning · Computer Science 2016-12-14 Daniel Jiwoong Im , He Ma , Chris Dongjoo Kim , Graham Taylor

Generative adversarial networks have been very successful in generative modeling, however they remain relatively challenging to train compared to standard deep neural networks. In this paper, we propose new visualization techniques for the…

Machine Learning · Computer Science 2020-04-28 Hugo Berard , Gauthier Gidel , Amjad Almahairi , Pascal Vincent , Simon Lacoste-Julien

In recent years, Generative Adversarial Networks (GANs) have received significant attention from the research community. With a straightforward implementation and outstanding results, GANs have been used for numerous applications. Despite…

Machine Learning · Computer Science 2019-08-01 P Manisha , Sujit Gujar

Generative Adversarial Networks (GANs) have been successful in producing outstanding results in areas as diverse as image, video, and text generation. Building on these successes, a large number of empirical studies have validated the…

Machine Learning · Computer Science 2021-06-21 Gérard Biau , Maxime Sangnier , Ugo Tanielian

Many applications in machine learning can be framed as minimization problems and solved efficiently using gradient-based techniques. However, recent applications of generative models, particularly GANs, have triggered interest in solving…

Machine Learning · Computer Science 2021-03-24 Paulina Grnarova , Yannic Kilcher , Kfir Y. Levy , Aurelien Lucchi , Thomas Hofmann

This paper studies how well generative adversarial networks (GANs) learn probability distributions from finite samples. Our main results establish the convergence rates of GANs under a collection of integral probability metrics defined…

Machine Learning · Computer Science 2022-06-10 Jian Huang , Yuling Jiao , Zhen Li , Shiao Liu , Yang Wang , Yunfei Yang

We propose Hellinger-type loss functions for training Generative Adversarial Networks (GANs), motivated by the boundedness, symmetry, and robustness properties of the Hellinger distance. We define an adversarial objective based on this…

Machine Learning · Statistics 2025-12-16 Giovanni Saraceno , Anand N. Vidyashankar , Claudio Agostinelli

Generative adversarial networks (GANs) generate data based on minimizing a divergence between two distributions. The choice of that divergence is therefore critical. We argue that the divergence must take into account the hypothesis set and…

Machine Learning · Computer Science 2019-11-07 Ben Adlam , Corinna Cortes , Mehryar Mohri , Ningshan Zhang

Generative adversarial networks have achieved remarkable performance on various tasks but suffer from training instability. Despite many training strategies proposed to improve training stability, this issue remains as a challenge. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Faqiang Liu , Mingkun Xu , Guoqi Li , Jing Pei , Luping Shi , Rong Zhao

We propose a novel technique to make neural network robust to adversarial examples using a generative adversarial network. We alternately train both classifier and generator networks. The generator network generates an adversarial…

Machine Learning · Computer Science 2023-07-06 Hyeungill Lee , Sungyeob Han , Jungwoo Lee

Generative adversarial networks (GANs) has gained tremendous popularity lately due to an ability to reinforce quality of its predictive model with generated objects and the quality of the generative model with and supervised feedback. GANs…

Computer Vision and Pattern Recognition · Computer Science 2017-05-31 Evgeny Zamyatin , Andrey Filchenkov

Semi-supervised learning methods based on generative adversarial networks (GANs) obtained strong empirical results, but it is not clear 1) how the discriminator benefits from joint training with a generator, and 2) why good semi-supervised…

Machine Learning · Computer Science 2017-11-06 Zihang Dai , Zhilin Yang , Fan Yang , William W. Cohen , Ruslan Salakhutdinov

In this paper, we analyze the numerics of common algorithms for training Generative Adversarial Networks (GANs). Using the formalism of smooth two-player games we analyze the associated gradient vector field of GAN training objectives. Our…

Machine Learning · Computer Science 2018-06-12 Lars Mescheder , Sebastian Nowozin , Andreas Geiger