English
Related papers

Related papers: Investigating Under and Overfitting in Wasserstein…

200 papers

Generative adversarial networks (GANs) have proven effective in modeling distributions of high-dimensional data. However, their training instability is a well-known hindrance to convergence, which results in practical challenges in their…

Machine Learning · Computer Science 2022-09-28 Alessandro Ferrero , Shireen Elhabian , Ross Whitaker

Generative adversarial networks (GANs) are capable of producing high quality image samples. However, unlike variational autoencoders (VAEs), GANs lack encoders that provide the inverse mapping for the generators, i.e., encode images back to…

Machine Learning · Statistics 2018-12-20 Paul K. Rubenstein , Yunpeng Li , Dominik Roblek

We introduce the "Energy-based Generative Adversarial Network" model (EBGAN) which views the discriminator as an energy function that attributes low energies to the regions near the data manifold and higher energies to other regions.…

Machine Learning · Computer Science 2017-03-08 Junbo Zhao , Michael Mathieu , Yann LeCun

Research on generalization bounds for deep networks seeks to give ways to predict test error using just the training dataset and the network parameters. While generalization bounds can give many insights about architecture design, training…

Machine Learning · Computer Science 2022-03-21 Yi Zhang , Arushi Gupta , Nikunj Saunshi , Sanjeev Arora

We examine Generative Adversarial Networks (GANs) through the lens of deep Energy Based Models (EBMs), with the goal of exploiting the density model that follows from this formulation. In contrast to a traditional view where the…

Machine Learning · Computer Science 2019-10-30 Shuangfei Zhai , Walter Talbott , Carlos Guestrin , Joshua M. Susskind

Thanks to their remarkable generative capabilities, GANs have gained great popularity, and are used abundantly in state-of-the-art methods and applications. In a GAN based model, a discriminator is trained to learn the real data…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Firas Shama , Roey Mechrez , Alon Shoshan , Lihi Zelnik-Manor

Generative Adversarial Networks (GANs) are widely used models to learn complex real-world distributions. In GANs, the training of the generator usually stops when the discriminator can no longer distinguish the generator's output from the…

Machine Learning · Computer Science 2021-02-19 Yuanzhi Li , Zehao Dou

Generative Adversarial Nets (GANs) are very successful at modeling distributions from given samples, even in the high-dimensional case. However, their formulation is also known to be hard to optimize and often not stable. While this is…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Ishan Deshpande , Ziyu Zhang , Alexander Schwing

Generative adversarial networks (GANs) are a class of machine-learning models that use adversarial training to generate new samples with the same (potentially very complex) statistics as the training samples. One major form of training…

Disordered Systems and Neural Networks · Physics 2022-12-12 Steven Durr , Youssef Mroueh , Yuhai Tu , Shenshen Wang

Generative Adversarial Networks (GANs) are a widely-used tool for generative modeling of complex data. Despite their empirical success, the training of GANs is not fully understood due to the min-max optimization of the generator and…

Machine Learning · Computer Science 2022-08-23 Evan Becker , Parthe Pandit , Sundeep Rangan , Alyson K. Fletcher

We investigate the training and performance of generative adversarial networks using the Maximum Mean Discrepancy (MMD) as critic, termed MMD GANs. As our main theoretical contribution, we clarify the situation with bias in GAN loss…

Machine Learning · Statistics 2021-01-15 Mikołaj Bińkowski , Danica J. Sutherland , Michael Arbel , Arthur Gretton

Most existing GANs architectures that generate images use transposed convolution or resize-convolution as their upsampling algorithm from lower to higher resolution feature maps in the generator. We argue that this kind of fixed operation…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Nhat M. Nguyen , Nilanjan Ray

Standard formulations of GANs, where a continuous function deforms a connected latent space, have been shown to be misspecified when fitting different classes of images. In particular, the generator will necessarily sample some low-quality…

Machine Learning · Computer Science 2021-10-20 Thibaut Issenhuth , Ugo Tanielian , David Picard , Jeremie Mary

Generative Adversarial Networks (GANs) are a recent advancement in unsupervised machine learning. They are a cat-and-mouse game between two neural networks: [1] a discriminator network which learns to validate whether a sample is real or…

Cosmology and Nongalactic Astrophysics · Physics 2020-06-23 Olivia Curtis , Tereasa G. Brainerd

As machine learning continues to develop, and data misuse scandals become more prevalent, individuals are becoming increasingly concerned about their personal information and are advocating for the right to remove their data. Machine…

Machine Learning · Computer Science 2023-08-22 Hui Sun , Tianqing Zhu , Wenhan Chang , Wanlei Zhou

Generative adversarial networks (GANs) are a novel approach to generative modelling, a task whose goal it is to learn a distribution of real data points. They have often proved difficult to train: GANs are unlike many techniques in machine…

Machine Learning · Computer Science 2018-07-02 Samuel A. Barnett

Recent work has shown that exploiting relations between labels improves the performance of multi-label classification. We propose a novel framework based on generative adversarial networks (GANs) to model label dependency. The discriminator…

Machine Learning · Computer Science 2018-11-13 Che-Ping Tsai , Hung-Yi Lee

Generative Adversarial Networks (GANs) have brought about rapid progress towards generating photorealistic images. Yet the equitable allocation of their modeling capacity among subgroups has received less attention, which could lead to…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Ning Yu , Ke Li , Peng Zhou , Jitendra Malik , Larry Davis , Mario Fritz

Generative Adversarial Networks (GANs) is a powerful family of models that learn an underlying distribution to generate synthetic data. Many existing studies of GANs focus on improving the realness of the generated image data for visual…

Machine Learning · Computer Science 2021-11-04 Si-An Chen , Chun-Liang Li , Hsuan-Tien Lin

Lack of ground-truth MR images impedes the common supervised training of neural networks for image reconstruction. To cope with this challenge, this paper leverages unpaired adversarial training for reconstruction networks, where the inputs…

Image and Video Processing · Electrical Eng. & Systems 2021-05-14 Ke Lei , Morteza Mardani , John M. Pauly , Shreyas S. Vasanawala