English
Related papers

Related papers: Statistical Error Bounds for GANs with Nonlinear O…

200 papers

We investigate the impact of the input dimension on the generalization error in generative adversarial networks (GANs). In particular, we first provide both theoretical and practical evidence to validate the existence of an optimal input…

Machine Learning · Computer Science 2024-05-08 Zhiyao Tan , Ling Zhou , Huazhen Lin

We study minimax convergence rates of nonparametric density estimation under a large class of loss functions called "adversarial losses", which, besides classical $\mathcal{L}^p$ losses, includes maximum mean discrepancy (MMD), Wasserstein…

Statistics Theory · Mathematics 2018-10-30 Shashank Singh , Ananya Uppal , Boyue Li , Chun-Liang Li , Manzil Zaheer , Barnabás Póczos

Generative Adversarial Networks have been crucial in the developments made in unsupervised learning in recent times. Exemplars of image synthesis from text or other images, these networks have shown remarkable improvements over conventional…

Machine Learning · Computer Science 2019-09-02 Rohan Akut , Sumukh Marathe , Rucha Apte , Ishan Joshi , Siddhivinayak Kulkarni

Generative adversarial networks (GANs) are successfully used for image synthesis but are known to face instability during training. In contrast, probabilistic diffusion models (DMs) are stable and generate high-quality images, at the cost…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Edgardo Solano-Carrillo , Angel Bueno Rodriguez , Borja Carrillo-Perez , Yannik Steiniger , Jannis Stoppe

Generative Adversarial Networks (GANs) can produce high-quality samples, but do not provide an estimate of the probability density around the samples. However, it has been noted that maximizing the log-likelihood within an energy-based…

Machine Learning · Computer Science 2023-10-03 Omri Ben-Dov , Pravir Singh Gupta , Victoria Abrevaya , Michael J. Black , Partha Ghosh

Generative adversarial networks (GANs) are a powerful approach to unsupervised learning. They have achieved state-of-the-art performance in the image domain. However, GANs are limited in two ways. They often learn distributions with low…

Machine Learning · Statistics 2019-10-11 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei , Michalis K. Titsias

In an effort to address the training instabilities of GANs, we introduce a class of dual-objective GANs with different value functions (objectives) for the generator (G) and discriminator (D). In particular, we model each objective using…

Machine Learning · Computer Science 2023-05-04 Monica Welfert , Kyle Otstot , Gowtham R. Kurri , Lalitha Sankar

Estimation of Distribution Algorithms (EDAs) require flexible probability models that can be efficiently learned and sampled. Generative Adversarial Networks (GAN) are generative neural networks which can be trained to implicitly model the…

Neural and Evolutionary Computing · Computer Science 2016-08-09 Malte Probst

Generative adversarial networks (GANs) have been shown to provide an effective way to model complex distributions and have obtained impressive results on various challenging tasks. However, typical GANs require fully-observed data during…

Machine Learning · Computer Science 2019-02-27 Steven Cheng-Xian Li , Bo Jiang , Benjamin Marlin

Generative adversarial networks (GANs) are emerging machine learning models for generating synthesized data similar to real data by jointly training a generator and a discriminator. In many applications, data and computational resources are…

Machine Learning · Computer Science 2021-07-20 Jinke Ren , Chonghe Liu , Guanding Yu , Dongning Guo

Unsupervised learning with generative adversarial networks (GANs) has proven to be hugely successful. Regular GANs hypothesize the discriminator as a classifier with the sigmoid cross entropy loss function. However, we found that this loss…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Xudong Mao , Qing Li , Haoran Xie , Raymond Y. K. Lau , Zhen Wang , Stephen Paul Smolley

As a revolutionary generative paradigm of deep learning, generative adversarial networks (GANs) have been widely applied in various fields to synthesize realistic data. However, it is challenging for conventional GANs to synthesize raw…

Signal Processing · Electrical Eng. & Systems 2023-06-27 Weidong Wang , Jiancheng An , Hongshu Liao , Lu Gan , Chau Yuen

Tuning curves characterizing the response selectivities of biological neurons often exhibit large degrees of irregularity and diversity across neurons. Theoretical network models that feature heterogeneous cell populations or random…

Quantitative Methods · Quantitative Biology 2017-07-20 Takafumi Arakaki , G. Barello , Yashar Ahmadian

Generative Adversarial Networks (GANs) have been promising in the field of image generation, however, they have been hard to train for language generation. GANs were originally designed to output differentiable values, so discrete language…

Machine Learning · Computer Science 2018-07-04 Mehrad Moradshahi , Utkarsh Contractor

Generative adversarial networks (GANs) were initially proposed to generate images by learning from a large number of samples. Recently, GANs have been used to emulate complex physical systems such as turbulent flows. However, a critical…

Computational Physics · Physics 2020-11-24 Zeng Yang , Jin-Long Wu , Heng Xiao

Generative models estimate the underlying distribution of a dataset to generate realistic samples according to that distribution. In this paper, we present the first membership inference attacks against generative models: given a data…

Cryptography and Security · Computer Science 2018-08-22 Jamie Hayes , Luca Melis , George Danezis , Emiliano De Cristofaro

This paper presents a methodology and workflow that overcome the limitations of the conventional Generative Adversarial Networks (GANs) for geological facies modeling. It attempts to improve the training stability and guarantee the…

Machine Learning · Computer Science 2019-09-25 Lingchen Zhu , Tuanfeng Zhang

We derive nearly sharp bounds for the bidirectional GAN (BiGAN) estimation error under the Dudley distance between the latent joint distribution and the data joint distribution with appropriately specified architecture of the neural…

Machine Learning · Computer Science 2021-10-26 Shiao Liu , Yunfei Yang , Jian Huang , Yuling Jiao , Yang Wang

Generative adversarial networks (GANs) learn a target probability distribution by optimizing a generator and a discriminator with minimax objectives. This paper addresses the question of whether such optimization actually provides the…

Machine Learning · Computer Science 2024-04-11 Yuhta Takida , Masaaki Imaizumi , Takashi Shibuya , Chieh-Hsin Lai , Toshimitsu Uesaka , Naoki Murata , Yuki Mitsufuji

In recent years, Generative Adversarial Networks (GANs) have shown substantial progress in modeling complex distributions of data. These networks have received tremendous attention since they can generate implicit probabilistic models that…

Signal Processing · Electrical Eng. & Systems 2018-10-25 Mehdi Ahmadi , Timothy Nest , Mostafa Abdelnaim , Thanh-Dung Le