English
Related papers

Related papers: Learning Distributions by Generative Adversarial N…

200 papers

This paper studies how well generative adversarial networks (GANs) learn probability distributions from finite samples. Our main results establish the convergence rates of GANs under a collection of integral probability metrics defined…

Machine Learning · Computer Science 2022-06-10 Jian Huang , Yuling Jiao , Zhen Li , Shiao Liu , Yang Wang , Yunfei Yang

This paper studies the rates of convergence for learning distributions implicitly with the adversarial framework and Generative Adversarial Networks (GANs), which subsume Wasserstein, Sobolev, MMD GAN, and Generalized/Simulated Method of…

Statistics Theory · Mathematics 2021-10-12 Tengyuan Liang

We study in this paper the rate of convergence for learning densities under the Generative Adversarial Networks (GAN) framework, borrowing insights from nonparametric statistics. We introduce an improved GAN estimator that achieves a faster…

Machine Learning · Statistics 2018-02-20 Tengyuan Liang

Generative Adversarial Networks (GANs) have achieved a great success in unsupervised learning. Despite its remarkable empirical performance, there are limited theoretical studies on the statistical properties of GANs. This paper provides…

Machine Learning · Computer Science 2022-07-22 Minshuo Chen , Wenjing Liao , Hongyuan Zha , Tuo Zhao

The generative adversarial network (GAN) is an important model developed for high-dimensional distribution learning in recent years. However, there is a pressing need for a comprehensive method to understand its error convergence rate. In…

Machine Learning · Statistics 2023-10-25 Mahmud Hasan , Hailin Sang

Generative adversarial networks (GAN) approximate a target data distribution by jointly optimizing an objective function through a "two-player game" between a generator and a discriminator. Despite their empirical success, however, two very…

Machine Learning · Computer Science 2017-05-30 Shuang Liu , Olivier Bousquet , Kamalika Chaudhuri

This paper studies the approximation capacity of ReLU neural networks with norm constraint on the weights. We prove upper and lower bounds on the approximation error of these networks for smooth function classes. The lower bound is derived…

Machine Learning · Computer Science 2023-03-31 Yuling Jiao , Yang Wang , Yunfei Yang

The generative adversarial network (GAN) is a well-known model for learning high-dimensional distributions, but the mechanism for its generalization ability is not understood. In particular, GAN is vulnerable to the memorization phenomenon,…

Machine Learning · Computer Science 2026-02-18 Hongkang Yang , Weinan E

Arguably the most fundamental question in the theory of generative adversarial networks (GANs) is to understand to what extent GANs can actually learn the underlying distribution. Theoretical and empirical evidence suggests local optimality…

Machine Learning · Computer Science 2022-01-19 Sitan Chen , Jerry Li , Yuanzhi Li , Raghu Meka

Studied here are Wasserstein generative adversarial networks (WGANs) with GroupSort neural networks as their discriminators. It is shown that the error bound of the approximation for the target distribution depends on the width and depth…

Machine Learning · Computer Science 2023-07-03 Yihang Gao , Michael K. Ng , Mingjie Zhou

We study the efficacy and efficiency of deep generative networks for approximating probability distributions. We prove that neural networks can transform a low-dimensional source distribution to a distribution that is arbitrarily close to a…

Machine Learning · Computer Science 2023-12-05 Yunfei Yang , Zhen Li , Yang Wang

While Generative Adversarial Networks (GANs) have empirically produced impressive results on learning complex real-world distributions, recent works have shown that they suffer from lack of diversity or mode collapse. The theoretical work…

Machine Learning · Computer Science 2019-07-02 Yu Bai , Tengyu Ma , Andrej Risteski

Do GANS (Generative Adversarial Nets) actually learn the target distribution? The foundational paper of (Goodfellow et al 2014) suggested they do, if they were given sufficiently large deep nets, sample size, and computation time. A recent…

Machine Learning · Computer Science 2017-07-04 Sanjeev Arora , Yi Zhang

Generative adversarial networks (GANs) are among the most successful models for learning high-complexity, real-world distributions. However, in theory, due to the highly non-convex, non-concave landscape of the minmax training objective,…

Machine Learning · Computer Science 2023-04-04 Zeyuan Allen-Zhu , Yuanzhi Li

Generative Adversarial Networks (GANs) are widely used models to learn complex real-world distributions. In GANs, the training of the generator usually stops when the discriminator can no longer distinguish the generator's output from the…

Machine Learning · Computer Science 2021-02-19 Yuanzhi Li , Zehao Dou

Generative adversarial networks (GANs) are unsupervised learning methods for training a generator distribution to produce samples that approximate those drawn from a target distribution. Many such methods can be formulated as minimization…

Machine Learning · Statistics 2025-05-13 Jeremiah Birrell

It is common in nonparametric estimation problems to impose a certain low-dimensional structure on the unknown parameter to avoid the curse of dimensionality. This paper considers a nonparametric distribution estimation problem with a…

Statistics Theory · Mathematics 2025-02-28 Jeyong Lee , Hyeok Kyu Kwon , Minwoo Chae

Generative adversarial networks (GANs) are powerful generative models, but usually suffer from instability and generalization problem which may lead to poor generations. Most existing works focus on stabilizing the training of the…

Machine Learning · Computer Science 2020-04-29 Shufei Zhang , Zhuang Qian , Kaizhu Huang , Jimin Xiao , Yuan He

Generative adversarial networks (GANs) are deep neural networks that allow us to sample from an arbitrary probability distribution without explicitly estimating the distribution. There is a generator that takes a latent vector as input and…

Machine Learning · Computer Science 2021-06-22 Alper Ahmetoğlu , Ethem Alpaydın

Generative Adversarial Networks (GANs) have proven to be a powerful framework for learning to draw samples from complex distributions. However, GANs are also notoriously difficult to train, with mode collapse and oscillations a common…

Machine Learning · Statistics 2018-11-28 Kevin J Liang , Chunyuan Li , Guoyin Wang , Lawrence Carin
‹ Prev 1 2 3 10 Next ›