English
Related papers

Related papers: Generalization error property of infoGAN for two-l…

200 papers

We investigate under and overfitting in Generative Adversarial Networks (GANs), using discriminators unseen by the generator to measure generalization. We find that the model capacity of the discriminator has a significant effect on the…

Machine Learning · Statistics 2019-11-01 Ben Adlam , Charles Weill , Amol Kapoor

A Triangle Generative Adversarial Network ($\Delta$-GAN) is developed for semi-supervised cross-domain joint distribution matching, where the training data consists of samples from each domain, and supervision of domain correspondence is…

Machine Learning · Computer Science 2017-11-21 Zhe Gan , Liqun Chen , Weiyao Wang , Yunchen Pu , Yizhe Zhang , Hao Liu , Chunyuan Li , Lawrence Carin

Generative adversarial networks (GANs) are a class of generative models, known for producing accurate samples. The key feature of GANs is that there are two antagonistic neural networks: the generator and the discriminator. The main…

Machine Learning · Computer Science 2025-08-05 Barbara Franci , Sergio Grammatico

Many supervised machine learning methods are naturally cast as optimization problems. For prediction models which are linear in their parameters, this often leads to convex problems for which many mathematical guarantees exist. Models which…

Machine Learning · Computer Science 2021-10-18 Francis Bach , Lenaïc Chizat

Generative Adversarial Networks (GANs) have significantly advanced image synthesis, however, the synthesis quality drops significantly given a limited amount of training data. To improve the data efficiency of GAN training, prior work…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Ceyuan Yang , Yujun Shen , Yinghao Xu , Bolei Zhou

In this paper, we study a physics-informed algorithm for Wasserstein Generative Adversarial Networks (WGANs) for uncertainty quantification in solutions of partial differential equations. By using groupsort activation functions in…

Numerical Analysis · Mathematics 2022-08-10 Yihang Gao , Michael K. Ng

We study overparameterization in generative adversarial networks (GANs) that can interpolate the training data. We show that overparameterization can improve generalization performance and accelerate the training process. We study the…

Machine Learning · Computer Science 2024-05-02 Lorenzo Luzi , Yehuda Dar , Richard Baraniuk

Generative Adversarial Networks (GAN) are among the widely used Generative models in various applications. However, the original GAN architecture may memorize the distribution of the training data and, therefore, poses a threat to…

Machine Learning · Computer Science 2024-10-11 Nirob Arefin

Generative adversarial networks (GANs) have enjoyed much success in learning high-dimensional distributions. Learning objectives approximately minimize an $f$-divergence ($f$-GANs) or an integral probability metric (Wasserstein GANs)…

Machine Learning · Computer Science 2020-06-19 Jiaming Song , Stefano Ermon

One way to expand the available dataset for training AI models in the medical field is through the use of Generative Adversarial Networks (GANs) for data augmentation. GANs work by employing a generator network to create new data samples…

Artificial Intelligence · Computer Science 2023-06-09 Angona Biswas , MD Abdullah Al Nasim , Al Imran , Anika Tabassum Sejuty , Fabliha Fairooz , Sai Puppala , Sajedul Talukder

Deep generative models, such as Generative Adversarial Networks (GANs), synthesize diverse high-fidelity data samples by estimating the underlying distribution of high dimensional data. Despite their success, GANs may disclose private…

Machine Learning · Computer Science 2022-06-02 Parisa Hassanzadeh , Robert E. Tillman

Generative Adversarial Networks (GANs) are widely used models to learn complex real-world distributions. In GANs, the training of the generator usually stops when the discriminator can no longer distinguish the generator's output from the…

Machine Learning · Computer Science 2021-02-19 Yuanzhi Li , Zehao Dou

Despite the dramatic success in image generation, Generative Adversarial Networks (GANs) still face great challenges in synthesizing sequences of discrete elements, in particular human language. The difficulty in generator training arises…

Computation and Language · Computer Science 2023-02-24 Yekun Chai , Qiyue Yin , Junge Zhang

Generative Adversarial Networks (GANs) have been shown to be powerful and flexible priors when solving inverse problems. One challenge of using them is overcoming representation error, the fundamental limitation of the network in…

Machine Learning · Computer Science 2022-04-12 Sean Gunn , Jorio Cocola , Paul Hand

In terms of Generative Adversarial Networks (GANs), the information metric to discriminate the generative data from the real data, lies in the key point of generation efficiency, which plays an important role in GAN-based applications,…

Machine Learning · Computer Science 2021-01-08 Rui She , Pingyi Fan

In this article, we study rates of convergence of the generalization error of multi-class margin classifiers. In particular, we develop an upper bound theory quantifying the generalization error of various large margin classifiers. The…

Statistics Theory · Mathematics 2011-11-10 Xiaotong Shen , Lifeng Wang

Generative Adversarial Networks (GANs) have become the gold standard when it comes to learning generative models for high-dimensional distributions. Since their advent, numerous variations of GANs have been introduced in the literature,…

Machine Learning · Computer Science 2019-10-15 Grigorios Chrysos , Stylianos Moschoglou , Yannis Panagakis , Stefanos Zafeiriou

Transformer-based language models have achieved state-of-the-art performance in natural language generation (NLG), yet their internal mechanisms for synthesizing task-relevant information remain insufficiently understood. While prior…

Computation and Language · Computer Science 2026-04-07 Ruidi Chang , Chunyuan Deng , Hanjie Chen

The goal of anomaly detection is to identify anomalous samples from normal ones. In this paper, a small number of anomalies are assumed to be available at the training stage, but they are assumed to be collected only from several anomaly…

Machine Learning · Computer Science 2022-05-03 Bowen Tian , Qinliang Su , Jian Yin

The Generative Adversarial Network (GAN) was recently introduced in the literature as a novel machine learning method for training generative models. It has many applications in statistics such as nonparametric clustering and nonparametric…

Machine Learning · Statistics 2023-06-26 Sehwan Kim , Qifan Song , Faming Liang