English
Related papers

Related papers: On Predicting Generalization using GANs

200 papers

We propose a novel theoretical framework of analysis for Generative Adversarial Networks (GANs). We reveal a fundamental flaw of previous analyses which, by incorrectly modeling GANs' training scheme, are subject to ill-defined…

Empirical studies show that gradient-based methods can learn deep neural networks (DNNs) with very good generalization performance in the over-parameterization regime, where DNNs can easily fit a random labeling of the training data. Very…

Machine Learning · Computer Science 2019-11-28 Yuan Cao , Quanquan Gu

Generative networks are fundamentally different in their aim and methods compared to CNNs for classification, segmentation, or object detection. They have initially not been meant to be an image analysis tool, but to produce naturally…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Markus Wenzel

Graph Neural Networks (GNNs) have become the standard method for learning from networks across fields ranging from biology to social systems, yet a principled understanding of what enables them to extract meaningful representations, or why…

Machine Learning · Statistics 2026-03-19 Nil Ayday , Mahalakshmi Sabanayagam , Debarghya Ghoshdastidar

Pseudo-random number generators (PRNG) are a fundamental element of many security algorithms. We introduce a novel approach to their implementation, by proposing the use of generative adversarial networks (GAN) to train a neural network to…

Machine Learning · Computer Science 2018-10-02 Marcello De Bernardi , MHR Khouzani , Pasquale Malacaria

Generative Adversarial Networks are used for generating the data using a generator and a discriminator, GANs usually produce high-quality images, but training GANs in an adversarial setting is a difficult task. GANs require high computation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Md Nurul Muttakin , Malik Shahid Sultan , Robert Hoehndorf , Hernando Ombao

Despite continuous improvements, precipitation forecasts are still not as accurate and reliable as those of other meteorological variables. A major contributing factor to this is that several key processes affecting precipitation…

Atmospheric and Oceanic Physics · Physics 2022-11-09 Lucy Harris , Andrew T. T. McRae , Matthew Chantry , Peter D. Dueben , Tim N. Palmer

Deep neural networks have been applied in wireless communications system to intelligently adapt to dynamically changing channel conditions, while the users are still under the threat of the malicious attacks due to the broadcasting property…

Information Theory · Computer Science 2025-05-02 Jianyuan Chen , Lin Zhang , Zuwei Chen , Yawen Chen , Hongcheng Zhuang

Generative Adversarial Networks (GANs) are well-known tools for data generation and semi-supervised classification. GANs, with less labeled data, outperform Deep Neural Networks (DNNs) and Convolutional Neural Networks (CNNs) in…

Machine Learning · Computer Science 2021-10-28 Ryan Nguyen , Shubhendu Kumar Singh , Rahul Rai

Deep learning's success has led to larger and larger models to handle more and more complex tasks; trained models can contain millions of parameters. These large models are compute- and memory-intensive, which makes it a challenge to deploy…

Machine Learning · Computer Science 2023-05-19 Chong Yu , Jeff Pool

Long-range time series forecasting is usually based on one of two existing forecasting strategies: Direct Forecasting and Iterative Forecasting, where the former provides low bias, high variance forecasts and the later leads to low…

Machine Learning · Computer Science 2022-08-08 Shiyu Liu , Rohan Ghosh , Mehul Motani

Estimating the Generalization Error (GE) of Deep Neural Networks (DNNs) is an important task that often relies on availability of held-out data. The ability to better predict GE based on a single training set may yield overarching DNN…

Machine Learning · Computer Science 2022-07-20 Angus Galloway , Anna Golubeva , Mahmoud Salem , Mihai Nica , Yani Ioannou , Graham W. Taylor

Insufficient training data is a major bottleneck for most deep learning practices, not least in medical imaging where data is difficult to collect and publicly available datasets are scarce due to ethics and privacy. This work investigates…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Gabriel Eilertsen , Apostolia Tsirikoglou , Claes Lundström , Jonas Unger

We introduce the Probabilistic Generative Adversarial Network (PGAN), a new GAN variant based on a new kind of objective function. The central idea is to integrate a probabilistic model (a Gaussian Mixture Model, in our case) into the GAN…

Machine Learning · Computer Science 2017-08-08 Hamid Eghbal-zadeh , Gerhard Widmer

In this paper, an image recognition algorithm based on the combination of deep learning and generative adversarial network (GAN) is studied, and compared with traditional image recognition methods. The purpose of this study is to evaluate…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Yihao Zhong , Yijing Wei , Yingbin Liang , Xiqing Liu , Rongwei Ji , Yiru Cang

Generative Adversarial Networks (GANs) are proficient at generating synthetic data but continue to suffer from mode collapse, where the generator produces a narrow range of outputs that fool the discriminator but fail to capture the full…

Machine Learning · Computer Science 2025-11-03 Mahsa Valizadeh , Rui Tuo , James Caverlee

Recently, Generative Adversarial Networks (GANs) have demonstrated their potential in federated learning, i.e., learning a centralized model from data privately hosted by multiple sites. A federatedGAN jointly trains a centralized generator…

Machine Learning · Computer Science 2021-02-10 Yikai Zhang , Hui Qu , Qi Chang , Huidong Liu , Dimitris Metaxas , Chao Chen

Generative adversarial networks (GANs) are a method based on the training of two neural networks, one called generator and the other discriminator, competing with each other to generate new instances that resemble those of the probability…

Artificial Intelligence · Computer Science 2023-02-21 Jordi de la Torre

Machine learning models, especially neural network (NN) classifiers, are widely used in many applications including natural language processing, computer vision and cybersecurity. They provide high accuracy under the assumption of…

Machine Learning · Computer Science 2019-03-08 Guanxiong Liu , Issa Khalil , Abdallah Khreishah

The generation of high-quality synthetic data presents significant challenges in machine learning research, particularly regarding statistical fidelity and uncertainty quantification. Existing generative models produce compelling synthetic…

Machine Learning · Computer Science 2025-05-13 Rahul Vishwakarma , Shrey Dharmendra Modi , Vishwanath Seshagiri