English
Related papers

Related papers: Generalization Error of GAN from the Discriminator…

200 papers

Generative adversarial network (GAN) continues to be a popular research direction due to its high generation quality. It is observed that many state-of-the-art GANs generate samples that are more similar to the training set than a holdout…

Machine Learning · Computer Science 2022-10-25 Andrew Bai , Cho-Jui Hsieh , Wendy Kan , Hsuan-Tien Lin

In this work, we train conditional Wasserstein generative adversarial networks to effectively sample from the posterior of physics-based Bayesian inference problems. The generator is constructed using a U-Net architecture, with the latent…

Machine Learning · Statistics 2022-11-21 Deep Ray , Harisankar Ramaswamy , Dhruv V. Patel , Assad A. Oberai

The combinatorial search space presents a significant challenge to learning causality from data. Recently, the problem has been formulated into a continuous optimization framework with an acyclicity constraint, allowing for the exploration…

Machine Learning · Computer Science 2022-04-04 Hristo Petkov , Colin Hanley , Feng Dong

The two key players in Generative Adversarial Networks (GANs), the discriminator and generator, are usually parameterized as deep neural networks (DNNs). On many generative tasks, GANs achieve state-of-the-art performance but are often…

Machine Learning · Computer Science 2019-01-31 Babajide O. Ayinde , Keishin Nishihama , Jacek M. Zurada

Generative adversarial networks (GANs) have received a tremendous amount of attention in the past few years, and have inspired applications addressing a wide range of problems. Despite its great potential, GANs are difficult to train.…

Machine Learning · Computer Science 2017-05-09 Zhimin Chen , Yuguang Tong

In this paper, we show that Generative Adversarial Networks (GANs) suffer from catastrophic forgetting even when they are trained to approximate a single target distribution. We show that GAN training is a continual learning problem in…

Machine Learning · Computer Science 2020-03-24 Hoang Thanh-Tung , Truyen Tran

Conventional methods for causal structure learning from data face significant challenges due to combinatorial search space. Recently, the problem has been formulated into a continuous optimization framework with an acyclicity constraint to…

Machine Learning · Computer Science 2022-06-06 Hristo Petkov , Colin Hanley , Feng Dong

We introduce the Probabilistic Generative Adversarial Network (PGAN), a new GAN variant based on a new kind of objective function. The central idea is to integrate a probabilistic model (a Gaussian Mixture Model, in our case) into the GAN…

Machine Learning · Computer Science 2017-08-08 Hamid Eghbal-zadeh , Gerhard Widmer

Bayesian inference on structured models typically relies on the ability to infer posterior distributions of underlying hidden variables. However, inference in implicit models or complex posterior distributions is hard. A popular tool for…

Machine Learning · Statistics 2016-12-16 Theofanis Karaletsos

Generative adversarial networks (GANs) are pow- erful generative models based on providing feed- back to a generative network via a discriminator network. However, the discriminator usually as- sesses individual samples. This prevents the…

Machine Learning · Computer Science 2018-06-20 Thomas Lucas , Corentin Tallec , Jakob Verbeek , Yann Ollivier

In this paper, we study a physics-informed algorithm for Wasserstein Generative Adversarial Networks (WGANs) for uncertainty quantification in solutions of partial differential equations. By using groupsort activation functions in…

Numerical Analysis · Mathematics 2022-08-10 Yihang Gao , Michael K. Ng

Conditional distribution is a fundamental quantity for describing the relationship between a response and a predictor. We propose a Wasserstein generative approach to learning a conditional distribution. The proposed approach uses a…

Machine Learning · Computer Science 2021-12-21 Shiao Liu , Xingyu Zhou , Yuling Jiao , Jian Huang

Generative adversarial networks (GANs) are so complex that the existing learning theories do not provide a satisfactory explanation for why GANs have great success in practice. The same situation also remains largely open for deep neural…

Machine Learning · Computer Science 2022-02-15 Khoat Than , Nghia Vu

Generative adversarial networks (GANs) have been shown to produce realistic samples from high-dimensional distributions, but training them is considered hard. A possible explanation for training instabilities is the inherent imbalance…

Machine Learning · Statistics 2018-07-12 Mehdi S. M. Sajjadi , Giambattista Parascandolo , Arash Mehrjou , Bernhard Schölkopf

This paper studies generative adversarial networks (GANs) from the perspective of statistical inference. A GAN is a popular machine learning method in which the parameters of two neural networks, a generator and a discriminator, are…

Statistics Theory · Mathematics 2023-12-06 Mika Meitz

Generative models, especially Generative Adversarial Networks (GANs), have received significant attention recently. However, it has been observed that in terms of some attributes, e.g. the number of simple geometric primitives in an image,…

Machine Learning · Computer Science 2019-10-08 Jinchen Xuan , Yunchang Yang , Ze Yang , Di He , Liwei Wang

Generating realistic graph-structured data is challenging due to discrete structures, variable sizes, and class-specific connectivity patterns that resist conventional generative modelling. While recent graph generation methods employ…

Machine Learning · Computer Science 2026-02-02 Seyedeh Ava Razi Razavi , James Sargant , Sheridan Houghten , Renata Dividino

In this paper, we aim to understand the generalization properties of generative adversarial networks (GANs) from a new perspective of privacy protection. Theoretically, we prove that a differentially private learning algorithm used for…

Machine Learning · Computer Science 2019-09-26 Bingzhe Wu , Shiwan Zhao , ChaoChao Chen , Haoyang Xu , Li Wang , Xiaolu Zhang , Guangyu Sun , Jun Zhou

From generating never-before-seen images to domain adaptation, applications of Generative Adversarial Networks (GANs) spread wide in the domain of vision and graphics problems. With the remarkable ability of GANs in learning the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Saman Motamed , Farzad Khalvati

State of the art deep generative networks are capable of producing images with such incredible realism that they can be suspected of memorizing training images. It is why it is not uncommon to include visualizations of training set nearest…

Machine Learning · Computer Science 2019-01-14 Ryan Webster , Julien Rabin , Loic Simon , Frederic Jurie