English
Related papers

Related papers: Deconstructing Generative Adversarial Networks

200 papers

In this article, we study the problem of high-dimensional conditional independence testing, a key building block in statistics and machine learning. We propose an inferential procedure based on double generative adversarial networks (GANs).…

Machine Learning · Statistics 2021-11-08 Chengchun Shi , Tianlin Xu , Wicher Bergsma , Lexin Li

Generative adversarial networks, or GANs, commonly display unstable behavior during training. In this work, we develop a principled theoretical framework for understanding the stability of various types of GANs. In particular, we derive…

Machine Learning · Computer Science 2020-02-12 Casey Chu , Kentaro Minami , Kenji Fukumizu

Generative adversarial networks (GANs) were initially proposed to generate images by learning from a large number of samples. Recently, GANs have been used to emulate complex physical systems such as turbulent flows. However, a critical…

Computational Physics · Physics 2020-11-24 Zeng Yang , Jin-Long Wu , Heng Xiao

Generative adversarial networks (GANs) generate data based on minimizing a divergence between two distributions. The choice of that divergence is therefore critical. We argue that the divergence must take into account the hypothesis set and…

Machine Learning · Computer Science 2019-11-07 Ben Adlam , Corinna Cortes , Mehryar Mohri , Ningshan Zhang

Generative Adversarial Networks (GANs) are an unsupervised generative model that learns data distribution through adversarial training. However, recent experiments indicated that GANs are difficult to train due to the requirement of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Wenliang Qian , Yang Xu , Wangmeng Zuo , Hui Li

Generative Adversarial Networks (GANs) have been widely applied in different scenarios thanks to the development of deep neural networks. The original GAN was proposed based on the non-parametric assumption of the infinite capacity of…

Machine Learning · Computer Science 2022-11-04 Ziqiang Li , Muhammad Usman , Rentuo Tao , Pengfei Xia , Chaoyue Wang , Huanhuan Chen , Bin Li

Generative adversarial networks (GANs) are a hot research topic recently. GANs have been widely studied since 2014, and a large number of algorithms have been proposed. However, there is few comprehensive study explaining the connections…

Machine Learning · Computer Science 2020-01-22 Jie Gui , Zhenan Sun , Yonggang Wen , Dacheng Tao , Jieping Ye

Generative adversarial networks (GANs) are a method based on the training of two neural networks, one called generator and the other discriminator, competing with each other to generate new instances that resemble those of the probability…

Artificial Intelligence · Computer Science 2023-02-21 Jordi de la Torre

Distributional causal inference requires estimating not only average treatment effects but also interventional outcome distributions, including quantiles, tail risks, and policy-dependent uncertainty. As a method for distributional causal…

Statistics Theory · Mathematics 2026-05-12 Shu Tamano , Masaaki Imaizumi

Recent generative adversarial networks (GANs) are able to generate impressive photo-realistic images. However, controllable generation with GANs remains a challenging research problem. Achieving controllable generation requires semantically…

Machine Learning · Computer Science 2021-05-04 Grigorios G Chrysos , Jean Kossaifi , Zhiding Yu , Anima Anandkumar

Recent techniques built on Generative Adversarial Networks (GANs), such as Cycle-Consistent GANs, are able to learn mappings among different domains built from unpaired datasets, through min-max optimization games between generators and…

Machine Learning · Computer Science 2020-08-18 Haoran You , Yu Cheng , Tianheng Cheng , Chunliang Li , Pan Zhou

In this paper, we analyze the numerics of common algorithms for training Generative Adversarial Networks (GANs). Using the formalism of smooth two-player games we analyze the associated gradient vector field of GAN training objectives. Our…

Machine Learning · Computer Science 2018-06-12 Lars Mescheder , Sebastian Nowozin , Andreas Geiger

Generative adversarial networks (GANs) are designed with the help of min-max optimization problems that are solved with stochastic gradient-type algorithms which are known to be non-robust. In this work we revisit a non-adversarial method…

Machine Learning · Computer Science 2018-11-26 Kalliopi Basioti , George V. Moustakides , Emmanouil Z. Psarakis

Conditional generative models enjoy remarkable progress over the past few years. One of the popular conditional models is Auxiliary Classifier GAN (AC-GAN), which generates highly discriminative images by extending the loss function of GAN…

Machine Learning · Computer Science 2019-11-06 Mingming Gong , Yanwu Xu , Chunyuan Li , Kun Zhang , Kayhan Batmanghelich

The mathematical forces at work behind Generative Adversarial Networks raise challenging theoretical issues. Motivated by the important question of characterizing the geometrical properties of the generated distributions, we provide a…

Machine Learning · Statistics 2023-10-06 Arthur Stéphanovitch , Ugo Tanielian , Benoît Cadre , Nicolas Klutchnikoff , Gérard Biau

Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training instability. The recently proposed Wasserstein GAN (WGAN) makes progress toward stable training of GANs, but sometimes can still generate only…

Machine Learning · Computer Science 2017-12-27 Ishaan Gulrajani , Faruk Ahmed , Martin Arjovsky , Vincent Dumoulin , Aaron Courville

Unsupervised learning with generative adversarial networks (GANs) has proven to be hugely successful. Regular GANs hypothesize the discriminator as a classifier with the sigmoid cross entropy loss function. However, we found that this loss…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Xudong Mao , Qing Li , Haoran Xie , Raymond Y. K. Lau , Zhen Wang , Stephen Paul Smolley

Bayesian inference on structured models typically relies on the ability to infer posterior distributions of underlying hidden variables. However, inference in implicit models or complex posterior distributions is hard. A popular tool for…

Machine Learning · Statistics 2016-12-16 Theofanis Karaletsos

Generative Adversarial Networks (GANs) are a revolutionary class of Deep Neural Networks (DNNs) that have been successfully used to generate realistic images, music, text, and other data. However, GAN training presents many challenges,…

Machine Learning · Computer Science 2022-03-30 Vineel Nagisetty , Laura Graves , Joseph Scott , Vijay Ganesh

In this paper, we propose Orthogonal Generative Adversarial Networks (O-GANs). We decompose the network of discriminator orthogonally and add an extra loss into the objective of common GANs, which can enforce discriminator become an…

Computer Vision and Pattern Recognition · Computer Science 2019-03-06 Jianlin Su