English
Related papers

Related papers: On Relativistic $f$-Divergences

200 papers

Since their invention, generative adversarial networks (GANs) have become a popular approach for learning to model a distribution of real (unlabeled) data. Convergence problems during training are overcome by Wasserstein GANs which minimize…

Machine Learning · Statistics 2018-03-06 Henning Petzka , Asja Fischer , Denis Lukovnicov

Generative Adversarial Networks (GANs) have achieved a great success in unsupervised learning. Despite its remarkable empirical performance, there are limited theoretical studies on the statistical properties of GANs. This paper provides…

Machine Learning · Computer Science 2022-07-22 Minshuo Chen , Wenjing Liao , Hongyuan Zha , Tuo Zhao

The study of multidimensional discriminator (critic) output for Generative Adversarial Networks has been underexplored in the literature. In this paper, we generalize the Wasserstein GAN framework to take advantage of multidimensional…

Machine Learning · Statistics 2022-07-15 Mengyu Dai , Haibin Hang , Anuj Srivastava

Since the introduction of Generative Adversarial Networks (GANs) and Variational Autoencoders (VAE), the literature on generative modelling has witnessed an overwhelming resurgence. The impressive, yet elusive empirical performance of GANs…

Machine Learning · Statistics 2019-04-29 Hisham Husain , Richard Nock , Robert C. Williamson

We introduce the Probabilistic Generative Adversarial Network (PGAN), a new GAN variant based on a new kind of objective function. The central idea is to integrate a probabilistic model (a Gaussian Mixture Model, in our case) into the GAN…

Machine Learning · Computer Science 2017-08-08 Hamid Eghbal-zadeh , Gerhard Widmer

Despite the remarkable empirical successes of Generative Adversarial Networks (GANs), the theoretical guarantees for their statistical accuracy remain rather pessimistic. In particular, the data distributions on which GANs are applied, such…

Machine Learning · Statistics 2025-07-17 Saptarshi Chakraborty , Peter L. Bartlett

Generative Adversarial Networks (GANs) have achieved great success in data generation. However, its statistical properties are not fully understood. In this paper, we consider the statistical behavior of the general $f$-divergence…

Statistics Theory · Mathematics 2022-09-16 Xinwei Shen , Kani Chen , Tong Zhang

In this paper, we propose a novel loss function for training Generative Adversarial Networks (GANs) aiming towards deeper theoretical understanding as well as improved stability and performance for the underlying optimization problem. The…

Machine Learning · Computer Science 2021-08-25 Yannis Pantazis , Dipjyoti Paul , Michail Fasoulakis , Yannis Stylianou , Markos Katsoulakis

Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training instability. The recently proposed Wasserstein GAN (WGAN) makes progress toward stable training of GANs, but sometimes can still generate only…

Machine Learning · Computer Science 2017-12-27 Ishaan Gulrajani , Faruk Ahmed , Martin Arjovsky , Vincent Dumoulin , Aaron Courville

In this paper, we investigate the underlying factor that leads to failure and success in the training of GANs. We study the property of the optimal discriminative function and show that in many GANs, the gradient from the optimal…

Machine Learning · Computer Science 2018-12-27 Zhiming Zhou , Yuxuan Song , Lantao Yu , Hongwei Wang , Jiadong Liang , Weinan Zhang , Zhihua Zhang , Yong Yu

Generative adversarial networks (GANs) are an exciting alternative to algorithms for solving density estimation problems---using data to assess how likely samples are to be drawn from the same distribution. Instead of explicitly computing…

Machine Learning · Computer Science 2017-09-20 Christopher Grimm , Yuhang Song , Michael L. Littman

Generative adversarial networks (GANs) are unsupervised learning methods for training a generator distribution to produce samples that approximate those drawn from a target distribution. Many such methods can be formulated as minimization…

Machine Learning · Statistics 2025-05-13 Jeremiah Birrell

Generative adversarial networks are a novel method for statistical inference that have achieved much empirical success; however, the factors contributing to this success remain ill-understood. In this work, we attempt to analyze generative…

Machine Learning · Computer Science 2018-09-13 Shuang Liu , Kamalika Chaudhuri

A unifying $\alpha$-parametrized generator loss function is introduced for a dual-objective generative adversarial network (GAN), which uses a canonical (or classical) discriminator loss function such as the one in the original GAN…

Machine Learning · Computer Science 2024-03-19 Justin Veiner , Fady Alajaji , Bahman Gharesifard

Generative adversarial networks are a class of generative algorithms that have been widely used to produce state-of-the-art samples. In this paper, we investigate GAN to perform anomaly detection on time series dataset. In order to achieve…

Machine Learning · Statistics 2018-12-12 Ilyass Haloui , Jayant Sen Gupta , Vincent Feuillard

GANs excel at learning high dimensional distributions, but they can update generator parameters in directions that do not correspond to the steepest descent direction of the objective. Prominent examples of problematic update directions…

Machine Learning · Computer Science 2018-06-08 Calvin Seward , Thomas Unterthiner , Urs Bergmann , Nikolay Jetchev , Sepp Hochreiter

Generative adversarial networks (GANs) are successful deep generative models. GANs are based on a two-player minimax game. However, the objective function derived in the original motivation is changed to obtain stronger gradients when…

Machine Learning · Statistics 2016-11-10 Masatoshi Uehara , Issei Sato , Masahiro Suzuki , Kotaro Nakayama , Yutaka Matsuo

Non-saturating generative adversarial network (GAN) training is widely used and has continued to obtain groundbreaking results. However so far this approach has lacked strong theoretical justification, in contrast to alternatives such as…

Machine Learning · Computer Science 2020-10-19 Matt Shannon , Ben Poole , Soroosh Mariooryad , Tom Bagby , Eric Battenberg , David Kao , Daisy Stanton , RJ Skerry-Ryan

Generative Adversarial Networks (GANs) are a class of generative algorithms that have been shown to produce state-of-the art samples, especially in the domain of image creation. The fundamental principle of GANs is to approximate the…

Machine Learning · Statistics 2018-03-22 G. Biau , B. Cadre , M. Sangnier , U. Tanielian

Generative adversarial networks (GANs) are a machine learning framework comprising a generative model for sampling from a target distribution and a discriminative model for evaluating the proximity of a sample to the target distribution.…

Quantum Physics · Physics 2021-07-22 Daniel Herr , Benjamin Obert , Matthias Rosenkranz