English
Related papers

Related papers: On Relativistic $f$-Divergences

200 papers

We study in this paper the rate of convergence for learning densities under the Generative Adversarial Networks (GAN) framework, borrowing insights from nonparametric statistics. We introduce an improved GAN estimator that achieves a faster…

Machine Learning · Statistics 2018-02-20 Tengyuan Liang

In this paper, we propose ComGAN(ComparativeGAN) which allows the generator in GANs to refer to the semantics of comparative samples(e.g. real data) by comparison. ComGAN generalizes relativistic GANs by using arbitrary architecture and…

Machine Learning · Computer Science 2023-04-25 Haeone Lee

Wasserstein Generative Adversarial Networks (WGANs) are the popular generative models built on the theory of Optimal Transport (OT) and the Kantorovich duality. Despite the success of WGANs, it is still unclear how well the underlying OT…

Machine Learning · Computer Science 2023-01-10 Alexander Korotin , Alexander Kolesov , Evgeny Burnaev

In recent studies, Generative Adversarial Network (GAN) is one of the popular schemes to augment the image dataset. However, in our study we find the generator G in the GAN fails to generate numerical data in lower-dimensional spaces, and…

Machine Learning · Computer Science 2020-10-27 Wei Wang , Yimeng Chai , Tao Cui , Chuang Wang , Baohua Zhang , Yue Li , Yi An

Arguably the most fundamental question in the theory of generative adversarial networks (GANs) is to understand to what extent GANs can actually learn the underlying distribution. Theoretical and empirical evidence suggests local optimality…

Machine Learning · Computer Science 2022-01-19 Sitan Chen , Jerry Li , Yuanzhi Li , Raghu Meka

Generative Adversarial Networks (GANs) have been widely adopted in various fields. However, existing GANs generally are not able to preserve the manifold of data space, mainly due to the simple representation of discriminator for the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Haozhe Liu , Hanbang Liang , Xianxu Hou , Haoqian Wu , Feng Liu , Linlin Shen

Training generative adversarial networks is unstable in high-dimensions as the true data distribution tends to be concentrated in a small fraction of the ambient space. The discriminator is then quickly able to classify nearly all generated…

Machine Learning · Computer Science 2018-06-26 Behnam Neyshabur , Srinadh Bhojanapalli , Ayan Chakrabarti

Generative Adversarial Networks (GANs) are a widely-used tool for generative modeling of complex data. Despite their empirical success, the training of GANs is not fully understood due to the min-max optimization of the generator and…

Machine Learning · Computer Science 2022-08-23 Evan Becker , Parthe Pandit , Sundeep Rangan , Alyson K. Fletcher

Distributional causal inference requires estimating not only average treatment effects but also interventional outcome distributions, including quantiles, tail risks, and policy-dependent uncertainty. As a method for distributional causal…

Statistics Theory · Mathematics 2026-05-12 Shu Tamano , Masaaki Imaizumi

We propose Hellinger-type loss functions for training Generative Adversarial Networks (GANs), motivated by the boundedness, symmetry, and robustness properties of the Hellinger distance. We define an adversarial objective based on this…

Machine Learning · Statistics 2025-12-16 Giovanni Saraceno , Anand N. Vidyashankar , Claudio Agostinelli

Generative adversarial networks (GANs) are a class of generative models with two antagonistic neural networks: a generator and a discriminator. These two neural networks compete against each other through an adversarial process that can be…

Machine Learning · Computer Science 2021-05-24 Barbara Franci , Sergio Grammatico

The generative adversarial network (GAN) is an important model developed for high-dimensional distribution learning in recent years. However, there is a pressing need for a comprehensive method to understand its error convergence rate. In…

Machine Learning · Statistics 2023-10-25 Mahmud Hasan , Hailin Sang

A myriad of recent literary works has leveraged generative adversarial networks (GANs) to generate unseen evasion samples. The purpose is to annex the generated data with the original train set for adversarial training to improve the…

Cryptography and Security · Computer Science 2022-08-09 Rizwan Hamid Randhawa , Nauman Aslam , Mohammad Alauthman , Husnain Rafiq

The two key players in Generative Adversarial Networks (GANs), the discriminator and generator, are usually parameterized as deep neural networks (DNNs). On many generative tasks, GANs achieve state-of-the-art performance but are often…

Machine Learning · Computer Science 2019-01-31 Babajide O. Ayinde , Keishin Nishihama , Jacek M. Zurada

We introduce Primal-Dual Wasserstein GAN, a new learning algorithm for building latent variable models of the data distribution based on the primal and the dual formulations of the optimal transport (OT) problem. We utilize the primal…

Machine Learning · Statistics 2018-05-25 Mevlana Gemici , Zeynep Akata , Max Welling

Generative adversarial nets (GANs) have been widely studied during the recent development of deep learning and unsupervised learning. With an adversarial training mechanism, GAN manages to train a generative model to fit the underlying…

Information Retrieval · Computer Science 2018-06-12 Weinan Zhang

Many neural-based recommender systems were proposed in recent years and part of them used Generative Adversarial Networks (GAN) to model user-item interactions. However, the exploration of Wasserstein GAN with Gradient Penalty (WGAN-GP) on…

Information Retrieval · Computer Science 2022-05-02 Hichem Ammar Khodja , Oussama Boudjeniba

Understanding of GAN training is still very limited. One major challenge is its non-convex-non-concave min-max objective, which may lead to sub-optimal local minima. In this work, we perform a global landscape analysis of the empirical loss…

Machine Learning · Computer Science 2020-11-11 Ruoyu Sun , Tiantian Fang , Alex Schwing

Generative adversarial nets (GANs) have been remarkably successful at learning to sample from distributions specified by a given dataset, particularly if the given dataset is reasonably large compared to its dimensionality. However, given…

Machine Learning · Computer Science 2022-11-29 Tiantian Fang , Ruoyu Sun , Alex Schwing

Generative adversial network (GAN) is a type of generative model that maps a high-dimensional noise to samples in target distribution. However, the dimension of noise required in GAN is not well understood. Previous approaches view GAN as a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Ziran Zhu , Tongda Xu , Ling Li , Yan Wang