English
Related papers

Related papers: Gradient penalty from a maximum margin perspective

200 papers

Generative adversarial networks (GANs) are an exciting alternative to algorithms for solving density estimation problems---using data to assess how likely samples are to be drawn from the same distribution. Instead of explicitly computing…

Machine Learning · Computer Science 2017-09-20 Christopher Grimm , Yuhang Song , Michael L. Littman

As a new way of training generative models, Generative Adversarial Nets (GAN) that uses a discriminative model to guide the training of the generative model has enjoyed considerable success in generating real-valued data. However, it has…

Machine Learning · Computer Science 2017-08-28 Lantao Yu , Weinan Zhang , Jun Wang , Yong Yu

We propose two new techniques for training Generative Adversarial Networks (GANs). Our objectives are to alleviate mode collapse in GAN and improve the quality of the generated samples. First, we propose neighbor embedding, a manifold…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Ngoc-Trung Tran , Tuan-Anh Bui , Ngai-Man Cheung

We present a new stage-wise learning paradigm for training generative adversarial networks (GANs). The goal of our work is to progressively strengthen the discriminator and thus, the generators, with each subsequent stage without changing…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Rahul Dey , Felix Juefei-Xu , Vishnu Naresh Boddeti , Marios Savvides

Robust scatter estimation is a fundamental task in statistics. The recent discovery on the connection between robust estimation and generative adversarial nets (GANs) by Gao et al. (2018) suggests that it is possible to compute depth-like…

Machine Learning · Computer Science 2019-03-06 Chao Gao , Yuan Yao , Weizhi Zhu

We are interested in the design of generative networks. The training of these mathematical structures is mostly performed with the help of adversarial (min-max) optimization problems. We propose a simple methodology for constructing such…

Machine Learning · Computer Science 2021-07-16 Kalliopi Basioti , George V. Moustakides

We study the convergence of gradient flow for the training of deep neural networks. If Residual Neural Networks are a popular example of very deep architectures, their training constitutes a challenging optimization problem due notably to…

Machine Learning · Computer Science 2025-07-22 Raphaël Barboni , Gabriel Peyré , François-Xavier Vialard

Generative adversarial networks (GANs) are a framework for producing a generative model by way of a two-player minimax game. In this paper, we propose the \emph{Generative Multi-Adversarial Network} (GMAN), a framework that extends GANs to…

Machine Learning · Computer Science 2017-03-06 Ishan Durugkar , Ian Gemp , Sridhar Mahadevan

Generative Adversarial Networks (GANs) have achieved great success in data generation. However, its statistical properties are not fully understood. In this paper, we consider the statistical behavior of the general $f$-divergence…

Statistics Theory · Mathematics 2022-09-16 Xinwei Shen , Kani Chen , Tong Zhang

We provide statistical theory for conditional and unconditional Wasserstein generative adversarial networks (WGANs) in the framework of dependent observations. We prove upper bounds for the excess Bayes risk of the WGAN estimators with…

Statistics Theory · Mathematics 2020-11-09 Moritz Haas , Stefan Richter

In order to alleviate the notorious mode collapse phenomenon in generative adversarial networks (GANs), we propose a novel training method of GANs in which certain fake samples are considered as real ones during the training process. This…

Machine Learning · Computer Science 2020-03-17 Song Tao , Jia Wang

Within a broad class of generative adversarial networks, we show that discriminator optimization process increases a lower bound of the dual cost function for the Wasserstein distance between the target distribution $p$ and the generator…

Machine Learning · Statistics 2023-08-09 Akinori Tanaka

Generative Adversarial Network (GAN) and its variants exhibit state-of-the-art performance in the class of generative models. To capture higher-dimensional distributions, the common learning procedure requires high computational complexity…

Machine Learning · Computer Science 2018-04-02 Xingwei Cao , Xuyang Zhao , Qibin Zhao

Recent work has shown local convergence of GAN training for absolutely continuous data and generator distributions. In this paper, we show that the requirement of absolute continuity is necessary: we describe a simple yet prototypical…

Machine Learning · Computer Science 2018-08-01 Lars Mescheder , Andreas Geiger , Sebastian Nowozin

In this paper, we propose a new adversarial training framework to address high-dimensional instantaneous channel estimation in wireless communications. Specifically, we train a generative adversarial network to predict a channel realization…

Signal Processing · Electrical Eng. & Systems 2025-04-16 Nghia Thinh Nguyen , Tri Nhu Do

Semi-supervision in Machine Learning can be used in searches for new physics where the signal plus background regions are not labelled. This strongly reduces model dependency in the search for signals Beyond the Standard Model. This…

High Energy Physics - Phenomenology · Physics 2022-02-04 Thabang Lebese , Xifeng Ruan

Generative Adversarial Networks (GANs) are commonly used for modeling complex distributions of data. Both the generators and discriminators of GANs are often modeled by neural networks, posing a non-transparent optimization problem which is…

Machine Learning · Computer Science 2022-03-22 Arda Sahiner , Tolga Ergen , Batu Ozturkler , Burak Bartan , John Pauly , Morteza Mardani , Mert Pilanci

Despite success on a wide range of problems related to vision, generative adversarial networks (GANs) often suffer from inferior performance due to unstable training, especially for text generation. To solve this issue, we propose a new…

Machine Learning · Computer Science 2020-11-02 Yue Wu , Pan Zhou , Andrew Gordon Wilson , Eric P. Xing , Zhiting Hu

Generative models based on latent variables, such as generative adversarial networks (GANs) and variational auto-encoders (VAEs), have gained lots of interests due to their impressive performance in many fields. However, many data such as…

Machine Learning · Statistics 2024-09-30 Yixuan Qiu , Qingyi Gao , Xiao Wang

Generative adversarial networks (GANs) are designed with the help of min-max optimization problems that are solved with stochastic gradient-type algorithms which are known to be non-robust. In this work we revisit a non-adversarial method…

Machine Learning · Computer Science 2018-11-26 Kalliopi Basioti , George V. Moustakides , Emmanouil Z. Psarakis