English
Related papers

Related papers: Revisiting GAN with Bayes-Optimal Discrimination

200 papers

Though recent research has achieved remarkable progress in generating realistic images with generative adversarial networks (GANs), the lack of training stability is still a lingering concern of most GANs, especially on high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Runmin Wu , Kunyao Zhang , Lijun Wang , Yue Wang , Pingping Zhang , Huchuan Lu , Yizhou Yu

This paper explores the problem of generative modeling, aiming to simulate diverse examples from an unknown distribution based on observed examples. While recent studies have focused on quantifying the statistical precision of popular…

Statistics Theory · Mathematics 2024-06-07 Elen Vardanyan , Sona Hunanyan , Tigran Galstyan , Arshak Minasyan , Arnak Dalalyan

We propose a novel regularizer to improve the training of Generative Adversarial Networks (GANs). The motivation is that when the discriminator D spreads out its model capacity in the right way, the learning signals given to the generator G…

Machine Learning · Computer Science 2018-05-11 Yanshuai Cao , Gavin Weiguang Ding , Kry Yik-Chau Lui , Ruitong Huang

Generative-adversarial networks (GANs) have been used to produce data closely resembling example data in a compressed, latent space that is close to sufficient for reconstruction in the original vector space. The Wasserstein metric has been…

Machine Learning · Statistics 2022-10-10 Oliver Serang

Generative adversarial networks (GANs) learn a target probability distribution by optimizing a generator and a discriminator with minimax objectives. This paper addresses the question of whether such optimization actually provides the…

Machine Learning · Computer Science 2024-04-11 Yuhta Takida , Masaaki Imaizumi , Takashi Shibuya , Chieh-Hsin Lai , Toshimitsu Uesaka , Naoki Murata , Yuki Mitsufuji

Generative adversarial training can be generally understood as minimizing certain moment matching loss defined by a set of discriminator functions, typically neural networks. The discriminator set should be large enough to be able to…

Machine Learning · Computer Science 2018-02-27 Pengchuan Zhang , Qiang Liu , Dengyong Zhou , Tao Xu , Xiaodong He

Generative adversarial networks (GANs) have been widely used and have achieved competitive results in semi-supervised learning. This paper theoretically analyzes how GAN-based semi-supervised learning (GAN-SSL) works. We first prove that,…

Machine Learning · Statistics 2020-07-14 Xuejiao Liu , Xueshuang Xiang

Lack of ground-truth MR images impedes the common supervised training of neural networks for image reconstruction. To cope with this challenge, this paper leverages unpaired adversarial training for reconstruction networks, where the inputs…

Image and Video Processing · Electrical Eng. & Systems 2021-05-14 Ke Lei , Morteza Mardani , John M. Pauly , Shreyas S. Vasanawala

Generative adversarial nets (GANs) and variational auto-encoders have significantly improved our distribution modeling capabilities, showing promise for dataset augmentation, image-to-image translation and feature learning. However, to…

Generative adversarial networks (GANs) are powerful generative models, but usually suffer from instability and generalization problem which may lead to poor generations. Most existing works focus on stabilizing the training of the…

Machine Learning · Computer Science 2020-04-29 Shufei Zhang , Zhuang Qian , Kaizhu Huang , Jimin Xiao , Yuan He

Thanks to their remarkable generative capabilities, GANs have gained great popularity, and are used abundantly in state-of-the-art methods and applications. In a GAN based model, a discriminator is trained to learn the real data…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Firas Shama , Roey Mechrez , Alon Shoshan , Lihi Zelnik-Manor

The Generative Adversarial Network (GAN) was recently introduced in the literature as a novel machine learning method for training generative models. It has many applications in statistics such as nonparametric clustering and nonparametric…

Machine Learning · Statistics 2023-06-26 Sehwan Kim , Qifan Song , Faming Liang

Generative adversarial networks (GANs) are a learning framework that rely on training a discriminator to estimate a measure of difference between a target and generated distributions. GANs, as normally formulated, rely on the generated…

Machine Learning · Statistics 2018-02-23 R Devon Hjelm , Athul Paul Jacob , Tong Che , Adam Trischler , Kyunghyun Cho , Yoshua Bengio

We introduce effective training algorithms for Generative Adversarial Networks (GAN) to alleviate mode collapse and gradient vanishing. In our system, we constrain the generator by an Autoencoder (AE). We propose a formulation to consider…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Ngoc-Trung Tran , Tuan-Anh Bui , Ngai-Man Cheung

We propose a new equilibrium enforcing method paired with a loss derived from the Wasserstein distance for training auto-encoder based Generative Adversarial Networks. This method balances the generator and discriminator during training.…

Machine Learning · Computer Science 2017-06-02 David Berthelot , Thomas Schumm , Luke Metz

Recent studies have empirically investigated different methods to train stochastic neural networks on a classification task by optimising a PAC-Bayesian bound via stochastic gradient descent. Most of these procedures need to replace the…

Machine Learning · Computer Science 2022-07-01 Eugenio Clerico , George Deligiannidis , Arnaud Doucet

Generative Adversarial Networks (GANs) have been successful in producing outstanding results in areas as diverse as image, video, and text generation. Building on these successes, a large number of empirical studies have validated the…

Machine Learning · Computer Science 2021-06-21 Gérard Biau , Maxime Sangnier , Ugo Tanielian

We investigate the training and performance of generative adversarial networks using the Maximum Mean Discrepancy (MMD) as critic, termed MMD GANs. As our main theoretical contribution, we clarify the situation with bias in GAN loss…

Machine Learning · Statistics 2021-01-15 Mikołaj Bińkowski , Danica J. Sutherland , Michael Arbel , Arthur Gretton

In past years, the minimax type single-level optimization formulation and its variations have been widely utilized to address Generative Adversarial Networks (GANs). Unfortunately, it has been proved that these alternating learning…

Machine Learning · Computer Science 2022-05-23 Risheng Liu , Jiaxin Gao , Xuan Liu , Xin Fan

Generative adversarial networks (GANs) are pow- erful generative models based on providing feed- back to a generative network via a discriminator network. However, the discriminator usually as- sesses individual samples. This prevents the…

Machine Learning · Computer Science 2018-06-20 Thomas Lucas , Corentin Tallec , Jakob Verbeek , Yann Ollivier