English
Related papers

Related papers: Improved generator objectives for GANs

200 papers

Despite the successes in capturing continuous distributions, the application of generative adversarial networks (GANs) to discrete settings, like natural language tasks, is rather restricted. The fundamental reason is the difficulty of…

Artificial Intelligence · Computer Science 2017-02-28 Tong Che , Yanran Li , Ruixiang Zhang , R Devon Hjelm , Wenjie Li , Yangqiu Song , Yoshua Bengio

Non-saturating generative adversarial network (GAN) training is widely used and has continued to obtain groundbreaking results. However so far this approach has lacked strong theoretical justification, in contrast to alternatives such as…

Machine Learning · Computer Science 2020-10-19 Matt Shannon , Ben Poole , Soroosh Mariooryad , Tom Bagby , Eric Battenberg , David Kao , Daisy Stanton , RJ Skerry-Ryan

Despite remarkable performance in producing realistic samples, Generative Adversarial Networks (GANs) often produce low-quality samples near low-density regions of the data manifold, e.g., samples of minor groups. Many techniques have been…

Machine Learning · Computer Science 2021-10-28 Jinhee Lee , Haeri Kim , Youngkyu Hong , Hye Won Chung

Many applications in machine learning can be framed as minimization problems and solved efficiently using gradient-based techniques. However, recent applications of generative models, particularly GANs, have triggered interest in solving…

Machine Learning · Computer Science 2021-03-24 Paulina Grnarova , Yannic Kilcher , Kfir Y. Levy , Aurelien Lucchi , Thomas Hofmann

The key objective of Generative Adversarial Networks (GANs) is to generate new data with the same statistics as the provided training data. However, multiple recent works show that state-of-the-art architectures yet struggle to achieve this…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Katja Schwarz , Yiyi Liao , Andreas Geiger

We introduce a method to stabilize Generative Adversarial Networks (GANs) by defining the generator objective with respect to an unrolled optimization of the discriminator. This allows training to be adjusted between using the optimal…

Machine Learning · Computer Science 2017-05-16 Luke Metz , Ben Poole , David Pfau , Jascha Sohl-Dickstein

Generative networks are fundamentally different in their aim and methods compared to CNNs for classification, segmentation, or object detection. They have initially not been meant to be an image analysis tool, but to produce naturally…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Markus Wenzel

Deep generative models are proficient in generating realistic data but struggle with producing rare samples in low density regions due to their scarcity of training datasets and the mode collapse problem. While recent methods aim to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Subeen Lee , Jiyeon Han , Soyeon Kim , Jaesik Choi

Semi-supervised learning methods based on generative adversarial networks (GANs) obtained strong empirical results, but it is not clear 1) how the discriminator benefits from joint training with a generator, and 2) why good semi-supervised…

Machine Learning · Computer Science 2017-11-06 Zihang Dai , Zhilin Yang , Fan Yang , William W. Cohen , Ruslan Salakhutdinov

Generative neural samplers are probabilistic models that implement sampling using feedforward neural networks: they take a random input vector and produce a sample from a probability distribution defined by the network weights. These models…

Machine Learning · Statistics 2016-06-03 Sebastian Nowozin , Botond Cseke , Ryota Tomioka

Despite the success of generative adversarial networks (GANs) for image generation, the trade-off between visual quality and image diversity remains a significant issue. This paper achieves both aims simultaneously by improving the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Duhyeon Bang , Hyunjung Shim

The key to overcome class imbalance problems is to capture the distribution of minority class accurately. Generative Adversarial Networks (GANs) have shown some potentials to tackle class imbalance problems due to their capability of…

Machine Learning · Computer Science 2020-08-06 Jingyu Hao , Chengjia Wang , Heye Zhang , Guang Yang

Generative adversarial networks (GANs) have been extremely effective in approximating complex distributions of high-dimensional, input data samples, and substantial progress has been made in understanding and improving GAN performance in…

Machine Learning · Computer Science 2018-05-01 Daniel Jiwoong Im , He Ma , Graham Taylor , Kristin Branson

We study two important concepts in adversarial deep learning---adversarial training and generative adversarial network (GAN). Adversarial training is the technique used to improve the robustness of discriminator by combining adversarial…

Machine Learning · Computer Science 2019-04-17 Xuanqing Liu , Cho-Jui Hsieh

Generative models are known to be difficult to assess. Recent works, especially on generative adversarial networks (GANs), produce good visual samples of varied categories of images. However, the validation of their quality is still…

Machine Learning · Computer Science 2019-09-25 Timothée Lesort , Andrei Stoain , Jean-François Goudou , David Filliat

We propose a new approach to train the Generative Adversarial Nets (GANs) with a mixture of generators to overcome the mode collapsing problem. The main intuition is to employ multiple generators, instead of using a single one as in the…

Machine Learning · Computer Science 2017-10-31 Quan Hoang , Tu Dinh Nguyen , Trung Le , Dinh Phung

Generative Adversarial Networks (GANs) are a class of generative algorithms that have been shown to produce state-of-the art samples, especially in the domain of image creation. The fundamental principle of GANs is to approximate the…

Machine Learning · Statistics 2018-03-22 G. Biau , B. Cadre , M. Sangnier , U. Tanielian

Recently, generative adversarial networks (GANs) have shown promising performance in generating realistic images. However, they often struggle in learning complex underlying modalities in a given dataset, resulting in poor-quality generated…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 David Keetae Park , Seungjoo Yoo , Hyojin Bahng , Jaegul Choo , Noseong Park

The impressive success of Generative Adversarial Networks (GANs) is often overshadowed by the difficulties in their training. Despite the continuous efforts and improvements, there are still open issues regarding their convergence…

Machine Learning · Computer Science 2018-11-08 Yannis Pantazis , Dipjyoti Paul , Michail Fasoulakis , Yannis Stylianou

Generative adversarial networks (GAN) have been effective for learning generative models for real-world data. However, existing GANs (GAN and its variants) tend to suffer from training problems such as instability and mode collapse. In this…

Machine Learning · Computer Science 2018-03-05 Chaoyue Wang , Chang Xu , Xin Yao , Dacheng Tao