English
Related papers

Related papers: Training language GANs from Scratch

200 papers

Neural text generation models are often autoregressive language models or seq2seq models. These models generate text by sampling words sequentially, with each word conditioned on the previous word, and are state-of-the-art for several…

Machine Learning · Statistics 2018-03-02 William Fedus , Ian Goodfellow , Andrew M. Dai

Generative adversarial networks (GANs) have been remarkably successful in learning complex high dimensional real word distributions and generating realistic samples. However, they provide limited control over the generation process.…

Machine Learning · Computer Science 2020-10-27 Arunava Chakraborty , Rahul Ragesh , Mahir Shah , Nipun Kwatra

Generative adversarial networks (GANs) have proven to be surprisingly efficient for image editing by inverting and manipulating the latent code corresponding to an input real image. This editing property emerges from the disentangled nature…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Mustafa Shukor , Xu Yao , Bharath Bushan Damodaran , Pierre Hellier

Generative adversarial networks (GANs) are a powerful approach to unsupervised learning. They have achieved state-of-the-art performance in the image domain. However, GANs are limited in two ways. They often learn distributions with low…

Machine Learning · Statistics 2019-10-11 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei , Michalis K. Titsias

Scalability has driven recent advances in generative modeling, yet its principles remain underexplored for adversarial learning. We investigate the scalability of Generative Adversarial Networks (GANs) through two design choices that have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Sangeek Hyun , MinKyu Lee , Jae-Pil Heo

We develop a novel method for training of GANs for unsupervised and class conditional generation of images, called Linear Discriminant GAN (LD-GAN). The discriminator of an LD-GAN is trained to maximize the linear separability between…

Machine Learning · Statistics 2017-07-26 Zhun Sun , Mete Ozay , Takayuki Okatani

Previous works on sequential learning address the problem of forgetting in discriminative models. In this paper we consider the case of generative models. In particular, we investigate generative adversarial networks (GANs) in the task of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Chenshen Wu , Luis Herranz , Xialei Liu , Yaxing Wang , Joost van de Weijer , Bogdan Raducanu

Softmax GAN is a novel variant of Generative Adversarial Network (GAN). The key idea of Softmax GAN is to replace the classification loss in the original GAN with a softmax cross-entropy loss in the sample space of one single batch. In the…

Machine Learning · Computer Science 2020-06-26 Min Lin

The Generative Adversarial Network (GAN) was recently introduced in the literature as a novel machine learning method for training generative models. It has many applications in statistics such as nonparametric clustering and nonparametric…

Machine Learning · Statistics 2023-06-26 Sehwan Kim , Qifan Song , Faming Liang

Generative Adversarial Networks (GANs), as a framework for estimating generative models via an adversarial process, have attracted huge attention and have proven to be powerful in a variety of tasks. However, training GANs is well known for…

Machine Learning · Computer Science 2017-11-09 Zi-Yi Dou

Deep learning algorithms have a large number of trainable parameters often with sizes of hundreds of thousands or more. Training this algorithm requires a large amount of training data and generating a sufficiently large dataset for these…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Kidist Amde Mekonnen

Generative adversarial networks (GANs) with clustered latent spaces can perform conditional generation in a completely unsupervised manner. In the real world, the salient attributes of unlabeled data can be imbalanced. However, most of…

Machine Learning · Computer Science 2022-03-16 Uiwon Hwang , Heeseung Kim , Dahuin Jung , Hyemi Jang , Hyungyu Lee , Sungroh Yoon

GANs have been shown to perform exceedingly well on tasks pertaining to image generation and style transfer. In the field of language modelling, word embeddings such as GLoVe and word2vec are state-of-the-art methods for applying neural…

Computation and Language · Computer Science 2020-05-19 Afroz Ahamad

Generative adversarial networks (GANs) can implicitly learn rich distributions over images, audio, and data which are hard to model with an explicit likelihood. We present a practical Bayesian formulation for unsupervised and…

Machine Learning · Statistics 2017-11-09 Yunus Saatchi , Andrew Gordon Wilson

Generative Adversarial Networks (GANs) have become exceedingly popular in a wide range of data-driven research fields, due in part to their success in image generation. Their ability to generate new samples, often from only a small amount…

Computation and Language · Computer Science 2019-03-19 Thomas Wiest , Nicholas Cummins , Alice Baird , Simone Hantke , Judith Dineley , Björn Schuller

Recent advancement in Generative Adversarial Networks in speech synthesis domain[3],[2] have shown, that it's possible to train GANs [8] in a reliable manner for high quality coherent waveform generation from mel-spectograms. We propose…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-16 Luka Chkhetiani , Levan Bejanidze

In biomedical image analysis, the applicability of deep learning methods is directly impacted by the quantity of image data available. This is due to deep learning models requiring large image datasets to provide high-level performance.…

Machine Learning · Computer Science 2023-08-14 Muhammad Muneeb Saad , Ruairi O'Reilly , Mubashir Husain Rehmani

Recently, generative adversarial networks (GANs) have shown promising performance in generating realistic images. However, they often struggle in learning complex underlying modalities in a given dataset, resulting in poor-quality generated…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 David Keetae Park , Seungjoo Yoo , Hyojin Bahng , Jaegul Choo , Noseong Park

Generative adversarial networks (GANs) have been extremely effective in approximating complex distributions of high-dimensional, input data samples, and substantial progress has been made in understanding and improving GAN performance in…

Machine Learning · Computer Science 2018-05-01 Daniel Jiwoong Im , He Ma , Graham Taylor , Kristin Branson

Generative Adversarial Networks (GAN) have greatly influenced the development of computer vision and artificial intelligence in the past decade and also connected art and machine intelligence together. This book begins with a detailed…