English
Related papers

Related papers: Training language GANs from Scratch

200 papers

Generative Adversarial Networks (GANs) have shown great promise recently in image generation. Training GANs for language generation has proven to be more difficult, because of the non-differentiable nature of generating text with recurrent…

Computation and Language · Computer Science 2017-12-22 Ofir Press , Amir Bar , Ben Bogin , Jonathan Berant , Lior Wolf

Generative Adversarial Networks (GANs) have been promising in the field of image generation, however, they have been hard to train for language generation. GANs were originally designed to output differentiable values, so discrete language…

Machine Learning · Computer Science 2018-07-04 Mehrad Moradshahi , Utkarsh Contractor

Generative Adversarial Networks (GANs) have experienced a recent surge in popularity, performing competitively in a variety of tasks, especially in computer vision. However, GAN training has shown limited success in natural language…

Computation and Language · Computer Science 2019-01-03 David Donahue , Anna Rumshisky

Despite success on a wide range of problems related to vision, generative adversarial networks (GANs) often suffer from inferior performance due to unstable training, especially for text generation. To solve this issue, we propose a new…

Machine Learning · Computer Science 2020-11-02 Yue Wu , Pan Zhou , Andrew Gordon Wilson , Eric P. Xing , Zhiting Hu

Generative Adversarial Networks (GANs) have known a tremendous success for many continuous generation tasks, especially in the field of image generation. However, for discrete outputs such as language, optimizing GANs remains an open…

Machine Learning · Computer Science 2022-01-31 Sylvain Lamprier , Thomas Scialom , Antoine Chaffin , Vincent Claveau , Ewa Kijak , Jacopo Staiano , Benjamin Piwowarski

Generative Adversarial Networks (GAN) is a model for data synthesis, which creates plausible data through the competition of generator and discriminator. Although GAN application to image synthesis is extensively studied, it has inherent…

Computation and Language · Computer Science 2025-01-07 Jun-Min Lee , Tae-Bin Ha

Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training instability. The recently proposed Wasserstein GAN (WGAN) makes progress toward stable training of GANs, but sometimes can still generate only…

Machine Learning · Computer Science 2017-12-27 Ishaan Gulrajani , Faruk Ahmed , Martin Arjovsky , Vincent Dumoulin , Aaron Courville

The impressive success of Generative Adversarial Networks (GANs) is often overshadowed by the difficulties in their training. Despite the continuous efforts and improvements, there are still open issues regarding their convergence…

Machine Learning · Computer Science 2018-11-08 Yannis Pantazis , Dipjyoti Paul , Michail Fasoulakis , Yannis Stylianou

Generative Adversarial Networks (GANs) are a promising approach for text generation that, unlike traditional language models (LM), does not suffer from the problem of ``exposure bias''. However, A major hurdle for understanding the…

Computation and Language · Computer Science 2019-03-26 Guy Tevet , Gavriel Habib , Vered Shwartz , Jonathan Berant

Generative Adversarial Networks (GANs) are an arrange of two neural networks -- the generator and the discriminator -- that are jointly trained to generate artificial data, such as images, from random inputs. The quality of these generated…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Manel Mateos , Alejandro González , Xavier Sevillano

Generative Adversarial Networks (GANs) have gathered a lot of attention from the computer vision community, yielding impressive results for image generation. Advances in the adversarial generation of natural language from noise however are…

Computation and Language · Computer Science 2017-06-01 Sai Rajeswar , Sandeep Subramanian , Francis Dutil , Christopher Pal , Aaron Courville

Since the creation of Generative Adversarial Networks (GANs), much work has been done to improve their training stability, their generated image quality, their range of application but nearly none of them explored their self-training…

Machine Learning · Computer Science 2017-10-31 Alan Do-Omri , Dalei Wu , Xiaohua Liu

The Generative Adversarial Network (GAN) has achieved great success in generating realistic (real-valued) synthetic data. However, convergence issues and difficulties dealing with discrete data hinder the applicability of GAN to text. We…

Machine Learning · Statistics 2017-11-21 Yizhe Zhang , Zhe Gan , Kai Fan , Zhi Chen , Ricardo Henao , Dinghan Shen , Lawrence Carin

Generative Adversarial Networks (GANs) advance face synthesis through learning the underlying distribution of observed data. Despite the high-quality generated faces, some minority groups can be rarely generated from the trained models due…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Shuhan Tan , Yujun Shen , Bolei Zhou

Generative Adversarial Networks (GANs) have proven to be a powerful framework for learning to draw samples from complex distributions. However, GANs are also notoriously difficult to train, with mode collapse and oscillations a common…

Machine Learning · Statistics 2018-11-28 Kevin J Liang , Chunyuan Li , Guoyin Wang , Lawrence Carin

Generative adversarial networks (GANs) have great successes on synthesizing data. However, the existing GANs restrict the discriminator to be a binary classifier, and thus limit their learning capacity for tasks that need to synthesize…

Computation and Language · Computer Science 2018-04-17 Kevin Lin , Dianqi Li , Xiaodong He , Zhengyou Zhang , Ming-Ting Sun

Text generative models trained via Maximum Likelihood Estimation (MLE) suffer from the notorious exposure bias problem, and Generative Adversarial Networks (GANs) are shown to have potential to tackle this problem. Existing language GANs…

Computation and Language · Computer Science 2023-07-19 Da Ren , Qing Li

Generative adversarial networks (GANs) have received an upsurging interest since being proposed due to the high quality of the generated data. While achieving increasingly impressive results, the resource demands associated with the large…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Shiwei Liu , Yuesong Tian , Tianlong Chen , Li Shen

While deep learning in the form of recurrent neural networks (RNNs) has caused a significant improvement in neural language modeling, the fact that they are extremely prone to overfitting is still a mainly unresolved issue. In this paper we…

Computation and Language · Computer Science 2022-11-18 Sajad Movahedi , Azadeh Shakery

Unconditional image generation has recently been dominated by generative adversarial networks (GANs). GAN methods train a generator which regresses images from random noise vectors, as well as a discriminator that attempts to differentiate…

Machine Learning · Computer Science 2018-12-24 Yedid Hoshen , Jitendra Malik
‹ Prev 1 2 3 10 Next ›