English
Related papers

Related papers: Generating Text through Adversarial Training using…

200 papers

Category text generation receives considerable attentions since it is beneficial for various natural language processing tasks. Recently, the generative adversarial network (GAN) has attained promising performance in text generation,…

Computation and Language · Computer Science 2023-08-03 Xinze Li , Kezhi Mao , Fanfan Lin , Zijian Feng

Learning distributed sentence representations remains an interesting problem in the field of Natural Language Processing (NLP). We want to learn a model that approximates the conditional latent space over the representations of a logical…

Computation and Language · Computer Science 2018-03-08 Yikang Shen , Shawn Tan , Chin-Wei Huang , Aaron Courville

The Visual Dialogue task requires an agent to engage in a conversation about an image with a human. It represents an extension of the Visual Question Answering task in that the agent needs to answer a question about an image, but it needs…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Qi Wu , Peng Wang , Chunhua Shen , Ian Reid , Anton van den Hengel

In the context of generative models, text-to-image generation achieved impressive results in recent years. Models using different approaches were proposed and trained in huge datasets of pairs of texts and images. However, some methods rely…

Neural and Evolutionary Computing · Computer Science 2022-07-08 Victor Costa , Nuno Lourenço , João Correia , Penousal Machado

Auto-encoding generative adversarial networks (GANs) combine the standard GAN algorithm, which discriminates between real and model-generated data, with a reconstruction loss given by an auto-encoder. Such models aim to prevent mode…

Machine Learning · Statistics 2017-10-24 Mihaela Rosca , Balaji Lakshminarayanan , David Warde-Farley , Shakir Mohamed

The text generated by neural language models is not as good as the real text. This means that their distributions are different. Generative Adversarial Nets (GAN) are used to alleviate it. However, some researchers argue that GAN variants…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Xingyuan Chen , Ping Cai , Peng Jin , Haokun Du , Hongjun Wang , Xingyu Dai , Jiajun Chen

To improve the generalization of the representations for natural language processing tasks, words are commonly represented using vectors, where distances among the vectors are related to the similarity of the words. While word2vec, the…

Computation and Language · Computer Science 2020-03-20 Canlin Zhang , Xiuwen Liu , Daniel Bis

In this paper, we propose GlyphGAN: style-consistent font generation based on generative adversarial networks (GANs). GANs are a framework for learning a generative model using a system of two neural networks competing with each other. One…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Hideaki Hayashi , Kohtaro Abe , Seiichi Uchida

This paper introduces a framework that connects a deep generative pre-trained Transformer language model with a generative adversarial network for semi-supervised text generation. In other words, the proposed model is first pre-trained…

Computation and Language · Computer Science 2025-02-11 Shengquan Wang

Auto-regressive text generation models usually focus on local fluency, and may cause inconsistent semantic meaning in long text generation. Further, automatically generating words with similar semantics is challenging, and hand-crafted…

Computation and Language · Computer Science 2020-05-05 Ruiyi Zhang , Changyou Chen , Zhe Gan , Wenlin Wang , Dinghan Shen , Guoyin Wang , Zheng Wen , Lawrence Carin

Current Generative Adversarial Network (GAN)-based approaches for time series generation face challenges such as suboptimal convergence, information loss in embedding spaces, and instability. To overcome these challenges, we introduce an…

Machine Learning · Computer Science 2024-10-29 MohammadReza EskandariNasab , Shah Muhammad Hamdi , Soukaina Filali Boubrahimi

We introduce a method for embedding words as probability densities in a low-dimensional space. Rather than assuming that a word embedding is fixed across the entire text collection, as in standard word embedding methods, in our Bayesian…

Computation and Language · Computer Science 2018-06-12 Arthur Bražinskas , Serhii Havrylov , Ivan Titov

Recent advances in large-scale pre-training such as GPT-3 allow seemingly high quality text to be generated from a given prompt. However, such generation systems often suffer from problems of hallucinated facts, and are not inherently…

Computation and Language · Computer Science 2022-02-25 Yizhe Zhang , Siqi Sun , Xiang Gao , Yuwei Fang , Chris Brockett , Michel Galley , Jianfeng Gao , Bill Dolan

Sentence representation at the semantic level is a challenging task for Natural Language Processing and Artificial Intelligence. Despite the advances in word embeddings (i.e. word vector representations), capturing sentence meaning is an…

Generative neural samplers are probabilistic models that implement sampling using feedforward neural networks: they take a random input vector and produce a sample from a probability distribution defined by the network weights. These models…

Machine Learning · Statistics 2016-06-03 Sebastian Nowozin , Botond Cseke , Ryota Tomioka

Recent advancements in language representation learning primarily emphasize language modeling for deriving meaningful representations, often neglecting style-specific considerations. This study addresses this gap by creating generic,…

Machine Learning · Computer Science 2025-03-17 Phil Ostheimer , Marius Kloft , Sophie Fellenz

Building effective text generation systems requires three critical components: content selection, text planning, and surface realization, and traditionally they are tackled as separate problems. Recent all-in-one style neural generation…

Computation and Language · Computer Science 2019-09-04 Xinyu Hua , Lu Wang

We present our Generative Enhanced Model (GEM) that we used to create samples awarded the first prize on the FEVER 2.0 Breakers Task. GEM is the extended language model developed upon GPT-2 architecture. The addition of novel target…

Computation and Language · Computer Science 2019-10-02 Piotr Niewinski , Maria Pszona , Maria Janicka

Automatic synthesis of realistic images from text would be interesting and useful, but current AI systems are still far from this goal. However, in recent years generic and powerful recurrent neural network architectures have been developed…

Neural and Evolutionary Computing · Computer Science 2016-06-07 Scott Reed , Zeynep Akata , Xinchen Yan , Lajanugen Logeswaran , Bernt Schiele , Honglak Lee

This study addresses the challenges of multi-label text classification. The difficulties arise from imbalanced data sets, varied text lengths, and numerous subjective feature labels. Existing solutions include traditional machine learning…

Computation and Language · Computer Science 2024-05-22 Hongren Wang