English
Related papers

Related papers: Content preserving text generation with attribute …

200 papers

Text style transfer is the task that generates a sentence by preserving the content of the input sentence and transferring the style. Most existing studies are progressing on non-parallel datasets because parallel datasets are limited and…

Computation and Language · Computer Science 2020-11-30 Joosung Lee

Text attribute transfer aims to automatically rewrite sentences such that they possess certain linguistic attributes, while simultaneously preserving their semantic content. This task remains challenging due to a lack of supervised parallel…

Computation and Language · Computer Science 2020-01-27 Zhijing Jin , Di Jin , Jonas Mueller , Nicholas Matthews , Enrico Santus

Although current state-of-the-art language models have achieved impressive results in numerous natural language processing tasks, still they could not solve the problem of producing repetitive, dull and sometimes inconsistent text in…

Computation and Language · Computer Science 2021-08-10 An Nguyen

In this paper we propose a general framework for learning distributed representations of attributes: characteristics of text whose representations can be jointly learned with word embeddings. Attributes can correspond to document indicators…

Machine Learning · Computer Science 2014-06-12 Ryan Kiros , Richard S. Zemel , Ruslan Salakhutdinov

Token prediction stability remains a challenge in autoregressive generative models, where minor variations in early inference steps often lead to significant semantic drift over extended sequences. A structured modulation mechanism was…

While large language models (LLMs) have achieved impressive performance in generating fluent and realistic text, controlling the generated text so that it exhibits properties such as safety, factuality, and non-toxicity remains challenging.…

Computation and Language · Computer Science 2023-11-10 Meng Cao , Mehdi Fatemi , Jackie Chi Kit Cheung , Samira Shabanian

Adaptive and flexible image editing is a desirable function of modern generative models. In this work, we present a generative model with auto-encoder architecture for per-region style manipulation. We apply a code consistency loss to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Ansheng You , Chenglin Zhou , Qixuan Zhang , Lan Xu

Existing models which generate textual explanations enforce task relevance through a discriminative term loss function, but such mechanisms only weakly constrain mentioned object parts to actually be present in the image. In this paper, a…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Lisa Anne Hendricks , Ronghang Hu , Trevor Darrell , Zeynep Akata

We tackle the problem of generating audio samples conditioned on descriptive text captions. In this work, we propose AaudioGen, an auto-regressive generative model that generates audio samples conditioned on text inputs. AudioGen operates…

Producing a reduced version of a source text, as in generic or focused summarization, inherently involves two distinct subtasks: deciding on targeted content and generating a coherent text conveying it. While some popular approaches address…

Computation and Language · Computer Science 2022-10-25 Aviv Slobodkin , Paul Roit , Eran Hirsch , Ori Ernst , Ido Dagan

Recent advancements in natural language generation has raised serious concerns. High-performance language models are widely used for language generation tasks because they are able to produce fluent and meaningful sentences. These models…

Computation and Language · Computer Science 2020-10-06 Saurabh Gupta , Huy H. Nguyen , Junichi Yamagishi , Isao Echizen

Most adversarial attack methods that are designed to deceive a text classifier change the text classifier's prediction by modifying a few words or characters. Few try to attack classifiers by rewriting a whole sentence, due to the…

Computation and Language · Computer Science 2022-10-21 Lei Xu , Ivan Ramirez , Kalyan Veeramachaneni

Large pre-trained language models are capable of generating varied and fluent texts. Starting from the prompt, these models generate a narrative that can develop unpredictably. The existing methods of controllable text generation, which…

Computation and Language · Computer Science 2022-06-22 Sergey Vychegzhanin , Evgeny Kotelnikov

Probabilistic topic models are generative models that describe the content of documents by discovering the latent topics underlying them. However, the structure of the textual input, and for instance the grouping of words in coherent text…

Computation and Language · Computer Science 2016-06-02 Georgios Balikas , Massih-Reza Amini , Marianne Clausel

In this paper, we investigate the use of discourse-aware rewards with reinforcement learning to guide a model to generate long, coherent text. In particular, we propose to learn neural rewards to model cross-sentence ordering as a means to…

Computation and Language · Computer Science 2018-05-11 Antoine Bosselut , Asli Celikyilmaz , Xiaodong He , Jianfeng Gao , Po-Sen Huang , Yejin Choi

Data availability is a bottleneck during early stages of development of new capabilities for intelligent artificial agents. We investigate the use of text generation techniques to augment the training data of a popular commercial artificial…

Computation and Language · Computer Science 2019-10-09 Nikolaos Malandrakis , Minmin Shen , Anuj Goyal , Shuyang Gao , Abhishek Sethi , Angeliki Metallinou

Adversarial examples are helpful for analyzing and improving the robustness of text classifiers. Generating high-quality adversarial examples is a challenging task as it requires generating fluent adversarial sentences that are semantically…

Computation and Language · Computer Science 2022-10-21 Lei Xu , Alfredo Cuesta-Infante , Laure Berti-Equille , Kalyan Veeramachaneni

Exemplar-Guided Paraphrase Generation (EGPG) aims to generate a target sentence which conforms to the style of the given exemplar while encapsulating the content information of the source sentence. In this paper, we propose a new method…

Computation and Language · Computer Science 2021-09-06 Haoran Yang , Wai Lam , Piji Li

Framing a news article means to portray the reported event from a specific perspective, e.g., from an economic or a health perspective. Reframing means to change this perspective. Depending on the audience or the submessage, reframing can…

Computation and Language · Computer Science 2021-09-13 Wei-Fan Chen , Khalid Al-Khatib , Benno Stein , Henning Wachsmuth

The performance of adversarial dialogue generation models relies on the quality of the reward signal produced by the discriminator. The reward signal from a poor discriminator can be very sparse and unstable, which may lead the generator to…

Computation and Language · Computer Science 2018-12-11 Ziming Li , Julia Kiseleva , Maarten de Rijke