English
Related papers

Related papers: Unsupervised Text Style Transfer with Deep Generat…

200 papers

This paper focuses on style transfer on the basis of non-parallel text. This is an instance of a broad family of problems including machine translation, decipherment, and sentiment modification. The key challenge is to separate the content…

Computation and Language · Computer Science 2017-11-07 Tianxiao Shen , Tao Lei , Regina Barzilay , Tommi Jaakkola

Typical methods for unsupervised text style transfer often rely on two key ingredients: 1) seeking the explicit disentanglement of the content and the attributes, and 2) troublesome adversarial learning. In this paper, we show that neither…

Computation and Language · Computer Science 2019-11-20 Dayiheng Liu , Jie Fu , Yidan Zhang , Chris Pal , Jiancheng Lv

Unsupervised style transfer models are mainly based on an inductive learning approach, which represents the style as embeddings, decoder parameters, or discriminator parameters and directly applies these general rules to the test cases.…

Computation and Language · Computer Science 2021-09-17 Fei Xiao , Liang Pang , Yanyan Lan , Yan Wang , Huawei Shen , Xueqi Cheng

Text style transfer rephrases a text from a source style (e.g., informal) to a target style (e.g., formal) while keeping its original meaning. Despite the success existing works have achieved using a parallel corpus for the two styles,…

Computation and Language · Computer Science 2019-04-09 Hongyu Gong , Suma Bhat , Lingfei Wu , Jinjun Xiong , Wen-mei Hwu

This paper tackles the problem of disentangling the latent variables of style and content in language models. We propose a simple yet effective approach, which incorporates auxiliary multi-task and adversarial objectives, for label…

Computation and Language · Computer Science 2018-09-12 Vineet John , Lili Mou , Hareesh Bahuleyan , Olga Vechtomova

Text style transfer refers to the task of rephrasing a given text in a different style. While various methods have been proposed to advance the state of the art, they often assume the transfer output follows a delta distribution, and thus…

Computation and Language · Computer Science 2020-02-18 Kevin Lin , Ming-Yu Liu , Ming-Ting Sun , Jan Kautz

Supervised training of abstractive language generation models results in learning conditional probabilities over language sequences based on the supervised training signal. When the training signal contains a variety of writing styles, such…

Computation and Language · Computer Science 2018-04-12 Ye Zhang , Nan Ding , Radu Soricut

Recent research has shown that word embedding spaces learned from text corpora of different languages can be aligned without any parallel data supervision. Inspired by the success in unsupervised cross-lingual word embeddings, in this paper…

Computation and Language · Computer Science 2018-09-24 Yu-An Chung , Wei-Hung Weng , Schrasing Tong , James Glass

Paraphrase generation has benefited extensively from recent progress in the designing of training objectives and model architectures. However, previous explorations have largely focused on supervised methods, which require a large amount of…

Computation and Language · Computer Science 2021-09-14 Tong Niu , Semih Yavuz , Yingbo Zhou , Nitish Shirish Keskar , Huan Wang , Caiming Xiong

Modern NLP defines the task of style transfer as modifying the style of a given sentence without appreciably changing its semantics, which implies that the outputs of style transfer systems should be paraphrases of their inputs. However,…

Computation and Language · Computer Science 2020-10-13 Kalpesh Krishna , John Wieting , Mohit Iyyer

Disentangling the content and style in the latent space is prevalent in unpaired text style transfer. However, two major issues exist in most of the current neural models. 1) It is difficult to completely strip the style information from…

Computation and Language · Computer Science 2019-08-21 Ning Dai , Jianze Liang , Xipeng Qiu , Xuanjing Huang

Text style transfer aims to modify the style of a sentence while keeping its content unchanged. Recent style transfer systems often fail to faithfully preserve the content after changing the style. This paper proposes a structured content…

Computation and Language · Computer Science 2018-11-02 Youzhi Tian , Zhiting Hu , Zhou Yu

Semantic sentence embedding models encode natural language sentences into vectors, such that closeness in embedding space indicates closeness in the semantics between the sentences. Bilingual data offers a useful signal for learning such…

Computation and Language · Computer Science 2020-11-20 John Wieting , Graham Neubig , Taylor Berg-Kirkpatrick

Style transfer is an important problem in natural language processing (NLP). However, the progress in language style transfer is lagged behind other domains, such as computer vision, mainly because of the lack of parallel data and principle…

Computation and Language · Computer Science 2017-11-28 Zhenxin Fu , Xiaoye Tan , Nanyun Peng , Dongyan Zhao , Rui Yan

Sentence representation at the semantic level is a challenging task for Natural Language Processing and Artificial Intelligence. Despite the advances in word embeddings (i.e. word vector representations), capturing sentence meaning is an…

We present models for encoding sentences into embedding vectors that specifically target transfer learning to other NLP tasks. The models are efficient and result in accurate performance on diverse transfer tasks. Two variants of the…

Unsupervised text style transfer task aims to rewrite a text into target style while preserving its main content. Traditional methods rely on the use of a fixed-sized vector to regulate text style, which is difficult to accurately convey…

Computation and Language · Computer Science 2023-06-16 Yazheng Yang , Zhou Zhao , Qi Liu

We propose an unsupervised method to obtain cross-lingual embeddings without any parallel data or pre-trained word embeddings. The proposed model, which we call multilingual neural language models, takes sentences of multiple languages as…

Computation and Language · Computer Science 2018-09-10 Takashi Wada , Tomoharu Iwata

Non-parallel text style transfer is an important task in natural language generation. However, previous studies concentrate on the token or sentence level, such as sentence sentiment and formality transfer, but neglect long style transfer…

Computation and Language · Computer Science 2023-05-16 Xuekai Zhu , Jian Guan , Minlie Huang , Juan Liu

This paper introduces a framework that connects a deep generative pre-trained Transformer language model with a generative adversarial network for semi-supervised text generation. In other words, the proposed model is first pre-trained…

Computation and Language · Computer Science 2025-02-11 Shengquan Wang