English
Related papers

Related papers: Unsupervised Paraphrasing with Pretrained Language…

200 papers

Paraphrasing exists at different granularity levels, such as lexical level, phrasal level and sentential level. This paper presents Decomposable Neural Paraphrase Generator (DNPG), a Transformer-based model that can learn and generate…

Computation and Language · Computer Science 2019-06-25 Zichao Li , Xin Jiang , Lifeng Shang , Qun Liu

Pre-trained word embeddings are the primary method for transfer learning in several Natural Language Processing (NLP) tasks. Recent works have focused on using unsupervised techniques such as language modeling to obtain these embeddings. In…

Computation and Language · Computer Science 2019-07-01 Mihir Kale , Aditya Siddhant , Sreyashi Nag , Radhika Parik , Matthias Grabmair , Anthony Tomasic

Most prior work on exemplar-based syntactically controlled paraphrase generation relies on automatically-constructed large-scale paraphrase datasets, which are costly to create. We sidestep this prerequisite by adapting models from prior…

Computation and Language · Computer Science 2021-09-21 Mingda Chen , Sam Wiseman , Kevin Gimpel

Leveraging multilingual parallel texts to automatically generate paraphrases has drawn much attention as size of high-quality paraphrase corpus is limited. Round-trip translation, also known as the pivoting method, is a typical approach to…

Computation and Language · Computer Science 2019-11-12 Yinpeng Guo , Yi Liao , Xin Jiang , Qing Zhang , Yibo Zhang , Qun Liu

We address the text-to-text generation problem of sentence-level paraphrasing -- a phenomenon distinct from and more difficult than word- or phrase-level paraphrasing. Our approach applies multiple-sequence alignment to sentences gathered…

Computation and Language · Computer Science 2007-05-23 Regina Barzilay , Lillian Lee

This paper explores deep latent variable models for semi-supervised paraphrase generation, where the missing target pair for unlabelled data is modelled as a latent paraphrase sequence. We present a novel unsupervised model named…

Computation and Language · Computer Science 2023-09-12 Jialin Yu , Alexandra I. Cristea , Anoushka Harit , Zhongtian Sun , Olanrewaju Tahir Aduragba , Lei Shi , Noura Al Moubayed

While sentence simplification is an active research topic in NLP, its adjacent tasks of sentence complexification and same-level paraphrasing are not. To train models on all three tasks, we present two new unsupervised datasets. We compare…

Computation and Language · Computer Science 2023-11-22 Alison Chi , Li-Kuang Chen , Yi-Chen Chang , Shu-Hui Lee , Jason S. Chang

Recent breakthroughs in Natural Language Processing (NLP) have been driven by language models trained on a massive amount of plain text. While powerful, deriving supervision from textual resources is still an open question. For example,…

Computation and Language · Computer Science 2022-07-22 Mingda Chen

The advent of deep learning has led to a significant gain in machine translation. However, most of the studies required a large parallel dataset which is scarce and expensive to construct and even unavailable for some languages. This paper…

Computation and Language · Computer Science 2023-04-04 Viet H. Pham , Thang M. Pham , Giang Nguyen , Long Nguyen , Dien Dinh

We present ParaBank, a large-scale English paraphrase dataset that surpasses prior work in both quantity and quality. Following the approach of ParaNMT, we train a Czech-English neural machine translation (NMT) system to generate novel…

Computation and Language · Computer Science 2019-01-14 J. Edward Hu , Rachel Rudinger , Matt Post , Benjamin Van Durme

We present a novel technique for zero-shot paraphrase generation. The key contribution is an end-to-end multilingual paraphrasing model that is trained using translated parallel corpora to generate paraphrases into "meaning spaces" --…

Computation and Language · Computer Science 2021-10-27 Monisha Jegadeesan , Sachin Kumar , John Wieting , Yulia Tsvetkov

We present a system that allows users to train their own state-of-the-art paraphrastic sentence representations in a variety of languages. We also release trained models for English, Arabic, German, French, Spanish, Russian, Turkish, and…

Computation and Language · Computer Science 2023-06-06 John Wieting , Kevin Gimpel , Graham Neubig , Taylor Berg-Kirkpatrick

An intuitive way for a human to write paraphrase sentences is to replace words or phrases in the original sentence with their corresponding synonyms and make necessary changes to ensure the new sentences are fluent and grammatically…

Computation and Language · Computer Science 2018-06-22 Shaohan Huang , Yu Wu , Furu Wei , Ming Zhou

Paraphrase generation has been widely used in various downstream tasks. Most tasks benefit mainly from high quality paraphrases, namely those that are semantically similar to, yet linguistically diverse from, the original sentence.…

Computation and Language · Computer Science 2022-04-04 Elron Bandel , Ranit Aharonov , Michal Shmueli-Scheuer , Ilya Shnayderman , Noam Slonim , Liat Ein-Dor

A long-standing issue with paraphrase generation is how to obtain reliable supervision signals. In this paper, we propose an unsupervised paradigm for paraphrase generation based on the assumption that the probabilities of generating two…

Computation and Language · Computer Science 2021-09-02 Yuxian Meng , Xiang Ao , Qing He , Xiaofei Sun , Qinghong Han , Fei Wu , Chun fan , Jiwei Li

Syntactically controlled paraphrase generation has become an emerging research direction in recent years. Most existing approaches require annotated paraphrase pairs for training and are thus costly to extend to new domains. Unsupervised…

Computation and Language · Computer Science 2022-11-03 Kuan-Hao Huang , Varun Iyer , Anoop Kumar , Sriram Venkatapathy , Kai-Wei Chang , Aram Galstyan

Paraphrase generation strives to generate high-quality and diverse expressions of a given text, a domain where diffusion models excel. Though SOTA diffusion generation reconciles generation quality and diversity, textual diffusion suffers…

Computation and Language · Computer Science 2025-01-20 Wei Zou , Ziyuan Zhuang , Xiang Geng , Shujian Huang , Jia Liu , Jiajun Chen

We propose Masker, an unsupervised text-editing method for style transfer. To tackle cases when no parallel source-target pairs are available, we train masked language models (MLMs) for both the source and the target domain. Then we find…

Computation and Language · Computer Science 2020-10-05 Eric Malmi , Aliaksei Severyn , Sascha Rothe

Compositional vector space models of meaning promise new solutions to stubborn language understanding problems. This paper makes two contributions toward this end: (i) it uses automatically-extracted paraphrase examples as a source of…

Computation and Language · Computer Science 2018-02-01 Avneesh Saluja , Chris Dyer , Jean-David Ruvini

Binary classifiers are often employed as discriminators in GAN-based unsupervised style transfer systems to ensure that transferred sentences are similar to sentences in the target domain. One difficulty with this approach is that the error…

Computation and Language · Computer Science 2019-01-31 Zichao Yang , Zhiting Hu , Chris Dyer , Eric P. Xing , Taylor Berg-Kirkpatrick