English
Related papers

Related papers: Unsupervised Paraphrase Generation using Pre-train…

200 papers

Data augmentation techniques are widely used for enhancing the performance of machine learning models by tackling class imbalance issues and data sparsity. State-of-the-art generative language models have been shown to provide significant…

Computation and Language · Computer Science 2023-01-10 Aleksandra Edwards , Asahi Ushio , Jose Camacho-Collados , Hélène de Ribaupierre , Alun Preece

Most prior work on exemplar-based syntactically controlled paraphrase generation relies on automatically-constructed large-scale paraphrase datasets, which are costly to create. We sidestep this prerequisite by adapting models from prior…

Computation and Language · Computer Science 2021-09-21 Mingda Chen , Sam Wiseman , Kevin Gimpel

Generating text from structured data is important for various tasks such as question answering and dialog systems. We show that in at least one domain, without any supervision and only based on unlabeled text, we are able to build a Natural…

Computation and Language · Computer Science 2018-08-28 Markus Freitag , Scott Roy

Question Answering (QA) is in increasing demand as the amount of information available online and the desire for quick access to this content grows. A common approach to QA has been to fine-tune a pretrained language model on a…

Computation and Language · Computer Science 2020-04-27 Alexander R. Fabbri , Patrick Ng , Zhiguo Wang , Ramesh Nallapati , Bing Xiang

In the paraphrase generation task, source sentences often contain phrases that should not be altered. Which phrases, however, can be context dependent and can vary by application. Our solution to this challenge is to provide the user with…

Computation and Language · Computer Science 2021-01-27 Mohan Zhang , Luchen Tan , Zhengkai Tu , Zihang Fu , Kun Xiong , Ming Li , Jimmy Lin

Transformer-based models achieve impressive performance on numerous Natural Language Inference (NLI) benchmarks when trained on respective training datasets. However, in certain cases, training samples may not be available or collecting…

Computation and Language · Computer Science 2022-03-16 Neeraj Varshney , Pratyay Banerjee , Tejas Gokhale , Chitta Baral

The power of natural language generation models has provoked a flurry of interest in automatic methods to detect if a piece of text is human or machine-authored. The problem so far has been framed in a standard supervised way and consists…

Computation and Language · Computer Science 2021-11-05 Matthias Gallé , Jos Rozen , Germán Kruszewski , Hady Elsahar

Paraphrasing is the task of re-writing an input text using other words, without altering the meaning of the original content. Conversational systems can exploit automatic paraphrasing to make the conversation more natural, e.g., talking…

Computation and Language · Computer Science 2024-02-19 Achille Globo , Antonio Trevisi , Andrea Zugarini , Leonardo Rigutini , Marco Maggini , Stefano Melacci

Distantly supervised relation extraction is widely used to extract relational facts from text, but suffers from noisy labels. Current relation extraction methods try to alleviate the noise by multi-instance learning and by providing…

Computation and Language · Computer Science 2019-06-21 Christoph Alt , Marc Hübner , Leonhard Hennig

To build a French national electronic injury surveillance system based on emergency room visits, we aim to develop a coding system to classify their causes from clinical notes in free-text. Supervised learning techniques have shown good…

Computation and Language · Computer Science 2021-04-08 Binbin Xu , Cédric Gil-Jardiné , Frantz Thiessard , Eric Tellier , Marta Avalos , Emmanuel Lagarde

While sentence simplification is an active research topic in NLP, its adjacent tasks of sentence complexification and same-level paraphrasing are not. To train models on all three tasks, we present two new unsupervised datasets. We compare…

Computation and Language · Computer Science 2023-11-22 Alison Chi , Li-Kuang Chen , Yi-Chen Chang , Shu-Hui Lee , Jason S. Chang

Leveraging multilingual parallel texts to automatically generate paraphrases has drawn much attention as size of high-quality paraphrase corpus is limited. Round-trip translation, also known as the pivoting method, is a typical approach to…

Computation and Language · Computer Science 2019-11-12 Yinpeng Guo , Yi Liao , Xin Jiang , Qing Zhang , Yibo Zhang , Qun Liu

Paraphrasing is expressing the meaning of an input sentence in different wording while maintaining fluency (i.e., grammatical and syntactical correctness). Most existing work on paraphrasing use supervised models that are limited to…

Computation and Language · Computer Science 2020-07-08 A. B. Siddique , Samet Oymak , Vagelis Hristidis

We address the text-to-text generation problem of sentence-level paraphrasing -- a phenomenon distinct from and more difficult than word- or phrase-level paraphrasing. Our approach applies multiple-sequence alignment to sentences gathered…

Computation and Language · Computer Science 2007-05-23 Regina Barzilay , Lillian Lee

While recent research on natural language inference has considerably benefited from large annotated datasets, the amount of inference-related knowledge (including commonsense) provided in the annotated data is still rather limited. There…

Computation and Language · Computer Science 2021-09-10 Xiaoyu Yang , Xiaodan Zhu , Zhan Shi , Tianda Li

One of the limitations of semantic parsing approaches to open-domain question answering is the lexicosyntactic gap between natural language questions and knowledge base entries -- there are many ways to ask a question, all with the same…

Computation and Language · Computer Science 2016-08-08 Shashi Narayan , Siva Reddy , Shay B. Cohen

Paraphrase generation is a long-standing task in natural language processing (NLP). Supervised paraphrase generation models, which rely on human-annotated paraphrase pairs, are cost-inefficient and hard to scale up. On the other hand,…

Computation and Language · Computer Science 2023-05-29 Kuan-Hao Huang , Varun Iyer , I-Hung Hsu , Anoop Kumar , Kai-Wei Chang , Aram Galstyan

Generative Pre-trained Transformers (GPTs) have recently been scaled to unprecedented sizes in the history of machine learning. These models, solely trained on the language modeling objective, have been shown to exhibit outstanding few-shot…

Computation and Language · Computer Science 2021-08-31 Jordi Armengol-Estapé , Ona de Gibert Bonet , Maite Melero

Paraphrase generation has been widely used in various downstream tasks. Most tasks benefit mainly from high quality paraphrases, namely those that are semantically similar to, yet linguistically diverse from, the original sentence.…

Computation and Language · Computer Science 2022-04-04 Elron Bandel , Ranit Aharonov , Michal Shmueli-Scheuer , Ilya Shnayderman , Noam Slonim , Liat Ein-Dor

Recent work has shown that a multilingual neural machine translation (NMT) model can be used to judge how well a sentence paraphrases another sentence in the same language (Thompson and Post, 2020); however, attempting to generate…

Computation and Language · Computer Science 2020-10-29 Brian Thompson , Matt Post