English
Related papers

Related papers: Generative Pretraining for Paraphrase Evaluation

200 papers

Learning phrase representations has been widely explored in many Natural Language Processing (NLP) tasks (e.g., Sentiment Analysis, Machine Translation) and has shown promising improvements. Previous studies either learn non-compositional…

Computation and Language · Computer Science 2017-10-17 Zhihao Zhou , Lifu Huang , Heng Ji

We introduce Discriminative BLEU (deltaBLEU), a novel metric for intrinsic evaluation of generated text in tasks that admit a diverse range of possible outputs. Reference strings are scored for quality by human raters on a scale of [-1, +1]…

Computation and Language · Computer Science 2015-06-25 Michel Galley , Chris Brockett , Alessandro Sordoni , Yangfeng Ji , Michael Auli , Chris Quirk , Margaret Mitchell , Jianfeng Gao , Bill Dolan

Recent work has shown that a multilingual neural machine translation (NMT) model can be used to judge how well a sentence paraphrases another sentence in the same language (Thompson and Post, 2020); however, attempting to generate…

Computation and Language · Computer Science 2020-10-29 Brian Thompson , Matt Post

Paraphrase generation is a long-standing problem and serves an essential role in many natural language processing problems. Despite some encouraging results, recent methods either confront the problem of favoring generic utterance or need…

Computation and Language · Computer Science 2020-12-01 Tien-Cuong Bui , Van-Duc Le , Hai-Thien To , Sang Kyun Cha

Automatic evaluation comparing candidate translations to human-generated paraphrases of reference translations has recently been proposed by Freitag et al. When used in place of original references, the paraphrased versions produce metric…

Computation and Language · Computer Science 2020-10-21 Markus Freitag , George Foster , David Grangier , Colin Cherry

Learning distributed sentence representations remains an interesting problem in the field of Natural Language Processing (NLP). We want to learn a model that approximates the conditional latent space over the representations of a logical…

Computation and Language · Computer Science 2018-03-08 Yikang Shen , Shawn Tan , Chin-Wei Huang , Aaron Courville

Automatic evaluation for open-ended natural language generation tasks remains a challenge. Existing metrics such as BLEU show a low correlation with human judgment. We propose a novel and powerful learning-based evaluation metric:…

Computation and Language · Computer Science 2020-08-20 Jing Gu , Qingyang Wu , Zhou Yu

Paraphrase generation is an interesting and challenging NLP task which has numerous practical applications. In this paper, we analyze datasets commonly used for paraphrase generation research, and show that simply parroting input sentences…

Computation and Language · Computer Science 2019-08-22 Hongren Mao , Hung-yi Lee

Many natural language processing applications use language models to generate text. These models are typically trained to predict the next word in a sequence, given the previous words and some context such as an image. However, at test time…

Machine Learning · Computer Science 2016-05-10 Marc'Aurelio Ranzato , Sumit Chopra , Michael Auli , Wojciech Zaremba

The task of determining whether two texts are paraphrases has long been a challenge in NLP. However, the prevailing notion of paraphrase is often quite simplistic, offering only a limited view of the vast spectrum of paraphrase phenomena.…

Computation and Language · Computer Science 2024-12-17 Andrianos Michail , Simon Clematide , Juri Opitz

Paraphrase generation is a difficult problem. This is not only because of the limitations in text generation capabilities but also due that to the lack of a proper definition of what qualifies as a paraphrase and corresponding metrics to…

Computation and Language · Computer Science 2022-05-27 Omkar Patil , Rahul Singh , Tarun Joshi

This study presents a new approach to metaphorical paraphrase generation by masking literal tokens of literal sentences and unmasking them with metaphorical language models. Unlike similar studies, the proposed algorithm does not only focus…

Computation and Language · Computer Science 2022-10-14 Giorgio Ottolina , John Pavlopoulos

We introduce Parallel Paraphrasing ($\text{Para}_\text{both}$), an augmentation method for translation metrics making use of automatic paraphrasing of both the reference and hypothesis. This method counteracts the typically misleading…

Computation and Language · Computer Science 2023-05-23 Claudio Paonessa , Dominik Frefel , Manfred Vogel

Text generation is an important Natural Language Processing task with various applications. Although several metrics have already been introduced to evaluate the text generation methods, each of them has its own shortcomings. The most…

Machine Learning · Computer Science 2019-05-22 Ehsan Montahaei , Danial Alihosseini , Mahdieh Soleymani Baghshah

We present a system that allows users to train their own state-of-the-art paraphrastic sentence representations in a variety of languages. We also release trained models for English, Arabic, German, French, Spanish, Russian, Turkish, and…

Computation and Language · Computer Science 2023-06-06 John Wieting , Kevin Gimpel , Graham Neubig , Taylor Berg-Kirkpatrick

Most recent approaches use the sequence-to-sequence model for paraphrase generation. The existing sequence-to-sequence model tends to memorize the words and the patterns in the training dataset instead of learning the meaning of the words.…

Computation and Language · Computer Science 2018-04-02 Shuming Ma , Xu Sun , Wei Li , Sujian Li , Wenjie Li , Xuancheng Ren

This paper describes our approach to hierarchical multi-label detection of persuasion techniques in meme texts. Our model, developed as a part of the recent SemEval task, is based on fine-tuning individual language models (BERT,…

Computation and Language · Computer Science 2024-07-04 Kota Shamanth Ramanath Nayak , Leila Kosseim

Paraphrase generation, a.k.a. paraphrasing, is a common and important task in natural language processing. Emotional paraphrasing, which changes the emotion embodied in a piece of text while preserving its meaning, has many potential…

Computation and Language · Computer Science 2022-12-08 Justin Xie

Compositional vector space models of meaning promise new solutions to stubborn language understanding problems. This paper makes two contributions toward this end: (i) it uses automatically-extracted paraphrase examples as a source of…

Computation and Language · Computer Science 2018-02-01 Avneesh Saluja , Chris Dyer , Jean-David Ruvini

Paraphrase generation is a longstanding important problem in natural language processing. In addition, recent progress in deep generative models has shown promising results on discrete latent variables for text generation. Inspired by…

Computation and Language · Computer Science 2020-01-08 Yao Fu , Yansong Feng , John P. Cunningham