English
Related papers

Related papers: Jointly Measuring Diversity and Quality in Text Ge…

200 papers

Most current state-of-the art systems for generating English text from Abstract Meaning Representation (AMR) have been evaluated only using automated metrics, such as BLEU, which are known to be problematic for natural language generation.…

Computation and Language · Computer Science 2020-12-02 Emma Manning , Shira Wein , Nathan Schneider

Generating diverse and relevant questions over text is a task with widespread applications. We argue that commonly-used evaluation metrics such as BLEU and METEOR are not suitable for this task due to the inherent diversity of reference…

Computation and Language · Computer Science 2020-08-18 Michael Sejr Schlichtkrull , Weiwei Cheng

Personalized text generation presents a specialized mechanism for delivering content that is specific to a user's personal context. While the research progress in this area has been rapid, evaluation still presents a challenge. Traditional…

Computation and Language · Computer Science 2023-10-19 Yaqing Wang , Jiepu Jiang , Mingyang Zhang , Cheng Li , Yi Liang , Qiaozhu Mei , Michael Bendersky

We propose BERTScore, an automatic evaluation metric for text generation. Analogously to common metrics, BERTScore computes a similarity score for each token in the candidate sentence with each token in the reference sentence. However,…

Computation and Language · Computer Science 2020-02-25 Tianyi Zhang , Varsha Kishore , Felix Wu , Kilian Q. Weinberger , Yoav Artzi

Generative models are increasingly able to produce remarkably high quality images and text. The community has developed numerous evaluation metrics for comparing generative models. However, these metrics do not effectively quantify data…

Machine Learning · Computer Science 2020-10-15 Liam Fowl , Micah Goldblum , Arjun Gupta , Amr Sharaf , Tom Goldstein

How can we measure whether a natural language generation system produces both high quality and diverse outputs? Human evaluation captures quality but not diversity, as it does not catch models that simply plagiarize from the training set.…

Computation and Language · Computer Science 2019-04-08 Tatsunori B. Hashimoto , Hugh Zhang , Percy Liang

Reproducibility is of utmost concern in machine learning and natural language processing (NLP). In the field of natural language generation (especially machine translation), the seminal paper of Post (2018) has pointed out problems of…

Computation and Language · Computer Science 2022-10-28 Yanran Chen , Jonas Belouadi , Steffen Eger

Evaluation is a bottleneck in the development of natural language generation (NLG) models. Automatic metrics such as BLEU rely on references, but for tasks such as open-ended generation, there are no references to draw upon. Although…

Computation and Language · Computer Science 2020-10-14 Kawin Ethayarajh , Dorsa Sadigh

Many natural language processing applications use language models to generate text. These models are typically trained to predict the next word in a sequence, given the previous words and some context such as an image. However, at test time…

Machine Learning · Computer Science 2016-05-10 Marc'Aurelio Ranzato , Sumit Chopra , Michael Auli , Wojciech Zaremba

Recent advances in automatic evaluation metrics for text have shown that deep contextualized word representations, such as those generated by BERT encoders, are helpful for designing metrics that correlate well with human judgements. At the…

Computation and Language · Computer Science 2020-10-14 Xi Chen , Nan Ding , Tomer Levinboim , Radu Soricut

Since no metrics are available to evaluate specific aspects of a text, such as its personalization quality, the researchers often rely solely on large language models to meta-evaluate such texts. Due to internal biases of individual…

Computation and Language · Computer Science 2025-10-01 Dominik Macko , Andrew Pulver

Text generation is the automated process of producing written or spoken language using computational methods. It involves generating coherent and contextually relevant text based on predefined rules or learned patterns. However, challenges…

Computation and Language · Computer Science 2025-01-30 Rahimanuddin Shaik , Katikela Sreeharsha Kishore

Natural Language Generation (NLG) refers to the operation of expressing the calculation results of a system in human language. Since the quality of generated sentences from an NLG model cannot be fully represented using only quantitative…

Computation and Language · Computer Science 2022-08-04 Dojun Park , Youngjin Jang , Harksoo Kim

Auto-regressive sequence generative models trained by Maximum Likelihood Estimation suffer the exposure bias problem in practical finite sample scenarios. The crux is that the number of training samples for Maximum Likelihood Estimation is…

Machine Learning · Statistics 2020-07-14 Yuxuan Song , Ning Miao , Hao Zhou , Lantao Yu , Mingxuan Wang , Lei Li

Neural Machine Translation (NMT) systems are typically evaluated using automated metrics that assess the agreement between generated translations and ground truth candidates. To improve systems with respect to these metrics, NLP researchers…

Computation and Language · Computer Science 2020-11-30 Nicholas Roberts , Davis Liang , Graham Neubig , Zachary C. Lipton

In this work, we explore a useful but often neglected methodology for robustness analysis of text generation evaluation metrics: stress tests with synthetic data. Basically, we design and synthesize a wide range of potential errors and…

Computation and Language · Computer Science 2023-05-22 Tianxing He , Jingyu Zhang , Tianle Wang , Sachin Kumar , Kyunghyun Cho , James Glass , Yulia Tsvetkov

A wide variety of NLP applications, such as machine translation, summarization, and dialog, involve text generation. One major challenge for these applications is how to evaluate whether such generated texts are actually fluent, accurate,…

Computation and Language · Computer Science 2021-10-28 Weizhe Yuan , Graham Neubig , Pengfei Liu

The use of language models for generating lyrics and poetry has received an increased interest in the last few years. They pose a unique challenge relative to standard natural language problems, as their ultimate purpose is reative, notions…

Artificial Intelligence · Computer Science 2018-11-13 Pablo Samuel Castro , Maria Attarian

Automatic metrics are extensively used to evaluate natural language processing systems. However, there has been increasing focus on how they are used and reported by practitioners within the field. In this paper, we have conducted a survey…

A major challenge in the field of Text Generation is evaluation: Human evaluations are cost-intensive, and automated metrics often display considerable disagreement with human judgments. In this paper, we propose a statistical model of Text…

Computation and Language · Computer Science 2023-06-07 Jan Deriu , Pius von Däniken , Don Tuggener , Mark Cieliebak