English
Related papers

Related papers: Reference-free Evaluation Metrics for Text Generat…

200 papers

Large Language Models (LLMs) evaluation is a patchy and inconsistent landscape, and it is becoming clear that the quality of automatic evaluation metrics is not keeping up with the pace of development of generative models. We aim to improve…

Computation and Language · Computer Science 2023-10-24 Andrea Sottana , Bin Liang , Kai Zou , Zheng Yuan

Automatic machine translation metrics typically rely on human translations to determine the quality of system translations. Common wisdom in the field dictates that the human references should be of very high quality. However, there are no…

Computation and Language · Computer Science 2024-04-11 Vilém Zouhar , Ondřej Bojar

The majority of NLG evaluation relies on automatic metrics, such as BLEU . In this paper, we motivate the need for novel, system- and data-independent automatic evaluation methods: We investigate a wide range of metrics, including…

Computation and Language · Computer Science 2017-09-18 Jekaterina Novikova , Ondřej Dušek , Amanda Cercas Curry , Verena Rieser

This research presents and compares multiple approaches to automate the generation of literature reviews using several Natural Language Processing (NLP) techniques and retrieval-augmented generation (RAG) with a Large Language Model (LLM).…

Computation and Language · Computer Science 2024-11-28 Nurshat Fateh Ali , Md. Mahdi Mohtasim , Shakil Mosharrof , T. Gopi Krishna

Work on instruction-tuned Large Language Models (LLMs) has used automatic methods based on text overlap and LLM judgments as cost-effective alternatives to human evaluation. In this paper, we perform a meta-evaluation of such methods and…

Computation and Language · Computer Science 2024-10-03 Ehsan Doostmohammadi , Oskar Holmström , Marco Kuhlmann

Automatic evaluation for open-ended natural language generation tasks remains a challenge. Existing metrics such as BLEU show a low correlation with human judgment. We propose a novel and powerful learning-based evaluation metric:…

Computation and Language · Computer Science 2020-08-20 Jing Gu , Qingyang Wu , Zhou Yu

In this study, we analyze automatic evaluation metrics for Natural Language Generation (NLG), specifically task-agnostic metrics and human-aligned metrics. Task-agnostic metrics, such as Perplexity, BLEU, BERTScore, are cost-effective and…

Computation and Language · Computer Science 2023-05-29 Iftitahu Ni'mah , Meng Fang , Vlado Menkovski , Mykola Pechenizkiy

There has always been criticism for using $n$-gram based similarity metrics, such as BLEU, NIST, etc, for evaluating the performance of NLG systems. However, these metrics continue to remain popular and are recently being used for…

Computation and Language · Computer Science 2018-09-03 Preksha Nema , Mitesh M. Khapra

While subjective assessments have been the gold standard for evaluating speech generation, there is a growing need for objective metrics that are highly correlated with human subjective judgments due to their cost efficiency. This paper…

Fluency is a crucial goal of all Natural Language Generation (NLG) systems. Widely used automatic evaluation metrics fall short in capturing the fluency of machine-generated text. Assessing the fluency of NLG systems poses a challenge since…

Computation and Language · Computer Science 2023-12-05 Gopichand Kanumolu , Lokesh Madasu , Pavan Baswani , Ananya Mukherjee , Manish Shrivastava

Question Generation (QG) aims to automate the task of composing questions for a passage with a set of chosen answers found within the passage. In recent years, the introduction of neural generation models has resulted in substantial…

Computation and Language · Computer Science 2022-11-09 Tianbo Ji , Chenyang Lyu , Gareth Jones , Liting Zhou , Yvette Graham

Automated evaluation of open domain natural language generation (NLG) models remains a challenge and widely used metrics such as BLEU and Perplexity can be misleading in some cases. In our paper, we propose to evaluate natural language…

Computation and Language · Computer Science 2020-02-13 Wangchunshu Zhou , Ke Xu

Many Natural Language Generation (NLG) tasks aim to generate a single output text given an input prompt. Other settings require the generation of multiple texts, e.g., for Synthetic Traffic Generation (STG). This generation task is crucial…

Computation and Language · Computer Science 2023-11-22 Simone Filice , Jason Ingyu Choi , Giuseppe Castellucci , Eugene Agichtein , Oleg Rokhlenko

Question generation (QGen) models are often evaluated with standardized NLG metrics that are based on n-gram overlap. In this paper, we measure whether these metric improvements translate to gains in a practical setting, focusing on the use…

Computation and Language · Computer Science 2022-05-05 Philippe Laban , Chien-Sheng Wu , Lidiya Murakhovs'ka , Wenhao Liu , Caiming Xiong

Fast and reliable evaluation metrics are key to R&D progress. While traditional natural language generation metrics are fast, they are not very reliable. Conversely, new metrics based on large pretrained language models are much more…

Computation and Language · Computer Science 2021-10-19 Moussa Kamal Eddine , Guokan Shang , Antoine J. -P. Tixier , Michalis Vazirgiannis

Automatic evaluation metrics capable of replacing human judgments are critical to allowing fast development of new methods. Thus, numerous research efforts have focused on crafting such metrics. In this work, we take a step back and analyze…

Computation and Language · Computer Science 2022-10-10 Pierre Colombo , Maxime Peyrard , Nathan Noiry , Robert West , Pablo Piantanida

Human ratings are one of the most prevalent methods to evaluate the performance of natural language processing algorithms. Similarly, it is common to measure the quality of sentences generated by a natural language generation model using…

Computation and Language · Computer Science 2021-04-13 Jakob Nyberg , Ramesh Manuvinakurike , Maike Paetzel-Prüsmann

Large language models (LLMs) have emerged as a potential solution to automate the complex processes involved in writing literature reviews, such as literature collection, organization, and summarization. However, it is yet unclear how good…

Computation and Language · Computer Science 2025-08-22 Xuemei Tang , Xufeng Duan , Zhenguang G. Cai

Existing metrics for evaluating the quality of automatically generated questions such as BLEU, ROUGE, BERTScore, and BLEURT compare the reference and predicted questions, providing a high score when there is a considerable lexical overlap…

Computation and Language · Computer Science 2023-05-29 Alireza Mohammadshahi , Thomas Scialom , Majid Yazdani , Pouya Yanki , Angela Fan , James Henderson , Marzieh Saeidi

Existing evaluation metrics for natural language generation (NLG) tasks face the challenges on generalization ability and interpretability. Specifically, most of the well-performed metrics are required to train on evaluation datasets of…

Computation and Language · Computer Science 2023-07-14 Pei Ke , Fei Huang , Fei Mi , Yasheng Wang , Qun Liu , Xiaoyan Zhu , Minlie Huang