English
Related papers

Related papers: Why We Need New Evaluation Metrics for NLG

200 papers

Human evaluation for natural language generation (NLG) often suffers from inconsistent user ratings. While previous research tends to attribute this problem to individual user preferences, we show that the quality of human judgements can…

Computation and Language · Computer Science 2018-10-03 Jekaterina Novikova , Ondřej Dušek , Verena Rieser

Evaluating natural language generation (NLG) systems in the medical domain presents unique challenges due to the critical demands for accuracy, relevance, and domain-specific expertise. Traditional automatic evaluation metrics, such as…

Computation and Language · Computer Science 2025-09-17 Wen-wai Yim , Asma Ben Abacha , Zixuan Yu , Robert Doerning , Fei Xia , Meliha Yetisgen

Although neural-based machine translation evaluation metrics, such as COMET or BLEURT, have achieved strong correlations with human judgements, they are sometimes unreliable in detecting certain phenomena that can be considered as critical…

Computation and Language · Computer Science 2023-05-31 Taisiya Glushkova , Chrysoula Zerva , André F. T. Martins

Re-speaking is a mechanism for obtaining high quality subtitles for use in live broadcast and other public events. Because it relies on humans performing the actual re-speaking, the task of estimating the quality of the results is…

Computation and Language · Computer Science 2016-01-13 Krzysztof Wołk , Danijel Koržinek

For natural language understanding (NLU) technology to be maximally useful, both practically and as a scientific object of study, it must be general: it must be able to process language in a way that is not exclusively tailored to any one…

Computation and Language · Computer Science 2019-02-26 Alex Wang , Amanpreet Singh , Julian Michael , Felix Hill , Omer Levy , Samuel R. Bowman

Automatic metrics are essential for developing natural language generation (NLG) models, particularly for open-ended language generation tasks such as story generation. However, existing automatic metrics are observed to correlate poorly…

Computation and Language · Computer Science 2021-05-20 Jian Guan , Zhexin Zhang , Zhuoer Feng , Zitao Liu , Wenbiao Ding , Xiaoxi Mao , Changjie Fan , Minlie Huang

Standard automatic metrics, e.g. BLEU, are not reliable for document-level MT evaluation. They can neither distinguish document-level improvements in translation quality from sentence-level ones, nor identify the discourse phenomena that…

Computation and Language · Computer Science 2022-07-06 Yuchen Eleanor Jiang , Tianyu Liu , Shuming Ma , Dongdong Zhang , Jian Yang , Haoyang Huang , Rico Sennrich , Ryan Cotterell , Mrinmaya Sachan , Ming Zhou

The quality of texts generated by natural language generation (NLG) systems is hard to measure automatically. Conventional reference-based metrics, such as BLEU and ROUGE, have been shown to have relatively low correlation with human…

Computation and Language · Computer Science 2023-05-25 Yang Liu , Dan Iter , Yichong Xu , Shuohang Wang , Ruochen Xu , Chenguang Zhu

Evaluating Natural Language Generation (NLG) systems is a challenging task. Firstly, the metric should ensure that the generated hypothesis reflects the reference's semantics. Secondly, it should consider the grammatical quality of the…

Computation and Language · Computer Science 2022-03-18 Md Rashad Al Hasan Rony , Liubov Kovriguina , Debanjan Chaudhuri , Ricardo Usbeck , Jens Lehmann

Large Language Model (LLM)-based systems present new opportunities for autonomous health monitoring in sensor-rich industrial environments. This study explores the potential of LLMs to detect and classify faults directly from sensor data,…

Artificial Intelligence · Computer Science 2025-09-30 Xian Yeow Lee , Lasitha Vidyaratne , Ahmed Farahat , Chetan Gupta

Artificial neural networks (NN) are instrumental in realizing highly-automated driving functionality. An overarching challenge is to identify best safety engineering practices for NN and other learning-enabled components. In particular,…

Machine Learning · Computer Science 2018-06-11 Chih-Hong Cheng , Georg Nührenberg , Chung-Hao Huang , Harald Ruess , Hirotoshi Yasuoka

Automated evaluation of open domain natural language generation (NLG) models remains a challenge and widely used metrics such as BLEU and Perplexity can be misleading in some cases. In our paper, we propose to evaluate natural language…

Computation and Language · Computer Science 2020-02-13 Wangchunshu Zhou , Ke Xu

While most neural machine translation (NMT) systems are still trained using maximum likelihood estimation, recent work has demonstrated that optimizing systems to directly improve evaluation metrics such as BLEU can substantially improve…

Computation and Language · Computer Science 2019-09-17 John Wieting , Taylor Berg-Kirkpatrick , Kevin Gimpel , Graham Neubig

As Natural Language Generation (NLG) dominates modern NLP, scalable evaluation remains a critical bottleneck. Consequently, LLM-as-a-judge (LaaJ) adoption has accelerated rapidly, appearing in more papers than human evaluation in 2025. This…

Assessing the quality of natural language generation systems through human annotation is very expensive. Additionally, human annotation campaigns are time-consuming and include non-reusable human labour. In practice, researchers rely on…

Computation and Language · Computer Science 2022-03-28 Pierre Colombo , Chloe Clavel , Pablo Piantanida

Machine translation (MT) was developed as one of the hottest research topics in the natural language processing (NLP) literature. One important issue in MT is that how to evaluate the MT system reasonably and tell us whether the translation…

Computation and Language · Computer Science 2022-01-25 Lifeng Han

Commit messages are essential in software development as they serve to document and explain code changes. Yet, their quality often falls short in practice, with studies showing significant proportions of empty or inadequate messages. While…

Software Engineering · Computer Science 2025-07-16 Qunhong Zeng , Yuxia Zhang , Zexiong Ma , Bo Jiang , Ningyuan Sun , Klaas-Jan Stol , Xingyu Mou , Hui Liu

Evaluation metrics that are not robust to dialect variation make it impossible to tell how well systems perform for many groups of users, and can even penalize systems for producing text in lower-resource dialects. However, currently, there…

Computation and Language · Computer Science 2022-11-03 Jiao Sun , Thibault Sellam , Elizabeth Clark , Tu Vu , Timothy Dozat , Dan Garrette , Aditya Siddhant , Jacob Eisenstein , Sebastian Gehrmann

Recent studies have used both automatic metrics and human evaluations to assess the simplification abilities of LLMs. However, the suitability of existing evaluation methodologies for LLMs remains in question. First, the suitability of…

Computation and Language · Computer Science 2025-07-15 Xuanxin Wu , Yuki Arase

This paper describes the DSBA submissions to the Prompting Large Language Models as Explainable Metrics shared task, where systems were submitted to two tracks: small and large summarization tracks. With advanced Large Language Models…

Computation and Language · Computer Science 2023-11-08 Joonghoon Kim , Saeran Park , Kiyoon Jeong , Sangmin Lee , Seung Hun Han , Jiyoon Lee , Pilsung Kang