English
Related papers

Related papers: Improve the Evaluation of Fluency Using Entropy fo…

200 papers

Neural machine translation (NMT) models are conventionally trained with token-level negative log-likelihood (NLL), which does not guarantee that the generated translations will be optimized for a selected sequence-level evaluation metric.…

Computation and Language · Computer Science 2021-04-16 Raphael Shu , Kang Min Yoo , Jung-Woo Ha

This paper presents a class of new fast non-trainable entropy-based confidence estimation methods for automatic speech recognition. We show how per-frame entropy values can be normalized and aggregated to obtain a confidence measure per…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-09 Aleksandr Laptev , Boris Ginsburg

In neural machine translation (NMT), the computational cost at the output layer increases with the size of the target-side vocabulary. Using a limited-size vocabulary instead may cause a significant decrease in translation quality. This…

Computation and Language · Computer Science 2018-07-31 Katsuki Chousa , Katsuhito Sudoh , Satoshi Nakamura

Recently many efforts have been devoted to interpreting the black-box NMT models, but little progress has been made on metrics to evaluate explanation methods. Word Alignment Error Rate can be used as such a metric that matches human…

Computation and Language · Computer Science 2020-05-05 Jierui Li , Lemao Liu , Huayang Li , Guanlin Li , Guoping Huang , Shuming Shi

We investigate a long-perceived shortcoming in the typical use of BLEU: its reliance on a single reference. Using modern neural paraphrasing techniques, we study whether automatically generating additional diverse references can provide…

Computation and Language · Computer Science 2020-10-12 Rachel Bawden , Biao Zhang , Lisa Yankovskaya , Andre Tättar , Matt Post

Machine-translated text plays an important role in modern life by smoothing communication from various communities using different languages. However, unnatural translation may lead to misunderstanding, a detector is thus needed to avoid…

Computation and Language · Computer Science 2019-04-25 Hoang-Quoc Nguyen-Son , Tran Phuong Thao , Seira Hidano , Shinsaku Kiyomoto

It is well known that translations generated by an excellent document-level neural machine translation (NMT) model are consistent and coherent. However, existing sentence-level evaluation metrics like BLEU can hardly reflect the model's…

Computation and Language · Computer Science 2022-08-22 Xin Tan , Longyin Zhang , Guodong Zhou

Machine translation (MT) was developed as one of the hottest research topics in the natural language processing (NLP) literature. One important issue in MT is that how to evaluate the MT system reasonably and tell us whether the translation…

Computation and Language · Computer Science 2022-01-25 Lifeng Han

Although neural machine translation(NMT) yields promising translation performance, it unfortunately suffers from over- and under-translation is- sues [Tu et al., 2016], of which studies have become research hotspots in NMT. At present,…

Computation and Language · Computer Science 2018-07-25 Jing Yang , Biao Zhang , Yue Qin , Xiangwen Zhang , Qian Lin , Jinsong Su

Neural machine translation (NMT), a new approach to machine translation, has achieved promising results comparable to those of traditional approaches such as statistical machine translation (SMT). Despite its recent success, NMT cannot…

Computation and Language · Computer Science 2017-09-07 Zi Long , Ryuichiro Kimura , Takehito Utsuro , Tomoharu Mitsuhashi , Mikio Yamamoto

Neural Machine Translation (NMT) systems are typically evaluated using automated metrics that assess the agreement between generated translations and ground truth candidates. To improve systems with respect to these metrics, NLP researchers…

Computation and Language · Computer Science 2020-11-30 Nicholas Roberts , Davis Liang , Graham Neubig , Zachary C. Lipton

The quality of machine translation systems has dramatically improved over the last decade, and as a result, evaluation has become an increasingly challenging problem. This paper describes our contribution to the WMT 2020 Metrics Shared…

Computation and Language · Computer Science 2020-10-21 Thibault Sellam , Amy Pu , Hyung Won Chung , Sebastian Gehrmann , Qijun Tan , Markus Freitag , Dipanjan Das , Ankur P. Parikh

Automatic metrics are commonly used as the exclusive tool for declaring the superiority of one machine translation system's quality over another. The community choice of automatic metric guides research directions and industrial…

Computation and Language · Computer Science 2021-09-15 Tom Kocmi , Christian Federmann , Roman Grundkiewicz , Marcin Junczys-Dowmunt , Hitokazu Matsushita , Arul Menezes

Automatic metrics are fundamental for the development and evaluation of machine translation systems. Judging whether, and to what extent, automatic metrics concur with the gold standard of human evaluation is not a straightforward problem.…

Computation and Language · Computer Science 2020-06-15 Nitika Mathur , Timothy Baldwin , Trevor Cohn

Neural metrics for machine translation evaluation, such as COMET, exhibit significant improvements in their correlation with human judgments, as compared to traditional metrics based on lexical overlap, such as BLEU. Yet, neural metrics…

Computation and Language · Computer Science 2023-05-22 Ricardo Rei , Nuno M. Guerreiro , Marcos Treviso , Luisa Coheur , Alon Lavie , André F. T. Martins

Learned metrics such as BLEURT have in recent years become widely employed to evaluate the quality of machine translation systems. Training such metrics requires data which can be expensive and difficult to acquire, particularly for…

Computation and Language · Computer Science 2023-02-08 Amirkeivan Mohtashami , Mauro Verzetti , Paul K. Rubenstein

Entropy rate of sequential data-streams naturally quantifies the complexity of the generative process. Thus entropy rate fluctuations could be used as a tool to recognize dynamical perturbations in signal sources, and could potentially be…

Information Theory · Computer Science 2014-03-24 Ishanu Chattopadhyay , Hod Lipson

Despite increasing instances of machine translation (MT) systems including contextual information, the evidence for translation quality improvement is sparse, especially for discourse phenomena. Popular metrics like BLEU are not expressive…

Computation and Language · Computer Science 2020-05-01 Prathyusha Jwalapuram , Barbara Rychalska , Shafiq Joty , Dominika Basaj

Reinforcement Learning (RL) is a powerful framework to address the discrepancy between loss functions used during training and the final evaluation metrics to be used at test time. When applied to neural Machine Translation (MT), it…

Computation and Language · Computer Science 2021-02-24 Julia Ive , Zixu Wang , Marina Fomicheva , Lucia Specia

Document-level translation models are usually evaluated using general metrics such as BLEU, which are not informative about the benefits of context. Current work on context-aware evaluation, such as contrastive methods, only measure…

Computation and Language · Computer Science 2024-02-05 Wafaa Mohammed , Vlad Niculae