English
Related papers

Related papers: Identifying Weaknesses in Machine Translation Metr…

200 papers

Maximum a posteriori decoding, a commonly used method for neural machine translation (NMT), aims to maximize the estimated posterior probability. However, high estimated probability does not always lead to high translation quality. Minimum…

Computation and Language · Computer Science 2025-05-27 Boxuan Lyu , Hidetaka Kamigaito , Kotaro Funakoshi , Manabu Okumura

For sequence-to-sequence tasks it is challenging to combine individual system outputs. Further, there is also often a mismatch between the decoding criterion and the one used for assessment. Minimum Bayes' Risk (MBR) decoding can be used to…

Computation and Language · Computer Science 2023-10-30 Vyas Raina , Mark Gales

Minimum Bayes risk (MBR) decoding is a decision rule of text generation, which selects the hypothesis that maximizes the expected utility and robustly generates higher-quality texts than maximum a posteriori (MAP) decoding. However, it…

Computation and Language · Computer Science 2025-09-17 Hiroyuki Deguchi , Masaaki Nagata

The 2020 WMT Biomedical translation task evaluated Medline abstract translations. This is a small-domain translation task, meaning limited relevant training data with very distinct style and vocabulary. Models trained on such data are…

Computation and Language · Computer Science 2020-10-13 Danielle Saunders , Bill Byrne

Neural machine translation models rely on the beam search algorithm for decoding. In practice, we found that the quality of hypotheses in the search space is negatively affected owing to the fixed beam size. To mitigate this problem, we…

Computation and Language · Computer Science 2017-07-11 Raphael Shu , Hideki Nakayama

Quality Estimation (QE) models for Neural Machine Translation (NMT) predict the quality of the hypothesis without having access to the reference. An emerging research direction in NMT involves the use of QE models, which have demonstrated…

Computation and Language · Computer Science 2025-06-03 Sai Koneru , Matthias Huck , Miriam Exel , Jan Niehues

Minimum Bayes risk (MBR) decoding outputs the hypothesis with the highest expected utility over the model distribution for some utility function. It has been shown to improve accuracy over beam search in conditional language generation…

Computation and Language · Computer Science 2023-11-28 Julius Cheng , Andreas Vlachos

Neural Machine Translation (NMT) has made remarkable progress over the past years. However, under-translation and over-translation remain two challenging problems in state-of-the-art NMT systems. In this work, we conduct an in-depth…

Computation and Language · Computer Science 2024-05-30 Chenze Shao , Fandong Meng , Jiali Zeng , Jie Zhou

We propose a novel decoding approach for neural machine translation (NMT) based on continuous optimisation. We convert decoding - basically a discrete optimization problem - into a continuous optimization problem. The resulting constrained…

Computation and Language · Computer Science 2017-07-25 Cong Duy Vu Hoang , Gholamreza Haffari , Trevor Cohn

Minimum Bayes Risk (MBR) decoding is a text generation technique that has been shown to improve the quality of machine translations, but is expensive, even if a sampling-based approximation is used. Besides requiring a large number of…

Computation and Language · Computer Science 2024-06-04 Jannis Vamvas , Rico Sennrich

Minimum Bayes risk (MBR) decoding is a decision rule of text generation tasks that outperforms conventional maximum a posterior (MAP) decoding using beam search by selecting high-quality outputs based on a utility function rather than those…

Computation and Language · Computer Science 2024-10-22 Hiroyuki Deguchi , Yusuke Sakai , Hidetaka Kamigaito , Taro Watanabe

Strongly human-correlated evaluation metrics serve as an essential compass for the development and improvement of generation models and must be highly reliable and robust. Recent embedding-based neural text evaluation metrics, such as COMET…

Computation and Language · Computer Science 2026-01-14 Hiroyuki Deguchi , Katsuki Chousa , Yusuke Sakai

We present a novel scheme to combine neural machine translation (NMT) with traditional statistical machine translation (SMT). Our approach borrows ideas from linearised lattice minimum Bayes-risk decoding for SMT. The NMT score is combined…

Computation and Language · Computer Science 2017-02-14 Felix Stahlberg , Adrià de Gispert , Eva Hasler , Bill Byrne

Neural Machine Translation systems built on top of Transformer-based architectures are routinely improving the state-of-the-art in translation quality according to word-overlap metrics. However, a growing number of studies also highlight…

Computation and Language · Computer Science 2022-10-18 Shanya Sharma , Manan Dey , Koustuv Sinha

Automatic metrics play a crucial role in machine translation. Despite the widespread use of n-gram-based metrics, there has been a recent surge in the development of pre-trained model-based metrics that focus on measuring sentence…

Computation and Language · Computer Science 2023-07-11 Yiming Yan , Tao Wang , Chengqi Zhao , Shujian Huang , Jiajun Chen , Mingxuan Wang

Minimum Bayes-risk (MBR) decoding has recently gained renewed attention in text generation. MBR decoding considers texts sampled from a model as pseudo-references and selects the text with the highest similarity to the others. Therefore,…

Computation and Language · Computer Science 2024-04-02 Atsumoto Ohashi , Ukyo Honda , Tetsuro Morimura , Yuu Jinnai

Previous studies show that intermediate supervision signals benefit various Natural Language Processing tasks. However, it is not clear whether there exist intermediate signals that benefit Neural Machine Translation (NMT). Borrowing…

Computation and Language · Computer Science 2023-05-17 Chaojun Wang , Yang Liu , Wai Lam

An important challenge in machine translation (MT) is to generate high-quality and diverse translations. Prior work has shown that the estimated likelihood from the MT model correlates poorly with translation quality. In contrast, quality…

Computation and Language · Computer Science 2024-10-17 Gonçalo R. A. Faria , Sweta Agrawal , António Farinhas , Ricardo Rei , José G. C. de Souza , André F. T. Martins

Minimum Bayes Risk (MBR) decoding optimizes output selection by maximizing the expected utility value of an underlying human distribution. While prior work has shown the effectiveness of MBR decoding through empirical evaluation, few…

Computation and Language · Computer Science 2025-06-23 Yuki Ichihara , Yuu Jinnai , Kaito Ariu , Tetsuro Morimura , Eiji Uchibe

Lexically constrained decoding for machine translation has shown to be beneficial in previous studies. Unfortunately, constraints provided by users may contain mistakes in real-world situations. It is still an open question that how to…

Computation and Language · Computer Science 2021-01-27 Huayang Li , Guoping Huang , Deng Cai , Lemao Liu