English
Related papers

Related papers: Enhanced Bilingual Evaluation Understudy

200 papers

Common intermediate language representation in neural machine translation can be used to extend bilingual to multilingual systems by incremental training. In this paper, we propose a new architecture based on introducing an interlingual…

Computation and Language · Computer Science 2019-12-10 Carlos Escolano , Marta R. Costa-jussà , José A. R. Fonollosa

For the past 60 years, Research in machine translation is going on. For the development in this field, a lot of new techniques are being developed each day. As a result, we have witnessed development of many automatic machine translators. A…

Computation and Language · Computer Science 2013-07-25 Nisheeth Joshi , Hemant Darbari , Iti Mathur

Automatic evaluation remains an open research question in Natural Language Generation. In the context of Sentence Simplification, this is particularly challenging: the task requires by nature to replace complex words with simpler ones that…

Computation and Language · Computer Science 2021-04-19 Thomas Scialom , Louis Martin , Jacopo Staiano , Éric Villemonte de la Clergerie , Benoît Sagot

Recently many efforts have been devoted to interpreting the black-box NMT models, but little progress has been made on metrics to evaluate explanation methods. Word Alignment Error Rate can be used as such a metric that matches human…

Computation and Language · Computer Science 2020-05-05 Jierui Li , Lemao Liu , Huayang Li , Guanlin Li , Guoping Huang , Shuming Shi

Recent research suggests that neural machine translation (MT) in the news domain has reached human-level performance, but for other professional domains, it is far below the level. In this paper, we conduct a fine-grained systematic human…

Computation and Language · Computer Science 2021-10-29 Ming Liu , He Zhang , Guanhao Wu

This work introduces a simple regressive ensemble for evaluating machine translation quality based on a set of novel and established metrics. We evaluate the ensemble using a correlation to expert-based MQM scores of the WMT 2021 Metrics…

Computation and Language · Computer Science 2021-09-16 Michal Štefánik , Vít Novotný , Petr Sojka

Machine translation quality has steadily improved over the years, achieving near-perfect translations in recent benchmarks. These high-quality outputs make it difficult to distinguish between state-of-the-art models and to identify areas…

Computation and Language · Computer Science 2025-08-29 Lorenzo Proietti , Stefano Perrella , Vilém Zouhar , Roberto Navigli , Tom Kocmi

Machine Translation is one of the major oldest and the most active research area in Natural Language Processing. Currently, Statistical Machine Translation (SMT) dominates the Machine Translation research. Statistical Machine Translation is…

Computation and Language · Computer Science 2014-10-01 M. Anand Kumar , V. Dhanalakshmi , K. P. Soman , V. Sharmiladevi

We present the first challenge set and evaluation protocol for the analysis of gender bias in machine translation (MT). Our approach uses two recent coreference resolution datasets composed of English sentences which cast participants into…

Computation and Language · Computer Science 2019-06-04 Gabriel Stanovsky , Noah A. Smith , Luke Zettlemoyer

Devising metrics to assess translation quality has always been at the core of machine translation (MT) research. Traditional automatic reference-based metrics, such as BLEU, have shown correlations with human judgements of adequacy and…

Computation and Language · Computer Science 2019-10-15 Carolina Scarton , Mikel L. Forcada , Miquel Esplà-Gomis , Lucia Specia

We propose to achieve explainable neural machine translation (NMT) by changing the output representation to explain itself. We present a novel approach to NMT which generates the target sentence by monotonically walking through the source…

Computation and Language · Computer Science 2018-08-30 Felix Stahlberg , Danielle Saunders , Bill Byrne

Low-resource languages such as isiZulu and isiXhosa face persistent challenges in machine translation due to limited parallel data and linguistic resources. Recent advances in large language models suggest that self-reflection, prompting a…

Computation and Language · Computer Science 2026-01-28 Nicholas Cheng

Neural machine translation has significantly pushed forward the quality of the field. However, there are remaining big issues with the output translations and one of them is fairness. Neural models are trained on large text corpora which…

Computation and Language · Computer Science 2019-06-04 Joel Escudé Font , Marta R. Costa-jussà

Processing of multi-word expressions (MWEs) is a known problem for any natural language processing task. Even neural machine translation (NMT) struggles to overcome it. This paper presents results of experiments on investigating NMT…

Computation and Language · Computer Science 2019-05-07 Matīss Rikters , Ondřej Bojar

I train models for the task of neural machine translation for English-Hungarian and Hungarian-English, using the Hunglish2 corpus. The main contribution of this work is evaluating different data augmentation methods during the training of…

Computation and Language · Computer Science 2021-11-09 Attila Nagy

This paper describes the Stevens Institute of Technology's submission for the WMT 2022 Shared Task: Code-mixed Machine Translation (MixMT). The task consisted of two subtasks, subtask $1$ Hindi/English to Hinglish and subtask $2$ Hinglish…

Computation and Language · Computer Science 2022-11-18 Abdul Rafae Khan , Hrishikesh Kanade , Girish Amar Budhrani , Preet Jhanglani , Jia Xu

Machine translation has many applications such as news translation, email translation, official letter translation etc. Commercial translators, e.g. Google Translation lags in regional vocabulary and are unable to learn the bilingual text…

Computation and Language · Computer Science 2020-08-04 Sandhya Aneja , Siti Nur Afikah Bte Abdul Mazid , Nagender Aneja

We propose iteratively prompting a large language model to self-correct a translation, with inspiration from their strong language understanding and translation capability as well as a human-like translation approach. Interestingly,…

Computation and Language · Computer Science 2024-05-03 Pinzhen Chen , Zhicheng Guo , Barry Haddow , Kenneth Heafield

Machine translation is evolving quite rapidly in terms of quality. Nowadays, we have several machine translation systems available in the web, which provide reasonable translations. However, these systems are not perfect, and their quality…

Computation and Language · Computer Science 2015-10-16 Krzysztof Wołk , Krzysztof Marasek , Wojciech Glinkowski

The creation of a quality summarization dataset is an expensive, time-consuming effort, requiring the production and evaluation of summaries by both trained humans and machines. If such effort is made in one language, it would be beneficial…

Computation and Language · Computer Science 2021-12-09 Spencer Braun , Oleg Vasilyev , Neslihan Iskender , John Bohannon