English
Related papers

Related papers: Regressive Ensemble for Machine Translation Qualit…

200 papers

Neural Machine Translation (NMT) approaches employing monolingual data are showing steady improvements in resource rich conditions. However, evaluations using real-world low-resource languages still result in unsatisfactory performance.…

Computation and Language · Computer Science 2021-03-11 Surafel M. Lakew , Matteo Negri , Marco Turchi

Word-level Quality Estimation (QE) of Machine Translation (MT) aims to find out potential translation errors in the translated sentence without reference. Typically, conventional works on word-level QE are designed to predict the…

Computation and Language · Computer Science 2022-09-14 Zhen Yang , Fandong Meng , Yuanmeng Yan , Jie Zhou

We present a novel framework for machine translation evaluation using neural networks in a pairwise setting, where the goal is to select the better translation from a pair of hypotheses, given the reference translation. In this framework,…

Computation and Language · Computer Science 2019-12-09 Francisco Guzman , Shafiq Joty , Lluis Marquez , Preslav Nakov

Recent work on multilingual neural machine translation reported competitive performance with respect to bilingual models and surprisingly good performance even on (zeroshot) translation directions not observed at training time. We…

Computation and Language · Computer Science 2018-11-06 Surafel M. Lakew , Quintino F. Lotito , Matteo Negri , Marco Turchi , Marcello Federico

The quality of a Neural Machine Translation system depends substantially on the availability of sizable parallel corpora. For low-resource language pairs this is not the case, resulting in poor translation quality. Inspired by work in…

Computation and Language · Computer Science 2018-02-14 Marzieh Fadaee , Arianna Bisazza , Christof Monz

Quality Estimation (QE) is the task of evaluating the quality of a translation when reference translation is not available. The goal of QE aligns with the task of corpus filtering, where we assign the quality score to the sentence pairs…

Computation and Language · Computer Science 2023-06-07 Akshay Batheja , Pushpak Bhattacharyya

Machine Translation (MT) has been widely used for cross-lingual classification, either by translating the test set into English and running inference with a monolingual model (translate-test), or translating the training set into the target…

Computation and Language · Computer Science 2023-05-24 Mikel Artetxe , Vedanuj Goswami , Shruti Bhosale , Angela Fan , Luke Zettlemoyer

We show how to derive state-of-the-art unsupervised neural machine translation systems from generatively pre-trained language models. Our method consists of three steps: few-shot amplification, distillation, and backtranslation. We first…

Machine Translation Quality Estimation is a notoriously difficult task, which lessens its usefulness in real-world translation environments. Such scenarios can be improved if quality predictions are accompanied by a measure of uncertainty.…

Computation and Language · Computer Science 2016-07-01 Daniel Beck , Lucia Specia , Trevor Cohn

Translation quality estimation (TQE) is the task of predicting translation quality without reference translations. Due to the enormous cost of creating training data for TQE, only a few translation directions can benefit from supervised…

Computation and Language · Computer Science 2023-11-10 Yuto Kuroda , Atsushi Fujita , Tomoyuki Kajiwara , Takashi Ninomiya

This paper describes our submission to the shared task on word/phrase level Quality Estimation (QE) in the First Conference on Statistical Machine Translation (WMT16). The objective of the shared task was to predict if the given word/phrase…

Computation and Language · Computer Science 2016-10-25 Raj Nath Patel , Sasikumar M

Machine Translation (MT) evaluation metrics assess translation quality automatically. Recently, researchers have employed MT metrics for various new use cases, such as data filtering and translation re-ranking. However, most MT metrics…

Computation and Language · Computer Science 2024-10-08 Stefano Perrella , Lorenzo Proietti , Pere-Lluís Huguet Cabot , Edoardo Barba , Roberto Navigli

Multilingual machine translation addresses the task of translating between multiple source and target languages. We propose task-specific attention models, a simple but effective technique for improving the quality of sequence-to-sequence…

Computation and Language · Computer Science 2018-06-11 Graeme Blackwood , Miguel Ballesteros , Todd Ward

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

Computation and Language · Computer Science 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

In an attempt to improve overall translation quality, there has been an increasing focus on integrating more linguistic elements into Machine Translation (MT). While significant progress has been achieved, especially recently with neural…

Computation and Language · Computer Science 2018-10-09 Karin Sim Smith , Lucia Specia

Neural machine translation systems estimate probabilities of target sentences given source sentences, yet these estimates may not align with human preferences. This work introduces QE-fusion, a method that synthesizes translations using a…

Computation and Language · Computer Science 2024-06-07 Giorgos Vernikos , Andrei Popescu-Belis

Quality Estimation (QE), the evaluation of machine translation output without the need of explicit references, has seen big improvements in the last years with the use of neural metrics. In this paper we analyze the viability of using QE…

Computation and Language · Computer Science 2023-11-10 Jan-Thorsten Peter , David Vilar , Daniel Deutsch , Mara Finkelstein , Juraj Juraska , Markus Freitag

Prior work has proved that Translation memory (TM) can boost the performance of Neural Machine Translation (NMT). In contrast to existing work that uses bilingual corpus as TM and employs source-side similarity search for memory retrieval,…

Computation and Language · Computer Science 2021-06-03 Deng Cai , Yan Wang , Huayang Li , Wai Lam , Lemao Liu

The ability of zero-shot translation emerges when we train a multilingual model with certain translation directions; the model can then directly translate in unseen directions. Alternatively, zero-shot translation can be accomplished by…

Computation and Language · Computer Science 2025-02-07 Yuqiao Wen , Behzad Shayegh , Chenyang Huang , Yanshuai Cao , Lili Mou

Recent advances in automatic quality estimation for machine translation have exclusively focused on written language, leaving the speech modality underexplored. In this work, we formulate the task of quality estimation for speech…

Computation and Language · Computer Science 2024-10-30 HyoJung Han , Kevin Duh , Marine Carpuat