English
Related papers

Related papers: Meta-Evaluation of Translation Evaluation Methods:…

200 papers

Several neural-based metrics have been recently proposed to evaluate machine translation quality. However, all of them resort to point estimates, which provide limited information at segment level. This is made worse as they are trained on…

Computation and Language · Computer Science 2022-03-28 Taisiya Glushkova , Chrysoula Zerva , Ricardo Rei , André F. T. Martins

Neural Machine Translation (NMT) has shown remarkable progress over the past few years with production systems now being deployed to end-users. One major drawback of current architectures is that they are expensive to train, typically…

Computation and Language · Computer Science 2017-03-23 Denny Britz , Anna Goldie , Minh-Thang Luong , Quoc Le

Recent machine translation (MT) metrics calibrate their effectiveness by correlating with human judgement but without any insights about their behaviour across different error types. Challenge sets are used to probe specific dimensions of…

Computation and Language · Computer Science 2024-01-30 Nikita Moghe , Arnisa Fazla , Chantal Amrhein , Tom Kocmi , Mark Steedman , Alexandra Birch , Rico Sennrich , Liane Guillou

In recent years, natural language processing (NLP) has got great development with deep learning techniques. In the sub-field of machine translation, a new approach named Neural Machine Translation (NMT) has emerged and got massive attention…

Computation and Language · Computer Science 2020-02-19 Shuoheng Yang , Yuxin Wang , Xiaowen Chu

Large Language Models (LLMs) are rapidly reshaping machine translation (MT), particularly by introducing instruction-following, in-context learning, and preference-based alignment into what has traditionally been a supervised…

Computation and Language · Computer Science 2026-04-29 Baban Gain , Dibyanayan Bandyopadhyay , Asif Ekbal , Trilok Nath Singh

While neural machine translation (NMT) has achieved state-of-the-art translation performance, it is unable to capture the alignment between the input and output during the translation process. The lack of alignment in NMT models leads to…

Computation and Language · Computer Science 2019-12-02 Jiacheng Zhang , Huanbo Luan , Maosong Sun , FeiFei Zhai , Jingfang Xu , Yang Liu

Current Machine Translation (MT) systems achieve very good results on a growing variety of language pairs and datasets. However, they are known to produce fluent translation outputs that can contain important meaning errors, thus…

Computation and Language · Computer Science 2021-09-23 Diptesh Kanojia , Marina Fomicheva , Tharindu Ranasinghe , Frédéric Blain , Constantin Orăsan , Lucia Specia

This paper presents EvolveMT for efficiently combining multiple machine translation (MT) engines. The proposed system selects the output from a single engine for each segment by utilizing online learning techniques to predict the most…

Computation and Language · Computer Science 2023-06-22 Kamer Ali Yuksel , Ahmet Gunduz , Mohamed Al-Badrashiny , Shreyas Sharma , Hassan Sawaf

Unsupervised Neural Machine Translation (UNMT) focuses on improving NMT results under the assumption there is no human translated parallel data, yet little work has been done so far in highlighting its advantages compared to supervised…

Computation and Language · Computer Science 2023-12-21 Isidora Chara Tourni , Derry Wijaya

Literary translation is a culturally significant task, but it is bottlenecked by the small number of qualified literary translators relative to the many untranslated works published around the world. Machine translation (MT) holds potential…

Computation and Language · Computer Science 2022-10-27 Katherine Thai , Marzena Karpinska , Kalpesh Krishna , Bill Ray , Moira Inghilleri , John Wieting , Mohit Iyyer

Achieving universal translation between all human language pairs is the holy-grail of machine translation (MT) research. While recent progress in massively multilingual MT is one step closer to reaching this goal, it is becoming evident…

Computation and Language · Computer Science 2022-01-14 Aditya Siddhant , Ankur Bapna , Orhan Firat , Yuan Cao , Mia Xu Chen , Isaac Caswell , Xavier Garcia

Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation, or having meta-information. Although there exist various…

Computation and Language · Computer Science 2020-10-20 Jingjing Huo , Christian Herold , Yingbo Gao , Leonard Dahlmann , Shahram Khadivi , Hermann Ney

Neural Machine Translation (NMT) models generally perform translation using a fixed-size lexical vocabulary, which is an important bottleneck on their generalization capability and overall translation quality. The standard approach to…

Computation and Language · Computer Science 2019-10-22 Duygu Ataman , Orhan Firat , Mattia A. Di Gangi , Marcello Federico , Alexandra Birch

Devising metrics to assess translation quality has always been at the core of machine translation (MT) research. Traditional automatic reference-based metrics, such as BLEU, have shown correlations with human judgements of adequacy and…

Computation and Language · Computer Science 2019-10-15 Carolina Scarton , Mikel L. Forcada , Miquel Esplà-Gomis , Lucia Specia

Machine Translation (MT) has been widely used for cross-lingual classification, either by translating the test set into English and running inference with a monolingual model (translate-test), or translating the training set into the target…

Computation and Language · Computer Science 2023-05-24 Mikel Artetxe , Vedanuj Goswami , Shruti Bhosale , Angela Fan , Luke Zettlemoyer

Machine Translation Quality Estimation is a notoriously difficult task, which lessens its usefulness in real-world translation environments. Such scenarios can be improved if quality predictions are accompanied by a measure of uncertainty.…

Computation and Language · Computer Science 2016-07-01 Daniel Beck , Lucia Specia , Trevor Cohn

Neural machine translation (NMT) has set new quality standards in automatic translation, yet its effect on post-editing productivity is still pending thorough investigation. We empirically test how the inclusion of NMT, in addition to…

Computation and Language · Computer Science 2019-06-06 Samuel Läubli , Chantal Amrhein , Patrick Düggelin , Beatriz Gonzalez , Alena Zwahlen , Martin Volk

Pretrained character-level and byte-level language models have been shown to be competitive with popular subword models across a range of Natural Language Processing (NLP) tasks. However, there has been little research on their…

Computation and Language · Computer Science 2024-05-24 Lukas Edman , Gabriele Sarti , Antonio Toral , Gertjan van Noord , Arianna Bisazza

Social media companies as well as authorities make extensive use of artificial intelligence (AI) tools to monitor postings of hate speech, celebrations of violence or profanity. Since AI software requires massive volumes of data to train…

Computation and Language · Computer Science 2021-09-30 Hadeel Saadany , Constantin Orasan

The field of Neural Style Transfer (NST) has witnessed remarkable progress in the past few years, with approaches being able to synthesize artistic and photorealistic images and videos of exceptional quality. To evaluate such results, a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Eleftherios Ioannou , Steve Maddock