English
Related papers

Related papers: Can Your Context-Aware MT System Pass the DiP Benc…

200 papers

This paper does not aim at introducing a novel model for document-level neural machine translation. Instead, we head back to the original Transformer model and hope to answer the following question: Is the capacity of current models strong…

Computation and Language · Computer Science 2022-03-15 Zewei Sun , Mingxuan Wang , Hao Zhou , Chengqi Zhao , Shujian Huang , Jiajun Chen , Lei Li

Popular Neural Machine Translation model training uses strategies like backtranslation to improve BLEU scores, requiring large amounts of additional data and training. We introduce a class of conditional generative-discriminative hybrid…

Computation and Language · Computer Science 2020-10-16 Prathyusha Jwalapuram , Shafiq Joty , Youlin Shen

Document-level machine translation conditions on surrounding sentences to produce coherent translations. There has been much recent work in this area with the introduction of custom model architectures and decoding algorithms. This paper…

Computation and Language · Computer Science 2021-01-28 Zhiyi Ma , Sergey Edunov , Michael Auli

Recent machine translation (MT) metrics calibrate their effectiveness by correlating with human judgement but without any insights about their behaviour across different error types. Challenge sets are used to probe specific dimensions of…

Computation and Language · Computer Science 2024-01-30 Nikita Moghe , Arnisa Fazla , Chantal Amrhein , Tom Kocmi , Mark Steedman , Alexandra Birch , Rico Sennrich , Liane Guillou

Image captioning involves generating textual descriptions from input images, bridging the gap between computer vision and natural language processing. Recent advancements in transformer-based models have significantly improved caption…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Israa A. Albadarneh , Bassam H. Hammo , Omar S. Al-Kadi

The high-quality translation results produced by machine translation (MT) systems still pose a huge challenge for automatic evaluation. Current MT evaluation pays the same attention to each sentence component, while the questions of…

Computation and Language · Computer Science 2021-08-02 Runzhe Zhan , Xuebo Liu , Derek F. Wong , Lidia S. Chao

The rapid proliferation of LLMs has created a critical evaluation paradox: while LLMs claim multilingual proficiency, comprehensive non-machine-translated benchmarks exist for fewer than 30 languages, leaving >98% of the world's 7,000…

This paper addresses the task of contextual translation using multi-segment models. Specifically we show that increasing model capacity further pushes the limits of this approach and that deeper models are more suited to capture context…

Computation and Language · Computer Science 2022-10-24 Suvodeep Majumder , Stanislas Lauly , Maria Nadejde , Marcello Federico , Georgiana Dinu

A good evaluation framework should evaluate multimodal machine translation (MMT) models by measuring 1) their use of visual information to aid in the translation task and 2) their ability to translate complex sentences such as done for…

Computation and Language · Computer Science 2024-03-06 Vipin Vijayan , Braeden Bowen , Scott Grigsby , Timothy Anderson , Jeremy Gwinnup

In translation, considering the document as a whole can help to resolve ambiguities and inconsistencies. In this paper, we propose a cross-sentence context-aware approach and investigate the influence of historical contextual information on…

Computation and Language · Computer Science 2017-07-25 Longyue Wang , Zhaopeng Tu , Andy Way , Qun Liu

Starting from the 1950s, Machine Translation (MT) was challenged by different scientific solutions, which included rule-based methods, example-based and statistical models (SMT), to hybrid models, and very recent years the neural models…

Computation and Language · Computer Science 2025-08-07 Lifeng Han , Serge Gladkoff

Alignment with human preferences is an important step in developing accurate and safe large language models. This is no exception in machine translation (MT), where better handling of language nuances and context-specific variations leads…

Several neural-based metrics have been recently proposed to evaluate machine translation quality. However, all of them resort to point estimates, which provide limited information at segment level. This is made worse as they are trained on…

Computation and Language · Computer Science 2022-03-28 Taisiya Glushkova , Chrysoula Zerva , Ricardo Rei , André F. T. Martins

Automatic evaluation metrics are crucial for advancing sign language translation (SLT). Current SLT evaluation metrics, such as BLEU and ROUGE, are only text-based, and it remains unclear to what extent text-based metrics can reliably…

Computation and Language · Computer Science 2025-11-17 Shakib Yazdani , Yasser Hamidullah , Cristina España-Bonet , Eleftherios Avramidis , Josef van Genabith

Neural metrics for machine translation evaluation, such as COMET, exhibit significant improvements in their correlation with human judgments, as compared to traditional metrics based on lexical overlap, such as BLEU. Yet, neural metrics…

Computation and Language · Computer Science 2023-05-22 Ricardo Rei , Nuno M. Guerreiro , Marcos Treviso , Luisa Coheur , Alon Lavie , André F. T. Martins

Multimodal machine translation (MMT) systems have been shown to outperform their text-only neural machine translation (NMT) counterparts when visual context is available. However, recent studies have also shown that the performance of MMT…

Computation and Language · Computer Science 2021-09-09 Jiaoda Li , Duygu Ataman , Rico Sennrich

The main limiting factor in the development of robust multilingual dialogue evaluation metrics is the lack of multilingual data and the limited availability of open sourced multilingual dialogue systems. In this work, we propose a…

Computation and Language · Computer Science 2023-09-01 John Mendonça , Alon Lavie , Isabel Trancoso

Contextual causal reasoning is a critical yet challenging capability for Large Language Models (LLMs). Existing benchmarks, however, often evaluate this skill in fragmented settings, failing to ensure context consistency or cover the full…

Computation and Language · Computer Science 2026-04-17 Pengfeng Li , Chen Huang , Chaoqun Hao , Hongyao Chen , Xiao-Yong Wei , Wenqiang Lei , See-Kiong Ng

Machine translation systems achieve near human-level performance on some languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences, which hinders their applicability to the majority of…

Computation and Language · Computer Science 2018-08-15 Guillaume Lample , Myle Ott , Alexis Conneau , Ludovic Denoyer , Marc'Aurelio Ranzato

Large-scale generative models show an impressive ability to perform a wide range of Natural Language Processing (NLP) tasks using in-context learning, where a few examples are used to describe a task to the model. For Machine Translation…

Computation and Language · Computer Science 2022-12-06 Sweta Agrawal , Chunting Zhou , Mike Lewis , Luke Zettlemoyer , Marjan Ghazvininejad