English
Related papers

Related papers: A Comparison of Approaches to Document-level Machi…

200 papers

Document-level context has received lots of attention for compensating neural machine translation (NMT) of isolated sentences. However, recent advances in document-level NMT focus on sophisticated integration of the context, explaining its…

Computation and Language · Computer Science 2019-10-02 Yunsu Kim , Duc Thanh Tran , Hermann Ney

Existing large language models (LLMs) for machine translation are typically fine-tuned on sentence-level translation instructions and achieve satisfactory performance at the sentence level. However, when applied to document-level…

Computation and Language · Computer Science 2024-01-17 Yachao Li , Junhui Li , Jing Jiang , Min Zhang

In Machine Translation, considering the document as a whole can help to resolve ambiguities and inconsistencies. In this paper, we propose a simple yet promising approach to add contextual information in Neural Machine Translation. We…

Computation and Language · Computer Science 2019-10-17 Valentin Macé , Christophe Servan

Modern sentence-level NMT systems often produce plausible translations of isolated sentences. However, when put in context, these translations may end up being inconsistent with each other. We propose a monolingual DocRepair model to…

Computation and Language · Computer Science 2019-10-16 Elena Voita , Rico Sennrich , Ivan Titov

Historically, sign language machine translation has been posed as a sentence-level task: datasets consisting of continuous narratives are chopped up and presented to the model as isolated clips. In this work, we explore the limitations of…

Computation and Language · Computer Science 2024-06-18 Garrett Tanzer , Maximus Shengelia , Ken Harrenstien , David Uthus

Although many context-aware neural machine translation models have been proposed to incorporate contexts in translation, most of those models are trained end-to-end on parallel documents aligned in sentence-level. Because only a few domains…

Computation and Language · Computer Science 2021-11-16 Amane Sugiyama , Naoki Yoshinaga

Context-aware neural machine translation involves leveraging information beyond sentence-level context to resolve inter-sentential discourse dependencies and improve document-level translation quality, and has given rise to a number of…

Computation and Language · Computer Science 2023-10-25 Linghao Jin , Jacqueline He , Jonathan May , Xuezhe Ma

Large language models (LLMs) are increasingly strong contenders in machine translation. In this work, we focus on document-level translation, where some words cannot be translated without context from outside the sentence. Specifically, we…

Computation and Language · Computer Science 2025-02-17 Wafaa Mohammed , Vlad Niculae

It is well known that translations generated by an excellent document-level neural machine translation (NMT) model are consistent and coherent. However, existing sentence-level evaluation metrics like BLEU can hardly reflect the model's…

Computation and Language · Computer Science 2022-08-22 Xin Tan , Longyin Zhang , Guodong Zhou

Document-level neural machine translation (DocNMT) achieves coherent translations by incorporating cross-sentence context. However, for most language pairs there's a shortage of parallel documents, although parallel sentences are readily…

Computation and Language · Computer Science 2022-05-18 Biao Zhang , Ankur Bapna , Melvin Johnson , Ali Dabirmoghaddam , Naveen Arivazhagan , Orhan Firat

Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level knowledge, such as generating synthetic parallel data or…

Computation and Language · Computer Science 2019-08-22 Rongxiang Weng , Heng Yu , Shujian Huang , Weihua Luo , Jiajun Chen

Text documents are structured on multiple levels of detail: individual words are related by syntax, but larger units of text are related by discourse structure. Existing language models generally fail to account for discourse structure, but…

Computation and Language · Computer Science 2016-02-23 Yangfeng Ji , Trevor Cohn , Lingpeng Kong , Chris Dyer , Jacob Eisenstein

Transformer architectures are increasingly effective at processing and generating very long chunks of texts, opening new perspectives for document-level machine translation (MT). In this work, we challenge the ability of MT systems to…

Computation and Language · Computer Science 2025-04-29 Ziqian Peng , Rachel Bawden , François Yvon

Document image classification is different from plain-text document classification and consists of classifying a document by understanding the content and structure of documents such as forms, emails, and other such documents. We show that…

Computation and Language · Computer Science 2023-10-26 Yoshinari Fujinuma , Siddharth Varia , Nishant Sankaran , Srikar Appalaraju , Bonan Min , Yogarshi Vyas

Literary translation is a culturally significant task, but it is bottlenecked by the small number of qualified literary translators relative to the many untranslated works published around the world. Machine translation (MT) holds potential…

Computation and Language · Computer Science 2022-10-27 Katherine Thai , Marzena Karpinska , Kalpesh Krishna , Bill Ray , Moira Inghilleri , John Wieting , Mohit Iyyer

In Machine Translation, Large Language Models (LLMs) have generally underperformed compared to conventional encoder-decoder systems and thus see limited adoption. However, LLMs excel at modeling contextual information, making them a natural…

Computation and Language · Computer Science 2026-03-24 Ireh Kim , Tesia Sker , Chanwoo Kim

Despite the progress made in sentence-level NMT, current systems still fall short at achieving fluent, good quality translation for a full document. Recent works in context-aware NMT consider only a few previous sentences as context and may…

Computation and Language · Computer Science 2019-05-27 Sameen Maruf , André F. T. Martins , Gholamreza Haffari

Despite Large Language Models (LLMs) demonstrating superior translation performance and long-context capabilities, evaluation methodologies remain constrained to sentence-level assessment due to dataset limitations, token number…

Computation and Language · Computer Science 2025-09-23 Kuang-Da Wang , Shuoyang Ding , Chao-Han Huck Yang , Ping-Chun Hsieh , Wen-Chih Peng , Vitaly Lavrukhin , Boris Ginsburg

The overall translation quality reached by current machine translation (MT) systems for high-resourced language pairs is remarkably good. Standard methods of evaluation are not suitable nor intended to uncover the many translation errors…

Computation and Language · Computer Science 2024-03-11 Vilém Zouhar , Věra Kloudová , Martin Popel , Ondřej Bojar

Context modeling is essential to generate coherent and consistent translation for Document-level Neural Machine Translations. The widely used method for document-level translation usually compresses the context information into a…

Computation and Language · Computer Science 2019-11-22 Zhengxin Yang , Jinchao Zhang , Fandong Meng , Shuhao Gu , Yang Feng , Jie Zhou