English
Related papers

Related papers: Document Flattening: Beyond Concatenating Context …

200 papers

Recently, document-level neural machine translation (NMT) has become a hot topic in the community of machine translation. Despite its success, most of existing studies ignored the discourse structure information of the input document to be…

Computation and Language · Computer Science 2020-06-23 Junxuan Chen , Xiang Li , Jiarui Zhang , Chulun Zhou , Jianwei Cui , Bin Wang , Jinsong Su

Neural machine translation (NMT) has recently gained widespread attention because of its high translation accuracy. However, it shows poor performance in the translation of long sentences, which is a major issue in low-resource languages.…

Computation and Language · Computer Science 2021-04-20 Seiichiro Kondo , Kengo Hotate , Masahiro Kaneko , Mamoru Komachi

Context-aware translation can be achieved by processing a concatenation of consecutive sentences with the standard Transformer architecture. This paper investigates the intuitive idea of providing the model with explicit information about…

Computation and Language · Computer Science 2023-04-06 Lorenzo Lupo , Marco Dinarelli , Laurent Besacier

The Transformer architecture has led to significant gains in machine translation. However, most studies focus on only sentence-level translation without considering the context dependency within documents, leading to the inadequacy of…

Artificial Intelligence · Computer Science 2022-10-21 Yukun Feng , Feng Li , Ziang Song , Boyuan Zheng , Philipp Koehn

Context-aware neural machine translation (NMT) incorporates contextual information of surrounding texts, that can improve the translation quality of document-level machine translation. Many existing works on context-aware NMT have focused…

Computation and Language · Computer Science 2021-09-14 Yongkeun Hwang , Hyungu Yun , Kyomin Jung

Since their release, Transformers have revolutionized many fields from Natural Language Understanding to Computer Vision. Document Understanding (DU) was not left behind with first Transformer based models for DU dating from late 2019.…

Computation and Language · Computer Science 2023-09-12 Thibault Douzon , Stefan Duffner , Christophe Garcia , Jérémy Espinas

This paper does not aim at introducing a novel model for document-level neural machine translation. Instead, we head back to the original Transformer model and hope to answer the following question: Is the capacity of current models strong…

Computation and Language · Computer Science 2022-03-15 Zewei Sun , Mingxuan Wang , Hao Zhou , Chengqi Zhao , Shujian Huang , Jiajun Chen , Lei Li

Document-level Neural Machine Translation (DocNMT) has been proven crucial for handling discourse phenomena by introducing document-level context information. One of the most important directions is to input the whole document directly to…

Computation and Language · Computer Science 2023-09-26 Zihan Liu , Zewei Sun , Shanbo Cheng , Shujian Huang , Mingxuan Wang

Previous work on document-level NMT usually focuses on limited contexts because of degraded performance on larger contexts. In this paper, we investigate on using large contexts with three main contributions: (1) Different from previous…

Computation and Language · Computer Science 2019-11-11 Liangyou Li , Xin Jiang , Qun Liu

Transfer learning on tabular data is challenging due to disparate feature spaces across domains, in contrast to the homogeneous structures of image and text. Large language models (LLMs) offer a knowledge base to improve the limited…

Machine Learning · Computer Science 2026-01-26 Ibna Kowsar , Kazi F. Akhter , Manar D. Samad

Recent work in neural machine translation has demonstrated both the necessity and feasibility of using inter-sentential context -- context from sentences other than those currently being translated. However, while many current methods…

Computation and Language · Computer Science 2021-06-03 Patrick Fernandes , Kayo Yin , Graham Neubig , André F. T. Martins

For machine translation to tackle discourse phenomena, models must have access to extra-sentential linguistic context. There has been recent interest in modelling context in neural machine translation (NMT), but models have been principally…

Computation and Language · Computer Science 2018-04-23 Rachel Bawden , Rico Sennrich , Alexandra Birch , Barry Haddow

Data availability limits the scope of any given task. In machine translation, historical models were incapable of handling longer contexts, so the lack of document-level datasets was less noticeable. Now, despite the emergence of…

Computation and Language · Computer Science 2024-06-07 Rachel Wicks , Matt Post , Philipp Koehn

Machine translation (MT) is an important task in natural language processing (NLP) as it automates the translation process and reduces the reliance on human translators. With the resurgence of neural networks, the translation quality…

Computation and Language · Computer Science 2021-01-14 Sameen Maruf , Fahimeh Saleh , Gholamreza Haffari

In translation, considering the document as a whole can help to resolve ambiguities and inconsistencies. In this paper, we propose a cross-sentence context-aware approach and investigate the influence of historical contextual information on…

Computation and Language · Computer Science 2017-07-25 Longyue Wang , Zhaopeng Tu , Andy Way , Qun Liu

Large language models (LLMs) with extended context windows have made significant strides yet remain a challenge due to the scarcity of long documents. Existing methods tend to synthesize long-context data but lack a clear mechanism to…

Computation and Language · Computer Science 2025-05-27 Chaochen Gao , Xing Wu , Zijia Lin , Debing Zhang , Songlin Hu

In this paper, we introduce DOCmT5, a multilingual sequence-to-sequence language model pretrained with large scale parallel documents. While previous approaches have focused on leveraging sentence-level parallel data, we try to build a…

Computation and Language · Computer Science 2022-05-06 Chia-Hsuan Lee , Aditya Siddhant , Viresh Ratnakar , Melvin Johnson

Pretrained contextualized representations offer great success for many downstream tasks, including document ranking. The multilingual versions of such pretrained representations provide a possibility of jointly learning many languages with…

Information Retrieval · Computer Science 2021-09-16 Zhiqi Huang , Hamed Bonab , Sheikh Muhammad Sarwar , Razieh Rahimi , James Allan

Document level Machine Translation (DocMT) approaches often struggle with effectively capturing discourse level phenomena. Existing approaches rely on heuristic rules to segment documents into discourse units, which rarely align with the…

Computation and Language · Computer Science 2025-07-08 Himanshu Dutta , Sunny Manchanda , Prakhar Bapat , Meva Ram Gurjar , Pushpak Bhattacharyya

An effective method to improve neural machine translation with monolingual data is to augment the parallel training corpus with back-translations of target language sentences. This work broadens the understanding of back-translation and…

Computation and Language · Computer Science 2018-10-04 Sergey Edunov , Myle Ott , Michael Auli , David Grangier