English
Related papers

Related papers: Addressing the Length Bias Problem in Document-Lev…

200 papers

Document-level Neural Machine Translation (DocNMT) has been proven crucial for handling discourse phenomena by introducing document-level context information. One of the most important directions is to input the whole document directly to…

Computation and Language · Computer Science 2023-09-26 Zihan Liu , Zewei Sun , Shanbo Cheng , Shujian Huang , Mingxuan Wang

Existing large language models (LLMs) for machine translation are typically fine-tuned on sentence-level translation instructions and achieve satisfactory performance at the sentence level. However, when applied to document-level…

Computation and Language · Computer Science 2024-01-17 Yachao Li , Junhui Li , Jing Jiang , Min Zhang

Neural machine translation (NMT) has recently gained widespread attention because of its high translation accuracy. However, it shows poor performance in the translation of long sentences, which is a major issue in low-resource languages.…

Computation and Language · Computer Science 2021-04-20 Seiichiro Kondo , Kengo Hotate , Masahiro Kaneko , Mamoru Komachi

Training data for NLP tasks often exhibits gender bias in that fewer sentences refer to women than to men. In Neural Machine Translation (NMT) gender bias has been shown to reduce translation quality, particularly when the target language…

Computation and Language · Computer Science 2020-07-10 Danielle Saunders , Bill Byrne

Neural Machine Translation (NMT) is known to suffer from a beam-search problem: after a certain point, increasing beam size causes an overall drop in translation quality. This effect is especially pronounced for long sentences. While much…

Computation and Language · Computer Science 2021-09-15 Ivan Provilkov , Andrey Malinin

Document translation poses a challenge for Neural Machine Translation (NMT) systems. Most document-level NMT systems rely on meticulously curated sentence-level parallel data, assuming flawless extraction of text from documents along with…

Computation and Language · Computer Science 2024-06-13 Benjamin Hsu , Xiaoyu Liu , Huayang Li , Yoshinari Fujinuma , Maria Nadejde , Xing Niu , Yair Kittenplon , Ron Litman , Raghavendra Pappagari

Simultaneous neural machine translation(SNMT) models start emitting the target sequence before they have processed the source sequence. The recent adaptive policies for SNMT use monotonic attention to perform read/write decisions based on…

Computation and Language · Computer Science 2021-09-08 Mohd Abbas Zaidi , Sathish Indurthi , Beomseok Lee , Nikhil Kumar Lakumarapu , Sangha Kim

Although attention-based Neural Machine Translation (NMT) has achieved remarkable progress in recent years, it still suffers from issues of repeating and dropping translations. To alleviate these issues, we propose a novel key-value…

Computation and Language · Computer Science 2018-07-02 Fandong Meng , Zhaopeng Tu , Yong Cheng , Haiyang Wu , Junjie Zhai , Yuekui Yang , Di Wang

Standard neural machine translation (NMT) is on the assumption that the document-level context is independent. Most existing document-level NMT approaches are satisfied with a smattering sense of global document-level information, while…

Computation and Language · Computer Science 2021-08-25 Shu Jiang , Rui Wang , Zuchao Li , Masao Utiyama , Kehai Chen , Eiichiro Sumita , Hai Zhao , Bao-liang Lu

Label smoothing is ubiquitously applied in Neural Machine Translation (NMT) training. While label smoothing offers a desired regularization effect during model training, in this paper we demonstrate that it nevertheless introduces length…

Computation and Language · Computer Science 2022-05-03 Bowen Liang , Pidong Wang , Yuan Cao

Document-level context has received lots of attention for compensating neural machine translation (NMT) of isolated sentences. However, recent advances in document-level NMT focus on sophisticated integration of the context, explaining its…

Computation and Language · Computer Science 2019-10-02 Yunsu Kim , Duc Thanh Tran , Hermann Ney

The evolution of Neural Machine Translation (NMT) has been significantly influenced by six core challenges (Koehn and Knowles, 2017), which have acted as benchmarks for progress in this field. This study revisits these challenges, offering…

Computation and Language · Computer Science 2024-12-16 Jianhui Pang , Fanghua Ye , Longyue Wang , Dian Yu , Derek F. Wong , Shuming Shi , Zhaopeng Tu

Many document-level neural machine translation (NMT) systems have explored the utility of context-aware architecture, usually requiring an increasing number of parameters and computational complexity. However, few attention is paid to the…

Computation and Language · Computer Science 2020-09-22 Pei Zhang , Boxing Chen , Niyu Ge , Kai Fan

Attention mechanism has enhanced state-of-the-art Neural Machine Translation (NMT) by jointly learning to align and translate. It tends to ignore past alignment information, however, which often leads to over-translation and…

Computation and Language · Computer Science 2016-08-09 Zhaopeng Tu , Zhengdong Lu , Yang Liu , Xiaohua Liu , Hang Li

Large language models (LLMs) are commonly trained on datasets consisting of fixed-length token sequences. These datasets are created by randomly concatenating documents of various lengths and then chunking them into sequences of a…

Computation and Language · Computer Science 2025-01-08 Hadi Pouransari , Chun-Liang Li , Jen-Hao Rick Chang , Pavan Kumar Anasosalu Vasu , Cem Koc , Vaishaal Shankar , Oncel Tuzel

Lexically constrained neural machine translation (LCNMT), which controls the translation generation with pre-specified constraints, is important in many practical applications. Current approaches to LCNMT typically assume that the…

Computation and Language · Computer Science 2023-05-30 Jinpeng Zhang , Nini Xiao , Ke Wang , Chuanqi Dong , Xiangyu Duan , Yuqi Zhang , Min Zhang

Recent years has witnessed dramatic progress of neural machine translation (NMT), however, the method of manually guiding the translation procedure remains to be better explored. Previous works proposed to handle such problem through…

Computation and Language · Computer Science 2019-02-01 Ya Li , Xinyu Liu , Dan Liu , Xueqiang Zhang , Junhua Liu

Large language models (LLMs) have demonstrated strong performance in sentence-level machine translation, but scaling to document-level translation remains challenging, particularly in modeling long-range dependencies and discourse phenomena…

Computation and Language · Computer Science 2025-08-29 Miguel Moura Ramos , Patrick Fernandes , Sweta Agrawal , André F. T. Martins

We present Neural Machine Translation (NMT) training using document-level metrics with batch-level documents. Previous sequence-objective approaches to NMT training focus exclusively on sentence-level metrics like sentence BLEU which do not…

Computation and Language · Computer Science 2020-05-05 Danielle Saunders , Felix Stahlberg , Bill Byrne

Language coverage bias, which indicates the content-dependent differences between sentence pairs originating from the source and target languages, is important for neural machine translation (NMT) because the target-original training data…

Computation and Language · Computer Science 2021-06-08 Shuo Wang , Zhaopeng Tu , Zhixing Tan , Shuming Shi , Maosong Sun , Yang Liu