English
Related papers

Related papers: Confidence-Aware Scheduled Sampling for Neural Mac…

200 papers

Multi-step ahead prediction in language models is challenging due to the discrepancy between training and test time processes. At test time, a sequence predictor is required to make predictions given past predictions as the input, instead…

Computation and Language · Computer Science 2021-01-26 James O' Neill , Danushka Bollegala

Exposure bias poses a common challenge in numerous natural language processing tasks, particularly in the dialog generation. In response to this issue, researchers have devised various techniques, among which scheduled sampling has proven…

Computation and Language · Computer Science 2023-09-06 Jiawen Liu , Kan Li

Simultaneous machine translation (SimulMT) speeds up the translation process by starting to translate before the source sentence is completely available. It is difficult due to limited context and word order difference between languages.…

Computation and Language · Computer Science 2022-05-05 Chih-Chiang Chang , Shun-Po Chuang , Hung-yi Lee

Low-frequency word prediction remains a challenge in modern neural machine translation (NMT) systems. Recent adaptive training methods promote the output of infrequent words by emphasizing their weights in the overall training objectives.…

Computation and Language · Computer Science 2021-12-30 Tong Zhang , Wei Ye , Baosong Yang , Long Zhang , Xingzhang Ren , Dayiheng Liu , Jinan Sun , Shikun Zhang , Haibo Zhang , Wen Zhao

Confidence calibration, which aims to make model predictions equal to the true correctness measures, is important for neural machine translation (NMT) because it is able to offer useful indicators of translation errors in the generated…

Computation and Language · Computer Science 2020-05-05 Shuo Wang , Zhaopeng Tu , Shuming Shi , Yang Liu

The task of multi-step ahead prediction in language models is challenging considering the discrepancy between training and testing. At test time, a language model is required to make predictions given past predictions as input, instead of…

Machine Learning · Computer Science 2018-09-18 James O' Neill , Danushka Bollegala

Pre-training models on vast quantities of unlabeled data has emerged as an effective approach to improving accuracy on many NLP tasks. On the other hand, traditional machine translation has a long history of leveraging unlabeled data…

Computation and Language · Computer Science 2020-11-17 Shruti Bhosale , Kyra Yee , Sergey Edunov , Michael Auli

During the pre-training step of natural language models, the main objective is to learn a general representation of the pre-training dataset, usually requiring large amounts of textual data to capture the complexity and diversity of natural…

Computation and Language · Computer Science 2023-10-23 Tobias Deußer , Cong Zhao , Wolfgang Krämer , David Leonhard , Christian Bauckhage , Rafet Sifa

Variational Neural Machine Translation (VNMT) is an attractive framework for modeling the generation of target translations, conditioned not only on the source sentence but also on some latent random variables. The latent variable modeling…

Computation and Language · Computer Science 2020-05-29 Hendra Setiawan , Matthias Sperber , Udhay Nallasamy , Matthias Paulik

Neural machine translation (NMT) generates the next target token given as input the previous ground truth target tokens during training while the previous generated target tokens during inference, which causes discrepancy between training…

Computation and Language · Computer Science 2020-07-22 Kaitao Song , Xu Tan , Jianfeng Lu

While it has been shown that Neural Machine Translation (NMT) is highly sensitive to noisy parallel training samples, prior work treats all types of mismatches between source and target as noise. As a result, it remains unclear how samples…

Computation and Language · Computer Science 2021-06-01 Eleftheria Briakou , Marine Carpuat

In Transformer-based neural machine translation (NMT), the positional encoding mechanism helps the self-attention networks to learn the source representation with order dependency, which makes the Transformer-based NMT achieve…

Computation and Language · Computer Science 2020-04-09 Kehai Chen , Rui Wang , Masao Utiyama , Eiichiro Sumita

Traditional Neural machine translation (NMT) involves a fixed training procedure where each sentence is sampled once during each epoch. In reality, some sentences are well-learned during the initial few epochs; however, using this approach,…

Computation and Language · Computer Science 2019-10-04 Rui Wang , Masao Utiyama , Eiichiro Sumita

Unsupervised neural machine translation(NMT) is associated with noise and errors in synthetic data when executing vanilla back-translations. Here, we explicitly exploits language model(LM) to drive construction of an unsupervised NMT…

Computation and Language · Computer Science 2019-11-12 Wei Zhang , Youyuan Lin , Ruoran Ren , Xiaodong Wang , Zhenshuang Liang , Zhen Huang

Auto-regressive sequence-to-sequence models with attention mechanisms have achieved state-of-the-art performance in various tasks including Text-To-Speech (TTS) and Neural Machine Translation (NMT). The standard training approach, teacher…

Computation and Language · Computer Science 2021-04-06 Qingyun Dou , Yiting Lu , Potsawee Manakul , Xixin Wu , Mark J. F. Gales

We present an interactive machine translation (MT) system designed for users who are not proficient in the target language. It aims to improve trustworthiness and explainability by identifying potentially mistranslated words and allowing…

Computation and Language · Computer Science 2025-04-01 Kenneth J. Sible , David Chiang

Self-training has proven effective for improving NMT performance by augmenting model training with synthetic parallel data. The common practice is to construct synthetic data based on a randomly sampled subset of large-scale monolingual…

Computation and Language · Computer Science 2021-06-03 Wenxiang Jiao , Xing Wang , Zhaopeng Tu , Shuming Shi , Michael R. Lyu , Irwin King

Machine translation is a popular test bed for research in neural sequence-to-sequence models but despite much recent research, there is still a lack of understanding of these models. Practitioners report performance degradation with large…

Computation and Language · Computer Science 2018-08-14 Myle Ott , Michael Auli , David Grangier , Marc'Aurelio Ranzato

Machine Translation models are trained to translate a variety of documents from one language into another. However, models specifically trained for a particular characteristics of the documents tend to perform better. Fine-tuning is a…

Computation and Language · Computer Science 2019-10-09 Alberto Poncelas , Gideon Maillette de Buy Wenniger , Andy Way

Attention-based Neural Machine Translation (NMT) models suffer from attention deficiency issues as has been observed in recent research. We propose a novel mechanism to address some of these limitations and improve the NMT attention.…

Computation and Language · Computer Science 2016-08-10 Baskaran Sankaran , Haitao Mi , Yaser Al-Onaizan , Abe Ittycheriah