English
Related papers

Related papers: Assessing the Bilingual Knowledge Learned by Neura…

200 papers

Neural machine translation (NMT), a new approach to machine translation, has achieved promising results comparable to those of traditional approaches such as statistical machine translation (SMT). Despite its recent success, NMT cannot…

Computation and Language · Computer Science 2017-09-07 Zi Long , Ryuichiro Kimura , Takehito Utsuro , Tomoharu Mitsuhashi , Mikio Yamamoto

Standard neural machine translation (NMT) is on the assumption of document-level context independent. Most existing document-level NMT methods are satisfied with a smattering sense of brief document-level information, while this work…

Computation and Language · Computer Science 2021-10-13 Shu Jiang , Hai Zhao , Zuchao Li , Bao-Liang Lu

We propose to achieve explainable neural machine translation (NMT) by changing the output representation to explain itself. We present a novel approach to NMT which generates the target sentence by monotonically walking through the source…

Computation and Language · Computer Science 2018-08-30 Felix Stahlberg , Danielle Saunders , Bill Byrne

The recently proposed massively multilingual neural machine translation (NMT) system has been shown to be capable of translating over 100 languages to and from English within a single model. Its improved translation performance on low…

Computation and Language · Computer Science 2019-11-13 Aditya Siddhant , Melvin Johnson , Henry Tsai , Naveen Arivazhagan , Jason Riesa , Ankur Bapna , Orhan Firat , Karthik Raman

Neural machine translation (NMT) has achieved remarkable success in producing high-quality translations. However, current NMT systems suffer from a lack of reliability, as their outputs that are often affected by lexical or syntactic…

Computation and Language · Computer Science 2023-09-20 Rongxiang Weng , Qiang Wang , Wensen Cheng , Changfeng Zhu , Min Zhang

Neural Machine Translation (NMT) is the task of translating a text from one language to another with the use of a trained neural network. Several existing works aim at incorporating external information into NMT models to improve or control…

Computation and Language · Computer Science 2024-04-30 Charles Brazier , Jean-Luc Rouas

Adding linguistic information (syntax or semantics) to neural machine translation (NMT) has mostly focused on using point estimates from pre-trained models. Directly using the capacity of massive pre-trained contextual word embedding models…

Computation and Language · Computer Science 2021-04-08 Hassan S. Shavarani , Anoop Sarkar

Recent advances in Neural Machine Translation (NMT) show that adding syntactic information to NMT systems can improve the quality of their translations. Most existing work utilizes some specific types of linguistically-inspired tree…

Computation and Language · Computer Science 2018-08-29 Xinyi Wang , Hieu Pham , Pengcheng Yin , Graham Neubig

Translating in real-time, a.k.a. simultaneous translation, outputs translation words before the input sentence ends, which is a challenging problem for conventional machine translation methods. We propose a neural machine translation (NMT)…

Computation and Language · Computer Science 2017-01-12 Jiatao Gu , Graham Neubig , Kyunghyun Cho , Victor O. K. Li

Neural chat translation aims to translate bilingual conversational text, which has a broad application in international exchanges and cooperation. Despite the impressive performance of sentence-level and context-aware Neural Machine…

Computation and Language · Computer Science 2021-07-26 Yunlong Liang , Fandong Meng , Yufeng Chen , Jinan Xu , Jie Zhou

Neural machine translation (NMT) models learn representations containing substantial linguistic information. However, it is not clear if such information is fully distributed or if some of it can be attributed to individual neurons. We…

Computation and Language · Computer Science 2018-11-06 Anthony Bau , Yonatan Belinkov , Hassan Sajjad , Nadir Durrani , Fahim Dalvi , James Glass

While modern machine translation has relied on large parallel corpora, a recent line of work has managed to train Neural Machine Translation (NMT) systems from monolingual corpora only (Artetxe et al., 2018c; Lample et al., 2018). Despite…

Computation and Language · Computer Science 2021-12-28 Mikel Artetxe , Gorka Labaka , Eneko Agirre

Despite their original goal to jointly learn to align and translate, Neural Machine Translation (NMT) models, especially Transformer, are often perceived as not learning interpretable word alignments. In this paper, we show that NMT models…

Computation and Language · Computer Science 2019-07-01 Shuoyang Ding , Hainan Xu , Philipp Koehn

Multilingual Neural Machine Translation (MNMT) enables one system to translate sentences from multiple source languages to multiple target languages, greatly reducing deployment costs compared with conventional bilingual systems. The MNMT…

Computation and Language · Computer Science 2022-07-01 Akiko Eriguchi , Shufang Xie , Tao Qin , Hany Hassan Awadalla

Despite impressive progress in high-resource settings, Neural Machine Translation (NMT) still struggles in low-resource and out-of-domain scenarios, often failing to match the quality of phrase-based translation. We propose a novel…

Computation and Language · Computer Science 2018-05-31 Xing Niu , Michael Denkowski , Marine Carpuat

Existing neural machine translation (NMT) studies mainly focus on developing dataset-specific models based on data from different tasks (e.g., document translation and chat translation). Although the dataset-specific models have achieved…

Computation and Language · Computer Science 2023-05-19 Yunlong Liang , Fandong Meng , Jinan Xu , Jiaan Wang , Yufeng Chen , Jie Zhou

Although end-to-end Neural Machine Translation (NMT) has achieved remarkable progress in the past two years, it suffers from a major drawback: translations generated by NMT systems often lack of adequacy. It has been widely observed that…

Computation and Language · Computer Science 2016-11-22 Zhaopeng Tu , Yang Liu , Lifeng Shang , Xiaohua Liu , Hang Li

Neural machine translation (NMT) is sensitive to domain shift. In this paper, we address this problem in an active learning setting where we can spend a given budget on translating in-domain data, and gradually fine-tune a pre-trained…

Computation and Language · Computer Science 2021-06-23 Junjie Hu , Graham Neubig

Despite the recent success of deep neural networks in natural language processing (NLP), their interpretability remains a challenge. We analyze the representations learned by neural machine translation models at various levels of…

Computation and Language · Computer Science 2019-11-04 Yonatan Belinkov , Nadir Durrani , Fahim Dalvi , Hassan Sajjad , James Glass

Neural Machine Translation (NMT) is a predominant machine translation technology nowadays because of its end-to-end trainable flexibility. However, NMT still struggles to translate properly in low-resource settings specifically on distant…

Computation and Language · Computer Science 2021-09-28 Baban Gain , Dibyanayan Bandyopadhyay , Asif Ekbal