English
Related papers

Related papers: An Operation Sequence Model for Explainable Neural…

200 papers

A neural machine translation (NMT) system is expensive to train, especially with high-resource settings. As the NMT architectures become deeper and wider, this issue gets worse and worse. In this paper, we aim to improve the efficiency of…

Computation and Language · Computer Science 2020-06-04 Xuebo Liu , Houtim Lai , Derek F. Wong , Lidia S. Chao

Existing neural machine translation (NMT) systems utilize sequence-to-sequence neural networks to generate target translation word by word, and then make the generated word at each time-step and the counterpart in the references as…

Computation and Language · Computer Science 2020-03-02 Chaoqun Duan , Kehai Chen , Rui Wang , Masao Utiyama , Eiichiro Sumita , Conghui Zhu , Tiejun Zhao

Machine translation systems achieve near human-level performance on some languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences, which hinders their applicability to the majority of…

Computation and Language · Computer Science 2018-08-15 Guillaume Lample , Myle Ott , Alexis Conneau , Ludovic Denoyer , Marc'Aurelio Ranzato

Neural machine translation (NMT) systems aim to map text from one language into another. While there are a wide variety of applications of NMT, one of the most important is translation of natural language. A distinguishing factor of natural…

Computation and Language · Computer Science 2022-01-04 Vivek Subramanian , Dhanasekar Sundararaman

Transfer learning approaches for Neural Machine Translation (NMT) train a NMT model on the assisting-target language pair (parent model) which is later fine-tuned for the source-target language pair of interest (child model), with the…

Computation and Language · Computer Science 2019-04-11 Rudra Murthy , Anoop Kunchukuttan , Pushpak Bhattacharyya

Neural machine translation (NMT) has arguably achieved human level parity when trained and evaluated at the sentence-level. Document-level neural machine translation has received less attention and lags behind its sentence-level…

Computation and Language · Computer Science 2020-03-12 Elman Mansimov , Gábor Melis , Lei Yu

Although attention-based Neural Machine Translation (NMT) has achieved remarkable progress in recent years, it still suffers from issues of repeating and dropping translations. To alleviate these issues, we propose a novel key-value…

Computation and Language · Computer Science 2018-07-02 Fandong Meng , Zhaopeng Tu , Yong Cheng , Haiyang Wu , Junjie Zhai , Yuekui Yang , Di Wang

Machine Translation (MT) is one of the most prominent tasks in Natural Language Processing (NLP) which involves the automatic conversion of texts from one natural language to another while preserving its meaning and fluency. Although the…

Computation and Language · Computer Science 2023-09-26 Kavit Gangar , Hardik Ruparel , Shreyas Lele

Evaluating translation models is a trade-off between effort and detail. On the one end of the spectrum there are automatic count-based methods such as BLEU, on the other end linguistic evaluations by humans, which arguably are more…

Computation and Language · Computer Science 2019-03-29 Robert Schwarzenberg , David Harbecke , Vivien Macketanz , Eleftherios Avramidis , Sebastian Möller

Simultaneous neural machine translation(SNMT) models start emitting the target sequence before they have processed the source sequence. The recent adaptive policies for SNMT use monotonic attention to perform read/write decisions based on…

Computation and Language · Computer Science 2021-09-08 Mohd Abbas Zaidi , Sathish Indurthi , Beomseok Lee , Nikhil Kumar Lakumarapu , Sangha Kim

Neural Machine Translation (NMT) is an end-to-end learning approach for automated translation, with the potential to overcome many of the weaknesses of conventional phrase-based translation systems. Unfortunately, NMT systems are known to…

In this paper, we introduce a hybrid search for attention-based neural machine translation (NMT). A target phrase learned with statistical MT models extends a hypothesis in the NMT beam search when the attention of the NMT model focuses on…

Computation and Language · Computer Science 2017-08-11 Leonard Dahlmann , Evgeny Matusov , Pavel Petrushkov , Shahram Khadivi

Neural machine translation (NMT) methods developed for natural language processing have been shown to be highly successful in automating translation from one natural language to another. Recently, these NMT methods have been adapted to the…

Computation and Language · Computer Science 2023-05-24 Dharma KC , Clayton T. Morrison

Phrases play an important role in natural language understanding and machine translation (Sag et al., 2002; Villavicencio et al., 2005). However, it is difficult to integrate them into current neural machine translation (NMT) which reads…

Computation and Language · Computer Science 2017-08-08 Xing Wang , Zhaopeng Tu , Deyi Xiong , Min Zhang

The necessity of using a fixed-size word vocabulary in order to control the model complexity in state-of-the-art neural machine translation (NMT) systems is an important bottleneck on performance, especially for morphologically rich…

Computation and Language · Computer Science 2017-08-01 Duygu Ataman , Matteo Negri , Marco Turchi , Marcello Federico

In this paper, we propose Neural Phrase-to-Phrase Machine Translation (NP$^2$MT). Our model uses a phrase attention mechanism to discover relevant input (source) segments that are used by a decoder to generate output (target) phrases. We…

Computation and Language · Computer Science 2018-11-07 Jiangtao Feng , Lingpeng Kong , Po-Sen Huang , Chong Wang , Da Huang , Jiayuan Mao , Kan Qiao , Dengyong Zhou

Multilingual Neural Machine Translation (MNMT) enables one system to translate sentences from multiple source languages to multiple target languages, greatly reducing deployment costs compared with conventional bilingual systems. The MNMT…

Computation and Language · Computer Science 2022-07-01 Akiko Eriguchi , Shufang Xie , Tao Qin , Hany Hassan Awadalla

Although Neural Machine Translation (NMT) has achieved remarkable progress in the past several years, most NMT systems still suffer from a fundamental shortcoming as in other sequence generation tasks: errors made early in generation…

Computation and Language · Computer Science 2018-11-14 Zhirui Zhang , Shuangzhi Wu , Shujie Liu , Mu Li , Ming Zhou , Tong Xu

Neural machine translation (NMT) systems have been shown to give undesirable translation when a small change is made in the source sentence. In this paper, we study the behaviour of NMT systems when multiple changes are made to the source…

Machine Learning · Computer Science 2020-03-02 Akshay Chaturvedi , Abijith KP , Utpal Garain

An attentional mechanism has lately been used to improve neural machine translation (NMT) by selectively focusing on parts of the source sentence during translation. However, there has been little work exploring useful architectures for…

Computation and Language · Computer Science 2015-09-22 Minh-Thang Luong , Hieu Pham , Christopher D. Manning