English
Related papers

Related papers: Pointer-Generator Networks for Low-Resource Machin…

200 papers

While it has been shown that Neural Machine Translation (NMT) is highly sensitive to noisy parallel training samples, prior work treats all types of mismatches between source and target as noise. As a result, it remains unclear how samples…

Computation and Language · Computer Science 2021-06-01 Eleftheria Briakou , Marine Carpuat

While neural machine translation (NMT) has achieved state-of-the-art translation performance, it is unable to capture the alignment between the input and output during the translation process. The lack of alignment in NMT models leads to…

Computation and Language · Computer Science 2019-12-02 Jiacheng Zhang , Huanbo Luan , Maosong Sun , FeiFei Zhai , Jingfang Xu , Yang Liu

Neural machine translation (NMT) systems have been shown to give undesirable translation when a small change is made in the source sentence. In this paper, we study the behaviour of NMT systems when multiple changes are made to the source…

Machine Learning · Computer Science 2020-03-02 Akshay Chaturvedi , Abijith KP , Utpal Garain

Conventional retrieval-augmented neural machine translation (RANMT) systems leverage bilingual corpora, e.g., translation memories (TMs). Yet, in many settings, monolingual corpora in the target language are often available. This work…

Computation and Language · Computer Science 2025-10-02 Maxime Bouthors , Josep Crego , François Yvon

Recently, the development of pre-trained language models has brought natural language processing (NLP) tasks to the new state-of-the-art. In this paper we explore the efficiency of various pre-trained language models. We pre-train a list of…

Computation and Language · Computer Science 2023-07-27 Tong Guo

Neural Machine Translation (NMT) is a new approach for Machine Translation (MT), and due to its success, it has absorbed the attention of many researchers in the field. In this paper, we study NMT model on Persian-English language pairs, to…

Computation and Language · Computer Science 2017-01-10 Mohaddeseh Bastan , Shahram Khadivi , Mohammad Mehdi Homayounpour

Building conversational speech recognition systems for new languages is constrained by the availability of utterances that capture user-device interactions. Data collection is both expensive and limited by the speed of manual transcription.…

Computation and Language · Computer Science 2019-12-03 Surabhi Punjabi , Harish Arsikere , Sri Garimella

Multilingual machine translation has recently been in vogue given its potential for improving machine translation performance for low-resource languages via transfer learning. Empirical examinations demonstrating the success of existing…

Computation and Language · Computer Science 2020-05-13 Ion Madrazo Azpiazu , Maria Soledad Pera

Machine translation systems for high resource languages perform exceptionally well and produce high quality translations. Unfortunately, the vast majority of languages are not considered high resource and lack the quantity of parallel…

Computation and Language · Computer Science 2024-10-22 Jonathan Hus , Antonios Anastasopoulos

Neural Networks trained with gradient descent are known to be susceptible to catastrophic forgetting caused by parameter shift during the training process. In the context of Neural Machine Translation (NMT) this results in poor performance…

Computation and Language · Computer Science 2019-06-20 Ankur Bapna , Orhan Firat

Prior work has proved that Translation memory (TM) can boost the performance of Neural Machine Translation (NMT). In contrast to existing work that uses bilingual corpus as TM and employs source-side similarity search for memory retrieval,…

Computation and Language · Computer Science 2021-06-03 Deng Cai , Yan Wang , Huayang Li , Wai Lam , Lemao Liu

Recent advances in Neural Machine Translation (NMT) show that adding syntactic information to NMT systems can improve the quality of their translations. Most existing work utilizes some specific types of linguistically-inspired tree…

Computation and Language · Computer Science 2018-08-29 Xinyi Wang , Hieu Pham , Pengcheng Yin , Graham Neubig

Machine Translation has made impressive progress in recent years offering close to human-level performance on many languages, but studies have primarily focused on high-resource languages with broad online presence and resources. With the…

Computation and Language · Computer Science 2024-04-15 Wan-Hua Her , Udo Kruschwitz

Neural networks have demonstrated significant advancements in Neural Machine Translation (NMT) compared to conventional phrase-based approaches. However, Multilingual Neural Machine Translation (MNMT) in extremely low-resource settings…

Computation and Language · Computer Science 2024-12-19 Vageesh Saxena , Sharid Loáiciga , Nils Rethmeier

There exists a token imbalance phenomenon in natural language as different tokens appear with different frequencies, which leads to different learning difficulties for tokens in Neural Machine Translation (NMT). The vanilla NMT model…

Computation and Language · Computer Science 2020-10-12 Shuhao Gu , Jinchao Zhang , Fandong Meng , Yang Feng , Wanying Xie , Jie Zhou , Dong Yu

The last decade has witnessed enormous improvements in science and technology, stimulating the growing demand for economic and cultural exchanges in various countries. Building a neural machine translation (NMT) system has become an urgent…

Computation and Language · Computer Science 2025-03-26 Bin Li , Yixuan Weng , Fei Xia , Hanjun Deng

Neural machine translation (NMT) methods developed for natural language processing have been shown to be highly successful in automating translation from one natural language to another. Recently, these NMT methods have been adapted to the…

Computation and Language · Computer Science 2023-05-24 Dharma KC , Clayton T. Morrison

Neural Machine Translation (NMT) is a new approach to machine translation that has shown promising results that are comparable to traditional approaches. A significant weakness in conventional NMT systems is their inability to correctly…

Computation and Language · Computer Science 2015-06-02 Minh-Thang Luong , Ilya Sutskever , Quoc V. Le , Oriol Vinyals , Wojciech Zaremba

Adapter layers are lightweight, learnable units inserted between transformer layers. Recent work explores using such layers for neural machine translation (NMT), to adapt pre-trained models to new domains or language pairs, training only a…

Computation and Language · Computer Science 2021-10-20 Asa Cooper Stickland , Alexandre Bérard , Vassilina Nikoulina

Neural machine translation (NMT), a new approach to machine translation, has been proved to outperform conventional statistical machine translation (SMT) across a variety of language pairs. Translation is an open-vocabulary problem, but…

Computation and Language · Computer Science 2017-11-15 Yining Wang , Long Zhou , Jiajun Zhang , Chengqing Zong