English
Related papers

Related papers: Character-level Transformer-based Neural Machine T…

200 papers

Transformer-based language models utilize the attention mechanism for substantial performance improvements in almost all natural language processing (NLP) tasks. Similar attention structures are also extensively studied in several other…

Computation and Language · Computer Science 2023-05-17 Nurullah Sevim , Ege Ozan Özyedek , Furkan Şahinuç , Aykut Koç

Compared to traditional statistical machine translation (SMT), neural machine translation (NMT) often sacrifices adequacy for the sake of fluency. We propose a method to combine the advantages of traditional SMT and NMT by exploiting an…

Computation and Language · Computer Science 2017-11-02 Jingyi Zhang , Masao Utiyama , Eiichro Sumita , Graham Neubig , Satoshi Nakamura

While neural machine translation (NMT) models provide improved translation quality in an elegant, end-to-end framework, it is less clear what they learn about language. Recent work has started evaluating the quality of vector…

Computation and Language · Computer Science 2018-01-25 Yonatan Belinkov , Lluís Màrquez , Hassan Sajjad , Nadir Durrani , Fahim Dalvi , James Glass

We present effective pre-training strategies for neural machine translation (NMT) using parallel corpora involving a pivot language, i.e., source-pivot and pivot-target, leading to a significant improvement in source-target translation. We…

Computation and Language · Computer Science 2019-09-23 Yunsu Kim , Petre Petrov , Pavel Petrushkov , Shahram Khadivi , Hermann Ney

Neural machine translation (NMT) systems require large amounts of high quality in-domain parallel corpora for training. State-of-the-art NMT systems still face challenges related to out-of-vocabulary words and dealing with low-resource…

Computation and Language · Computer Science 2019-09-18 Jetic Gū , Hassan S. Shavarani , Anoop Sarkar

Transfer learning or multilingual model is essential for low-resource neural machine translation (NMT), but the applicability is limited to cognate languages by sharing their vocabularies. This paper shows effective techniques to transfer a…

Computation and Language · Computer Science 2019-06-06 Yunsu Kim , Yingbo Gao , Hermann Ney

We propose a simple modification to existing neural machine translation (NMT) models that enables using a single universal model to translate between multiple languages while allowing for language specific parameterization, and that can…

Computation and Language · Computer Science 2018-08-28 Emmanouil Antonios Platanios , Mrinmaya Sachan , Graham Neubig , Tom Mitchell

A large number of significant assets are available online in English, which is frequently translated into native languages to ease the information sharing among local people who are not much familiar with English. However, manual…

Computation and Language · Computer Science 2020-04-30 Himanshu Choudhary , Shivansh Rao , Rajesh Rohilla

Neural Machine Translation (NMT) is a new approach for automatic translation of text from one human language into another. The basic concept in NMT is to train a large Neural Network that maximizes the translation performance on a given…

Computation and Language · Computer Science 2016-12-22 Markus Freitag , Yaser Al-Onaizan

Neural Machine Translation (NMT) has become a popular technology in recent years, and the encoder-decoder framework is the mainstream among all the methods. It's obvious that the quality of the semantic representations from encoding is very…

Computation and Language · Computer Science 2020-01-15 Boyuan Pan , Yazheng Yang , Zhou Zhao , Yueting Zhuang , Deng Cai

Transformer based models are the modern work horses for neural machine translation (NMT), reaching state of the art across several benchmarks. Despite their impressive accuracy, we observe a systemic and rudimentary class of errors made by…

Computation and Language · Computer Science 2021-04-19 Adithya Renduchintala , Adina Williams

Language pairs with limited amounts of parallel data, also known as low-resource languages, remain a challenge for neural machine translation. While the Transformer model has achieved significant improvements for many language pairs and has…

Computation and Language · Computer Science 2020-11-05 Ali Araabi , Christof Monz

Character-based representations have important advantages over subword-based ones for morphologically rich languages. They come with increased robustness to noisy input and do not need a separate tokenization step. However, they also have a…

Computation and Language · Computer Science 2022-05-30 Lukas Edman , Antonio Toral , Gertjan van Noord

Within the field of Statistical Machine Translation (SMT), the neural approach (NMT) has recently emerged as the first technology able to challenge the long-standing dominance of phrase-based approaches (PBMT). In particular, at the IWSLT…

Computation and Language · Computer Science 2016-10-11 Luisa Bentivogli , Arianna Bisazza , Mauro Cettolo , Marcello Federico

Neural machine translation (NMT) has achieved notable success in recent times, however it is also widely recognized that this approach has limitations with handling infrequent words and word pairs. This paper presents a novel…

Computation and Language · Computer Science 2017-08-08 Yang Feng , Shiyue Zhang , Andi Zhang , Dong Wang , Andrew Abel

There have been significant efforts to interpret the encoder of Transformer-based encoder-decoder architectures for neural machine translation (NMT); meanwhile, the decoder remains largely unexamined despite its critical role. During…

Computation and Language · Computer Science 2020-10-07 Yilin Yang , Longyue Wang , Shuming Shi , Prasad Tadepalli , Stefan Lee , Zhaopeng Tu

We present a literature and empirical survey that critically assesses the state of the art in character-level modeling for machine translation (MT). Despite evidence in the literature that character-level systems are comparable with subword…

Computation and Language · Computer Science 2022-04-28 Jindřich Libovický , Helmut Schmid , Alexander Fraser

Differently from the traditional statistical MT that decomposes the translation task into distinct separately learned components, neural machine translation uses a single neural network to model the entire translation process. Despite…

Computation and Language · Computer Science 2021-09-06 Elena Voita , Rico Sennrich , Ivan Titov

To satisfy the compute and memory demands of deep neural networks, neural processing units (NPUs) are widely being utilized for accelerating deep learning algorithms. Similar to how GPUs have evolved from a slave device into a mainstream…

Hardware Architecture · Computer Science 2019-11-19 Bongjoon Hyun , Youngeun Kwon , Yujeong Choi , John Kim , Minsoo Rhu

Transformer is a state-of-the-art model in the field of natural language processing (NLP). Current NLP models primarily increase the number of transformers to improve processing performance. However, this technique requires a lot of…

Computation and Language · Computer Science 2023-10-18 Woohyeon Moon , Taeyoung Kim , Bumgeun Park , Dongsoo Har