English
Related papers

Related papers: Character-level NMT and language similarity

200 papers

Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation, or having meta-information. Although there exist various…

Computation and Language · Computer Science 2020-10-20 Jingjing Huo , Christian Herold , Yingbo Gao , Leonard Dahlmann , Shahram Khadivi , Hermann Ney

This paper investigates the impact of data volume and the use of similar languages on transfer learning in a machine translation task. We find out that having more data generally leads to better performance, as it allows the model to learn…

Computation and Language · Computer Science 2023-06-02 Juuso Eronen , Michal Ptaszynski , Karol Nowakowski , Zheng Lin Chia , Fumito Masui

The existing machine translation systems, whether phrase-based or neural, have relied almost exclusively on word-level modelling with explicit segmentation. In this paper, we ask a fundamental question: can neural machine translation…

Computation and Language · Computer Science 2016-06-22 Junyoung Chung , Kyunghyun Cho , Yoshua Bengio

Neural machine translation (NMT) takes deterministic sequences for source representations. However, either word-level or subword-level segmentations have multiple choices to split a source sequence with different word segmentors or…

Computation and Language · Computer Science 2019-06-05 Fengshun Xiao , Jiangtong Li , Hai Zhao , Rui Wang , Kehai Chen

Character-level Neural Machine Translation (NMT) models have recently achieved impressive results on many language pairs. They mainly do well for Indo-European language pairs, where the languages share the same writing system. However, for…

Computation and Language · Computer Science 2018-08-28 Nikola I. Nikolov , Yuhuang Hu , Mi Xue Tan , Richard H. R. Hahnloser

Neural machine translation (NMT) systems operate primarily on words (or sub-words), ignoring lower-level patterns of morphology. We present a character-aware decoder designed to capture such patterns when translating into morphologically…

Computation and Language · Computer Science 2019-06-20 Adithya Renduchintala , Pamela Shapiro , Kevin Duh , Philipp Koehn

Multilingual Neural Machine Translation (MNMT) models leverage many language pairs during training to improve translation quality for low-resource languages by transferring knowledge from high-resource languages. We study the quality of a…

Computation and Language · Computer Science 2022-12-06 Miguel Rios , Raluca-Maria Chereji , Alina Secara , Dragos Ciobanu

Character-based translation has several appealing advantages, but its performance is in general worse than a carefully tuned BPE baseline. In this paper we study the impact of character-based input and output with the Transformer…

Computation and Language · Computer Science 2019-11-13 Rohit Gupta , Laurent Besacier , Marc Dymetman , Matthias Gallé

Neural machine translation (NMT) models are able to partially learn syntactic information from sequential lexical information. Still, some complex syntactic phenomena such as prepositional phrase attachment are poorly modeled. This work…

Computation and Language · Computer Science 2017-07-19 Maria Nadejde , Siva Reddy , Rico Sennrich , Tomasz Dwojak , Marcin Junczys-Dowmunt , Philipp Koehn , Alexandra Birch

Machine translation systems achieve near human-level performance on some languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences, which hinders their applicability to the majority of…

Computation and Language · Computer Science 2018-08-15 Guillaume Lample , Myle Ott , Alexis Conneau , Ludovic Denoyer , Marc'Aurelio Ranzato

Most modern neural machine translation (NMT) systems rely on presegmented inputs. Segmentation granularity importantly determines the input and output sequence lengths, hence the modeling depth, and source and target vocabularies, which in…

Computation and Language · Computer Science 2018-11-06 Julia Kreutzer , Artem Sokolov

This paper presents an in-depth investigation on integrating neural language models in translation systems. Scaling neural language models is a difficult task, but crucial for real-world applications. This paper evaluates the impact on…

Computation and Language · Computer Science 2015-03-23 Paul Baltescu , Phil Blunsom

While Transformer-based neural machine translation (NMT) is very effective in high-resource settings, many languages lack the necessary large parallel corpora to benefit from it. In the context of low-resource (LR) MT between two…

Computation and Language · Computer Science 2024-06-19 Niyati Bafna , Philipp Koehn , David Yarowsky

This paper investigates neural character-based morphological tagging for languages with complex morphology and large tag sets. We systematically explore a variety of neural architectures (DNN, CNN, CNNHighway, LSTM, BLSTM) to obtain…

Computation and Language · Computer Science 2016-06-22 Georg Heigold , Guenter Neumann , Josef van Genabith

One of the significant challenges of Machine Translation (MT) is the scarcity of large amounts of data, mainly parallel sentence aligned corpora. If the evaluation is as rigorous as resource-rich languages, both Neural Machine Translation…

Computation and Language · Computer Science 2023-03-06 Amit Kumar , Rupjyoti Baruah , Ajay Pratap , Mayank Swarnkar , Anil Kumar Singh

Multilingual language models have shown impressive cross-lingual transfer ability across a diverse set of languages and tasks. To improve the cross-lingual ability of these models, some strategies include transliteration and finer-grained…

Computation and Language · Computer Science 2023-05-08 Sonal Sannigrahi , Rachel Bawden

Neural machine translation aims at building a single large neural network that can be trained to maximize translation performance. The encoder-decoder architecture with an attention mechanism achieves a translation performance comparable to…

Computation and Language · Computer Science 2016-08-22 Shenjian Zhao , Zhihua Zhang

Translation into morphologically-rich languages challenges neural machine translation (NMT) models with extremely sparse vocabularies where atomic treatment of surface forms is unrealistic. This problem is typically addressed by either…

Computation and Language · Computer Science 2020-02-28 Duygu Ataman , Wilker Aziz , Alexandra Birch

Neural machine translation has recently achieved impressive results, while using little in the way of external linguistic information. In this paper we show that the strong learning capability of neural MT models does not make linguistic…

Computation and Language · Computer Science 2016-06-29 Rico Sennrich , Barry Haddow

Even for common NLP tasks, sufficient supervision is not available in many languages -- morphological tagging is no exception. In the work presented here, we explore a transfer learning scheme, whereby we train character-level recurrent…

Computation and Language · Computer Science 2025-04-25 Ryan Cotterell , Georg Heigold