English
Related papers

Related papers: Context Models for OOV Word Translation in Low-Res…

200 papers

Neural Machine Translation (NMT) is an open vocabulary problem. As a result, dealing with the words not occurring during training (a.k.a. out-of-vocabulary (OOV) words) have long been a fundamental challenge for NMT systems. The predominant…

Computation and Language · Computer Science 2022-08-18 Ali Araabi , Christof Monz , Vlad Niculae

In Machine Translation, considering the document as a whole can help to resolve ambiguities and inconsistencies. In this paper, we propose a simple yet promising approach to add contextual information in Neural Machine Translation. We…

Computation and Language · Computer Science 2019-10-17 Valentin Macé , Christophe Servan

Deep neural networks and huge language models are becoming omnipresent in natural language applications. As they are known for requiring large amounts of training data, there is a growing body of work to improve the performance in…

Computation and Language · Computer Science 2021-04-12 Michael A. Hedderich , Lukas Lange , Heike Adel , Jannik Strötgen , Dietrich Klakow

Out-of-vocabulary words account for a large proportion of errors in machine translation systems, especially when the system is used on a different domain than the one where it was trained. In order to alleviate the problem, we propose to…

Computation and Language · Computer Science 2016-08-08 Pranava Swaroop Madhyastha , Cristina España-Bonet

We propose a novel method for translation selection in statistical machine translation, in which a convolutional neural network is employed to judge the similarity between a phrase pair in two languages. The specifically designed…

Computation and Language · Computer Science 2015-06-25 Zhaopeng Tu , Baotian Hu , Zhengdong Lu , Hang Li

Rule-based machine translation is a machine translation paradigm where linguistic knowledge is encoded by an expert in the form of rules that translate text from source to target language. While this approach grants extensive control over…

Computation and Language · Computer Science 2020-09-29 Daniel Torregrosa , Nivranshu Pasricha , Maraim Masoud , Bharathi Raja Chakravarthi , Juan Alonso , Noe Casas , Mihael Arcan

Increased adaptability of RNN language models leads to improved predictions that benefit many applications. However, current methods do not take full advantage of the RNN structure. We show that the most widely-used approach to adaptation…

Computation and Language · Computer Science 2017-04-24 Aaron Jaech , Mari Ostendorf

Many language pairs are low resource, meaning the amount and/or quality of available parallel data is not sufficient to train a neural machine translation (NMT) model which can reach an acceptable standard of accuracy. Many works have…

Computation and Language · Computer Science 2021-11-23 Idris Abdulmumin , Bashir Shehu Galadanci , Abubakar Isa , Habeebah Adamu Kakudi , Ismaila Idris Sinan

Neural machine translation systems typically are trained on curated corpora and break when faced with non-standard orthography or punctuation. Resilience to spelling mistakes and typos, however, is crucial as machine translation systems are…

Computation and Language · Computer Science 2020-09-15 Toms Bergmanis , Artūrs Stafanovičs , Mārcis Pinnis

Machine Translation has made impressive progress in recent years offering close to human-level performance on many languages, but studies have primarily focused on high-resource languages with broad online presence and resources. With the…

Computation and Language · Computer Science 2024-04-15 Wan-Hua Her , Udo Kruschwitz

Pre-trained language models have achieved huge improvement on many NLP tasks. However, these methods are usually designed for written text, so they do not consider the properties of spoken language. Therefore, this paper aims at…

Computation and Language · Computer Science 2020-11-03 Chao-Wei Huang , Yun-Nung Chen

Lexical ambiguity is a challenging and pervasive problem in machine translation (\mt). We introduce a simple and scalable approach to resolve translation ambiguity by incorporating a small amount of extra-sentential context in neural \mt.…

Computation and Language · Computer Science 2023-11-28 Elijah Rippeth , Marine Carpuat , Kevin Duh , Matt Post

Neural Chat Translation (NCT) aims to translate conversational text between speakers of different languages. Despite the promising performance of sentence-level and context-aware neural machine translation models, there still remain…

Computation and Language · Computer Science 2021-09-03 Yunlong Liang , Chulun Zhou , Fandong Meng , Jinan Xu , Yufeng Chen , Jinsong Su , Jie Zhou

We conduct an empirical study of neural machine translation (NMT) for truly low-resource languages, and propose a training curriculum fit for cases when both parallel training data and compute resource are lacking, reflecting the reality of…

Computation and Language · Computer Science 2021-11-30 Garry Kuwanto , Afra Feyza Akyürek , Isidora Chara Tourni , Siyang Li , Alexander Gregory Jones , Derry Wijaya

Publicly available TTS datasets for low-resource languages like Hindi and Tamil typically contain 10-20 hours of data, leading to poor vocabulary coverage. This limitation becomes evident in downstream applications where domain-specific…

Computation and Language · Computer Science 2024-07-19 Srija Anand , Praveen Srinivasa Varadhan , Ashwin Sankar , Giri Raju , Mitesh M. Khapra

Using large language models, this paper presents techniques to improve extremely low-resourced indigenous language translations. Our approaches are grounded in the use of (1) the presence of a datastore consisting of a limited number of…

Computation and Language · Computer Science 2024-07-19 You-Cheng Liao , Chen-Jui Yu , Chi-Yi Lin , He-Feng Yun , Yen-Hsiang Wang , Hsiao-Min Li , Yao-Chung Fan

Standard context-aware neural machine translation (NMT) typically relies on parallel document-level data, exploiting both source and target contexts. Concatenation-based approaches in particular, still a strong baseline for document-level…

Computation and Language · Computer Science 2024-02-12 Harritxu Gete , Thierry Etchegoyhen

Transformers have shown great promise as an approach to Neural Machine Translation (NMT) for low-resource languages. However, at the same time, transformer models remain difficult to optimize and require careful tuning of hyper-parameters…

Computation and Language · Computer Science 2020-04-16 Elan van Biljon , Arnu Pretorius , Julia Kreutzer

This paper presents an in-depth investigation on integrating neural language models in translation systems. Scaling neural language models is a difficult task, but crucial for real-world applications. This paper evaluates the impact on…

Computation and Language · Computer Science 2015-03-23 Paul Baltescu , Phil Blunsom

This paper examines the problem of adapting neural machine translation systems to new, low-resourced languages (LRLs) as effectively and rapidly as possible. We propose methods based on starting with massively multilingual "seed models",…

Computation and Language · Computer Science 2018-08-14 Graham Neubig , Junjie Hu