English
Related papers

Related papers: Sparsely Factored Neural Machine Translation

200 papers

We present a multilingual Named Entity Recognition approach based on a robust and general set of features across languages and datasets. Our system combines shallow local information with clustering semi-supervised features induced on large…

Computation and Language · Computer Science 2017-02-03 Rodrigo Agerri , German Rigau

We propose a straightforward vocabulary adaptation scheme to extend the language capacity of multilingual machine translation models, paving the way towards efficient continual learning for multilingual machine translation. Our approach is…

Computation and Language · Computer Science 2021-03-12 Xavier Garcia , Noah Constant , Ankur P. Parikh , Orhan Firat

The many-to-many multilingual neural machine translation can be regarded as the process of integrating semantic features from the source sentences and linguistic features from the target sentences. To enhance zero-shot translation, models…

Computation and Language · Computer Science 2024-08-05 Mengyu Bu , Shuhao Gu , Yang Feng

The surge of social media use brings huge demand of multilingual sentiment analysis (MSA) for unveiling cultural difference. So far, traditional methods resorted to machine translation---translating texts in other languages to English, and…

Computation and Language · Computer Science 2017-10-11 Yujie Lu , Tatsunori Mori

Word segmentation plays a pivotal role in improving any Arabic NLP application. Therefore, a lot of research has been spent in improving its accuracy. Off-the-shelf tools, however, are: i) complicated to use and ii) domain/dialect…

Computation and Language · Computer Science 2017-09-05 Hassan Sajjad , Fahim Dalvi , Nadir Durrani , Ahmed Abdelali , Yonatan Belinkov , Stephan Vogel

Compounding is a highly productive word-formation process in some languages that is often problematic for natural language processing applications. In this paper, we investigate whether distributional semantics in the form of word…

Computation and Language · Computer Science 2015-09-16 Joachim Daiber , Lautaro Quiroz , Roger Wechsler , Stella Frank

Accurate terminology translation is crucial for ensuring the practicality and reliability of neural machine translation (NMT) systems. To address this, lexically constrained NMT explores various methods to ensure pre-specified words and…

Computation and Language · Computer Science 2021-08-13 Gyubok Lee , Seongjun Yang , Edward Choi

Standard neural machine translation (NMT) is on the assumption of document-level context independent. Most existing document-level NMT methods are satisfied with a smattering sense of brief document-level information, while this work…

Computation and Language · Computer Science 2021-10-13 Shu Jiang , Hai Zhao , Zuchao Li , Bao-Liang Lu

Unstructured text provides decision-makers with a rich data source in many domains, ranging from product reviews in retail to nursing notes in healthcare. To leverage this information, words are typically translated into word embeddings --…

Machine Learning · Statistics 2024-02-20 Kan Xu , Xuanyi Zhao , Hamsa Bastani , Osbert Bastani

In NMT, words are sometimes dropped from the source or generated repeatedly in the translation. We explore novel strategies to address the coverage problem that change only the attention transformation. Our approach allocates fertilities to…

Computation and Language · Computer Science 2018-05-23 Chaitanya Malaviya , Pedro Ferreira , André F. T. Martins

We present a three-pronged approach to improving Statistical Machine Translation (SMT), building on recent success in the application of neural networks to SMT. First, we propose new features based on neural networks to model various…

Computation and Language · Computer Science 2015-06-03 Hendra Setiawan , Zhongqiang Huang , Jacob Devlin , Thomas Lamar , Rabih Zbib , Richard Schwartz , John Makhoul

While achieving state-of-the-art results in multiple tasks and languages, translation-based cross-lingual transfer is often overlooked in favour of massively multilingual pre-trained encoders. Arguably, this is due to its main limitations:…

Computation and Language · Computer Science 2021-07-26 Edoardo Maria Ponti , Julia Kreutzer , Ivan Vulić , Siva Reddy

We introduce Probabilistic FastText, a new model for word embeddings that can capture multiple word senses, sub-word structure, and uncertainty information. In particular, we represent each word with a Gaussian mixture density, where the…

Computation and Language · Computer Science 2018-06-11 Ben Athiwaratkun , Andrew Gordon Wilson , Anima Anandkumar

The lack of annotated data in many languages is a well-known challenge within the field of multilingual natural language processing (NLP). Therefore, many recent studies focus on zero-shot transfer learning and joint training across…

Computation and Language · Computer Science 2019-12-24 Niels van der Heijden , Samira Abnar , Ekaterina Shutova

Existing machine translation decoding algorithms generate translations in a strictly monotonic fashion and never revisit previous decisions. As a result, earlier mistakes cannot be corrected at a later stage. In this paper, we present a…

Computation and Language · Computer Science 2018-04-17 Roman Novak , Michael Auli , David Grangier

This work focuses on the rapid development of linguistic annotation tools for resource-poor languages. We experiment several cross-lingual annotation projection methods using Recurrent Neural Networks (RNN) models. The distinctive feature…

Computation and Language · Computer Science 2016-09-30 Othman Zennaki , Nasredine Semmar , Laurent Besacier

Neural word representations have proven useful in Natural Language Processing (NLP) tasks due to their ability to efficiently model complex semantic and syntactic word relationships. However, most techniques model only one representation…

Computation and Language · Computer Science 2015-11-23 Andrew Trask , Phil Michalak , John Liu

In neural machine translation (NMT), the computational cost at the output layer increases with the size of the target-side vocabulary. Using a limited-size vocabulary instead may cause a significant decrease in translation quality. This…

Computation and Language · Computer Science 2018-07-31 Katsuki Chousa , Katsuhito Sudoh , Satoshi Nakamura

The necessity of using a fixed-size word vocabulary in order to control the model complexity in state-of-the-art neural machine translation (NMT) systems is an important bottleneck on performance, especially for morphologically rich…

Computation and Language · Computer Science 2017-08-01 Duygu Ataman , Matteo Negri , Marco Turchi , Marcello Federico

Natural Language Understanding has seen an increasing number of publications in the last few years, especially after robust word embeddings models became prominent, when they proved themselves able to capture and represent semantic…

Computation and Language · Computer Science 2022-12-20 Terry Ruas , William Grosky , Akiko Aizawa