English
Related papers

Related papers: Controlling Utterance Length in NMT-based Word Seg…

200 papers

Multilingual pre-trained models could leverage the training data from a rich source language (such as English) to improve performance on low resource languages. However, the transfer quality for multilingual Machine Reading Comprehension…

Computation and Language · Computer Science 2020-05-11 Fei Yuan , Linjun Shou , Xuanyu Bai , Ming Gong , Yaobo Liang , Nan Duan , Yan Fu , Daxin Jiang

Automated discourse analysis tools based on Natural Language Processing (NLP) aiming at the diagnosis of language-impairing dementias generally extract several textual metrics of narrative transcripts. However, the absence of sentence…

Computation and Language · Computer Science 2017-08-17 Marcos Vinícius Treviso , Christopher Shulby , Sandra Maria Aluísio

In neural machine translation (NMT), the computational cost at the output layer increases with the size of the target-side vocabulary. Using a limited-size vocabulary instead may cause a significant decrease in translation quality. This…

Computation and Language · Computer Science 2018-07-31 Katsuki Chousa , Katsuhito Sudoh , Satoshi Nakamura

The necessity of using a fixed-size word vocabulary in order to control the model complexity in state-of-the-art neural machine translation (NMT) systems is an important bottleneck on performance, especially for morphologically rich…

Computation and Language · Computer Science 2017-08-01 Duygu Ataman , Matteo Negri , Marco Turchi , Marcello Federico

Unsupervised Neural Machine Translation (UNMT) focuses on improving NMT results under the assumption there is no human translated parallel data, yet little work has been done so far in highlighting its advantages compared to supervised…

Computation and Language · Computer Science 2023-12-21 Isidora Chara Tourni , Derry Wijaya

This paper considers the unsupervised domain adaptation problem for neural machine translation (NMT), where we assume the access to only monolingual text in either the source or target language in the new domain. We propose a cross-lingual…

Computation and Language · Computer Science 2021-09-10 Thuy-Trang Vu , Xuanli He , Dinh Phung , Gholamreza Haffari

Documenting languages helps to prevent the extinction of endangered dialects, many of which are otherwise expected to disappear by the end of the century. When documenting oral languages, unsupervised word segmentation (UWS) from speech is…

Computation and Language · Computer Science 2022-05-19 Marcely Zanon Boito , Bolaji Yusuf , Lucas Ondel , Aline Villavicencio , Laurent Besacier

Neural Machine Translation (NMT) models have demonstrated strong state of the art performance on translation tasks where well-formed training and evaluation data are provided, but they remain sensitive to inputs that include errors of…

Computation and Language · Computer Science 2020-10-22 Daniel Li , Te I , Naveen Arivazhagan , Colin Cherry , Dirk Padfield

Data-driven subword segmentation has become the default strategy for open-vocabulary machine translation and other NLP tasks, but may not be sufficiently generic for optimal learning of non-concatenative morphology. We design a test suite…

Computation and Language · Computer Science 2021-09-03 Chantal Amrhein , Rico Sennrich

Accurate terminology translation is crucial for ensuring the practicality and reliability of neural machine translation (NMT) systems. To address this, lexically constrained NMT explores various methods to ensure pre-specified words and…

Computation and Language · Computer Science 2021-08-13 Gyubok Lee , Seongjun Yang , Edward Choi

For endangered languages, data collection campaigns have to accommodate the challenge that many of them are from oral tradition, and producing transcriptions is costly. Therefore, it is fundamental to translate them into a widely spoken…

Computation and Language · Computer Science 2020-03-31 Marcely Zanon Boito , Aline Villavicencio , Laurent Besacier

The recent advances introduced by neural machine translation (NMT) are rapidly expanding the application fields of machine translation, as well as reshaping the quality level to be targeted. In particular, if translations have to fit some…

Computation and Language · Computer Science 2019-10-28 Surafel Melaku Lakew , Mattia Di Gangi , Marcello Federico

While recent advances in deep learning led to significant improvements in machine translation, neural machine translation is often still not able to continuously adapt to the environment. For humans, as well as for machine translation,…

Computation and Language · Computer Science 2021-02-15 Jan Niehues

Prior methods to text segmentation are mostly at token level. Despite the adequacy, this nature limits their full potential to capture the long-term dependencies among segments. In this work, we propose a novel framework that incrementally…

Computation and Language · Computer Science 2021-04-16 Yangming Li , Lemao Liu , Kaisheng Yao

Subword units are an effective way to alleviate the open vocabulary problems in neural machine translation (NMT). While sentences are usually converted into unique subword sequences, subword segmentation is potentially ambiguous and…

Computation and Language · Computer Science 2018-05-01 Taku Kudo

In Neural Machine Translation (NMT) the usage of subwords and characters as source and target units offers a simple and flexible solution for translation of rare and unseen words. However, selecting the optimal subword segmentation involves…

Computation and Language · Computer Science 2019-10-29 Tejas Srinivasan , Ramon Sanabria , Florian Metze

The authors of (Cho et al., 2014a) have shown that the recently introduced neural network translation systems suffer from a significant drop in translation quality when translating long sentences, unlike existing phrase-based translation…

Computation and Language · Computer Science 2014-10-08 Jean Pouget-Abadie , Dzmitry Bahdanau , Bart van Merrienboer , Kyunghyun Cho , Yoshua Bengio

Neural Machine Translation (NMT) models generally perform translation using a fixed-size lexical vocabulary, which is an important bottleneck on their generalization capability and overall translation quality. The standard approach to…

Computation and Language · Computer Science 2019-10-22 Duygu Ataman , Orhan Firat , Mattia A. Di Gangi , Marcello Federico , Alexandra Birch

Recent advancements in open vocabulary models, like CLIP, have notably advanced zero-shot classification and segmentation by utilizing natural language for class-specific embeddings. However, most research has focused on improving model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Wenfang Sun , Yingjun Du , Gaowen Liu , Ramana Kompella , Cees G. M. Snoek

Unsupervised cross-lingual pretraining has achieved strong results in neural machine translation (NMT), by drastically reducing the need for large parallel data. Most approaches adapt masked-language modeling (MLM) to sequence-to-sequence…

Computation and Language · Computer Science 2021-06-11 Christos Baziotis , Ivan Titov , Alexandra Birch , Barry Haddow