English
Related papers

Related papers: Incorporating Word and Subword Units in Unsupervis…

200 papers

We propose to achieve explainable neural machine translation (NMT) by changing the output representation to explain itself. We present a novel approach to NMT which generates the target sentence by monotonically walking through the source…

Computation and Language · Computer Science 2018-08-30 Felix Stahlberg , Danielle Saunders , Bill Byrne

Recently, neural machine translation (NMT) has emerged as a powerful alternative to conventional statistical approaches. However, its performance drops considerably in the presence of morphologically rich languages (MRLs). Neural engines…

Computation and Language · Computer Science 2018-04-19 Peyman Passban , Qun Liu , Andy Way

Current multimodal machine translation (MMT) systems rely on fully supervised data (i.e models are trained on sentences with their translations and accompanying images). However, this type of data is costly to collect, limiting the…

Computation and Language · Computer Science 2025-03-12 Matthieu Futeral , Cordelia Schmid , Benoît Sagot , Rachel Bawden

Neural machine translation (NMT) systems are usually trained on a large amount of bilingual sentence pairs and translate one sentence at a time, ignoring inter-sentence information. This may make the translation of a sentence ambiguous or…

Computation and Language · Computer Science 2018-06-13 Shaohui Kuang , Deyi Xiong

Neural machine translation has significantly pushed forward the quality of the field. However, there are remaining big issues with the output translations and one of them is fairness. Neural models are trained on large text corpora which…

Computation and Language · Computer Science 2019-06-04 Joel Escudé Font , Marta R. Costa-jussà

Existing neural machine translation (NMT) studies mainly focus on developing dataset-specific models based on data from different tasks (e.g., document translation and chat translation). Although the dataset-specific models have achieved…

Computation and Language · Computer Science 2023-05-19 Yunlong Liang , Fandong Meng , Jinan Xu , Jiaan Wang , Yufeng Chen , Jie Zhou

In recent years, pretrained word embeddings have proved useful for multimodal neural machine translation (NMT) models to address the shortage of available datasets. However, the integration of pretrained word embeddings has not yet been…

Computation and Language · Computer Science 2019-06-25 Tosho Hirasawa , Mamoru Komachi

This paper presents Adam Mickiewicz University's (AMU) submissions to the constrained track of the WMT 2022 General MT Task. We participated in the Ukrainian $\leftrightarrow$ Czech translation directions. The systems are a weighted…

Computation and Language · Computer Science 2022-09-08 Artur Nowakowski , Gabriela Pałka , Kamil Guttmann , Mikołaj Pokrywka

We explore the idea of automatically crafting a tuning dataset for Statistical Machine Translation (SMT) that makes the hyper-parameters of the SMT system more robust with respect to some specific deficiencies of the parameter tuning…

Computation and Language · Computer Science 2017-10-03 Preslav Nakov , Stephan Vogel

We explore ways of incorporating bilingual dictionaries to enable semi-supervised neural machine translation. Conventional back-translation methods have shown success in leveraging target side monolingual data. However, since the quality of…

Computation and Language · Computer Science 2020-04-07 Sreyashi Nag , Mihir Kale , Varun Lakshminarasimhan , Swapnil Singhavi

In the encoder-decoder architecture for neural machine translation (NMT), the hidden states of the recurrent structures in the encoder and decoder carry the crucial information about the sentence.These vectors are generated by parameters…

Computation and Language · Computer Science 2017-08-08 Rongxiang Weng , Shujian Huang , Zaixiang Zheng , Xinyu Dai , Jiajun Chen

Past vocabulary learning techniques identify relevant vocabulary before training, relying on statistical and entropy-based assumptions that largely neglect the role of model training. Empirically, we observe that trained translation models…

Computation and Language · Computer Science 2025-04-02 Pin-Jie Lin , Ernie Chang , Yangyang Shi , Vikas Chandra

Improving neural machine translation (NMT) systems with prompting has achieved significant progress in recent years. In this work, we focus on how to integrate multi-knowledge, multiple types of knowledge, into NMT models to enhance the…

Computation and Language · Computer Science 2023-12-11 Ke Wang , Jun Xie , Yuqi Zhang , Yu Zhao

Although neural machine translation (NMT) has achieved impressive progress recently, it is usually trained on the clean parallel data set and hence cannot work well when the input sentence is the production of the automatic speech…

Computation and Language · Computer Science 2018-11-05 Xiang Li , Haiyang Xue , Wei Chen , Yang Liu , Yang Feng , Qun Liu

We propose several ways of reusing subword embeddings and other weights in subword-aware neural language models. The proposed techniques do not benefit a competitive character-aware model, but some of them improve the performance of…

Computation and Language · Computer Science 2018-04-26 Zhenisbek Assylbekov , Rustem Takhanov

Morphological modeling in neural machine translation (NMT) is a promising approach to achieving open-vocabulary machine translation for morphologically-rich languages. However, existing methods such as sub-word tokenization and…

Computation and Language · Computer Science 2024-04-04 Antoine Nzeyimana

Multimodal machine translation (MMT) aims to improve neural machine translation (NMT) with additional visual information, but most existing MMT methods require paired input of source sentence and image, which makes them suffer from shortage…

Computation and Language · Computer Science 2022-03-22 Qingkai Fang , Yang Feng

As a sequence-to-sequence generation task, neural machine translation (NMT) naturally contains intrinsic uncertainty, where a single sentence in one language has multiple valid counterparts in the other. However, the dominant methods for…

Computation and Language · Computer Science 2020-10-12 Xiangpeng Wei , Heng Yu , Yue Hu , Rongxiang Weng , Luxi Xing , Weihua Luo

The standard approach to incorporate linguistic information to neural machine translation systems consists in maintaining separate vocabularies for each of the annotated features to be incorporated (e.g. POS tags, dependency relation…

Computation and Language · Computer Science 2021-02-18 Noe Casas , Jose A. R. Fonollosa , Marta R. Costa-jussà

Existing machine translation decoding algorithms generate translations in a strictly monotonic fashion and never revisit previous decisions. As a result, earlier mistakes cannot be corrected at a later stage. In this paper, we present a…

Computation and Language · Computer Science 2018-04-17 Roman Novak , Michael Auli , David Grangier