English
Related papers

Related papers: Logographic Subword Model for Neural Machine Trans…

200 papers

In this paper, we empirically investigate applying word-level weights to adapt neural machine translation to e-commerce domains, where small e-commerce datasets and large out-of-domain datasets are available. In order to mine in-domain like…

Computation and Language · Computer Science 2019-06-10 Shen Yan , Leonard Dahlmann , Pavel Petrushkov , Sanjika Hewavitharana , Shahram Khadivi

Resolving semantic ambiguity has long been recognised as a central challenge in the field of Machine Translation. Recent work on benchmarking translation performance on ambiguous sentences has exposed the limitations of conventional Neural…

Computation and Language · Computer Science 2023-10-24 Vivek Iyer , Pinzhen Chen , Alexandra Birch

Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level knowledge, such as generating synthetic parallel data or…

Computation and Language · Computer Science 2019-08-22 Rongxiang Weng , Heng Yu , Shujian Huang , Weihua Luo , Jiajun Chen

This paper does not aim at introducing a novel model for document-level neural machine translation. Instead, we head back to the original Transformer model and hope to answer the following question: Is the capacity of current models strong…

Computation and Language · Computer Science 2022-03-15 Zewei Sun , Mingxuan Wang , Hao Zhou , Chengqi Zhao , Shujian Huang , Jiajun Chen , Lei Li

Chinese input recommendation plays an important role in alleviating human cost in typing Chinese words, especially in the scenario of mobile applications. The fundamental problem is to predict the conditional probability of the next word…

Computation and Language · Computer Science 2019-07-12 Hainan Zhang , Yanyan Lan , Jiafeng Guo , Jun Xu , Xueqi Cheng

This paper reports the performances of shallow word-level convolutional neural networks (CNN), our earlier work (2015), on the eight datasets with relatively large training data that were used for testing the very deep character-level CNN…

Computation and Language · Computer Science 2016-09-05 Rie Johnson , Tong Zhang

This paper presents a novel semantic-based phrase translation model. A pair of source and target phrases are projected into continuous-valued vector representations in a low-dimensional latent semantic space, where their translation score…

Computation and Language · Computer Science 2013-12-03 Jianfeng Gao , Xiaodong He , Wen-tau Yih , Li Deng

This paper examines the problem of adapting neural machine translation systems to new, low-resourced languages (LRLs) as effectively and rapidly as possible. We propose methods based on starting with massively multilingual "seed models",…

Computation and Language · Computer Science 2018-08-14 Graham Neubig , Junjie Hu

This paper provides an analysis of character-level machine translation models used in pivot-based translation when applied to sparse and noisy datasets, such as crowdsourced movie subtitles. In our experiments, we find that such…

Computation and Language · Computer Science 2021-09-29 Jörg Tiedemann , Preslav Nakov

Unsupervised neural machine translation (UNMT) requires only monolingual data of similar language pairs during training and can produce bi-directional translation models with relatively good performance on alphabetic languages (Lample et…

Computation and Language · Computer Science 2019-03-04 Longtu Zhang , Mamoru Komachi

Word discovery is the task of extracting words from unsegmented text. In this paper we examine to what extent neural networks can be applied to this task in a realistic unwritten language scenario, where only small corpora and limited…

Computation and Language · Computer Science 2017-09-20 Marcely Zanon Boito , Alexandre Berard , Aline Villavicencio , Laurent Besacier

Neural machine translation (NMT) approaches have improved the state of the art in many machine translation settings over the last couple of years, but they require large amounts of training data to produce sensible output. We demonstrate…

Computation and Language · Computer Science 2017-08-22 Robert Östling , Jörg Tiedemann

Given the advantage and recent success of English character-level and subword-unit models in several NLP tasks, we consider the equivalent modeling problem for Chinese. Chinese script is logographic and many Chinese logograms are composed…

Computation and Language · Computer Science 2018-09-11 Falcon Z. Dai , Zheng Cai

We leverage embedding duplication between aligned sub-words to extend the Parent-Child transfer learning method, so as to improve low-resource machine translation. We conduct experiments on benchmark datasets of My-En, Id-En and Tr-En…

Computation and Language · Computer Science 2022-05-10 Minhan Xu , Yu Hong

Artificial neural networks are powerful models, which have been widely applied into many aspects of machine translation, such as language modeling and translation modeling. Though notable improvements have been made in these areas, the…

Computation and Language · Computer Science 2017-09-25 Yiming Cui , Shijin Wang , Jianfeng Li

Machine translation has many applications such as news translation, email translation, official letter translation etc. Commercial translators, e.g. Google Translation lags in regional vocabulary and are unable to learn the bilingual text…

Computation and Language · Computer Science 2020-08-04 Sandhya Aneja , Siti Nur Afikah Bte Abdul Mazid , Nagender Aneja

Recent studies have shown effectiveness in using neural networks for Chinese word segmentation. However, these models rely on large-scale data and are less effective for low-resource datasets because of insufficient training data. We…

Computation and Language · Computer Science 2017-09-15 Jingjing Xu , Xu Sun

Neural machine translation on low-resource language is challenging due to the lack of bilingual sentence pairs. Previous works usually solve the low-resource translation problem with knowledge transfer in a multilingual setting. In this…

Computation and Language · Computer Science 2019-08-20 Tianyu He , Jiale Chen , Xu Tan , Tao Qin

Deep neural networks are effective feature extractors but they are prohibitively large for deployment scenarios. Due to the huge number of parameters, interpretability of parameters in different layers is not straight-forward. This is why…

Computation and Language · Computer Science 2021-12-23 Saeed Damadi

Translating characters instead of words or word-fragments has the potential to simplify the processing pipeline for neural machine translation (NMT), and improve results by eliminating hyper-parameters and manual feature engineering.…

Computation and Language · Computer Science 2018-08-30 Colin Cherry , George Foster , Ankur Bapna , Orhan Firat , Wolfgang Macherey