English
Related papers

Related papers: Modeling Homophone Noise for Robust Neural Machine…

200 papers

Neural machine translation (NMT) is notoriously sensitive to noises, but noises are almost inevitable in practice. One special kind of noise is the homophone noise, where words are replaced by other words with similar pronunciations. We…

Computation and Language · Computer Science 2019-06-05 Hairong Liu , Mingbo Ma , Liang Huang , Hao Xiong , Zhongjun He

Neural machine translation (NMT) often suffers from the vulnerability to noisy perturbations in the input. We propose an approach to improving the robustness of NMT models, which consists of two parts: (1) attack the translation model with…

Computation and Language · Computer Science 2019-06-07 Yong Cheng , Lu Jiang , Wolfgang Macherey

Neural Machine Translation (NMT) models have been proved strong when translating clean texts, but they are very sensitive to noise in the input. Improving NMT models robustness can be seen as a form of "domain" adaption to noise. The…

Computation and Language · Computer Science 2019-11-12 Zhenhao Li , Lucia Specia

Small perturbations in the input can severely distort intermediate representations and thus impact translation quality of neural machine translation (NMT) models. In this paper, we propose to improve the robustness of NMT models with…

Computation and Language · Computer Science 2018-05-17 Yong Cheng , Zhaopeng Tu , Fandong Meng , Junjie Zhai , Yang Liu

Although neural machine translation (NMT) has achieved impressive progress recently, it is usually trained on the clean parallel data set and hence cannot work well when the input sentence is the production of the automatic speech…

Computation and Language · Computer Science 2018-11-05 Xiang Li , Haiyang Xue , Wei Chen , Yang Liu , Yang Feng , Qun Liu

Character-based neural machine translation (NMT) models alleviate out-of-vocabulary issues, learn morphology, and move us closer to completely end-to-end translation systems. Unfortunately, they are also very brittle and easily falter when…

Computation and Language · Computer Science 2018-02-27 Yonatan Belinkov , Yonatan Bisk

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

Computation and Language · Computer Science 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

Neural machine translation models have shown to achieve high quality when trained and fed with well structured and punctuated input texts. Unfortunately, the latter condition is not met in spoken language translation, where the input is…

Computation and Language · Computer Science 2019-10-24 Mattia Antonino Di Gangi , Robert Enyedi , Alessandra Brusadin , Marcello Federico

Neural machine translation (NMT) becomes a new state-of-the-art and achieves promising translation results using a simple encoder-decoder neural network. This neural network is trained once on the parallel corpus and the fixed network is…

Computation and Language · Computer Science 2016-09-22 Xiaoqing Li , Jiajun Zhang , Chengqing Zong

Neural Machine Translation (NMT) has achieved significant breakthrough in performance but is known to suffer vulnerability to input perturbations. As real input noise is difficult to predict during training, robustness is a big issue for…

Computation and Language · Computer Science 2021-04-21 Weiwen Xu , Ai Ti Aw , Yang Ding , Kui Wu , Shafiq Joty

Transformer models have demonstrated remarkable performance in neural machine translation (NMT). However, their vulnerability to noisy input poses a significant challenge in practical implementation, where generating clean output from noisy…

Computation and Language · Computer Science 2023-10-25 Quinten Bolding , Baohao Liao , Brandon James Denis , Jun Luo , Christof Monz

Neural Machine Translation (NMT) is a new approach to machine translation that has made great progress in recent years. However, recent studies show that NMT generally produces fluent but inadequate translations (Tu et al. 2016b; Tu et al.…

Computation and Language · Computer Science 2017-01-02 Xing Wang , Zhengdong Lu , Zhaopeng Tu , Hang Li , Deyi Xiong , Min Zhang

Modern Machine Translation (MT) systems perform consistently well on clean, in-domain text. However most human generated text, particularly in the realm of social media, is full of typos, slang, dialect, idiolect and other noise which can…

Computation and Language · Computer Science 2019-04-12 Vaibhav Vaibhav , Sumeet Singh , Craig Stewart , Graham Neubig

Massively multilingual neural machine translation (MMNMT) has been proven to enhance the translation quality of low-resource languages. In this paper, we empirically investigate the translation robustness of Indonesian-Chinese translation…

Computation and Language · Computer Science 2024-05-14 Supryadi , Leiyu Pan , Deyi Xiong

Homographs, words with different meanings but the same surface form, have long caused difficulty for machine translation systems, as it is difficult to select the correct translation based on the context. However, with the advent of neural…

Computation and Language · Computer Science 2018-03-29 Frederick Liu , Han Lu , Graham Neubig

Transformers (Vaswani et al., 2017) have brought a remarkable improvement in the performance of neural machine translation (NMT) systems but they could be surprisingly vulnerable to noise. In this work, we try to investigate how noise…

Computation and Language · Computer Science 2021-09-13 Peyman Passban , Puneeth S. M. Saladi , Qun Liu

Unsupervised neural machine translation (UNMT) has recently attracted great interest in the machine translation community. The main advantage of the UNMT lies in its easy collection of required large training text sentences while with only…

Computation and Language · Computer Science 2020-12-04 Haipeng Sun , Rui Wang , Kehai Chen , Xugang Lu , Masao Utiyama , Eiichiro Sumita , Tiejun Zhao

Unsupervised neural machine translation(NMT) is associated with noise and errors in synthetic data when executing vanilla back-translations. Here, we explicitly exploits language model(LM) to drive construction of an unsupervised NMT…

Computation and Language · Computer Science 2019-11-12 Wei Zhang , Youyuan Lin , Ruoran Ren , Xiaodong Wang , Zhenshuang Liang , Zhen Huang

k-Nearest-Neighbor Machine Translation (kNN-MT) becomes an important research direction of NMT in recent years. Its main idea is to retrieve useful key-value pairs from an additional datastore to modify translations without updating the NMT…

Computation and Language · Computer Science 2022-10-18 Hui Jiang , Ziyao Lu , Fandong Meng , Chulun Zhou , Jie Zhou , Degen Huang , Jinsong Su

Neural machine translation (MT) models achieve strong results across a variety of settings, but it is widely believed that they are highly sensitive to "noisy" inputs, such as spelling errors, abbreviations, and other formatting issues. In…

Computation and Language · Computer Science 2025-10-06 Ben Peters , André F. T. Martins
‹ Prev 1 2 3 10 Next ›