中文
相关论文

相关论文: Hard but Robust, Easy but Sensitive: How Encoder a…

200 篇论文

In state-of-the-art Neural Machine Translation (NMT), an attention mechanism is used during decoding to enhance the translation. At every step, the decoder uses this mechanism to focus on different parts of the source sentence to gather the…

计算与语言 · 计算机科学 2018-05-31 Jean-Benoit Delbrouck , Stéphane Dupont

Neural machine translation (NMT) is notoriously sensitive to noises, but noises are almost inevitable in practice. One special kind of noise is the homophone noise, where words are replaced by other words with similar pronunciations. We…

计算与语言 · 计算机科学 2019-06-05 Hairong Liu , Mingbo Ma , Liang Huang , Hao Xiong , Zhongjun He

Neural machine translation aims at building a single large neural network that can be trained to maximize translation performance. The encoder-decoder architecture with an attention mechanism achieves a translation performance comparable to…

计算与语言 · 计算机科学 2016-08-22 Shenjian Zhao , Zhihua Zhang

Neural Machine Translation (NMT) is the task of translating a text from one language to another with the use of a trained neural network. Several existing works aim at incorporating external information into NMT models to improve or control…

计算与语言 · 计算机科学 2024-04-30 Charles Brazier , Jean-Luc Rouas

Neural Machine Translation (NMT) models generally perform translation using a fixed-size lexical vocabulary, which is an important bottleneck on their generalization capability and overall translation quality. The standard approach to…

计算与语言 · 计算机科学 2019-10-22 Duygu Ataman , Orhan Firat , Mattia A. Di Gangi , Marcello Federico , Alexandra Birch

Recent work in multilingual translation advances translation quality surpassing bilingual baselines using deep transformer models with increased capacity. However, the extra latency and memory costs introduced by this approach may make it…

计算与语言 · 计算机科学 2022-06-07 Xiang Kong , Adithya Renduchintala , James Cross , Yuqing Tang , Jiatao Gu , Xian Li

Neural Machine Translation (NMT) models have been proved strong when translating clean texts, but they are very sensitive to noise in the input. Improving NMT models robustness can be seen as a form of "domain" adaption to noise. The…

计算与语言 · 计算机科学 2019-11-12 Zhenhao Li , Lucia Specia

Most existing Neural Machine Translation models use groups of characters or whole words as their unit of input and output. We propose a model with a hierarchical char2word encoder, that takes individual characters both as input and output.…

In this paper, we propose a robust neural machine translation (NMT) framework. The framework consists of a homophone noise detector and a syllable-aware NMT model to homophone errors. The detector identifies potential homophone errors in a…

计算与语言 · 计算机科学 2020-12-16 Wenjie Qin , Xiang Li , Yuhui Sun , Deyi Xiong , Jianwei Cui , Bin Wang

Recent advances in Neural Machine Translation (NMT) show that adding syntactic information to NMT systems can improve the quality of their translations. Most existing work utilizes some specific types of linguistically-inspired tree…

计算与语言 · 计算机科学 2018-08-29 Xinyi Wang , Hieu Pham , Pengcheng Yin , Graham Neubig

Neural Machine Translation (NMT) leverages one or more trained neural networks for the translation of phrases. Sutskever introduced a sequence to sequence based encoder-decoder model which became the standard for NMT based systems.…

计算与语言 · 计算机科学 2020-06-11 Satish Mylapore , Ryan Quincy Paul , Joshua Yi , Robert D. Slater

We propose a novel decoding approach for neural machine translation (NMT) based on continuous optimisation. We convert decoding - basically a discrete optimization problem - into a continuous optimization problem. The resulting constrained…

计算与语言 · 计算机科学 2017-07-25 Cong Duy Vu Hoang , Gholamreza Haffari , Trevor Cohn

We introduce multi-modal, attention-based neural machine translation (NMT) models which incorporate visual features into different parts of both the encoder and the decoder. We utilise global image features extracted using a pre-trained…

计算与语言 · 计算机科学 2017-01-24 Iacer Calixto , Qun Liu , Nick Campbell

Neural Machine Translation (NMT) is resource intensive. We design a quantization procedure to compress NMT models better for devices with limited hardware capability. Because most neural network parameters are near zero, we employ…

计算与语言 · 计算机科学 2019-09-23 Alham Fikri Aji , Kenneth Heafield

Unsupervised neural machine translation (UNMT) has recently attracted great interest in the machine translation community. The main advantage of the UNMT lies in its easy collection of required large training text sentences while with only…

计算与语言 · 计算机科学 2020-12-04 Haipeng Sun , Rui Wang , Kehai Chen , Xugang Lu , Masao Utiyama , Eiichiro Sumita , Tiejun Zhao

Neural Machine Translation (NMT) has become a popular technology in recent years, and the encoder-decoder framework is the mainstream among all the methods. It's obvious that the quality of the semantic representations from encoding is very…

计算与语言 · 计算机科学 2020-01-15 Boyuan Pan , Yazheng Yang , Zhou Zhao , Yueting Zhuang , Deng Cai

The prevalent approach to neural machine translation relies on bi-directional LSTMs to encode the source sentence. In this paper we present a faster and simpler architecture based on a succession of convolutional layers. This allows to…

计算与语言 · 计算机科学 2017-07-26 Jonas Gehring , Michael Auli , David Grangier , Yann N. Dauphin

Standard neural machine translation (NMT) is on the assumption of document-level context independent. Most existing document-level NMT methods are satisfied with a smattering sense of brief document-level information, while this work…

计算与语言 · 计算机科学 2021-10-13 Shu Jiang , Hai Zhao , Zuchao Li , Bao-Liang Lu

Neural machine translation (NMT) models learn representations containing substantial linguistic information. However, it is not clear if such information is fully distributed or if some of it can be attributed to individual neurons. We…

计算与语言 · 计算机科学 2018-11-06 Anthony Bau , Yonatan Belinkov , Hassan Sajjad , Nadir Durrani , Fahim Dalvi , James Glass

Neural Machine Translation model is a sequence-to-sequence converter based on neural networks. Existing models use recurrent neural networks to construct both the encoder and decoder modules. In alternative research, the recurrent networks…

计算与语言 · 计算机科学 2021-05-04 Ritam Mallick , Seba Susan , Vaibhaw Agrawal , Rizul Garg , Prateek Rawal