中文
相关论文

相关论文: Hard but Robust, Easy but Sensitive: How Encoder a…

200 篇论文

Neural Machine Translation (NMT) is a new approach to machine translation that has made great progress in recent years. However, recent studies show that NMT generally produces fluent but inadequate translations (Tu et al. 2016b; Tu et al.…

计算与语言 · 计算机科学 2017-01-02 Xing Wang , Zhengdong Lu , Zhaopeng Tu , Hang Li , Deyi Xiong , Min Zhang

In Neural Machine Translation (NMT), the decoder can capture the features of the entire prediction history with neural connections and representations. This means that partial hypotheses with different prefixes will be regarded differently…

计算与语言 · 计算机科学 2018-10-16 Zhisong Zhang , Rui Wang , Masao Utiyama , Eiichiro Sumita , Hai Zhao

Unlike literal expressions, idioms' meanings do not directly follow from their parts, posing a challenge for neural machine translation (NMT). NMT models are often unable to translate idioms accurately and over-generate compositional,…

计算与语言 · 计算机科学 2022-05-31 Verna Dankers , Christopher G. Lucas , Ivan Titov

Recent work has shown that the encoder-decoder attention mechanisms in neural machine translation (NMT) are different from the word alignment in statistical machine translation. In this paper, we focus on analyzing encoder-decoder attention…

计算与语言 · 计算机科学 2018-10-18 Gongbo Tang , Rico Sennrich , Joakim Nivre

With the rapid advancement of Neural Machine Translation (NMT), enhancing translation efficiency and quality has become a focal point of research. Despite the commendable performance of general models such as the Transformer in various…

计算与语言 · 计算机科学 2024-02-26 Jingpu Yang , Zehua Han , Mengyu Xiang , Helin Wang , Yuxiao Huang , Miao Fang

In Transformer-based neural machine translation (NMT), the positional encoding mechanism helps the self-attention networks to learn the source representation with order dependency, which makes the Transformer-based NMT achieve…

计算与语言 · 计算机科学 2020-04-09 Kehai Chen , Rui Wang , Masao Utiyama , Eiichiro Sumita

Transformer is the state-of-the-art model in recent machine translation evaluations. Two strands of research are promising to improve models of this kind: the first uses wide networks (a.k.a. Transformer-Big) and has been the de facto…

计算与语言 · 计算机科学 2019-06-06 Qiang Wang , Bei Li , Tong Xiao , Jingbo Zhu , Changliang Li , Derek F. Wong , Lidia S. Chao

Encoder-decoder has been widely used in neural machine translation (NMT). A few methods have been proposed to improve it with multiple passes of decoding. However, their full potential is limited by a lack of appropriate termination…

计算与语言 · 计算机科学 2021-05-11 Yangming Li , Kaisheng Yao

Recently, document-level neural machine translation (NMT) has become a hot topic in the community of machine translation. Despite its success, most of existing studies ignored the discourse structure information of the input document to be…

计算与语言 · 计算机科学 2020-06-23 Junxuan Chen , Xiang Li , Jiarui Zhang , Chulun Zhou , Jianwei Cui , Bin Wang , Jinsong Su

Character-based neural machine translation (NMT) models alleviate out-of-vocabulary issues, learn morphology, and move us closer to completely end-to-end translation systems. Unfortunately, they are also very brittle and easily falter when…

计算与语言 · 计算机科学 2018-02-27 Yonatan Belinkov , Yonatan Bisk

Neural machine translation (NMT) has recently become popular in the field of machine translation. However, NMT suffers from the problem of repeating or missing words in the translation. To address this problem, Tu et al. (2017) proposed an…

计算与语言 · 计算机科学 2017-06-27 Yukio Matsumura , Takayuki Sato , Mamoru Komachi

Compared to sentence-level systems, document-level neural machine translation (NMT) models produce a more consistent output across a document and are able to better resolve ambiguities within the input. There are many works on…

计算与语言 · 计算机科学 2023-06-09 Christian Herold , Hermann Ney

Neural machine translation (MT) models obtain state-of-the-art performance while maintaining a simple, end-to-end architecture. However, little is known about what these models learn about source and target languages during the training…

计算与语言 · 计算机科学 2018-10-23 Yonatan Belinkov , Nadir Durrani , Fahim Dalvi , Hassan Sajjad , James Glass

Recently, neural machine translation (NMT) has been extended to multilinguality, that is to handle more than one translation direction with a single system. Multilingual NMT showed competitive performance against pure bilingual systems.…

计算与语言 · 计算机科学 2018-06-22 Surafel M. Lakew , Mauro Cettolo , Marcello Federico

Neural machine translation (NMT) is nowadays commonly applied at the subword level, using byte-pair encoding. A promising alternative approach focuses on character-level translation, which simplifies processing pipelines in NMT…

计算与语言 · 计算机科学 2020-05-25 Nikolay Banar , Walter Daelemans , Mike Kestemont

Machine translation systems require semantic knowledge and grammatical understanding. Neural machine translation (NMT) systems often assume this information is captured by an attention mechanism and a decoder that ensures fluency. Recent…

计算与语言 · 计算机科学 2018-05-29 Ke Tran , Yonatan Bisk

While current state-of-the-art NMT models, such as RNN seq2seq and Transformers, possess a large number of parameters, they are still shallow in comparison to convolutional models used for both text and vision applications. In this work we…

计算与语言 · 计算机科学 2018-09-06 Ankur Bapna , Mia Xu Chen , Orhan Firat , Yuan Cao , Yonghui Wu

Neural machine translation has shown very promising results lately. Most NMT models follow the encoder-decoder framework. To make encoder-decoder models more flexible, attention mechanism was introduced to machine translation and also other…

计算与语言 · 计算机科学 2016-01-25 Shi Feng , Shujie Liu , Mu Li , Ming Zhou

Even though sequence-to-sequence neural machine translation (NMT) model have achieved state-of-art performance in the recent fewer years, but it is widely concerned that the recurrent neural network (RNN) units are very hard to capture the…

计算与语言 · 计算机科学 2018-05-28 Wen Zhang , Jiawei Hu , Yang Feng , Qun Liu

We train neural machine translation (NMT) models from English to six target languages, using NMT encoder representations to predict ancestor constituent labels of source language words. We find that NMT encoders learn similar source syntax…

计算与语言 · 计算机科学 2020-05-19 Tyler A. Chang , Anna N. Rafferty