中文
相关论文

相关论文: Refining Source Representations with Relation Netw…

200 篇论文

Neural machine translation (NMT) becomes a new state-of-the-art and achieves promising translation results using a simple encoder-decoder neural network. This neural network is trained once on the parallel corpus and the fixed network is…

计算与语言 · 计算机科学 2016-09-22 Xiaoqing Li , Jiajun Zhang , Chengqing Zong

There has been relatively little attention to incorporating linguistic prior to neural machine translation. Much of the previous work was further constrained to considering linguistic prior on the source side. In this paper, we propose a…

计算与语言 · 计算机科学 2017-04-25 Akiko Eriguchi , Yoshimasa Tsuruoka , Kyunghyun Cho

In the encoder-decoder architecture for neural machine translation (NMT), the hidden states of the recurrent structures in the encoder and decoder carry the crucial information about the sentence.These vectors are generated by parameters…

计算与语言 · 计算机科学 2017-08-08 Rongxiang Weng , Shujian Huang , Zaixiang Zheng , Xinyu Dai , Jiajun Chen

In Neural Machine Translation (NMT), the decoder can capture the features of the entire prediction history with neural connections and representations. This means that partial hypotheses with different prefixes will be regarded differently…

计算与语言 · 计算机科学 2018-10-16 Zhisong Zhang , Rui Wang , Masao Utiyama , Eiichiro Sumita , Hai Zhao

While Transformer-based neural machine translation (NMT) is very effective in high-resource settings, many languages lack the necessary large parallel corpora to benefit from it. In the context of low-resource (LR) MT between two…

计算与语言 · 计算机科学 2024-06-19 Niyati Bafna , Philipp Koehn , David Yarowsky

We first observe a potential weakness of continuous vector representations of symbols in neural machine translation. That is, the continuous vector representation, or a word embedding vector, of a symbol encodes multiple dimensions of…

计算与语言 · 计算机科学 2016-07-05 Heeyoul Choi , Kyunghyun Cho , Yoshua Bengio

Modern neural machine translation (NMT) models have achieved competitive performance in standard benchmarks. However, they have recently been shown to suffer limitation in compositional generalization, failing to effectively learn the…

计算与语言 · 计算机科学 2022-10-14 Yongjing Yin , Yafu Li , Fandong Meng , Jie Zhou , Yue Zhang

Neural machine translation (NMT) approaches have improved the state of the art in many machine translation settings over the last couple of years, but they require large amounts of training data to produce sensible output. We demonstrate…

计算与语言 · 计算机科学 2017-08-22 Robert Östling , Jörg Tiedemann

Attention-based Neural Machine Translation (NMT) models suffer from attention deficiency issues as has been observed in recent research. We propose a novel mechanism to address some of these limitations and improve the NMT attention.…

计算与语言 · 计算机科学 2016-08-10 Baskaran Sankaran , Haitao Mi , Yaser Al-Onaizan , Abe Ittycheriah

While neural machine translation (NMT) models provide improved translation quality in an elegant, end-to-end framework, it is less clear what they learn about language. Recent work has started evaluating the quality of vector…

计算与语言 · 计算机科学 2018-01-25 Yonatan Belinkov , Lluís Màrquez , Hassan Sajjad , Nadir Durrani , Fahim Dalvi , James Glass

Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level knowledge, such as generating synthetic parallel data or…

计算与语言 · 计算机科学 2019-08-22 Rongxiang Weng , Heng Yu , Shujian Huang , Weihua Luo , Jiajun Chen

While neural machine translation (NMT) has achieved state-of-the-art translation performance, it is unable to capture the alignment between the input and output during the translation process. The lack of alignment in NMT models leads to…

计算与语言 · 计算机科学 2019-12-02 Jiacheng Zhang , Huanbo Luan , Maosong Sun , FeiFei Zhai , Jingfang Xu , Yang Liu

Machine translation systems require semantic knowledge and grammatical understanding. Neural machine translation (NMT) systems often assume this information is captured by an attention mechanism and a decoder that ensures fluency. Recent…

计算与语言 · 计算机科学 2018-05-29 Ke Tran , Yonatan Bisk

In Neural Machine Translation (NMT), each token prediction is conditioned on the source sentence and the target prefix (what has been previously translated at a decoding step). However, previous work on interpretability in NMT has mainly…

计算与语言 · 计算机科学 2022-11-08 Javier Ferrando , Gerard I. Gállego , Belen Alastruey , Carlos Escolano , Marta R. Costa-jussà

Neural machine translation (NMT) has recently achieved impressive results. A potential problem of the existing NMT algorithm, however, is that the decoding is conducted from left to right, without considering the right context. This paper…

计算与语言 · 计算机科学 2017-10-06 Aodong Li , Shiyue Zhang , Dong Wang , Thomas Fang Zheng

In this paper, we present our first attempts in building a multilingual Neural Machine Translation framework under a unified approach. We are then able to employ attention-based NMT for many-to-many multilingual translation tasks. Our…

计算与语言 · 计算机科学 2016-11-16 Thanh-Le Ha , Jan Niehues , Alexander Waibel

Multi-modal neural machine translation (NMT) aims to translate source sentences into a target language paired with images. However, dominant multi-modal NMT models do not fully exploit fine-grained semantic correspondences between semantic…

计算与语言 · 计算机科学 2020-07-20 Yongjing Yin , Fandong Meng , Jinsong Su , Chulun Zhou , Zhengyuan Yang , Jie Zhou , Jiebo Luo

Recently, document-level neural machine translation (NMT) has become a hot topic in the community of machine translation. Despite its success, most of existing studies ignored the discourse structure information of the input document to be…

计算与语言 · 计算机科学 2020-06-23 Junxuan Chen , Xiang Li , Jiarui Zhang , Chulun Zhou , Jianwei Cui , Bin Wang , Jinsong Su

Conventional attention-based Neural Machine Translation (NMT) conducts dynamic alignment in generating the target sentence. By repeatedly reading the representation of source sentence, which keeps fixed after generated by the encoder…

计算与语言 · 计算机科学 2016-10-18 Fandong Meng , Zhengdong Lu , Hang Li , Qun Liu

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

计算与语言 · 计算机科学 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong