中文
相关论文

相关论文: A Sketch-Based Neural Model for Generating Commit …

200 篇论文

In this paper, we try to understand neural machine translation (NMT) via simplifying NMT architectures and training encoder-free NMT models. In an encoder-free model, the sums of word embeddings and positional embeddings represent the…

计算与语言 · 计算机科学 2019-07-19 Gongbo Tang , Rico Sennrich , Joakim Nivre

We introduce multi-modal, attention-based neural machine translation (NMT) models which incorporate visual features into different parts of both the encoder and the decoder. We utilise global image features extracted using a pre-trained…

计算与语言 · 计算机科学 2017-01-24 Iacer Calixto , Qun Liu , Nick Campbell

Most existing machine translation systems operate at the level of words, relying on explicit segmentation to extract tokens. We introduce a neural machine translation (NMT) model that maps a source character sequence to a target character…

计算与语言 · 计算机科学 2017-06-14 Jason Lee , Kyunghyun Cho , Thomas Hofmann

Syntax has been proven to be remarkably effective in neural machine translation (NMT). Previous models obtained syntax information from syntactic parsing tools and integrated it into NMT models to improve translation performance. In this…

计算与语言 · 计算机科学 2024-06-18 Yang Liu , Yuexian Hou

Neural Machine Translation (NMT) leverages one or more trained neural networks for the translation of phrases. Sutskever introduced a sequence to sequence based encoder-decoder model which became the standard for NMT based systems.…

计算与语言 · 计算机科学 2020-06-11 Satish Mylapore , Ryan Quincy Paul , Joshua Yi , Robert D. Slater

Neural machine translation (NMT) heavily relies on word-level modelling to learn semantic representations of input sentences. However, for languages without natural word delimiters (e.g., Chinese) where input sentences have to be tokenized…

计算与语言 · 计算机科学 2016-12-12 Jinsong Su , Zhixing Tan , Deyi Xiong , Rongrong Ji , Xiaodong Shi , Yang Liu

Attention-based Neural Machine Translation (NMT) models suffer from attention deficiency issues as has been observed in recent research. We propose a novel mechanism to address some of these limitations and improve the NMT attention.…

计算与语言 · 计算机科学 2016-08-10 Baskaran Sankaran , Haitao Mi , Yaser Al-Onaizan , Abe Ittycheriah

Commit messages are natural language descriptions of code changes, which are important for software evolution such as code understanding and maintenance. However, previous methods are trained on the entire dataset without considering the…

软件工程 · 计算机科学 2024-01-17 Wei Tao , Yucheng Zhou , Yanlin Wang , Hongyu Zhang , Haofen Wang , Wenqiang Zhang

We train neural machine translation (NMT) models from English to six target languages, using NMT encoder representations to predict ancestor constituent labels of source language words. We find that NMT encoders learn similar source syntax…

计算与语言 · 计算机科学 2020-05-19 Tyler A. Chang , Anna N. Rafferty

Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation, or having meta-information. Although there exist various…

计算与语言 · 计算机科学 2020-10-20 Jingjing Huo , Christian Herold , Yingbo Gao , Leonard Dahlmann , Shahram Khadivi , Hermann Ney

Commit messages play an important role in several software engineering tasks such as program comprehension and understanding program evolution. However, programmers neglect to write good commit messages. Hence, several Commit Message…

软件工程 · 计算机科学 2022-04-21 Samanta Dey , Venkatesh Vinayakarao , Monika Gupta , Sampath Dechu

Neural Machine Translation (NMT) models are typically trained on heterogeneous data that are concatenated and randomly shuffled. However, not all of the training data are equally useful to the model. Curriculum training aims to present the…

计算与语言 · 计算机科学 2022-03-29 Tasnim Mohiuddin , Philipp Koehn , Vishrav Chaudhary , James Cross , Shruti Bhosale , Shafiq Joty

Previous studies have shown that neural machine translation (NMT) models can benefit from explicitly modeling translated (Past) and untranslated (Future) to groups of translated and untranslated contents through parts-to-wholes assignment.…

计算与语言 · 计算机科学 2019-09-23 Zaixiang Zheng , Shujian Huang , Zhaopeng Tu , Xin-Yu Dai , Jiajun Chen

We introduce a powerful approach for Neural Machine Translation (NMT), whereby, during training and testing, together with the input we provide its phonetic encoding and the variants of such an encoding. This way we obtain very significant…

计算与语言 · 计算机科学 2019-11-12 Abdul Rafae Khan , Jia Xu

Sequence-to-sequence neural translation models learn semantic and syntactic relations between sentence pairs by optimizing the likelihood of the target given the source, i.e., $p(y|x)$, an objective that ignores other potentially useful…

计算与语言 · 计算机科学 2016-03-24 Jiwei Li , Dan Jurafsky

Neural Machine Translation model is a sequence-to-sequence converter based on neural networks. Existing models use recurrent neural networks to construct both the encoder and decoder modules. In alternative research, the recurrent networks…

计算与语言 · 计算机科学 2021-05-04 Ritam Mallick , Seba Susan , Vaibhaw Agrawal , Rizul Garg , Prateek Rawal

We present an approach to neural machine translation (NMT) that supports multiple domains in a single model and allows switching between the domains when translating. The core idea is to treat text domains as distinct languages and use…

计算与语言 · 计算机科学 2018-05-08 Sander Tars , Mark Fishel

Machine Translation models are trained to translate a variety of documents from one language into another. However, models specifically trained for a particular characteristics of the documents tend to perform better. Fine-tuning is a…

计算与语言 · 计算机科学 2019-10-09 Alberto Poncelas , Gideon Maillette de Buy Wenniger , Andy Way

Neural machine translation (NMT) becomes a new state-of-the-art and achieves promising translation results using a simple encoder-decoder neural network. This neural network is trained once on the parallel corpus and the fixed network is…

计算与语言 · 计算机科学 2016-09-22 Xiaoqing Li , Jiajun Zhang , Chengqing Zong

Existing approaches to neural machine translation (NMT) generate the target language sequence token by token from left to right. However, this kind of unidirectional decoding framework cannot make full use of the target-side future contexts…

计算与语言 · 计算机科学 2019-05-14 Long Zhou , Jiajun Zhang , Chengqing Zong