中文
相关论文

相关论文: Supervised Attentions for Neural Machine Translati…

200 篇论文

Automatic translation from natural language descriptions into programs is a longstanding challenging problem. In this work, we consider a simple yet important sub-problem: translation from textual descriptions to If-Then programs. We devise…

计算与语言 · 计算机科学 2016-11-08 Xinyun Chen , Chang Liu , Richard Shin , Dawn Song , Mingcheng Chen

In this paper we provide the largest published comparison of translation quality for phrase-based SMT and neural machine translation across 30 translation directions. For ten directions we also include hierarchical phrase-based MT.…

计算与语言 · 计算机科学 2016-12-01 Marcin Junczys-Dowmunt , Tomasz Dwojak , Hieu Hoang

In this paper, we present an approach to improve the accuracy of a strong transition-based dependency parser by exploiting dependency language models that are extracted from a large parsed corpus. We integrated a small number of features…

计算与语言 · 计算机科学 2017-09-01 Juntao Yu , Bernd Bohnet

Recently, non-recurrent architectures (convolutional, self-attentional) have outperformed RNNs in neural machine translation. CNNs and self-attentional networks can connect distant words via shorter network paths than RNNs, and it has been…

计算与语言 · 计算机科学 2018-11-13 Gongbo Tang , Mathias Müller , Annette Rios , Rico Sennrich

While machine translation has traditionally relied on large amounts of parallel corpora, a recent research line has managed to train both Neural Machine Translation (NMT) and Statistical Machine Translation (SMT) systems using monolingual…

计算与语言 · 计算机科学 2021-12-28 Mikel Artetxe , Gorka Labaka , Eneko Agirre

Neural machine translation has shown very promising results lately. Most NMT models follow the encoder-decoder framework. To make encoder-decoder models more flexible, attention mechanism was introduced to machine translation and also other…

计算与语言 · 计算机科学 2016-01-25 Shi Feng , Shujie Liu , Mu Li , Ming Zhou

This paper proposes a hierarchical attentional neural translation model which focuses on enhancing source-side hierarchical representations by covering both local and global semantic information using a bidirectional tree-based encoder. To…

计算与语言 · 计算机科学 2017-07-18 Baosong Yang , Derek F. Wong , Tong Xiao , Lidia S. Chao , Jingbo Zhu

In order to capture rich language phenomena, neural machine translation models have to use a large vocabulary size, which requires high computing time and large memory usage. In this paper, we alleviate this issue by introducing a…

计算与语言 · 计算机科学 2016-08-02 Haitao Mi , Zhiguo Wang , Abe Ittycheriah

The Transformer model has revolutionized Natural Language Processing tasks such as Neural Machine Translation, and many efforts have been made to study the Transformer architecture, which increased its efficiency and accuracy. One potential…

计算与语言 · 计算机科学 2023-08-17 Daniela N. Rim , Kimera Richard , Heeyoul Choi

Confidence calibration, which aims to make model predictions equal to the true correctness measures, is important for neural machine translation (NMT) because it is able to offer useful indicators of translation errors in the generated…

计算与语言 · 计算机科学 2020-05-05 Shuo Wang , Zhaopeng Tu , Shuming Shi , Yang Liu

We aim to shed light on the strengths and weaknesses of the newly introduced neural machine translation paradigm. To that end, we conduct a multifaceted evaluation in which we compare outputs produced by state-of-the-art neural machine…

计算与语言 · 计算机科学 2017-01-12 Antonio Toral , Víctor M. Sánchez-Cartagena

Document alignment techniques based on multilingual sentence representations have recently shown state of the art results. However, these techniques rely on unsupervised distance measurement techniques, which cannot be fined-tuned to the…

计算与语言 · 计算机科学 2021-12-01 Charith Rajitha , Lakmali Piyarathne , Dilan Sachintha , Surangika Ranathunga

Neural Machine Translation (NMT) has been proven to achieve impressive results. The NMT system translation results depend strongly on the size and quality of parallel corpora. Nevertheless, for many language pairs, no rich-resource parallel…

计算与语言 · 计算机科学 2019-05-23 Jinyi Zhang , Tadahiro Matsumoto

Unsupervised Neural Machine Translation (UNMT) focuses on improving NMT results under the assumption there is no human translated parallel data, yet little work has been done so far in highlighting its advantages compared to supervised…

计算与语言 · 计算机科学 2023-12-21 Isidora Chara Tourni , Derry Wijaya

Image translation between two domains is a class of problems aiming to learn mapping from an input image in the source domain to an output image in the target domain. It has been applied to numerous domains, such as data augmentation,…

计算机视觉与模式识别 · 计算机科学 2019-06-06 Chao Yang , Taehwan Kim , Ruizhe Wang , Hao Peng , C. -C. Jay Kuo

Training efficiency is one of the main problems for Neural Machine Translation (NMT). Deep networks need for very large data as well as many training iterations to achieve state-of-the-art performance. This results in very high computation…

计算与语言 · 计算机科学 2017-10-04 Dakun Zhang , Jungi Kim , Josep Crego , Jean Senellart

Attention mechanisms represent a fundamental paradigm shift in neural network architectures, enabling models to selectively focus on relevant portions of input sequences through learned weighting functions. This monograph provides a…

机器学习 · 计算机科学 2026-01-08 Hasi Hays

This work aims to improve semi-supervised learning in a neural network architecture by introducing a hybrid supervised and unsupervised cost function. The unsupervised component is trained using a differentiable estimator of the Maximum…

机器学习 · 计算机科学 2018-10-30 Mark Hamilton

Fine-tuning pre-trained Neural Machine Translation (NMT) models is the dominant approach for adapting to new languages and domains. However, fine-tuning requires adapting and maintaining a separate model for each target task. We propose a…

计算与语言 · 计算机科学 2019-09-19 Ankur Bapna , Naveen Arivazhagan , Orhan Firat

The advent of deep learning has led to a significant gain in machine translation. However, most of the studies required a large parallel dataset which is scarce and expensive to construct and even unavailable for some languages. This paper…

计算与语言 · 计算机科学 2023-04-04 Viet H. Pham , Thang M. Pham , Giang Nguyen , Long Nguyen , Dien Dinh