English
Related papers

Related papers: Generating Diverse Translation from Model Distribu…

200 papers

Differently from the traditional statistical MT that decomposes the translation task into distinct separately learned components, neural machine translation uses a single neural network to model the entire translation process. Despite…

Computation and Language · Computer Science 2021-09-06 Elena Voita , Rico Sennrich , Ivan Titov

An effective method to improve neural machine translation with monolingual data is to augment the parallel training corpus with back-translations of target language sentences. This work broadens the understanding of back-translation and…

Computation and Language · Computer Science 2018-10-04 Sergey Edunov , Myle Ott , Michael Auli , David Grangier

Although neural machine translation (NMT) models perform well in the general domain, it remains rather challenging to control their generation behavior to satisfy the requirement of different users. Given the expensive training cost and the…

Computation and Language · Computer Science 2024-03-22 Yuzhuang Xu , Shuo Wang , Peng Li , Xuebo Liu , Xiaolong Wang , Weidong Liu , Yang Liu

Neural machine translation (NMT) models typically operate with a fixed vocabulary, but translation is an open-vocabulary problem. Previous work addresses the translation of out-of-vocabulary words by backing off to a dictionary. In this…

Computation and Language · Computer Science 2016-06-13 Rico Sennrich , Barry Haddow , Alexandra Birch

Recently, the development of neural machine translation (NMT) has significantly improved the translation quality of automatic machine translation. While most sentences are more accurate and fluent than translations by statistical machine…

Computation and Language · Computer Science 2016-10-18 Jan Niehues , Eunah Cho , Thanh-Le Ha , Alex Waibel

Both research and commercial machine translation have so far neglected the importance of properly handling the spelling, lexical and grammar divergences occurring among language varieties. Notable cases are standard national varieties such…

Computation and Language · Computer Science 2018-11-06 Surafel M. Lakew , Aliia Erofeeva , Marcello Federico

Many language generation models are now available for a wide range of generation tasks, including machine translation and summarization. Combining such diverse models may lead to further progress, but ensembling generation models is…

Computation and Language · Computer Science 2022-10-31 Jungo Kasai , Keisuke Sakaguchi , Ronan Le Bras , Hao Peng , Ximing Lu , Dragomir Radev , Yejin Choi , Noah A. Smith

One of the difficulties of neural machine translation (NMT) is the recall and appropriate translation of low-frequency words or phrases. In this paper, we propose a simple, fast, and effective method for recalling previously seen…

Computation and Language · Computer Science 2018-04-10 Jingyi Zhang , Masao Utiyama , Eiichro Sumita , Graham Neubig , Satoshi Nakamura

This paper rethinks translation memory augmented neural machine translation (TM-augmented NMT) from two perspectives, i.e., a probabilistic view of retrieval and the variance-bias decomposition principle. The finding demonstrates that…

Computation and Language · Computer Science 2023-06-13 Hongkun Hao , Guoping Huang , Lemao Liu , Zhirui Zhang , Shuming Shi , Rui Wang

We explore the utility of information contained within a dropout based Bayesian neural network (BNN) for the task of detecting out of distribution (OOD) data. We first show how previous attempts to leverage the randomized embeddings induced…

Machine Learning · Computer Science 2022-02-21 Andre T. Nguyen , Fred Lu , Gary Lopez Munoz , Edward Raff , Charles Nicholas , James Holt

Bayesian Neural Networks (BNN) have recently emerged in the Deep Learning world for dealing with uncertainty estimation in classification tasks, and are used in many application domains such as astrophysics, autonomous driving...BNN assume…

Machine Learning · Computer Science 2021-02-04 Claire Theobald , Frédéric Pennerath , Brieuc Conan-Guez , Miguel Couceiro , Amedeo Napoli

The state of the art in machine translation (MT) is governed by neural approaches, which typically provide superior translation accuracy over statistical approaches. However, on the closely related task of word alignment, traditional…

Computation and Language · Computer Science 2019-09-06 Sarthak Garg , Stephan Peitz , Udhyakumar Nallasamy , Matthias Paulik

We show that Bayes' rule provides an effective mechanism for creating document translation models that can be learned from only parallel sentences and monolingual documents---a compelling benefit as parallel documents are not always…

Computation and Language · Computer Science 2020-07-03 Lei Yu , Laurent Sartran , Wojciech Stokowiec , Wang Ling , Lingpeng Kong , Phil Blunsom , Chris Dyer

Advanced neural machine translation (NMT) models generally implement encoder and decoder as multiple layers, which allows systems to model complex functions and capture complicated linguistic structures. However, only the top layers of…

Computation and Language · Computer Science 2018-10-25 Zi-Yi Dou , Zhaopeng Tu , Xing Wang , Shuming Shi , Tong Zhang

Neural machine translation (NMT) systems are usually trained on a large amount of bilingual sentence pairs and translate one sentence at a time, ignoring inter-sentence information. This may make the translation of a sentence ambiguous or…

Computation and Language · Computer Science 2018-06-13 Shaohui Kuang , Deyi Xiong

Existing neural machine translation systems do not explicitly model what has been translated and what has not during the decoding phase. To address this problem, we propose a novel mechanism that separates the source information into two…

Computation and Language · Computer Science 2017-12-27 Zaixiang Zheng , Hao Zhou , Shujian Huang , Lili Mou , Xinyu Dai , Jiajun Chen , Zhaopeng Tu

We introduce a neural machine translation model that views the input and output sentences as sequences of characters rather than words. Since word-level information provides a crucial source of bias, our input model composes representations…

Computation and Language · Computer Science 2015-11-17 Wang Ling , Isabel Trancoso , Chris Dyer , Alan W Black

Recent studies have revealed a number of pathologies of neural machine translation (NMT) systems. Hypotheses explaining these mostly suggest there is something fundamentally wrong with NMT as a model or its training algorithm, maximum…

Computation and Language · Computer Science 2020-10-29 Bryan Eikema , Wilker Aziz

One central mystery of neural NLP is what neural models "know" about their subject matter. When a neural machine translation system learns to translate from one language to another, does it learn the syntax or semantics of the languages?…

Computation and Language · Computer Science 2017-08-01 Chaitanya Malaviya , Graham Neubig , Patrick Littell

Recent progress in neural machine translation is directed towards larger neural networks trained on an increasing amount of hardware resources. As a result, NMT models are costly to train, both financially, due to the electricity and…

Computation and Language · Computer Science 2020-05-19 Tom Kocmi , Ondřej Bojar