English
Related papers

Related papers: Neural Machine Translation with Error Correction

200 papers

In this work, we introduce instruction finetuning for Neural Machine Translation (NMT) models, which distills instruction following capabilities from Large Language Models (LLMs) into orders-of-magnitude smaller NMT models. Our…

Computation and Language · Computer Science 2024-10-10 Vikas Raunak , Roman Grundkiewicz , Marcin Junczys-Dowmunt

Simultaneous neural machine translation(SNMT) models start emitting the target sequence before they have processed the source sequence. The recent adaptive policies for SNMT use monotonic attention to perform read/write decisions based on…

Computation and Language · Computer Science 2021-09-08 Mohd Abbas Zaidi , Sathish Indurthi , Beomseok Lee , Nikhil Kumar Lakumarapu , Sangha Kim

Machine translation systems are conventionally trained on textual resources that do not model phenomena that occur in spoken language. While the evaluation of neural machine translation systems on textual inputs is actively researched in…

Computation and Language · Computer Science 2019-04-26 Nicholas Ruiz , Mattia Antonino Di Gangi , Nicola Bertoldi , Marcello Federico

Machine translation (MT) systems translate text between different languages by automatically learning in-depth knowledge of bilingual lexicons, grammar and semantics from the training examples. Although neural machine translation (NMT) has…

Computation and Language · Computer Science 2020-04-29 Shilin He , Xing Wang , Shuming Shi , Michael R. Lyu , Zhaopeng Tu

Neural Machine Translation (NMT) is widely applied in software engineering tasks. The effectiveness of NMT for code retrieval relies on the ability to learn from the sequence of tokens in the source language to the sequence of tokens in the…

Software Engineering · Computer Science 2023-08-10 Hung Phan , Ali Jannesari

We propose a neural machine translation (NMT) approach that, instead of pursuing adequacy and fluency ("human-oriented" quality criteria), aims to generate translations that are best suited as input to a natural language processing…

Computation and Language · Computer Science 2019-10-02 Amirhossein Tebbifakhr , Luisa Bentivogli , Matteo Negri , Marco Turchi

While neural machine translation (NMT) is making good progress in the past two years, tens of millions of bilingual sentence pairs are needed for its training. However, human labeling is very costly. To tackle this training data bottleneck,…

Computation and Language · Computer Science 2016-11-02 Yingce Xia , Di He , Tao Qin , Liwei Wang , Nenghai Yu , Tie-Yan Liu , Wei-Ying Ma

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

Computation and Language · Computer Science 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

An effective method to generate a large number of parallel sentences for training improved neural machine translation (NMT) systems is the use of back-translations of the target-side monolingual data. Recently, iterative back-translation…

Computation and Language · Computer Science 2020-12-11 Idris Abdulmumin , Bashir Shehu Galadanci , Abubakar Isa

A prerequisite for training corpus-based machine translation (MT) systems -- either Statistical MT (SMT) or Neural MT (NMT) -- is the availability of high-quality parallel data. This is arguably more important today than ever before, as NMT…

Computation and Language · Computer Science 2018-04-18 Alberto Poncelas , Dimitar Shterionov , Andy Way , Gideon Maillette de Buy Wenniger , Peyman Passban

Neural Machine Translation (NMT) systems are known to degrade when confronted with noisy data, especially when the system is trained only on clean data. In this paper, we show that augmenting training data with sentences containing…

Computation and Language · Computer Science 2019-03-13 Antonios Anastasopoulos , Alison Lui , Toan Nguyen , David Chiang

Auto-regressive sequence-to-sequence models with attention mechanisms have achieved state-of-the-art performance in various tasks including Text-To-Speech (TTS) and Neural Machine Translation (NMT). The standard training approach, teacher…

Computation and Language · Computer Science 2021-04-06 Qingyun Dou , Yiting Lu , Potsawee Manakul , Xixin Wu , Mark J. F. Gales

Recent studies have proven that the training of neural machine translation (NMT) can be facilitated by mimicking the learning process of humans. Nevertheless, achievements of such kind of curriculum learning rely on the quality of…

Computation and Language · Computer Science 2022-10-20 Yu Wan , Baosong Yang , Derek F. Wong , Yikai Zhou , Lidia S. Chao , Haibo Zhang , Boxing Chen

The field of machine translation (MT), the automatic translation of written text from one natural language into another, has experienced a major paradigm shift in recent years. Statistical MT, which mainly relies on various count-based…

Computation and Language · Computer Science 2020-10-01 Felix Stahlberg

Neural Machine Translation (NMT) has become a popular technology in recent years, and the encoder-decoder framework is the mainstream among all the methods. It's obvious that the quality of the semantic representations from encoding is very…

Computation and Language · Computer Science 2020-01-15 Boyuan Pan , Yazheng Yang , Zhou Zhao , Yueting Zhuang , Deng Cai

In neural machine translation (NMT), the computational cost at the output layer increases with the size of the target-side vocabulary. Using a limited-size vocabulary instead may cause a significant decrease in translation quality. This…

Computation and Language · Computer Science 2018-07-31 Katsuki Chousa , Katsuhito Sudoh , Satoshi Nakamura

Existing curriculum learning approaches to Neural Machine Translation (NMT) require sampling sufficient amounts of "easy" samples from training data at the early training stage. This is not always achievable for low-resource languages where…

Computation and Language · Computer Science 2021-03-23 Chen Liang , Haoming Jiang , Xiaodong Liu , Pengcheng He , Weizhu Chen , Jianfeng Gao , Tuo Zhao

In recent years, Neural Machine Translation (NMT) has been shown to be more effective than phrase-based statistical methods, thus quickly becoming the state of the art in machine translation (MT). However, NMT systems are limited in…

Computation and Language · Computer Science 2019-09-17 Surafel M. Lakew , Marcello Federico , Matteo Negri , Marco Turchi

Neural Machine Translation (NMT) systems are used in various applications. However, it has been shown that they are vulnerable to very small perturbations of their inputs, known as adversarial attacks. In this paper, we propose a new…

Computation and Language · Computer Science 2023-03-03 Sahar Sadrizadeh , AmirHossein Dabiri Aghdam , Ljiljana Dolamic , Pascal Frossard

In this paper, we present our first attempts in building a multilingual Neural Machine Translation framework under a unified approach. We are then able to employ attention-based NMT for many-to-many multilingual translation tasks. Our…

Computation and Language · Computer Science 2016-11-16 Thanh-Le Ha , Jan Niehues , Alexander Waibel
‹ Prev 1 3 4 5 6 7 10 Next ›