English
Related papers

Related papers: Dynamic Multi-Branch Layers for On-Device Neural M…

200 papers

While very deep neural networks have shown effectiveness for computer vision and text classification applications, how to increase the network depth of neural machine translation (NMT) models for better translation quality remains a…

Computation and Language · Computer Science 2019-07-04 Lijun Wu , Yiren Wang , Yingce Xia , Fei Tian , Fei Gao , Tao Qin , Jianhuang Lai , Tie-Yan Liu

Fine-tuning pre-trained Neural Machine Translation (NMT) models is the dominant approach for adapting to new languages and domains. However, fine-tuning requires adapting and maintaining a separate model for each target task. We propose a…

Computation and Language · Computer Science 2019-09-19 Ankur Bapna , Naveen Arivazhagan , Orhan Firat

We propose a method to transfer knowledge across neural machine translation (NMT) models by means of a shared dynamic vocabulary. Our approach allows to extend an initial model for a given language pair to cover new languages by adapting…

Computation and Language · Computer Science 2018-11-06 Surafel M. Lakew , Aliia Erofeeva , Matteo Negri , Marcello Federico , Marco Turchi

Neural machine translation (NMT) is sensitive to domain shift. In this paper, we address this problem in an active learning setting where we can spend a given budget on translating in-domain data, and gradually fine-tune a pre-trained…

Computation and Language · Computer Science 2021-06-23 Junjie Hu , Graham Neubig

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

Computation and Language · Computer Science 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

We introduce Data Diversification: a simple but effective strategy to boost neural machine translation (NMT) performance. It diversifies the training data by using the predictions of multiple forward and backward models and then merging…

Computation and Language · Computer Science 2020-10-06 Xuan-Phi Nguyen , Shafiq Joty , Wu Kui , Ai Ti Aw

We present an approach to neural machine translation (NMT) that supports multiple domains in a single model and allows switching between the domains when translating. The core idea is to treat text domains as distinct languages and use…

Computation and Language · Computer Science 2018-05-08 Sander Tars , Mark Fishel

Conventional Neural Machine Translation (NMT) models benefit from the training with an additional agent, e.g., dual learning, and bidirectional decoding with one agent decoding from left to right and the other decoding in the opposite…

Computation and Language · Computer Science 2019-09-04 Tianchi Bi , Hao Xiong , Zhongjun He , Hua Wu , Haifeng Wang

With the promising progress of deep neural networks, layer aggregation has been used to fuse information across layers in various fields, such as computer vision and machine translation. However, most of the previous methods combine layers…

Computation and Language · Computer Science 2019-02-18 Zi-Yi Dou , Zhaopeng Tu , Xing Wang , Longyue Wang , Shuming Shi , Tong Zhang

Multilingual neural machine translation (MNMT) learns to translate multiple language pairs with a single model, potentially improving both the accuracy and the memory-efficiency of deployed models. However, the heavy data imbalance between…

Computation and Language · Computer Science 2021-09-10 Chunting Zhou , Daniel Levy , Xian Li , Marjan Ghazvininejad , Graham Neubig

Neural Machine Translation (NMT) models achieve state-of-the-art performance on many translation benchmarks. As an active research field in NMT, knowledge distillation is widely applied to enhance the model's performance by transferring…

Computation and Language · Computer Science 2021-05-28 Fusheng Wang , Jianhao Yan , Fandong Meng , Jie Zhou

Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation, or having meta-information. Although there exist various…

Computation and Language · Computer Science 2020-10-20 Jingjing Huo , Christian Herold , Yingbo Gao , Leonard Dahlmann , Shahram Khadivi , Hermann Ney

Deep Neural Networks (DNNs) have provably enhanced the state-of-the-art Neural Machine Translation (NMT) with their capability in modeling complex functions and capturing complex linguistic structures. However NMT systems with deep…

Computation and Language · Computer Science 2017-05-03 Mingxuan Wang , Zhengdong Lu , Jie Zhou , Qun Liu

State-of-the-art neural machine translation (NMT) systems are data-hungry and perform poorly on new domains with no supervised data. As data collection is expensive and infeasible in many cases, domain adaptation methods are needed. In this…

Computation and Language · Computer Science 2020-06-09 Di Jin , Zhijing Jin , Joey Tianyi Zhou , Peter Szolovits

Multimodal Machine Translation (MMT) typically enhances text-only translation by incorporating aligned visual features. Despite the remarkable progress, state-of-the-art MMT approaches often rely on paired image-text inputs at inference and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Jie Wang , Zhendong Yang , Liansong Zong , Xiaobo Zhang , Dexian Wang , Ji Zhang

Neural Machine Translation (NMT) is a new approach for automatic translation of text from one human language into another. The basic concept in NMT is to train a large Neural Network that maximizes the translation performance on a given…

Computation and Language · Computer Science 2016-12-22 Markus Freitag , Yaser Al-Onaizan

We propose multi-way, multilingual neural machine translation. The proposed approach enables a single neural translation model to translate between multiple languages, with a number of parameters that grows only linearly with the number of…

Computation and Language · Computer Science 2016-01-07 Orhan Firat , Kyunghyun Cho , Yoshua Bengio

While the multi-branch architecture is one of the key ingredients to the success of computer vision tasks, it has not been well investigated in natural language processing, especially sequence learning tasks. In this work, we propose a…

Computation and Language · Computer Science 2020-07-28 Yang Fan , Shufang Xie , Yingce Xia , Lijun Wu , Tao Qin , Xiang-Yang Li , Tie-Yan Liu

Standard neural machine translation (NMT) is on the assumption of document-level context independent. Most existing document-level NMT methods are satisfied with a smattering sense of brief document-level information, while this work…

Computation and Language · Computer Science 2021-10-13 Shu Jiang , Hai Zhao , Zuchao Li , Bao-Liang Lu

Standard neural machine translation (NMT) is on the assumption that the document-level context is independent. Most existing document-level NMT approaches are satisfied with a smattering sense of global document-level information, while…

Computation and Language · Computer Science 2021-08-25 Shu Jiang , Rui Wang , Zuchao Li , Masao Utiyama , Kehai Chen , Eiichiro Sumita , Hai Zhao , Bao-liang Lu
‹ Prev 1 2 3 10 Next ›