English
Related papers

Related papers: Learning Light-Weight Translation Models from Deep…

200 papers

Deep learning has witnessed significant advancements in recent years at the cost of increasing training, inference, and model storage overhead. While existing model compression methods strive to reduce the number of model parameters while…

Machine Learning · Computer Science 2024-01-12 Wujie Sun , Defang Chen , Jiawei Chen , Yan Feng , Chun Chen , Can Wang

Learning deeper models is usually a simple and effective approach to improve model performance, but deeper models have larger model parameters and are more difficult to train. To get a deeper model, simply stacking more layers of the model…

Computation and Language · Computer Science 2021-08-27 GuoLiang Li , Yiyang Li

Deep neural networks (DNNs) continue to make significant advances, solving tasks from image classification to translation or reinforcement learning. One aspect of the field receiving considerable attention is efficiently executing deep…

Neural and Evolutionary Computing · Computer Science 2018-02-16 Antonio Polino , Razvan Pascanu , Dan Alistarh

Pre-trained language models such as BERT have proven to be highly effective for natural language processing (NLP) tasks. However, the high demand for computing resources in training such models hinders their application in practice. In…

Computation and Language · Computer Science 2019-08-27 Siqi Sun , Yu Cheng , Zhe Gan , Jingjing Liu

Unsupervised neural machine translation(NMT) is associated with noise and errors in synthetic data when executing vanilla back-translations. Here, we explicitly exploits language model(LM) to drive construction of an unsupervised NMT…

Computation and Language · Computer Science 2019-11-12 Wei Zhang , Youyuan Lin , Ruoran Ren , Xiaodong Wang , Zhenshuang Liang , Zhen Huang

Machine Translation (MT) is one of the most prominent tasks in Natural Language Processing (NLP) which involves the automatic conversion of texts from one natural language to another while preserving its meaning and fluency. Although the…

Computation and Language · Computer Science 2023-09-26 Kavit Gangar , Hardik Ruparel , Shreyas Lele

Resource-constrained perception systems such as edge computing and vision-for-robotics require vision models to be both accurate and lightweight in computation and memory usage. While knowledge distillation is a proven strategy to enhance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Shengcao Cao , Mengtian Li , James Hays , Deva Ramanan , Yi-Xiong Wang , Liang-Yan Gui

Recently, the Transformer machine translation system has shown strong results by stacking attention layers on both the source and target-language sides. But the inference of this model is slow due to the heavy use of dot-product attention…

Computation and Language · Computer Science 2019-06-27 Tong Xiao , Yinqiao Li , Jingbo Zhu , Zhengtao Yu , Tongran Liu

Compressing deep neural network (DNN) models becomes a very important and necessary technique for real-world applications, such as deploying those models on mobile devices. Knowledge distillation is one of the most popular methods for model…

Machine Learning · Computer Science 2020-03-02 Makoto Takamoto , Yusuke Morishita , Hitoshi Imaoka

How do we perform efficient inference while retaining high translation quality? Existing neural machine translation models, such as Transformer, achieve high performance, but they decode words one by one, which is inefficient. Recent…

Computation and Language · Computer Science 2021-10-15 Chenyang Huang , Hao Zhou , Osmar R. Zaïane , Lili Mou , Lei Li

Many document-level neural machine translation (NMT) systems have explored the utility of context-aware architecture, usually requiring an increasing number of parameters and computational complexity. However, few attention is paid to the…

Computation and Language · Computer Science 2020-09-22 Pei Zhang , Boxing Chen , Niyu Ge , Kai Fan

Transfer learning or multilingual model is essential for low-resource neural machine translation (NMT), but the applicability is limited to cognate languages by sharing their vocabularies. This paper shows effective techniques to transfer a…

Computation and Language · Computer Science 2019-06-06 Yunsu Kim , Yingbo Gao , Hermann Ney

Pre-trained Transformer-based models have achieved state-of-the-art performance for various Natural Language Processing (NLP) tasks. However, these models often have billions of parameters, and, thus, are too resource-hungry and…

Machine Learning · Computer Science 2021-09-29 Prakhar Ganesh , Yao Chen , Xin Lou , Mohammad Ali Khan , Yin Yang , Hassan Sajjad , Preslav Nakov , Deming Chen , Marianne Winslett

Transformer is a state-of-the-art model in the field of natural language processing (NLP). Current NLP models primarily increase the number of transformers to improve processing performance. However, this technique requires a lot of…

Computation and Language · Computer Science 2023-10-18 Woohyeon Moon , Taeyoung Kim , Bumgeun Park , Dongsoo Har

Multilingual machine translation models often outperform traditional bilingual models by leveraging translation knowledge transfer. Recent advancements have led to these models supporting hundreds of languages and achieving state-of-the-art…

Computation and Language · Computer Science 2024-11-12 Pedram Rostami , Mohammad Javad Dousti

Deep learning methods usually require a large amount of training data and lack interpretability. In this paper, we propose a novel knowledge distillation and model interpretation framework for medical image classification that jointly…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Thanh Nguyen-Duc , He Zhao , Jianfei Cai , Dinh Phung

Since deep learning became a key player in natural language processing (NLP), many deep learning models have been showing remarkable performances in a variety of NLP tasks, and in some cases, they are even outperforming humans. Such high…

Computation and Language · Computer Science 2019-08-07 Sangchul Hahn , Heeyoul Choi

This study proposes a knowledge distillation algorithm based on large language models and feature alignment, aiming to effectively transfer the knowledge of large pre-trained models into lightweight student models, thereby reducing…

Computation and Language · Computer Science 2024-12-30 Shuo Wang , Chihang Wang , Jia Gao , Zhen Qi , Hongye Zheng , Xiaoxuan Liao

The encoder-decoder framework for neural machine translation (NMT) has been shown effective in large data scenarios, but is much less effective for low-resource languages. We present a transfer learning method that significantly improves…

Computation and Language · Computer Science 2016-04-11 Barret Zoph , Deniz Yuret , Jonathan May , Kevin Knight

Recent evidence reveals that Neural Machine Translation (NMT) models with deeper neural networks can be more effective but are difficult to train. In this paper, we present a MultiScale Collaborative (MSC) framework to ease the training of…

Computation and Language · Computer Science 2020-05-12 Xiangpeng Wei , Heng Yu , Yue Hu , Yue Zhang , Rongxiang Weng , Weihua Luo