English
Related papers

Related papers: knn-seq: Efficient, Extensible kNN-MT Framework

200 papers

A great proportion of sequence-to-sequence (Seq2Seq) models for Neural Machine Translation (NMT) adopt Recurrent Neural Network (RNN) to generate translation word by word following a sequential order. As the studies of linguistics have…

Computation and Language · Computer Science 2018-06-14 Junyang Lin , Xu Sun , Xuancheng Ren , Shuming Ma , Jinsong Su , Qi Su

Neural machine translation has achieved promising results on many translation tasks. However, previous studies have shown that neural models induce a non-smooth representation space, which harms its generalization results. Recently, kNN-MT…

Computation and Language · Computer Science 2023-06-13 Wenhao Zhu , Jingjing Xu , Shujian Huang , Lingpeng Kong , Jiajun Chen

In this paper we present our open-source neural machine translation (NMT) toolkit called "Yet Another Neural Machine Translation Toolkit" abbreviated as YANMTT which is built on top of the Transformers library. Despite the growing…

Computation and Language · Computer Science 2021-08-26 Raj Dabre , Eiichiro Sumita

Nearest neighbor machine translation is a successful approach for fast domain adaption, which interpolates the pre-trained transformers with domain-specific token-level k-nearest-neighbor (kNN) retrieval without retraining. Despite kNN MT's…

Artificial Intelligence · Computer Science 2024-08-20 Hossam Amer , Abdelrahman Abouelenin , Mohamed Maher , Evram Narouz , Mohamed Afify , Hany Awadallah

While current state-of-the-art NMT models, such as RNN seq2seq and Transformers, possess a large number of parameters, they are still shallow in comparison to convolutional models used for both text and vision applications. In this work we…

Computation and Language · Computer Science 2018-09-06 Ankur Bapna , Mia Xu Chen , Orhan Firat , Yuan Cao , Yonghui Wu

Even though sequence-to-sequence neural machine translation (NMT) model have achieved state-of-art performance in the recent fewer years, but it is widely concerned that the recurrent neural network (RNN) units are very hard to capture the…

Computation and Language · Computer Science 2018-05-28 Wen Zhang , Jiawei Hu , Yang Feng , Qun Liu

Generating multiple translation candidates would enable users to choose the one that satisfies their needs. Although there has been work on diversified generation, there exists room for improving the diversity mainly because the previous…

Computation and Language · Computer Science 2024-02-15 Yuto Nishida , Makoto Morishita , Hidetaka Kamigaito , Taro Watanabe

The $k$-nearest-neighbor language model ($k$NN-LM), one of the retrieval-augmented language models, improves the perplexity for given text by directly accessing a large datastore built from any text data during inference. A widely held…

Computation and Language · Computer Science 2025-03-31 Yuto Nishida , Makoto Morishita , Hiroyuki Deguchi , Hidetaka Kamigaito , Taro Watanabe

With the rapid development of Natural Language Processing (NLP) technology, the accuracy and efficiency of machine translation have become hot topics of research. This paper proposes a novel Seq2Seq model aimed at improving translation…

Computation and Language · Computer Science 2024-11-01 Yuxu Wu , Yiren Xing

To protect user privacy and meet legal regulations, federated learning (FL) is attracting significant attention. Training neural machine translation (NMT) models with traditional FL algorithm (e.g., FedAvg) typically relies on multi-round…

Computation and Language · Computer Science 2023-02-24 Yichao Du , Zhirui Zhang , Bingzhe Wu , Lemao Liu , Tong Xu , Enhong Chen

Recently, neural machine translation has achieved remarkable progress by introducing well-designed deep neural networks into its encoder-decoder framework. From the optimization perspective, residual connections are adopted to improve…

Computation and Language · Computer Science 2018-07-03 Yanyao Shen , Xu Tan , Di He , Tao Qin , Tie-Yan Liu

A prerequisite for training corpus-based machine translation (MT) systems -- either Statistical MT (SMT) or Neural MT (NMT) -- is the availability of high-quality parallel data. This is arguably more important today than ever before, as NMT…

Computation and Language · Computer Science 2018-04-18 Alberto Poncelas , Dimitar Shterionov , Andy Way , Gideon Maillette de Buy Wenniger , Peyman Passban

Non-parametric, k-nearest-neighbor algorithms have recently made inroads to assist generative models such as language models and machine translation decoders. We explore whether such non-parametric models can improve machine translation…

Computation and Language · Computer Science 2023-05-24 Jiayi Wang , Ke Wang , Yuqi Zhang , Yu Zhao , Pontus Stenetorp

Neural machine translation (NMT) becomes a new state-of-the-art and achieves promising translation results using a simple encoder-decoder neural network. This neural network is trained once on the parallel corpus and the fixed network is…

Computation and Language · Computer Science 2016-09-22 Xiaoqing Li , Jiajun Zhang , Chengqing Zong

Existing neural machine translation (NMT) systems utilize sequence-to-sequence neural networks to generate target translation word by word, and then make the generated word at each time-step and the counterpart in the references as…

Computation and Language · Computer Science 2020-03-02 Chaoqun Duan , Kehai Chen , Rui Wang , Masao Utiyama , Eiichiro Sumita , Conghui Zhu , Tiejun Zhao

Deploying NMT models on mobile devices is essential for privacy, low latency, and offline scenarios. For high model capacity, NMT models are rather large. Running these models on devices is challenging with limited storage, memory,…

Artificial Intelligence · Computer Science 2023-06-08 Ye Lin , Xiaohui Wang , Zhexi Zhang , Mingxuan Wang , Tong Xiao , Jingbo Zhu

How to effectively adapt neural machine translation (NMT) models according to emerging cases without retraining? Despite the great success of neural machine translation, updating the deployed models online remains a challenge. Existing…

Computation and Language · Computer Science 2021-12-09 Qingnan Jiang , Mingxuan Wang , Jun Cao , Shanbo Cheng , Shujian Huang , Lei Li

Past years have witnessed rapid developments in Neural Machine Translation (NMT). Most recently, with advanced modeling and training techniques, the RNN-based NMT (RNMT) has shown its potential strength, even compared with the well-known…

Computation and Language · Computer Science 2019-07-17 Fandong Meng , Jinchao Zhang

Although attention-based Neural Machine Translation (NMT) has achieved remarkable progress in recent years, it still suffers from issues of repeating and dropping translations. To alleviate these issues, we propose a novel key-value…

Computation and Language · Computer Science 2018-07-02 Fandong Meng , Zhaopeng Tu , Yong Cheng , Haiyang Wu , Junjie Zhai , Yuekui Yang , Di Wang

We describe an open-source toolkit for neural machine translation (NMT). The toolkit prioritizes efficiency, modularity, and extensibility with the goal of supporting NMT research into model architectures, feature representations, and…

Computation and Language · Computer Science 2017-03-07 Guillaume Klein , Yoon Kim , Yuntian Deng , Jean Senellart , Alexander M. Rush