English
Related papers

Related papers: Efficient Cluster-Based k-Nearest-Neighbor Machine…

200 papers

$k$NN-MT is a straightforward yet powerful approach for fast domain adaptation, which directly plugs pre-trained neural machine translation (NMT) models with domain-specific token-level $k$-nearest-neighbor ($k$NN) retrieval to achieve…

Computation and Language · Computer Science 2023-02-24 Yuhan Dai , Zhirui Zhang , Qiuzhi Liu , Qu Cui , Weihua Li , Yichao Du , Tong Xu

$k$NN based neural machine translation ($k$NN-MT) has achieved state-of-the-art results in a variety of MT tasks. One significant shortcoming of $k$NN-MT lies in its inefficiency in identifying the $k$ nearest neighbors of the query…

Computation and Language · Computer Science 2021-12-16 Shuhe Wang , Jiwei Li , Yuxian Meng , Rongbin Ouyang , Guoyin Wang , Xiaoya Li , Tianwei Zhang , Shi Zong

Nearest Neighbor Machine Translation ($k$NN-MT) has achieved great success in domain adaptation tasks by integrating pre-trained Neural Machine Translation (NMT) models with domain-specific token-level retrieval. However, the reasons…

Computation and Language · Computer Science 2023-10-25 Ruize Gao , Zhirui Zhang , Yichao Du , Lemao Liu , Rui Wang

Recent works have proven the effectiveness of k-nearest-neighbor machine translation(a.k.a kNN-MT) approaches to produce remarkable improvement in cross-domain translations. However, these models suffer from heavy retrieve overhead on the…

Computation and Language · Computer Science 2025-01-07 Xiangyu Shi , Yunlong Liang , Jinan Xu , Yufeng Chen

Semi-parametric models, which augment generation with retrieval, have led to impressive results in language modeling and machine translation, due to their ability to retrieve fine-grained information from a datastore of examples. One of the…

Computation and Language · Computer Science 2022-11-08 Pedro Henrique Martins , Zita Marinho , André F. T. Martins

kNN-MT, recently proposed by Khandelwal et al. (2020a), successfully combines pre-trained neural machine translation (NMT) model with token-level k-nearest-neighbor (kNN) retrieval to improve the translation accuracy. However, the…

Computation and Language · Computer Science 2021-05-28 Xin Zheng , Zhirui Zhang , Junliang Guo , Shujian Huang , Boxing Chen , Weihua Luo , Jiajun Chen

To achieve non-parametric NMT domain adaptation, $k$-Nearest-Neighbor Machine Translation ($k$NN-MT) constructs an external datastore to store domain-specific translation knowledge, which derives a $k$NN distribution to interpolate the…

Computation and Language · Computer Science 2024-06-11 Yan Gao , Zhiwei Cao , Zhongjian Miao , Baosong Yang , Shiyu Liu , Min Zhang , Jinsong Su

$k$-Nearest neighbor machine translation ($k$NN-MT) has attracted increasing attention due to its ability to non-parametrically adapt to new translation domains. By using an upstream NMT model to traverse the downstream training corpus, it…

Computation and Language · Computer Science 2023-05-29 Zhiwei Cao , Baosong Yang , Huan Lin , Suhang Wu , Xiangpeng Wei , Dayiheng Liu , Jun Xie , Min Zhang , Jinsong Su

Though nearest neighbor Machine Translation ($k$NN-MT) \citep{khandelwal2020nearest} has proved to introduce significant performance boosts over standard neural MT systems, it is prohibitively slow since it uses the entire reference corpus…

Computation and Language · Computer Science 2022-11-23 Yuxian Meng , Xiaoya Li , Xiayu Zheng , Fei Wu , Xiaofei Sun , Tianwei Zhang , Jiwei Li

Augmenting neural machine translation with external memory at decoding time, in the form of k-nearest neighbors machine translation ($k$-NN MT), is a well-established strategy for increasing translation performance. $k$-NN MT retrieves a…

Computation and Language · Computer Science 2025-09-23 Evgeniia Tokarchuk , Sergey Troshin , Vlad Niculae

k-Nearest-Neighbor Machine Translation (kNN-MT) becomes an important research direction of NMT in recent years. Its main idea is to retrieve useful key-value pairs from an additional datastore to modify translations without updating the NMT…

Computation and Language · Computer Science 2022-10-18 Hui Jiang , Ziyao Lu , Fandong Meng , Chulun Zhou , Jie Zhou , Degen Huang , Jinsong Su

We introduce $k$-nearest-neighbor machine translation ($k$NN-MT), which predicts tokens with a nearest neighbor classifier over a large datastore of cached examples, using representations from a neural translation model for similarity…

Computation and Language · Computer Science 2021-07-23 Urvashi Khandelwal , Angela Fan , Dan Jurafsky , Luke Zettlemoyer , Mike Lewis

Recently, $k$NN-MT has shown the promising capability of directly incorporating the pre-trained neural machine translation (NMT) model with domain-specific token-level $k$-nearest-neighbor ($k$NN) retrieval to achieve domain adaptation…

Computation and Language · Computer Science 2022-05-26 Xin Zheng , Zhirui Zhang , Shujian Huang , Boxing Chen , Jun Xie , Weihua Luo , Jiajun Chen

K-Nearest Neighbor Neural Machine Translation (kNN-MT) successfully incorporates external corpus by retrieving word-level representations at test time. Generally, kNN-MT borrows the off-the-shelf context representation in the translation…

Computation and Language · Computer Science 2023-09-20 Qiang Wang , Rongxiang Weng , Ming Chen

Nearest Neighbor Machine Translation (kNNMT) is a simple and effective method of augmenting neural machine translation (NMT) with a token-level nearest neighbor retrieval mechanism. The effectiveness of kNNMT directly depends on the quality…

Computation and Language · Computer Science 2022-12-20 Jiahuan Li , Shanbo Cheng , Zewei Sun , Mingxuan Wang , Shujian Huang

k-nearest-neighbor machine translation (NN-MT), proposed by Khandelwal et al. (2021), has achieved many state-of-the-art results in machine translation tasks. Although effective, NN-MT requires conducting NN searches through the large…

Computation and Language · Computer Science 2022-05-03 Zhixian Yang , Renliang Sun , Xiaojun Wan

One of the significant challenges of Machine Translation (MT) is the scarcity of large amounts of data, mainly parallel sentence aligned corpora. If the evaluation is as rigorous as resource-rich languages, both Neural Machine Translation…

Computation and Language · Computer Science 2023-03-06 Amit Kumar , Rupjyoti Baruah , Ajay Pratap , Mayank Swarnkar , Anil Kumar Singh

k-nearest-neighbor machine translation (kNN-MT) boosts the translation quality of a pre-trained neural machine translation (NMT) model by utilizing translation examples during decoding. Translation examples are stored in a vector database,…

Computation and Language · Computer Science 2023-10-20 Hiroyuki Deguchi , Hayate Hirano , Tomoki Hoshino , Yuto Nishida , Justin Vasselli , Taro Watanabe

Neural machine translation (NMT) approaches have improved the state of the art in many machine translation settings over the last couple of years, but they require large amounts of training data to produce sensible output. We demonstrate…

Computation and Language · Computer Science 2017-08-22 Robert Östling , Jörg Tiedemann

Neural Machine Translation (NMT) is a new approach for automatic translation of text from one human language into another. The basic concept in NMT is to train a large Neural Network that maximizes the translation performance on a given…

Computation and Language · Computer Science 2016-12-22 Markus Freitag , Yaser Al-Onaizan
‹ Prev 1 2 3 10 Next ›