中文
相关论文

相关论文: Simply Trainable Nearest Neighbour Machine Transla…

200 篇论文

$k$NN-MT is a straightforward yet powerful approach for fast domain adaptation, which directly plugs pre-trained neural machine translation (NMT) models with domain-specific token-level $k$-nearest-neighbor ($k$NN) retrieval to achieve…

计算与语言 · 计算机科学 2023-02-24 Yuhan Dai , Zhirui Zhang , Qiuzhi Liu , Qu Cui , Weihua Li , Yichao Du , Tong Xu

Nearest Neighbor Machine Translation ($k$NN-MT) has achieved great success in domain adaptation tasks by integrating pre-trained Neural Machine Translation (NMT) models with domain-specific token-level retrieval. However, the reasons…

计算与语言 · 计算机科学 2023-10-25 Ruize Gao , Zhirui Zhang , Yichao Du , Lemao Liu , Rui Wang

We introduce $k$-nearest-neighbor machine translation ($k$NN-MT), which predicts tokens with a nearest neighbor classifier over a large datastore of cached examples, using representations from a neural translation model for similarity…

计算与语言 · 计算机科学 2021-07-23 Urvashi Khandelwal , Angela Fan , Dan Jurafsky , Luke Zettlemoyer , Mike Lewis

kNN-MT, recently proposed by Khandelwal et al. (2020a), successfully combines pre-trained neural machine translation (NMT) model with token-level k-nearest-neighbor (kNN) retrieval to improve the translation accuracy. However, the…

计算与语言 · 计算机科学 2021-05-28 Xin Zheng , Zhirui Zhang , Junliang Guo , Shujian Huang , Boxing Chen , Weihua Luo , Jiajun Chen

k-Nearest-Neighbor Machine Translation (kNN-MT) becomes an important research direction of NMT in recent years. Its main idea is to retrieve useful key-value pairs from an additional datastore to modify translations without updating the NMT…

计算与语言 · 计算机科学 2022-10-18 Hui Jiang , Ziyao Lu , Fandong Meng , Chulun Zhou , Jie Zhou , Degen Huang , Jinsong Su

Neural machine translation has achieved promising results on many translation tasks. However, previous studies have shown that neural models induce a non-smooth representation space, which harms its generalization results. Recently, kNN-MT…

计算与语言 · 计算机科学 2023-06-13 Wenhao Zhu , Jingjing Xu , Shujian Huang , Lingpeng Kong , Jiajun Chen

$k$-Nearest neighbor machine translation ($k$NN-MT) has attracted increasing attention due to its ability to non-parametrically adapt to new translation domains. By using an upstream NMT model to traverse the downstream training corpus, it…

计算与语言 · 计算机科学 2023-05-29 Zhiwei Cao , Baosong Yang , Huan Lin , Suhang Wu , Xiangpeng Wei , Dayiheng Liu , Jun Xie , Min Zhang , Jinsong Su

Though nearest neighbor Machine Translation ($k$NN-MT) \citep{khandelwal2020nearest} has proved to introduce significant performance boosts over standard neural MT systems, it is prohibitively slow since it uses the entire reference corpus…

计算与语言 · 计算机科学 2022-11-23 Yuxian Meng , Xiaoya Li , Xiayu Zheng , Fei Wu , Xiaofei Sun , Tianwei Zhang , Jiwei Li

k-Nearest-Neighbor Machine Translation (kNN-MT) has been recently proposed as a non-parametric solution for domain adaptation in neural machine translation (NMT). It aims to alleviate the performance degradation of advanced MT systems in…

计算与语言 · 计算机科学 2022-05-04 Dexin Wang , Kai Fan , Boxing Chen , Deyi Xiong

To achieve non-parametric NMT domain adaptation, $k$-Nearest-Neighbor Machine Translation ($k$NN-MT) constructs an external datastore to store domain-specific translation knowledge, which derives a $k$NN distribution to interpolate the…

计算与语言 · 计算机科学 2024-06-11 Yan Gao , Zhiwei Cao , Zhongjian Miao , Baosong Yang , Shiyu Liu , Min Zhang , Jinsong Su

Recently, $k$NN-MT has shown the promising capability of directly incorporating the pre-trained neural machine translation (NMT) model with domain-specific token-level $k$-nearest-neighbor ($k$NN) retrieval to achieve domain adaptation…

计算与语言 · 计算机科学 2022-05-26 Xin Zheng , Zhirui Zhang , Shujian Huang , Boxing Chen , Jun Xie , Weihua Luo , Jiajun Chen

k-nearest-neighbor machine translation (NN-MT), proposed by Khandelwal et al. (2021), has achieved many state-of-the-art results in machine translation tasks. Although effective, NN-MT requires conducting NN searches through the large…

计算与语言 · 计算机科学 2022-05-03 Zhixian Yang , Renliang Sun , Xiaojun Wan

K-Nearest Neighbor Neural Machine Translation (kNN-MT) successfully incorporates external corpus by retrieving word-level representations at test time. Generally, kNN-MT borrows the off-the-shelf context representation in the translation…

计算与语言 · 计算机科学 2023-09-20 Qiang Wang , Rongxiang Weng , Ming Chen

Nearest Neighbor Machine Translation (kNNMT) is a simple and effective method of augmenting neural machine translation (NMT) with a token-level nearest neighbor retrieval mechanism. The effectiveness of kNNMT directly depends on the quality…

计算与语言 · 计算机科学 2022-12-20 Jiahuan Li , Shanbo Cheng , Zewei Sun , Mingxuan Wang , Shujian Huang

Augmenting neural machine translation with external memory at decoding time, in the form of k-nearest neighbors machine translation ($k$-NN MT), is a well-established strategy for increasing translation performance. $k$-NN MT retrieves a…

计算与语言 · 计算机科学 2025-09-23 Evgeniia Tokarchuk , Sergey Troshin , Vlad Niculae

Recent works have proven the effectiveness of k-nearest-neighbor machine translation(a.k.a kNN-MT) approaches to produce remarkable improvement in cross-domain translations. However, these models suffer from heavy retrieve overhead on the…

计算与语言 · 计算机科学 2025-01-07 Xiangyu Shi , Yunlong Liang , Jinan Xu , Yufeng Chen

We introduce $k$NN-LMs, which extend a pre-trained neural language model (LM) by linearly interpolating it with a $k$-nearest neighbors ($k$NN) model. The nearest neighbors are computed according to distance in the pre-trained LM embedding…

计算与语言 · 计算机科学 2020-02-18 Urvashi Khandelwal , Omer Levy , Dan Jurafsky , Luke Zettlemoyer , Mike Lewis

Recurrent neural networks (RNNs) have represented for years the state of the art in neural machine translation. Recently, new architectures have been proposed, which can leverage parallel computation on GPUs better than classical RNNs.…

计算与语言 · 计算机科学 2018-05-14 Mattia Antonino Di Gangi , Marcello Federico

Neural Machine Translation (NMT) is a new approach for automatic translation of text from one human language into another. The basic concept in NMT is to train a large Neural Network that maximizes the translation performance on a given…

计算与语言 · 计算机科学 2016-12-22 Markus Freitag , Yaser Al-Onaizan

Nearest neighbor machine translation augments the Autoregressive Translation~(AT) with $k$-nearest-neighbor retrieval, by comparing the similarity between the token-level context representations of the target tokens in the query and the…

计算与语言 · 计算机科学 2023-02-08 Rui Lv , Junliang Guo , Rui Wang , Xu Tan , Qi Liu , Tao Qin
‹ 上一页 1 2 3 10 下一页 ›