English
Related papers

Related papers: Towards Example-Based NMT with Multi-Levenshtein T…

200 papers

Reasoning-oriented large language models (RLMs) achieve strong gains on tasks such as mathematics and coding by generating explicit intermediate reasoning. However, their impact on machine translation (MT) remains underexplored. We…

Computation and Language · Computer Science 2026-02-17 Sara Rajaee , Sebastian Vincent , Alexandre Berard , Marzieh Fadaee , Kelly Marchisio , Tom Kocmi

Despite their original goal to jointly learn to align and translate, Neural Machine Translation (NMT) models, especially Transformer, are often perceived as not learning interpretable word alignments. In this paper, we show that NMT models…

Computation and Language · Computer Science 2019-07-01 Shuoyang Ding , Hainan Xu , Philipp Koehn

Neural Machine Translation (NMT) models achieve state-of-the-art performance on many translation benchmarks. As an active research field in NMT, knowledge distillation is widely applied to enhance the model's performance by transferring…

Computation and Language · Computer Science 2021-05-28 Fusheng Wang , Jianhao Yan , Fandong Meng , Jie Zhou

Levenshtein transformer (LevT) is a non-autoregressive machine translation model with high decoding efficiency and comparable translation quality in terms of bleu score, due to its parallel decoding and iterative refinement procedure. Are…

Computation and Language · Computer Science 2024-02-20 Ruiyang Zhou

Most recent research about automatic music transcription (AMT) uses convolutional neural networks and recurrent neural networks to model the mapping from music signals to symbolic notation. Based on a high-resolution piano transcription…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Longshen Ou , Ziyi Guo , Emmanouil Benetos , Jiqing Han , Ye Wang

Despite the growing variety of languages supported by existing multilingual neural machine translation (MNMT) models, most of the world's languages are still being left behind. We aim to extend large-scale MNMT models to incorporate a new…

Computation and Language · Computer Science 2025-12-02 Wen Lai , Viktor Hangya , Yingli Shen , Alexander Fraser

Improving neural machine translation (NMT) systems with prompting has achieved significant progress in recent years. In this work, we focus on how to integrate multi-knowledge, multiple types of knowledge, into NMT models to enhance the…

Computation and Language · Computer Science 2023-12-11 Ke Wang , Jun Xie , Yuqi Zhang , Yu Zhao

Previous work on multimodal machine translation (MMT) has focused on the way of incorporating vision features into translation but little attention is on the quality of vision models. In this work, we investigate the impact of vision models…

Computation and Language · Computer Science 2022-03-18 Bei Li , Chuanhao Lv , Zefan Zhou , Tao Zhou , Tong Xiao , Anxiang Ma , JingBo Zhu

We describe a multi-task learning approach to train a Neural Machine Translation (NMT) model with a Relevance-based Auxiliary Task (RAT) for search query translation. The translation process for Cross-lingual Information Retrieval (CLIR)…

Information Retrieval · Computer Science 2019-06-18 Sheikh Muhammad Sarwar , Hamed Bonab , James Allan

Automatic Music Transcription (AMT) has been recognized as a key enabling technology with a wide range of applications. Given the task's complexity, best results have typically been reported for systems focusing on specific settings, e.g.…

Although end-to-end Neural Machine Translation (NMT) has achieved remarkable progress in the past two years, it suffers from a major drawback: translations generated by NMT systems often lack of adequacy. It has been widely observed that…

Computation and Language · Computer Science 2016-11-22 Zhaopeng Tu , Yang Liu , Lifeng Shang , Xiaohua Liu , Hang Li

It is intuitive that semantic representations can be useful for machine translation, mainly because they can help in enforcing meaning preservation and handling data sparsity (many sentences correspond to one meaning) of machine translation…

Computation and Language · Computer Science 2019-06-07 Linfeng Song , Daniel Gildea , Yue Zhang , Zhiguo Wang , Jinsong Su

Recent years have witnessed growing interest in applying Large Reasoning Models (LRMs) to Machine Translation (MT). Existing approaches predominantly adopt a "think-first-then-translate" paradigm. Although explicit reasoning trajectories…

Computation and Language · Computer Science 2026-04-22 Kunquan Li , Yingxue Zhang , Fandong Meng , Jinsong Su

Recent studies have shown that reinforcement learning (RL) is an effective approach for improving the performance of neural machine translation (NMT) system. However, due to its instability, successfully RL training is challenging,…

Machine Learning · Computer Science 2018-08-28 Lijun Wu , Fei Tian , Tao Qin , Jianhuang Lai , Tie-Yan Liu

\textbf{RE}trieval-\textbf{A}ugmented \textbf{L}LM-based \textbf{M}achine \textbf{T}ranslation (REAL-MT) shows promise for knowledge-intensive tasks like idiomatic translation, but its reliability under noisy retrieval contexts remains…

Computation and Language · Computer Science 2025-11-18 Yanming Sun , Runzhe Zhan , Chi Seng Cheang , Han Wu , Xuebo Liu , Yuyao Niu , Fengying Ye , Kaixin Lan , Lidia S. Chao , Derek F. Wong

Neural Networks trained with gradient descent are known to be susceptible to catastrophic forgetting caused by parameter shift during the training process. In the context of Neural Machine Translation (NMT) this results in poor performance…

Computation and Language · Computer Science 2019-06-20 Ankur Bapna , Orhan Firat

Retrieval-augmented generation (RAG) introduces additional information to enhance large language models (LLMs). In machine translation (MT), previous work typically retrieves in-context examples from paired MT corpora, or domain-specific…

Computation and Language · Computer Science 2025-09-01 Jiaan Wang , Fandong Meng , Yingxue Zhang , Jie Zhou

Confidence estimation aims to quantify the confidence of the model prediction, providing an expectation of success. A well-calibrated confidence estimate enables accurate failure prediction and proper risk measurement when given noisy…

Computation and Language · Computer Science 2022-03-23 Yu Lu , Jiali Zeng , Jiajun Zhang , Shuangzhi Wu , Mu Li

Attention-based Neural Machine Translation (NMT) models suffer from attention deficiency issues as has been observed in recent research. We propose a novel mechanism to address some of these limitations and improve the NMT attention.…

Computation and Language · Computer Science 2016-08-10 Baskaran Sankaran , Haitao Mi , Yaser Al-Onaizan , Abe Ittycheriah

In Neural Machine Translation (NMT), data augmentation methods such as back-translation have proven their effectiveness in improving translation performance. In this paper, we propose a novel data augmentation approach for NMT, which is…

Computation and Language · Computer Science 2022-05-11 Chang Jin , Shigui Qiu , Nini Xiao , Hao Jia