English
Related papers

Related papers: Improving Neural Machine Translation Robustness vi…

200 papers

Rapid progress in Neural Machine Translation (NMT) systems over the last few years has been driven primarily towards improving translation quality, and as a secondary focus, improved robustness to input perturbations (e.g. spelling and…

Computation and Language · Computer Science 2021-04-16 Prasanna Parthasarathi , Koustuv Sinha , Joelle Pineau , Adina Williams

Previous studies show that incorporating external information could improve the translation quality of Neural Machine Translation (NMT) systems. However, there are inevitably noises in the external information, severely reducing the benefit…

Computation and Language · Computer Science 2018-11-20 Zaixiang Zheng , Shujian Huang , Zewei Sun , Rongxiang Weng , Xin-Yu Dai , Jiajun Chen

Robustness, the ability of models to maintain performance in the face of perturbations, is critical for developing reliable NLP systems. Recent studies have shown promising results in improving the robustness of models through adversarial…

Artificial Intelligence · Computer Science 2023-11-01 Leiyu Pan , Supryadi , Deyi Xiong

In this paper, we propose a robust neural machine translation (NMT) framework. The framework consists of a homophone noise detector and a syllable-aware NMT model to homophone errors. The detector identifies potential homophone errors in a…

Computation and Language · Computer Science 2020-12-16 Wenjie Qin , Xiang Li , Yuhui Sun , Deyi Xiong , Jianwei Cui , Bin Wang

Transformer models have demonstrated remarkable performance in neural machine translation (NMT). However, their vulnerability to noisy input poses a significant challenge in practical implementation, where generating clean output from noisy…

Computation and Language · Computer Science 2023-10-25 Quinten Bolding , Baohao Liao , Brandon James Denis , Jun Luo , Christof Monz

Without real bilingual corpus available, unsupervised Neural Machine Translation (NMT) typically requires pseudo parallel data generated with the back-translation method for the model training. However, due to weak supervision, the pseudo…

Computation and Language · Computer Science 2019-01-15 Shuo Ren , Zhirui Zhang , Shujie Liu , Ming Zhou , Shuai Ma

In Neural Machine Translation (NMT), data augmentation methods such as back-translation have proven their effectiveness in improving translation performance. In this paper, we propose a novel data augmentation approach for NMT, which is…

Computation and Language · Computer Science 2022-05-11 Chang Jin , Shigui Qiu , Nini Xiao , Hao Jia

Sensitivity of deep-neural models to input noise is known to be a challenging problem. In NLP, model performance often deteriorates with naturally occurring noise, such as spelling errors. To mitigate this issue, models may leverage…

Computation and Language · Computer Science 2021-11-18 Jakub Náplava , Martin Popel , Milan Straka , Jana Straková

While it has been shown that Neural Machine Translation (NMT) is highly sensitive to noisy parallel training samples, prior work treats all types of mismatches between source and target as noise. As a result, it remains unclear how samples…

Computation and Language · Computer Science 2021-06-01 Eleftheria Briakou , Marine Carpuat

Neural Machine Translation (NMT) has made remarkable progress using large-scale textual data, but the potential of incorporating multimodal inputs, especially visual information, remains underexplored in high-resource settings. While prior…

Computation and Language · Computer Science 2025-10-31 Baban Gain , Dibyanayan Bandyopadhyay , Samrat Mukherjee , Chandranath Adak , Asif Ekbal

Current Machine Translation (MT) models still struggle with more challenging input, such as noisy data and tail-end words and phrases. Several works have addressed this robustness issue by identifying specific categories of noise and…

Computation and Language · Computer Science 2022-11-11 Jacob Bremerman , Xiang Ren , Jonathan May

We consider the problem of making machine translation more robust to character-level variation at the source side, such as typos. Existing methods achieve greater coverage by applying subword models such as byte-pair encoding (BPE) and…

Computation and Language · Computer Science 2019-02-06 Vladimir Karpukhin , Omer Levy , Jacob Eisenstein , Marjan Ghazvininejad

Document-level context for neural machine translation (NMT) is crucial to improve the translation consistency and cohesion, the translation of ambiguous inputs, as well as several other linguistic phenomena. Many works have been published…

Computation and Language · Computer Science 2023-06-09 Christian Herold , Hermann Ney

\textbf{RE}trieval-\textbf{A}ugmented \textbf{L}LM-based \textbf{M}achine \textbf{T}ranslation (REAL-MT) shows promise for knowledge-intensive tasks like idiomatic translation, but its reliability under noisy retrieval contexts remains…

Computation and Language · Computer Science 2025-11-18 Yanming Sun , Runzhe Zhan , Chi Seng Cheang , Han Wu , Xuebo Liu , Yuyao Niu , Fengying Ye , Kaixin Lan , Lidia S. Chao , Derek F. Wong

Noisy or non-standard input text can cause disastrous mistranslations in most modern Machine Translation (MT) systems, and there has been growing research interest in creating noise-robust MT systems. However, as of yet there are no…

Computation and Language · Computer Science 2018-09-05 Paul Michel , Graham Neubig

The development of LLMs has greatly enhanced the intelligence and fluency of question answering, while the emergence of retrieval enhancement has enabled models to better utilize external information. However, the presence of noise and…

Computation and Language · Computer Science 2024-09-19 Xingyun Hong , Yan Shao , Zhilin Wang , Manni Duan , Jin Xiongnan

A prerequisite for training corpus-based machine translation (MT) systems -- either Statistical MT (SMT) or Neural MT (NMT) -- is the availability of high-quality parallel data. This is arguably more important today than ever before, as NMT…

Computation and Language · Computer Science 2018-04-18 Alberto Poncelas , Dimitar Shterionov , Andy Way , Gideon Maillette de Buy Wenniger , Peyman Passban

Through the development of neural machine translation, the quality of machine translation systems has been improved significantly. By exploiting advancements in deep learning, systems are now able to better approximate the complex mapping…

Computation and Language · Computer Science 2018-08-03 Jan Niehues , Ngoc-Quan Pham , Thanh-Le Ha , Matthias Sperber , Alex Waibel

Massively multilingual neural machine translation (MMNMT) has been proven to enhance the translation quality of low-resource languages. In this paper, we empirically investigate the translation robustness of Indonesian-Chinese translation…

Computation and Language · Computer Science 2024-05-14 Supryadi , Leiyu Pan , Deyi Xiong

Community Question-Answering (CQA) portals serve as a valuable tool for helping users within an organization. However, making them accessible to non-English-speaking users continues to be a challenge. Translating questions can broaden the…

Computation and Language · Computer Science 2023-10-25 Baban Gain , Ramakrishna Appicharla , Soumya Chennabasavaraj , Nikesh Garera , Asif Ekbal , Muthusamy Chelliah