中文
相关论文

相关论文: Scrambled Translation Problem: A Problem of Denois…

200 篇论文

Neural machine translation (NMT), a new approach to machine translation, has achieved promising results comparable to those of traditional approaches such as statistical machine translation (SMT). Despite its recent success, NMT cannot…

计算与语言 · 计算机科学 2017-09-07 Zi Long , Ryuichiro Kimura , Takehito Utsuro , Tomoharu Mitsuhashi , Mikio Yamamoto

Neural Machine Translation (NMT) systems are known to degrade when confronted with noisy data, especially when the system is trained only on clean data. In this paper, we show that augmenting training data with sentences containing…

计算与语言 · 计算机科学 2019-03-13 Antonios Anastasopoulos , Alison Lui , Toan Nguyen , David Chiang

While it has been shown that Neural Machine Translation (NMT) is highly sensitive to noisy parallel training samples, prior work treats all types of mismatches between source and target as noise. As a result, it remains unclear how samples…

计算与语言 · 计算机科学 2021-06-01 Eleftheria Briakou , Marine Carpuat

Neural Machine Translation (NMT) is known to suffer from a beam-search problem: after a certain point, increasing beam size causes an overall drop in translation quality. This effect is especially pronounced for long sentences. While much…

计算与语言 · 计算机科学 2021-09-15 Ivan Provilkov , Andrey Malinin

Successful methods for unsupervised neural machine translation (UNMT) employ crosslingual pretraining via self-supervision, often in the form of a masked language modeling or a sequence generation task, which requires the model to align the…

计算与语言 · 计算机科学 2021-04-15 Alexandra Chronopoulou , Dario Stojanovski , Alexander Fraser

We propose to achieve explainable neural machine translation (NMT) by changing the output representation to explain itself. We present a novel approach to NMT which generates the target sentence by monotonically walking through the source…

计算与语言 · 计算机科学 2018-08-30 Felix Stahlberg , Danielle Saunders , Bill Byrne

In this paper, we propose an effective way for biasing the attention mechanism of a sequence-to-sequence neural machine translation (NMT) model towards the well-studied statistical word alignment models. We show that our novel guided…

计算与语言 · 计算机科学 2016-07-07 Wenhu Chen , Evgeny Matusov , Shahram Khadivi , Jan-Thorsten Peter

In neural machine translation (NMT), the computational cost at the output layer increases with the size of the target-side vocabulary. Using a limited-size vocabulary instead may cause a significant decrease in translation quality. This…

计算与语言 · 计算机科学 2018-07-31 Katsuki Chousa , Katsuhito Sudoh , Satoshi Nakamura

We aim to investigate whether UNMT approaches with self-supervised pre-training are robust to word-order divergence between language pairs. We achieve this by comparing two models pre-trained with the same self-supervised pre-training…

计算与语言 · 计算机科学 2023-03-03 Tamali Banerjee , Rudra Murthy , Pushpak Bhattacharyya

One of the difficulties of neural machine translation (NMT) is the recall and appropriate translation of low-frequency words or phrases. In this paper, we propose a simple, fast, and effective method for recalling previously seen…

计算与语言 · 计算机科学 2018-04-10 Jingyi Zhang , Masao Utiyama , Eiichro Sumita , Graham Neubig , Satoshi Nakamura

An effective method to improve neural machine translation with monolingual data is to augment the parallel training corpus with back-translations of target language sentences. This work broadens the understanding of back-translation and…

计算与语言 · 计算机科学 2018-10-04 Sergey Edunov , Myle Ott , Michael Auli , David Grangier

Recent work in simultaneous machine translation is often trained with conventional full sentence translation corpora, leading to either excessive latency or necessity to anticipate as-yet-unarrived words, when dealing with a language pair…

计算与语言 · 计算机科学 2021-10-20 HyoJung Han , Seokchan Ahn , Yoonjung Choi , Insoo Chung , Sangha Kim , Kyunghyun Cho

Lexical ambiguity is a significant and pervasive challenge in Neural Machine Translation (NMT), with many state-of-the-art (SOTA) NMT systems struggling to handle polysemous words (Campolungo et al., 2022). The same holds for the NMT…

计算与语言 · 计算机科学 2023-10-24 Vivek Iyer , Edoardo Barba , Alexandra Birch , Jeff Z. Pan , Roberto Navigli

We present an ensemble-driven self-training framework for unsupervised neural machine translation (UNMT). Starting from a primary language pair, we train multiple UNMT models that share the same translation task but differ in an auxiliary…

计算与语言 · 计算机科学 2026-03-19 Ido Aharon , Jonathan Shaki , Sarit Kraus

In recent years, neural machine translation (NMT) has become the dominant approach in automated translation. However, like many other deep learning approaches, NMT suffers from overfitting when the amount of training data is limited. This…

计算与语言 · 计算机科学 2019-10-01 Inigo Jauregi Unanue , Ehsan Zare Borzeshi , Massimo Piccardi

While back-translation is simple and effective in exploiting abundant monolingual corpora to improve low-resource neural machine translation (NMT), the synthetic bilingual corpora generated by NMT models trained on limited authentic…

计算与语言 · 计算机科学 2019-09-04 Shuo Wang , Yang Liu , Chao Wang , Huanbo Luan , Maosong Sun

Neural Machine Translation (NMT) systems rely on large amounts of parallel data. This is a major challenge for low-resource languages. Building on recent work on unsupervised and semi-supervised methods, we present an approach that combines…

计算与语言 · 计算机科学 2018-05-29 Lierni Sestorain , Massimiliano Ciaramita , Christian Buck , Thomas Hofmann

The basic concept in Neural Machine Translation (NMT) is to train a large Neural Network that maximizes the translation performance on a given parallel corpus. NMT is then using a simple left-to-right beam-search decoder to generate new…

计算与语言 · 计算机科学 2018-12-19 Markus Freitag , Yaser Al-Onaizan

Subword units are an effective way to alleviate the open vocabulary problems in neural machine translation (NMT). While sentences are usually converted into unique subword sequences, subword segmentation is potentially ambiguous and…

计算与语言 · 计算机科学 2018-05-01 Taku Kudo

Neural machine translation (NMT) has achieved remarkable success in producing high-quality translations. However, current NMT systems suffer from a lack of reliability, as their outputs that are often affected by lexical or syntactic…

计算与语言 · 计算机科学 2023-09-20 Rongxiang Weng , Qiang Wang , Wensen Cheng , Changfeng Zhu , Min Zhang