English
Related papers

Related papers: Sockeye: A Toolkit for Neural Machine Translation

200 papers

We present Nematus, a toolkit for Neural Machine Translation. The toolkit prioritizes high translation accuracy, usability, and extensibility. Nematus has been used to build top-performing submissions to shared translation tasks at WMT and…

Despite the success of neural machine translation (NMT), simultaneous neural machine translation (SNMT), the task of translating in real time before a full sentence has been observed, remains challenging due to the syntactic structure…

Computation and Language · Computer Science 2020-10-06 Yun Chen , Liangyou Li , Xin Jiang , Xiao Chen , Qun Liu

Recent studies have proven that the training of neural machine translation (NMT) can be facilitated by mimicking the learning process of humans. Nevertheless, achievements of such kind of curriculum learning rely on the quality of…

Computation and Language · Computer Science 2022-10-20 Yu Wan , Baosong Yang , Derek F. Wong , Yikai Zhou , Lidia S. Chao , Haibo Zhang , Boxing Chen

This paper describes SentencePiece, a language-independent subword tokenizer and detokenizer designed for Neural-based text processing, including Neural Machine Translation. It provides open-source C++ and Python implementations for subword…

Computation and Language · Computer Science 2018-08-21 Taku Kudo , John Richardson

Existing curriculum learning approaches to Neural Machine Translation (NMT) require sampling sufficient amounts of "easy" samples from training data at the early training stage. This is not always achievable for low-resource languages where…

Computation and Language · Computer Science 2021-03-23 Chen Liang , Haoming Jiang , Xiaodong Liu , Pengcheng He , Weizhu Chen , Jianfeng Gao , Tuo Zhao

Neural machine translation (NMT), a new approach to machine translation, has achieved promising results comparable to those of traditional approaches such as statistical machine translation (SMT). Despite its recent success, NMT cannot…

Computation and Language · Computer Science 2017-07-21 Zi Long , Takehito Utsuro , Tomoharu Mitsuhashi , Mikio Yamamoto

Quality Estimation (QE) models for Neural Machine Translation (NMT) predict the quality of the hypothesis without having access to the reference. An emerging research direction in NMT involves the use of QE models, which have demonstrated…

Computation and Language · Computer Science 2025-06-03 Sai Koneru , Matthias Huck , Miriam Exel , Jan Niehues

We conduct an empirical study of neural machine translation (NMT) for truly low-resource languages, and propose a training curriculum fit for cases when both parallel training data and compute resource are lacking, reflecting the reality of…

Computation and Language · Computer Science 2021-11-30 Garry Kuwanto , Afra Feyza Akyürek , Isidora Chara Tourni , Siyang Li , Alexander Gregory Jones , Derry Wijaya

Translation Quality Evaluation (TQE) is an essential step of the modern translation production process. TQE is critical in assessing both machine translation (MT) and human translation (HT) quality without reference translations. The…

Computation and Language · Computer Science 2024-06-24 Serge Gladkoff , Lifeng Han , Gleb Erofeev , Irina Sorokina , Goran Nenadic

Increasingly larger and better Transformer models keep advancing state-of-the-art accuracy and capability for Natural Language Processing applications. These models demand more computational power, storage, and energy. Mokey reduces the…

Machine Learning · Computer Science 2022-06-07 Ali Hadi Zadeh , Mostafa Mahmoud , Ameer Abdelhadi , Andreas Moshovos

We present an ensemble-driven self-training framework for unsupervised neural machine translation (UNMT). Starting from a primary language pair, we train multiple UNMT models that share the same translation task but differ in an auxiliary…

Computation and Language · Computer Science 2026-03-19 Ido Aharon , Jonathan Shaki , Sarit Kraus

NeurST is an open-source toolkit for neural speech translation. The toolkit mainly focuses on end-to-end speech translation, which is easy to use, modify, and extend to advanced speech translation research and products. NeurST aims at…

Computation and Language · Computer Science 2021-06-16 Chengqi Zhao , Mingxuan Wang , Qianqian Dong , Rong Ye , Lei Li

This paper presents EvolveMT for efficiently combining multiple machine translation (MT) engines. The proposed system selects the output from a single engine for each segment by utilizing online learning techniques to predict the most…

Computation and Language · Computer Science 2023-06-22 Kamer Ali Yuksel , Ahmet Gunduz , Mohamed Al-Badrashiny , Shreyas Sharma , Hassan Sawaf

We introduce ChrEnTranslate, an online machine translation demonstration system for translation between English and an endangered language Cherokee. It supports both statistical and neural translation models as well as provides quality…

Computation and Language · Computer Science 2021-08-03 Shiyue Zhang , Benjamin Frey , Mohit Bansal

Machine translation (MT) is an important sub-field of natural language processing that aims to translate natural languages using computers. In recent years, end-to-end neural machine translation (NMT) has achieved great success and has…

Computation and Language · Computer Science 2021-01-01 Zhixing Tan , Shuo Wang , Zonghan Yang , Gang Chen , Xuancheng Huang , Maosong Sun , Yang Liu

Neural machine translation (NMT) approaches have improved the state of the art in many machine translation settings over the last couple of years, but they require large amounts of training data to produce sensible output. We demonstrate…

Computation and Language · Computer Science 2017-08-22 Robert Östling , Jörg Tiedemann

NLTK, the Natural Language Toolkit, is a suite of open source program modules, tutorials and problem sets, providing ready-to-use computational linguistics courseware. NLTK covers symbolic and statistical natural language processing, and is…

Computation and Language · Computer Science 2007-05-23 Edward Loper , Steven Bird

The transfer learning toolkit wraps the codes of 17 transfer learning models and provides integrated interfaces, allowing users to use those models by calling a simple function. It is easy for primary researchers to use this toolkit and to…

Machine Learning · Computer Science 2019-11-21 Fuzhen Zhuang , Keyu Duan , Tongjia Guo , Yongchun Zhu , Dongbo Xi , Zhiyuan Qi , Qing He

Transliteration is a key component of machine translation systems and software internationalization. This paper demonstrates that neural sequence-to-sequence models obtain state of the art or close to state of the art results on existing…

Computation and Language · Computer Science 2016-11-01 Mihaela Rosca , Thomas Breuel

Neural machine translation~(NMT) is ineffective for zero-resource languages. Recent works exploring the possibility of unsupervised neural machine translation (UNMT) with only monolingual data can achieve promising results. However, there…

Computation and Language · Computer Science 2021-04-02 Mingxuan Wang , Hongxiao Bai , Hai Zhao , Lei Li