English
Related papers

Related papers: Sockeye: A Toolkit for Neural Machine Translation

200 papers

This paper presents FunCodec, a fundamental neural speech codec toolkit, which is an extension of the open-source speech processing toolkit FunASR. FunCodec provides reproducible training recipes and inference scripts for the latest neural…

Sound · Computer Science 2023-10-10 Zhihao Du , Shiliang Zhang , Kai Hu , Siqi Zheng

Neural Machine Translation (NMT) models from English to SPARQL are a promising development for SPARQL query generation. However, current architectures are unable to integrate the knowledge base (KB) schema and handle questions on knowledge…

Computation and Language · Computer Science 2022-11-21 Rose Hirigoyen , Amal Zouaq , Samuel Reyd

The sparse Mixture-of-Experts (MoE) has achieved significant progress for neural machine translation (NMT). However, there exist two limitations in current MoE solutions which may lead to sub-optimal performance: 1) they directly use the…

Computation and Language · Computer Science 2025-05-21 Yunlong Liang , Fandong Meng , Jie Zhou

A rising interest in the modality extension of foundation language models warrants discussion on the most effective, and efficient, multimodal training approach. This work focuses on neural machine translation (NMT) and proposes a joint…

This paper describes SYSTRAN's systems submitted to the WMT 2017 shared news translation task for English-German, in both translation directions. Our systems are built using OpenNMT, an open-source neural machine translation system,…

Computation and Language · Computer Science 2017-09-13 Yongchao Deng , Jungi Kim , Guillaume Klein , Catherine Kobus , Natalia Segal , Christophe Servan , Bo Wang , Dakun Zhang , Josep Crego , Jean Senellart

In this paper we provide the largest published comparison of translation quality for phrase-based SMT and neural machine translation across 30 translation directions. For ten directions we also include hierarchical phrase-based MT.…

Computation and Language · Computer Science 2016-12-01 Marcin Junczys-Dowmunt , Tomasz Dwojak , Hieu Hoang

Most neural machine translation (NMT) models are based on the sequential encoder-decoder framework, which makes no use of syntactic information. In this paper, we improve this model by explicitly incorporating source-side syntactic trees.…

Computation and Language · Computer Science 2017-07-19 Huadong Chen , Shujian Huang , David Chiang , Jiajun Chen

In this paper, we propose a robust neural machine translation (NMT) framework. The framework consists of a homophone noise detector and a syllable-aware NMT model to homophone errors. The detector identifies potential homophone errors in a…

Computation and Language · Computer Science 2020-12-16 Wenjie Qin , Xiang Li , Yuhui Sun , Deyi Xiong , Jianwei Cui , Bin Wang

Unsupervised neural machine translation(NMT) is associated with noise and errors in synthetic data when executing vanilla back-translations. Here, we explicitly exploits language model(LM) to drive construction of an unsupervised NMT…

Computation and Language · Computer Science 2019-11-12 Wei Zhang , Youyuan Lin , Ruoran Ren , Xiaodong Wang , Zhenshuang Liang , Zhen Huang

The addition of syntax-aware decoding in Neural Machine Translation (NMT) systems requires an effective tree-structured neural network, a syntax-aware attention model and a language generation model that is sensitive to sentence structure.…

Computation and Language · Computer Science 2018-09-07 Jetic Gū , Hassan S. Shavarani , Anoop Sarkar

A conventional approach to improving the performance of end-to-end speech translation (E2E-ST) models is to leverage the source transcription via pre-training and joint training with automatic speech recognition (ASR) and neural machine…

Computation and Language · Computer Science 2021-04-15 Hirofumi Inaguma , Tatsuya Kawahara , Shinji Watanabe

Neural machine translation (NMT) is often criticized for failures that happen without awareness. The lack of competency awareness makes NMT untrustworthy. This is in sharp contrast to human translators who give feedback or conduct further…

Computation and Language · Computer Science 2022-11-28 Pei Zhang , Baosong Yang , Haoran Wei , Dayiheng Liu , Kai Fan , Luo Si , Jun Xie

In simultaneous machine translation, the objective is to determine when to produce a partial translation given a continuous stream of source words, with a trade-off between latency and quality. We propose a neural machine translation (NMT)…

Computation and Language · Computer Science 2020-06-01 Patrick Wilken , Tamer Alkhouli , Evgeny Matusov , Pavel Golik

We present ESPnet-SpeechLM, an open toolkit designed to democratize the development of speech language models (SpeechLMs) and voice-driven agentic applications. The toolkit standardizes speech processing tasks by framing them as universal…

Translation quality estimation (TQE) is the task of predicting translation quality without reference translations. Due to the enormous cost of creating training data for TQE, only a few translation directions can benefit from supervised…

Computation and Language · Computer Science 2023-11-10 Yuto Kuroda , Atsushi Fujita , Tomoyuki Kajiwara , Takashi Ninomiya

Recently, universal neural machine translation (NMT) with shared encoder-decoder gained good performance on zero-shot translation. Unlike universal NMT, jointly trained language-specific encoders-decoders aim to achieve universal…

Computation and Language · Computer Science 2021-02-15 Junwei Liao , Yu Shi , Ming Gong , Linjun Shou , Hong Qu , Michael Zeng

Neural Machine Translation (NMT) is an end-to-end learning approach for automated translation, with the potential to overcome many of the weaknesses of conventional phrase-based translation systems. Unfortunately, NMT systems are known to…

As the size of large language models continue to scale, so does the computational resources required to run it. Spiking Neural Networks (SNNs) have emerged as an energy-efficient approach to deep learning that leverage sparse and…

Computation and Language · Computer Science 2024-07-12 Rui-Jie Zhu , Qihang Zhao , Guoqi Li , Jason K. Eshraghian

Despite the progress in machine translation quality estimation and evaluation in the last years, decoding in neural machine translation (NMT) is mostly oblivious to this and centers around finding the most probable translation according to…

Computation and Language · Computer Science 2022-05-03 Patrick Fernandes , António Farinhas , Ricardo Rei , José G. C. de Souza , Perez Ogayo , Graham Neubig , André F. T. Martins

While end-to-end neural machine translation (NMT) has made remarkable progress recently, NMT systems only rely on parallel corpora for parameter estimation. Since parallel corpora are usually limited in quantity, quality, and coverage,…

Computation and Language · Computer Science 2016-12-13 Yong Cheng , Wei Xu , Zhongjun He , Wei He , Hua Wu , Maosong Sun , Yang Liu