English
Related papers

Related papers: Isometric MT: Neural Machine Translation for Autom…

200 papers

Despite impressive progress in high-resource settings, Neural Machine Translation (NMT) still struggles in low-resource and out-of-domain scenarios, often failing to match the quality of phrase-based translation. We propose a novel…

Computation and Language · Computer Science 2018-05-31 Xing Niu , Michael Denkowski , Marine Carpuat

To translate speech for automatic dubbing, machine translation needs to be isochronous, i.e. translated speech needs to be aligned with the source in terms of speech durations. We introduce target factors in a transformer model to predict…

Computation and Language · Computer Science 2023-05-23 Proyag Pal , Brian Thompson , Yogesh Virkar , Prashant Mathur , Alexandra Chronopoulou , Marcello Federico

We propose a simple solution to use a single Neural Machine Translation (NMT) model to translate between multiple languages. Our solution requires no change in the model architecture from our base system but instead introduces an artificial…

Machine translation (MT) is one of the main tasks in natural language processing whose objective is to translate texts automatically from one natural language to another. Nowadays, using deep neural networks for MT tasks has received great…

Video dubbing aims to translate the original speech in a film or television program into the speech in a target language, which can be achieved with a cascaded system consisting of speech recognition, machine translation and speech…

Computation and Language · Computer Science 2023-12-06 Yihan Wu , Junliang Guo , Xu Tan , Chen Zhang , Bohan Li , Ruihua Song , Lei He , Sheng Zhao , Arul Menezes , Jiang Bian

The goal of automatic dubbing is to perform speech-to-speech translation while achieving audiovisual coherence. This entails isochrony, i.e., translating the original speech by also matching its prosodic structure into phrases and pauses,…

Computation and Language · Computer Science 2022-04-07 Yogesh Virkar , Marcello Federico , Robert Enyedi , Roberto Barra-Chicote

Neural machine translation (NMT) methods developed for natural language processing have been shown to be highly successful in automating translation from one natural language to another. Recently, these NMT methods have been adapted to the…

Computation and Language · Computer Science 2023-05-24 Dharma KC , Clayton T. Morrison

Machine translation (MT) is a technique that leverages computers to translate human languages automatically. Nowadays, neural machine translation (NMT) which models direct mapping between source and target languages with deep neural…

Computation and Language · Computer Science 2020-04-14 Jiajun Zhang , Chengqing Zong

In this paper, we propose a new task of machine translation (MT), which is based on no parallel sentences but can refer to a ground-truth bilingual dictionary. Motivated by the ability of a monolingual speaker learning to translate via…

Computation and Language · Computer Science 2020-07-07 Xiangyu Duan , Baijun Ji , Hao Jia , Min Tan , Min Zhang , Boxing Chen , Weihua Luo , Yue Zhang

While neural machine translation (NMT) has achieved state-of-the-art translation performance, it is unable to capture the alignment between the input and output during the translation process. The lack of alignment in NMT models leads to…

Computation and Language · Computer Science 2019-12-02 Jiacheng Zhang , Huanbo Luan , Maosong Sun , FeiFei Zhai , Jingfang Xu , Yang Liu

A major open problem in neural machine translation (NMT) is the translation of idiomatic expressions, such as "under the weather". The meaning of these expressions is not composed by the meaning of their constituent words, and NMT models…

Computation and Language · Computer Science 2022-10-11 Christos Baziotis , Prashant Mathur , Eva Hasler

Simultaneous Machine Translation (SiMT) requires high-quality translations under strict real-time constraints, which traditional policies with only READ/WRITE actions cannot fully address. We extend the action space of SiMT with four…

Computation and Language · Computer Science 2026-01-19 Qianen Zhang , Zeyu Yang , Satoshi Nakamura

Neural Machine Translation (NMT) models have demonstrated strong state of the art performance on translation tasks where well-formed training and evaluation data are provided, but they remain sensitive to inputs that include errors of…

Computation and Language · Computer Science 2020-10-22 Daniel Li , Te I , Naveen Arivazhagan , Colin Cherry , Dirk Padfield

In recent years, Neural Machine Translation (NMT) has been shown to be more effective than phrase-based statistical methods, thus quickly becoming the state of the art in machine translation (MT). However, NMT systems are limited in…

Computation and Language · Computer Science 2019-09-17 Surafel M. Lakew , Marcello Federico , Matteo Negri , Marco Turchi

Training efficiency is one of the main problems for Neural Machine Translation (NMT). Deep networks need for very large data as well as many training iterations to achieve state-of-the-art performance. This results in very high computation…

Computation and Language · Computer Science 2017-10-04 Dakun Zhang , Jungi Kim , Josep Crego , Jean Senellart

Machine translation (MT) has come a long way and is readily employed in production systems to serve millions of users daily. With the recent advances in generative AI, a new form of translation is becoming possible - video dubbing. This…

Computation and Language · Computer Science 2024-10-16 Nikolai Rozanov , Vikentiy Pankov , Dmitrii Mukhutdinov , Dima Vypirailenko

Multilingual neural machine translation (MNMT) learns to translate multiple language pairs with a single model, potentially improving both the accuracy and the memory-efficiency of deployed models. However, the heavy data imbalance between…

Computation and Language · Computer Science 2021-09-10 Chunting Zhou , Daniel Levy , Xian Li , Marjan Ghazvininejad , Graham Neubig

Multilingual neural machine translation (NMT) enables training a single model that supports translation from multiple source languages into multiple target languages. In this paper, we push the limits of multilingual NMT in terms of number…

Computation and Language · Computer Science 2019-07-03 Roee Aharoni , Melvin Johnson , Orhan Firat

Neural Machine Translation (NMT) models generally perform translation using a fixed-size lexical vocabulary, which is an important bottleneck on their generalization capability and overall translation quality. The standard approach to…

Computation and Language · Computer Science 2019-10-22 Duygu Ataman , Orhan Firat , Mattia A. Di Gangi , Marcello Federico , Alexandra Birch

Although neural machine translation (NMT) has achieved impressive progress recently, it is usually trained on the clean parallel data set and hence cannot work well when the input sentence is the production of the automatic speech…

Computation and Language · Computer Science 2018-11-05 Xiang Li , Haiyang Xue , Wei Chen , Yang Liu , Yang Feng , Qun Liu