English
Related papers

Related papers: An Automatic Quality Metric for Evaluating Simulta…

200 papers

Simultaneous translation is widely useful but remains challenging. Previous work falls into two main categories: (a) fixed-latency policies such as Ma et al. (2019) and (b) adaptive policies such as Gu et al. (2017). The former are simple…

Computation and Language · Computer Science 2019-09-13 Baigong Zheng , Renjie Zheng , Mingbo Ma , Liang Huang

Transfer learning approaches for Neural Machine Translation (NMT) train a NMT model on the assisting-target language pair (parent model) which is later fine-tuned for the source-target language pair of interest (child model), with the…

Computation and Language · Computer Science 2019-04-11 Rudra Murthy , Anoop Kunchukuttan , Pushpak Bhattacharyya

We introduce Parallel Paraphrasing ($\text{Para}_\text{both}$), an augmentation method for translation metrics making use of automatic paraphrasing of both the reference and hypothesis. This method counteracts the typically misleading…

Computation and Language · Computer Science 2023-05-23 Claudio Paonessa , Dominik Frefel , Manfred Vogel

We frame the task of machine translation evaluation as one of scoring machine translation output with a sequence-to-sequence paraphraser, conditioned on a human reference. We propose training the paraphraser as a multilingual NMT system,…

Computation and Language · Computer Science 2020-10-29 Brian Thompson , Matt Post

While automatic metrics drive progress in Machine Translation (MT) and Text Summarization (TS), existing metrics have been developed and validated almost exclusively for English and other high-resource languages. This narrow focus leaves…

Computation and Language · Computer Science 2025-10-09 Amir Hossein Yari , Kalmit Kulkarni , Ahmad Raza Khan , Fajri Koto

Speech language models (Speech LMs) enable end-to-end speech-text modeling within a single model, offering a promising direction for spoken dialogue systems. The choice of speech-text jointly decoding paradigm plays a critical role in…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-12 Haibin Wu , Yuxuan Hu , Ruchao Fan , Xiaofei Wang , Kenichi Kumatani , Bo Ren , Jianwei Yu , Heng Lu , Lijuan Wang , Yao Qian , Jinyu Li

Automatic postediting (APE) is an automated process to refine a given machine translation (MT). Recent findings present that existing APE systems are not good at handling high-quality MTs even for a language pair with abundant data…

Computation and Language · Computer Science 2023-06-21 Baikjin Jung , Myungji Lee , Jong-Hyeok Lee , Yunsu Kim

As research on machine translation moves to translating text beyond the sentence level, it remains unclear how effective automatic evaluation metrics are at scoring longer translations. In this work, we first propose a method for creating…

Computation and Language · Computer Science 2023-08-29 Daniel Deutsch , Juraj Juraska , Mara Finkelstein , Markus Freitag

Human evaluation of modern high-quality machine translation systems is a difficult problem, and there is increasing evidence that inadequate evaluation procedures can lead to erroneous conclusions. While there has been considerable research…

Computation and Language · Computer Science 2022-04-27 Markus Freitag , George Foster , David Grangier , Viresh Ratnakar , Qijun Tan , Wolfgang Macherey

To translate speech for automatic dubbing, machine translation needs to be isochronous, i.e. translated speech needs to be aligned with the source in terms of speech durations. We introduce target factors in a transformer model to predict…

Computation and Language · Computer Science 2023-05-23 Proyag Pal , Brian Thompson , Yogesh Virkar , Prashant Mathur , Alexandra Chronopoulou , Marcello Federico

Simultaneous machine translation, which aims at a real-time translation, is useful in many live scenarios but very challenging due to the trade-off between accuracy and latency. To achieve the balance for both, the model needs to wait for…

Computation and Language · Computer Science 2023-03-22 Lei Lin , Shuangtao Li , Xiaodong Shi

Attention is the core mechanism of today's most used architectures for natural language processing and has been analyzed from many perspectives, including its effectiveness for machine translation-related tasks. Among these studies,…

Computation and Language · Computer Science 2026-02-04 Sara Papi , Marco Turchi , Matteo Negri

We present an interactive machine translation (MT) system designed for users who are not proficient in the target language. It aims to improve trustworthiness and explainability by identifying potentially mistranslated words and allowing…

Computation and Language · Computer Science 2025-04-01 Kenneth J. Sible , David Chiang

Despite notable advances in large language models (LLMs), reliable evaluation of text generation tasks such as text style transfer (TST) remains an open challenge. Existing research has shown that automatic metrics often correlate poorly…

Computation and Language · Computer Science 2026-03-05 Vitaly Protasov , Nikolay Babakov , Daryna Dementieva , Alexander Panchenko

Simultaneous speech translation (SimulST) is the task in which output generation has to be performed on partial, incremental speech input. In recent years, SimulST has become popular due to the spread of cross-lingual application scenarios,…

Computation and Language · Computer Science 2022-05-06 Sara Papi , Matteo Negri , Marco Turchi

Simultaneous or streaming machine translation generates translation while reading the input stream. These systems face a quality/latency trade-off, aiming to achieve high translation quality similar to non-streaming models with minimal…

Computation and Language · Computer Science 2025-03-31 Zeeshan Ahmed , Frank Seide , Zhe Liu , Rastislav Rabatin , Jachym Kolar , Niko Moritz , Ruiming Xie , Simone Merello , Christian Fuegen

We propose iteratively prompting a large language model to self-correct a translation, with inspiration from their strong language understanding and translation capability as well as a human-like translation approach. Interestingly,…

Computation and Language · Computer Science 2024-05-03 Pinzhen Chen , Zhicheng Guo , Barry Haddow , Kenneth Heafield

The advent of NMT has expanded the scope of translation beyond isolated sentences, enabling context to be preserved across paragraphs and documents. However, current evaluation metrics largely remain restricted to the sentence level and…

Computational Engineering, Finance, and Science · Computer Science 2026-04-23 Hyeokmin Lee , Youngkyu Kim , Byounghyun Yoo

Word reordering is one of the most difficult aspects of statistical machine translation (SMT), and an important factor of its quality and efficiency. Despite the vast amount of research published to date, the interest of the community in…

Computation and Language · Computer Science 2017-02-27 Arianna Bisazza , Marcello Federico

Machine translation (MT) has come a long way and is readily employed in production systems to serve millions of users daily. With the recent advances in generative AI, a new form of translation is becoming possible - video dubbing. This…

Computation and Language · Computer Science 2024-10-16 Nikolai Rozanov , Vikentiy Pankov , Dmitrii Mukhutdinov , Dima Vypirailenko