中文
相关论文

相关论文: An Automatic Quality Metric for Evaluating Simulta…

200 篇论文

Automatic dubbing (AD) is among the machine translation (MT) use cases where translations should match a given length to allow for synchronicity between source and target speech. For neural MT, generating translations of length close to the…

计算与语言 · 计算机科学 2022-02-18 Surafel M. Lakew , Yogesh Virkar , Prashant Mathur , Marcello Federico

Automated metrics for Machine Translation have made significant progress, with the goal of replacing expensive and time-consuming human evaluations. These metrics are typically assessed by their correlation with human judgments, which…

计算与语言 · 计算机科学 2024-12-31 Pius von Däniken , Jan Deriu , Mark Cieliebak

Machine Translation (MT) evaluation metrics assess translation quality automatically. Recently, researchers have employed MT metrics for various new use cases, such as data filtering and translation re-ranking. However, most MT metrics…

计算与语言 · 计算机科学 2024-10-08 Stefano Perrella , Lorenzo Proietti , Pere-Lluís Huguet Cabot , Edoardo Barba , Roberto Navigli

In simultaneous machine translation, the objective is to determine when to produce a partial translation given a continuous stream of source words, with a trade-off between latency and quality. We propose a neural machine translation (NMT)…

计算与语言 · 计算机科学 2020-06-01 Patrick Wilken , Tamer Alkhouli , Evgeny Matusov , Pavel Golik

Simultaneous speech-to-speech translation is widely useful but extremely challenging, since it needs to generate target-language speech concurrently with the source-language speech, with only a few seconds delay. In addition, it needs to…

计算与语言 · 计算机科学 2020-10-23 Renjie Zheng , Mingbo Ma , Baigong Zheng , Kaibo Liu , Jiahong Yuan , Kenneth Church , Liang Huang

Simultaneous translation involves translating a sentence before the speaker's utterance is completed in order to realize real-time understanding in multiple languages. This task is significantly more challenging than the general full…

计算与语言 · 计算机科学 2020-10-26 Aizhan Imankulova , Masahiro Kaneko , Tosho Hirasawa , Mamoru Komachi

Increasing interpreting needs a more objective and automatic measurement. We hold a basic idea that 'translating means translating meaning' in that we can assessment interpretation quality by comparing the meaning of the interpreting output…

计算与语言 · 计算机科学 2016-11-15 Xiaojun Zhang

Simultaneous interpretation, the translation of speech from one language to another in real-time, is an inherently difficult and strenuous task. One of the greatest challenges faced by interpreters is the accurate translation of difficult…

计算与语言 · 计算机科学 2019-04-02 Nikolai Vogler , Craig Stewart , Graham Neubig

Simultaneous machine translation aims at solving the task of real-time translation by starting to translate before consuming the full input, which poses challenges in terms of balancing quality and latency of the translation. The wait-$k$…

计算与语言 · 计算机科学 2024-07-19 Abderrahmane Issam , Yusuf Can Semerci , Jan Scholtes , Gerasimos Spanakis

The challenge of low-latency speech translation has recently draw significant interest in the research community as shown by several publications and shared tasks. Therefore, it is essential to evaluate these different approaches in…

Automatic evaluation of ST systems is typically performed by comparing translation hypotheses with one or more reference translations. While effective to some extent, this approach inherits the limitation of reference-based evaluation that…

计算与语言 · 计算机科学 2026-04-09 Mauro Cettolo , Marco Gaido , Matteo Negri , Sara Papi , Luisa Bentivogli

Reordering is a preprocessing stage for Statistical Machine Translation (SMT) system where the words of the source sentence are reordered as per the syntax of the target language. We are proposing a rich set of rules for better reordering.…

计算与语言 · 计算机科学 2016-10-25 Raj Nath Patel , Rohit Gupta , Prakash B. Pimpale , Sasikumar M

Machine Translation (MT) is usually viewed as a one-shot process that generates the target language equivalent of some source text from scratch. We consider here a more general setting which assumes an initial target sequence, that must be…

计算与语言 · 计算机科学 2022-10-25 Jitao Xu , Josep Crego , François Yvon

Simultaneous machine translation (SiMT) starts translating while receiving the streaming source inputs, and hence the source sentence is always incomplete during translating. Different from the full-sentence MT using the conventional…

计算与语言 · 计算机科学 2022-03-24 Shaolei Zhang , Yang Feng

Machine translation has wide applications in daily life. In mission-critical applications such as translating official documents, incorrect translation can have unpleasant or sometimes catastrophic consequences. This motivates recent…

软件工程 · 计算机科学 2022-04-07 Jialun Cao , Meiziniu Li , Yeting Li , Ming Wen , Shing-Chi Cheung

Simultaneous machine translation (SiMT) outputs translation while reading source sentence and hence requires a policy to decide whether to wait for the next source word (READ) or generate a target word (WRITE), the actions of which form a…

计算与语言 · 计算机科学 2022-03-23 Shaolei Zhang , Yang Feng

Obtaining meaningful quality scores for machine translation systems through human evaluation remains a challenge given the high variability between human evaluators, partly due to subjective expectations for translation quality for…

计算与语言 · 计算机科学 2022-05-18 Daniel Licht , Cynthia Gao , Janice Lam , Francisco Guzman , Mona Diab , Philipp Koehn

When the complete source sentence is provided, Large Language Models (LLMs) perform excellently in offline machine translation even with a simple prompt "Translate the following sentence from [src lang] into [tgt lang]:". However, in many…

计算与语言 · 计算机科学 2025-05-30 Biao Fu , Minpeng Liao , Kai Fan , Chengxi Li , Liang Zhang , Yidong Chen , Xiaodong Shi

The goal of translation, be it by human or by machine, is, given some text in a source language, to produce text in a target language that simultaneously 1) preserves the meaning of the source text and 2) achieves natural expression in the…

计算与语言 · 计算机科学 2025-08-08 Gergely Flamich , David Vilar , Jan-Thorsten Peter , Markus Freitag

Simultaneous speech-to-text translation systems must balance translation quality with latency. Although quality evaluation is well established, latency measurement remains a challenge. Existing metrics produce inconsistent results,…

计算与语言 · 计算机科学 2026-03-09 Peter Polák , Sara Papi , Luisa Bentivogli , Ondřej Bojar