English

Does Simultaneous Speech Translation need Simultaneous Models?

Computation and Language 2023-10-19 v3

Abstract

In simultaneous speech translation (SimulST), finding the best trade-off between high translation quality and low latency is a challenging task. To meet the latency constraints posed by the different application scenarios, multiple dedicated SimulST models are usually trained and maintained, generating high computational costs. In this paper, motivated by the increased social and environmental impact caused by these costs, we investigate whether a single model trained offline can serve not only the offline but also the simultaneous task without the need for any additional training or adaptation. Experiments on en->{de, es} indicate that, aside from facilitating the adoption of well-established offline techniques and architectures without affecting latency, the offline solution achieves similar or better translation quality compared to the same model trained in simultaneous settings, as well as being competitive with the SimulST state of the art.

Keywords

Cite

@article{arxiv.2204.03783,
  title  = {Does Simultaneous Speech Translation need Simultaneous Models?},
  author = {Sara Papi and Marco Gaido and Matteo Negri and Marco Turchi},
  journal= {arXiv preprint arXiv:2204.03783},
  year   = {2023}
}

Comments

Findings of EMNLP 2022

R2 v1 2026-06-24T10:41:53.947Z