English
Related papers

Related papers: Presenting Simultaneous Translation in Limited Spa…

200 papers

User studies have shown that reducing the latency of our simultaneous lecture translation system should be the most important goal. We therefore have worked on several techniques for reducing the latency for both components, the automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-24 Thai Son Nguyen , Jan Niehues , Eunah Cho , Thanh-Le Ha , Kevin Kilgour , Markus Muller , Matthias Sperber , Sebastian Stueker , Alex Waibel

Simultaneous Machine Translation (SiMT) requires high-quality translations under strict real-time constraints, which traditional policies with only READ/WRITE actions cannot fully address. We extend the action space of SiMT with four…

Computation and Language · Computer Science 2026-01-19 Qianen Zhang , Zeyu Yang , Satoshi Nakamura

Simultaneous interpretation, translation of the spoken word in real-time, is both highly challenging and physically demanding. Methods to predict interpreter confidence and the adequacy of the interpreted message have a number of potential…

Computation and Language · Computer Science 2018-07-09 Craig Stewart , Nikolai Vogler , Junjie Hu , Jordan Boyd-Graber , Graham Neubig

TV subtitles are a rich source of transcriptions of many types of speech, ranging from read speech in news reports to conversational and spontaneous speech in talk shows and soaps. However, subtitles are not verbatim (i.e. exact)…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-17 Jakob Poncelet , Hugo Van hamme

We describe efforts towards getting better resources for English-Arabic machine translation of spoken text. In particular, we look at movie subtitles as a unique, rich resource, as subtitles in one language often get translated into other…

Computation and Language · Computer Science 2016-09-06 Fahad Al-Obaidli , Stephen Cox , Preslav Nakov

Simultaneous speech translation (SimulST) is a demanding task that involves generating translations in real-time while continuously processing speech input. This paper offers a comprehensive overview of the recent developments in SimulST…

Sound · Computer Science 2024-08-21 Xiaoqian Liu , Guoqiang Hu , Yangfan Du , Erfeng He , Yingfeng Luo , Chen Xu , Tong Xiao , Jingbo Zhu

Recent work in simultaneous machine translation is often trained with conventional full sentence translation corpora, leading to either excessive latency or necessity to anticipate as-yet-unarrived words, when dealing with a language pair…

Computation and Language · Computer Science 2021-10-20 HyoJung Han , Seokchan Ahn , Yoonjung Choi , Insoo Chung , Sangha Kim , Kyunghyun Cho

This paper addresses the problem of evaluating the quality of automatically generated subtitles, which includes not only the quality of the machine-transcribed or translated speech, but also the quality of line segmentation and subtitle…

Computation and Language · Computer Science 2022-05-13 Patrick Wilken , Panayota Georgakopoulou , Evgeny Matusov

Speech translation for subtitling (SubST) is the task of automatically translating speech data into well-formed subtitles by inserting subtitle breaks compliant to specific displaying guidelines. Similar to speech translation (ST), model…

Computation and Language · Computer Science 2022-11-18 Sara Papi , Alina Karakanta , Matteo Negri , Marco Turchi

Transformer architectures are increasingly effective at processing and generating very long chunks of texts, opening new perspectives for document-level machine translation (MT). In this work, we challenge the ability of MT systems to…

Computation and Language · Computer Science 2025-04-29 Ziqian Peng , Rachel Bawden , François Yvon

The goal of this work is to temporally align asynchronous subtitles in sign language videos. In particular, we focus on sign-language interpreted TV broadcast data comprising (i) a video of continuous signing, and (ii) subtitles…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Hannah Bull , Triantafyllos Afouras , Gül Varol , Samuel Albanie , Liliane Momeni , Andrew Zisserman

Speech translation (ST) has lately received growing interest for the generation of subtitles without the need for an intermediate source language transcription and timing (i.e. captions). However, the joint generation of source captions and…

Computation and Language · Computer Science 2021-07-14 Alina Karakanta , Marco Gaido , Matteo Negri , Marco Turchi

We have seen significant improvements in machine translation due to the usage of deep learning. While the improvements in translation quality are impressive, the encoder-decoder architecture enables many more possibilities. In this paper,…

Computation and Language · Computer Science 2020-04-08 Jan Niehues

A large number of machine translation approaches have recently been developed to facilitate the fluid migration of content across languages. However, the literature suggests that many obstacles must still be dealt with to achieve better…

Computation and Language · Computer Science 2018-07-18 Diego Moussallem , Matthias Wauer , Axel-Cyrille Ngonga Ngomo

Quality estimation (QE) for tasks involving language data is hard owing to numerous aspects of natural language like variations in paraphrasing, style, grammar, etc. There can be multiple answers with varying levels of acceptability…

Computation and Language · Computer Science 2020-04-30 Prabhakar Gupta , Anil Nelakanti

Simultaneous interpretation, the translation of speech from one language to another in real-time, is an inherently difficult and strenuous task. One of the greatest challenges faced by interpreters is the accurate translation of difficult…

Computation and Language · Computer Science 2019-04-02 Nikolai Vogler , Craig Stewart , Graham Neubig

The authors of (Cho et al., 2014a) have shown that the recently introduced neural network translation systems suffer from a significant drop in translation quality when translating long sentences, unlike existing phrase-based translation…

Computation and Language · Computer Science 2014-10-08 Jean Pouget-Abadie , Dzmitry Bahdanau , Bart van Merrienboer , Kyunghyun Cho , Yoshua Bengio

This paper tackles several challenges that arise when integrating Automatic Speech Recognition (ASR) and Machine Translation (MT) for real-time, on-device streaming speech translation. Although state-of-the-art ASR systems based on…

Computation and Language · Computer Science 2025-08-20 Zeeshan Ahmed , Frank Seide , Niko Moritz , Ju Lin , Ruiming Xie , Simone Merello , Zhe Liu , Christian Fuegen

A large number of machine translation approaches have recently been developed to facilitate the fluid migration of content across languages. However, the literature suggests that many obstacles must still be dealt with to achieve better…

Computation and Language · Computer Science 2019-07-26 Diego Moussallem , Matthias Wauer , Axel-Cyrille Ngonga Ngomo

Through the development of neural machine translation, the quality of machine translation systems has been improved significantly. By exploiting advancements in deep learning, systems are now able to better approximate the complex mapping…

Computation and Language · Computer Science 2018-08-03 Jan Niehues , Ngoc-Quan Pham , Thanh-Le Ha , Matthias Sperber , Alex Waibel