English
Related papers

Related papers: The Volctrans Neural Speech Translation System for…

200 papers

This work describes the participation of the MLLP-VRAIN research group in the shared task of the IWSLT 2025 Simultaneous Speech Translation track. Our submission addresses the unique challenges of real-time translation of long-form speech…

Computation and Language · Computer Science 2025-06-24 Jorge Iranzo-Sánchez , Javier Iranzo-Sánchez , Adrià Giménez , Jorge Civera , Alfons Juan

This paper describes the University of Sydney& JD's joint submission of the IWSLT 2021 low resource speech translation task. We participated in the Swahili-English direction and got the best scareBLEU (25.3) score among all the…

Computation and Language · Computer Science 2021-07-27 Liang Ding , Di Wu , Dacheng Tao

To participate in the Isometric Spoken Language Translation Task of the IWSLT 2022 evaluation, constrained condition, AppTek developed neural Transformer-based systems for English-to-German with various mechanisms of length control, ranging…

Computation and Language · Computer Science 2022-05-13 Patrick Wilken , Evgeny Matusov

This paper describes FBK's participation in the IWSLT 2020 offline speech translation (ST) task. The task evaluates systems' ability to translate English TED talks audio into German texts. The test talks are provided in two versions: one…

Computation and Language · Computer Science 2020-06-05 Marco Gaido , Mattia Antonino Di Gangi , Matteo Negri , Marco Turchi

Simultaneous text translation and end-to-end speech translation have recently made great progress but little work has combined these tasks together. We investigate how to adapt simultaneous text translation methods such as wait-k and…

Computation and Language · Computer Science 2020-11-05 Xutai Ma , Juan Pino , Philipp Koehn

Simultaneous speech translation (SST) takes streaming speech input and generates text translation on the fly. Existing methods either have high latency due to recomputation of input representations, or fall behind of offline ST in…

Computation and Language · Computer Science 2024-08-20 Siqi Ouyang , Xi Xu , Chinmay Dandekar , Lei Li

This paper describes the NPU-MSXF system for the IWSLT 2023 speech-to-speech translation (S2ST) task which aims to translate from English speech of multi-source to Chinese speech. The system is built in a cascaded manner consisting of…

Sound · Computer Science 2023-07-11 Kun Song , Yi lei , Peikun Chen , Yiqing Cao , Kun Wei , Yongmao Zhang , Lei Xie , Ning Jiang , Guoqing Zhao

In simultaneous machine translation, the objective is to determine when to produce a partial translation given a continuous stream of source words, with a trade-off between latency and quality. We propose a neural machine translation (NMT)…

Computation and Language · Computer Science 2020-06-01 Patrick Wilken , Tamer Alkhouli , Evgeny Matusov , Pavel Golik

The scope of the International Workshop on Spoken Language Translation (IWSLT) has recently broadened beyond traditional Speech Translation (ST) to encompass a wider array of tasks, including Speech Question Answering and Summarization.…

Computation and Language · Computer Science 2025-05-20 Sai Koneru , Maike Züfle , Thai-Binh Nguyen , Seymanur Akti , Jan Niehues , Alexander Waibel

Large Language Models (LLMs) are currently under exploration for various tasks, including Automatic Speech Recognition (ASR), Machine Translation (MT), and even End-to-End Speech Translation (ST). In this paper, we present KIT's offline…

Computation and Language · Computer Science 2024-06-25 Sai Koneru , Thai-Binh Nguyen , Ngoc-Quan Pham , Danni Liu , Zhaolin Li , Alexander Waibel , Jan Niehues

This paper describes the ON-TRAC Consortium translation systems developed for two challenge tracks featured in the Evaluation Campaign of IWSLT 2022: low-resource and dialect speech translation. For the Tunisian Arabic-English dataset…

This paper presents NAVER LABS Europe's systems for Tamasheq-French and Quechua-Spanish speech translation in the IWSLT 2023 Low-Resource track. Our work attempts to maximize translation quality in low-resource settings using multilingual…

Computation and Language · Computer Science 2023-06-14 Edward Gow-Smith , Alexandre Berard , Marcely Zanon Boito , Ioan Calapodescu

Multimodal Large Language Models (MLLMs) have achieved notable success in enhancing translation performance by integrating multimodal information. However, existing research primarily focuses on image-guided methods, whose applicability is…

Computation and Language · Computer Science 2026-03-04 Yexing Du , Youcheng Pan , Zekun Wang , Zheng Chu , Yichong Huang , Kaiyuan Liu , Bo Yang , Yang Xiang , Ming Liu , Bing Qin

This paper presents HITSZ's submission for the IWSLT 2025 Indic track, focusing on speech-to-text translation (ST) for English-to-Indic and Indic-to-English language pairs. To enhance translation quality in this low-resource scenario, we…

Computation and Language · Computer Science 2025-07-29 Xuchen Wei , Yangxin Wu , Yaoyin Zhang , Henglyu Liu , Kehai Chen , Xuefeng Bai , Min Zhang

Boosted by the simultaneous translation shared task at IWSLT 2020, promising end-to-end online speech translation approaches were recently proposed. They consist in incrementally encoding a speech input (in a source language) and decoding…

Computation and Language · Computer Science 2021-06-15 Ha Nguyen , Yannick Estève , Laurent Besacier

This paper is an ELITR system submission for the non-native speech translation task at IWSLT 2020. We describe systems for offline ASR, real-time ASR, and our cascaded approach to offline SLT and real-time SLT. We select our primary…

Incremental Decoding is an effective framework that enables the use of an offline model in a simultaneous setting without modifying the original model, making it suitable for Low-Latency Simultaneous Speech Translation. However, this…

Computation and Language · Computer Science 2024-01-12 Jiaxin Guo , Zhanglin Wu , Zongyao Li , Hengchao Shang , Daimeng Wei , Xiaoyu Chen , Zhiqiang Rao , Shaojun Li , Hao Yang

End-to-end speech translation models have become a new trend in research due to their potential of reducing error propagation. However, these models still suffer from the challenge of data scarcity. How to effectively use unlabeled or other…

Computation and Language · Computer Science 2021-06-21 Rong Ye , Mingxuan Wang , Lei Li

This paper describes FBK's submission to the end-to-end English-German speech translation task at IWSLT 2018. Our system relies on a state-of-the-art model based on LSTMs and CNNs, where the CNNs are used to reduce the temporal dimension of…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-18 Mattia Antonino Di Gangi , Roberto Dessì , Roldano Cattoni , Matteo Negri , Marco Turchi

This paper describes the MeMAD project entry to the IWSLT Speech Translation Shared Task, addressing the translation of English audio into German text. Between the pipeline and end-to-end model tracks, we participated only in the former,…

Computation and Language · Computer Science 2018-10-25 Umut Sulubacak , Jörg Tiedemann , Aku Rouhe , Stig-Arne Grönroos , Mikko Kurimo